[ci] See if we can provision by default on devdiv (#26170)

[ci] See if we can provision by default on devdiv (#26170) #3925