After finding out my build issues had to do with version-control mechanisms locking files and preventing them from being cleaned I determined that I don't want this integration.
How do I completely remove version-control mechanisms from Visual Studio 2017?
If you really want to take this path:
In options, set version control to None:
And uninstall any extensions that act on Version Control.
Alternatively, file a bug on Developer Community.