After the latest VS Code update there is the Commit & Push
button. How could I hide it to have my IDE as it was before?
There is a configuration in VS Code for this. There is setting in vs code to hide this action button by unchecking this you can hide the button.
You may also read the release notes from VS Code for the same. https://code.visualstudio.com/updates/v1_69#_commit-action-button-for-git-repositories