When releasing desktop apps we usually rename the binary to contain the version number. This version isn't stored anywhere else but in the file name.
This is an old article but still has validity so might be worthwhile reading. You can manage versioning in VS in the projects properties its quite simple to do.