I have uploaded new binary as a new version of my application and at the time of uploading binary, I select the option that "I Will Release this version".
Suppose my application is approved by apple But I dont want to release that version.
Is it possible to reject that binary or remove that version from iTunes connect?
Yes you can reject it!
Click on your "New version" > "Binary Details" > "Reject Binary"