When I am submitting the iPhone and iPad apps, the iPhone app went through just fine while iTunes Connect showed an "Invalid Binary" for the iPad app. There weren't any other explanations. The build did pass the validation and submission from xCode.
I got the error, the provisioning profile for the project and target was not set properly. That is, set the distribution provisioning profile and build it, it works.