Is it against YouTube's terms of service to use http://www.youtube.com/get_video_info?video_id=...
to extract a video's stream and display it in a video player?
I want to do this in an app I plan to share on the play store.
Yes, it very much is. See the DTOS document, the following sections: