Can ChromeCast and/or the Google Cast protocol run apps that are not video?
In other words, is it possible to create an html5 app that runs on the ChromeCast and controlled by the smartphone/tablet?
Yes, the receiver is an arbitrary HTML5 application. Of course, you should make sure it's suitable to be displayed on a TV with no attached keyboard and mouse, etc.
See the Google Cast receiver documentation for some more detail.