I would like to get video stream with some real-time events synchronized with it. For example I would like to have a possibility to unlock a button, after something on the screen happenened - when something happens in front of the camera, there should be send some info about it (i.e. cameraman is pushing special button). The quest is to have this info (or event) synchronized with situation on the screen. Is it possible to send and receive such metadata using RTSP? The application will be written in WPF.
I need to get functionality very similar to this one: http://www.adobe.com/devnet/flashmediaserver/articles/metadata_video_streaming.html offered by flash, but on .NET platform. Do you know any libraries that could help me?
http://www.streamingmedia.com/conferences/west2010/presentations/SMWest-2010-Microsoft-Workshop.pdf
I have found 2 solutions that are offering requied functionality. First one is Microsoft Media Server. It's offered by MIcrosoft, so it's quite easy to use it in WPF. The problem here is that it's not a Real Time protocol. For me lags about 10-20 seconds (on localhost) were not acceptable.
The second one is Flash Media Streaming Server using RTMP. It also offers requied functionality and what is more as it's name says it's Real Time protocol. Lags here were unnoticeable (usually much lower than 1 second on localhost). But as it's Flash technology it must be handled by Flash code. I resolved it by putting Flash componnent inside ActiveX formant. For me it was my perfect match ;)