Is there some library to capture a screen to be a compressed video file or some solution that can do it?
Your best option seems to be Windows Media Encoder.
Here are some resources:
Capture Desktop Activities As a Movie
Capture Activities on Screen in a Movie
Capture screen activities/video using WmEncoder