Search code examples
videoffmpegtimestampframe-rateavconv

Can I create a VFR video from timestamped images?

First, I have almost zero experience in making videos from images.

What I have is a set of BMP timestamped images from which I want to generate a video. Since the timestamps are not equally spaced, I cannot simply use software that create constant-frame-rate videos from images.

A possible solution would be to create artificial images at fixed time intervals, but I prefer to leave that as a last resort if I fail to make a VFR video.

Any suggestions on how to achieve what I want?

Solution

  • You can use a combination of two tools to do this: ffmpeg and mp4fpsmod

    Step 1 is to generate a constant frame rate file using ffmpeg

    ffmpeg -i images%d.bmp -pix_fmt yuv420p ffmpeg-cfr.mp4

    Step 2 is to generate a timecode file like the one below, with each line containing the relative timestamp for a frame in milliseconds.

    # timecode format v2

0
33
88
100
120
160
200
230
330
347

    Step 3 is to use mp4fpsmod to generate the VFR file

    mp4fpsmod -o vfr.mp4 -t timecodes.txt ffmpeg-cfr.mp4

    This file plays as expected with ffplay but may not with some players, in which case run

    Step 4 Generate a CFR MP4 from the VFR using FFmpeg

    ffmpeg -i vfr.mp4 final-cfr.mp4

    This is a CFR file but the temporal relations are preserved as per the VFR, although there will be some PTS adjustments, if the timecode intervals are very irregular. That can be remedied by specifying a high framerate -r N