Search code examples
image-processingmachine-learningartificial-intelligence

How can I predict the next image from a series of images?


I am planing to predict the next image from an image sequence. I have searched on the internet (Google/YouTube) for tutorials and for similar work. but I couldn't find any. I want to know whether it is possible to find the pattern and predict the next image and can I find some tutorials for that.


Solution

  • You can use a CNN:

    • The input is then not 3 * w * h but (3*number of images) * w * h - so you can just concatenate the stuff in depth
    • The output is just an image instead of a class. So no flattening in between... or a reshape has to be added.

    Have a look at Fully Convolutional Networks for Semantic Segmentation and Image-to-Image translation.

    If you haven't seen it already: Keras is pretty handy.

    You might also be interested in the concept of Optical Flow