Frame interpolation is a technique employed in video processing to generate extra frames between the existing ones in a video sequence. This method is used to enhance the frame rate of a video, which can subsequently lead to smoother motion and superior visual quality. These benefits are particularly noticeable when creating slow-motion effects or when converting video content from one frame rate to another.
In this instance, the author intends to apply frame interpolation on a series of images that are similar to each other with the aim of making them appear as if they are morphing from one to another. Besides this, he mentions that the technique can also be used to increase the number of frames in a video to make it smoother. His primary motivation for developing this was to convert images to video using Frame Interpolation.
The author used the Film VFI node for this process which, according to him, delivered the best results. The model associated with this node is automatically downloaded when it is run. It weighs only 130 Mb, making it lightweight and easy to run.
The workflow of this process is available for download. The author provides detailed instructions on how to download and import the workflow into a ComfyUI instance. Both PNG and JSON formats are available for the workflow, and the accompanying note explains some of the settings and their uses.
The technique yields a very smooth and fluid result, making the images appear as if they are morphing from one to the next, when images that are similar in composition are used. The author showcases a sample video comprised of various clips created using the same workflow. However, he clarifies that the images used in the video were not generated using this workflow.
To get optimal results, the author suggests finding images that can easily blend with each other. For example, images of steam punk ladies that are posed and framed similarly can blend well. Another good example given is the Maui god images generated using ControlNet, where the composition is uniform due to the same prompt but a varying seed. The author finally recommends using images with similar colour schemes to ensure a seamless morph from one image to the next, creating a smooth transition effect.
