I made 60fps Flipbooks using A.I.
TLDRIn this video, the creator explores the use of AI frame interpolation software to enhance the frame rate of flipbooks from 12 frames per second (fps) to 60 fps. Despite personal reservations about the artificial motion smoothing often seen on TVs, the experiment is conducted with curiosity. The process involves removing blurred or duplicate frames from the original 12 fps flipbook footage to create a clean video. This clean video is then processed by the AI software, which fills in the gaps between frames, resulting in an animation where 80% of the frames are artificially generated. The results are mixed, with some animations appearing smoother but losing the original crispness and timing. The creator concludes that while the technology is fascinating, they prefer the original animations and believe that AI motion smoothing cannot replicate the animator's original intent. The video ends with a call for viewer opinions on the matter.
Takeaways
- π¬ The experiment involves using AI frame interpolation to increase the frame rate of a flipbook from 12fps to 60fps.
- π€ AI motion smoothing can create a smoother animation but may introduce an artificial look that some viewers find unappealing.
- π The process requires a significant amount of frame interpolation, with 80% of the final frames being generated by the AI.
- πΉ The video quality is affected by the initial filming conditions, such as the presence of blur or duplicate frames.
- π» High-quality video cards are recommended for running the AI software due to its demanding processing requirements.
- π Close examination of the AI-generated frames reveals some inconsistencies and a loss of the original animation's crispness.
- π The creator prefers the original animation and feels that motion smoothing can detract from the animator's intent and timing.
- π The most successful result was with the balloon flipbook, which maintained a cleaner look after AI processing.
- π§ The experiment raises interesting questions about the role of AI in animation and the balance between authenticity and enhancement.
- π The process involves re-filming the flipbook with a high shutter speed to eliminate motion blur and ensure clean frames for AI processing.
- π The final video shows a comparison between the original and AI-smoothed versions, highlighting the differences and potential drawbacks of the technique.
- π¬ The creator invites viewers to share their opinions on motion smoothing in the comments, encouraging a discussion on the merits and drawbacks of the technology.
Q & A
What is the purpose of using AI frame interpolation software on a flipbook?
-The purpose is to experiment with boosting the frame rate from 12 frames per second to 60 frames per second, to see how the flipbook animation would look at a higher frame rate.
Why does the video mention that 80 percent of the final animation would be fake when using AI to interpolate frames?
-If the original animation is at 12 frames per second and it's increased to 60 frames per second, the AI has to generate 48 new frames for every 12 original frames, which means the majority of the frames (80%) are artificially created.
What does the author initially think about artificial motion smoothing on TVs?
-The author is not a fan of artificial motion smoothing on TVs, describing it as looking fake and terrible, and it's the first feature they turn off on their TV.
What challenges did the author face when trying to create a clean video of the flipbook to use with AI frame interpolation?
-The author faced challenges such as redundant frames due to the video being at 24 frames per second and the presence of blur frames from the pages moving. They needed to re-film the flipbook with a high shutter speed to avoid blur and remove duplicate or blurred frames.
What software did the author use for frame interpolation?
-The author used a frame interpolation software called Rife to run the flipbook through the AI.
What was the author's observation about the quality of the animation after using AI to interpolate frames?
-The author noticed some weird frames and a loss of the original animation's crispness in the overly smoothed version. They felt the AI-generated version lacked the snap and impact of the original.
How did the author describe the process of running the AI frame interpolation software?
-The author described the process as being slower than expected, especially if one doesn't have a decent video card, comparing it to a herd of turtles stampeding through peanut butter.
What was the author's final verdict on using AI for frame interpolation on flipbooks?
-The author concluded that while it was an interesting experiment and showcased cool technology, they still prefer the original animation and do not like motion smoothing, as it can distort the original animator's intentions and timing.
Which flipbook did the author find to be the most successful when using AI frame interpolation?
-The author found the balloon flipbook to be the most successful with AI frame interpolation, as it was pretty clean.
What does the author suggest for viewers who might have a different opinion on motion smoothing?
-The author encourages viewers who disagree with their opinion on motion smoothing to share their thoughts in the comments section.
What advice does the author give to the viewers at the end of the video?
-The author advises viewers to stay creative and expresses affection towards them, indicating that they will see them in the next video.
How does the author describe the visual effect of the AI-generated 60fps flipbooks when viewed slowly or frame by frame?
-When viewed slowly or frame by frame, the author notes that there are definitely some weird elements, but acknowledges the interesting aspect of 80% of what is seen being artificially created.
Outlines
π¬ Experimenting with AI Frame Interpolation on Flip Books
The video script introduces an experiment where the creator plans to use AI frame interpolation software to increase the frame rate of a flip book from 12 frames per second (fps) to 60 fps. The creator expresses skepticism about the quality of motion smoothing, especially on TVs, but is curious to see how a flip book would look with the increased frame rate. The process involves using a software called Rife to interpolate frames, and the creator discusses the challenges of achieving a clean video without blur frames. The experiment reveals that while the AI can create a smoother animation, it also introduces some unnatural elements, and the original crispness of the animation is somewhat lost in the process.
πΉ Stop-Motion Testing and AI Smoothing Results
The second paragraph discusses the creator's process of filming stop-motion versions of their flip books to test the AI frame interpolation. They then run these through the software to observe the results at an AI-generated 60 fps. The creator also shares their final test with a larger flip book, 'return of grumpy Cloud'. Upon review, they notice some oddities in the AI-generated frames, but also find it intriguing that 80% of the animation is artificially created. The creator, identifying as a purist, prefers the original animation and feels that motion smoothing lacks the intended impact and timing of the original work. They conclude that while the technology is fascinating, they remain unconvinced about the appeal of motion smoothing and invite viewers to share their opinions in the comments.
Mindmap
Keywords
π‘Flipbook
π‘AI Frame Interpolation
π‘Frames Per Second (FPS)
π‘Artificial Motion Smoothing
π‘Rife
π‘Stop Motion
π‘High Shutter Speed
π‘Final Cut Pro
π‘Blur Frames
π‘Snap and Impact
π‘Wobbly Jello
Highlights
The experiment aims to increase the frame rate of a 12fps flipbook to 60fps using AI frame interpolation software.
AI motion smoothing can artificially increase frame rates, but it may not always look better.
The creator is not a fan of artificial motion smoothing on TVs, as it can look fake and terrible.
Interpolating from 12fps to 60fps involves creating four artificial frames for every real frame, resulting in 80% of the final animation being fake.
The pencil flipbook is the first subject of the AI frame interpolation process.
The software used for frame interpolation is called Rife, which has many confusing settings.
The video of the flipbook at 24fps has redundant frames and blur, which complicates the interpolation process.
A clean video of the flipbook at 12fps with no blur frames is needed for better results.
Re-filming the flipbook with a high shutter speed helps to achieve crisp frames for the AI process.
After removing blur or duplicate frames, a clean video at 12fps is obtained for AI processing.
The AI frame interpolation process is very slow without a decent video card.
The final AI-processed animation shows some weirdness and loss of crispness compared to the original.
The creator prefers the original animation and believes that fake motion smoothing lacks the original animator's intention.
Motion smoothing can disrupt the timing and impact of the original animation, making it feel like 'wobbly Jello'.
The balloon flipbook is the most successful in the AI frame interpolation, appearing clean and less affected by the process.
Despite the weirdness, it's interesting to consider that 80% of the AI-generated animation didn't originally exist.
The creator encourages viewers to share their opinions on motion smoothing in the comments.
The video concludes by emphasizing the importance of staying creative and looking forward to the next video.