We Remastered My First Video in 4K!

Linus Tech Tips
17 Mar 202212:43

TLDRIn this video, Linus Sebastian from Linus Tech Tips explores the process of upscaling old video footage to 4K resolution using machine learning-assisted software by Topaz. He discusses the limitations of basic upscaling techniques and the challenges of enhancing very low-resolution footage, such as his first YouTube video shot in 240P. The video demonstrates the results of upscaling both the 240P video and a higher resolution 720P video, noting that while the software can produce impressive results, it struggles with motion in the footage. Linus also highlights the importance of hardware capabilities in the upscaling process, as showcased by the MSI Creator Z16P laptop used in the project. The video concludes with a discussion on the potential applications of upscaling software and an invitation for viewers to share their own upscaling experiences.

Takeaways

  • 📚 Upscaling is commonly used to enhance the quality of old or degraded videos, and not just photos and games.
  • 🔍 Basic upscaling techniques multiply each pixel to match a new resolution, but more advanced methods are needed for better results.
  • 🤖 Topaz's machine learning-assisted upscaling software was used to restore the video of Rick Astley's 'Never Gonna Give You Up' in 4K 60 FPS.
  • 🖥️ The process of upscaling a video is complex due to the large number of frames and the need to create millions of new pixels for higher resolutions like 4K.
  • 📈 The original video quality affects the outcome; the lower the resolution, the harder it is to achieve good results.
  • 📹 Interlaced footage, common in older videos, can present challenges in upscaling due to its method of drawing half the picture at a time.
  • 💻 Powerful hardware like the MSI Creator Z16P laptop can significantly speed up the rendering process for upscaling videos.
  • 🔧 Video Enhance AI (VEAI) software offers various modes and features to fine-tune the upscaling process, but may require multiple runs to get the desired result.
  • 🔥 High motion in videos can be challenging for upscaling algorithms, leading to less than perfect results in areas with a lot of movement.
  • 📈 The VEAI Chronos option uses machine learning to predict the best intermediate frames, which can help reduce motion jitter and pixel occlusion issues.
  • 🎥 For the best results, using footage that is already at a higher resolution, like 720P, can yield much better outcomes than starting from very low resolutions like 240P.

Q & A

  • What is the common use of upscaling technology mentioned in the video?

    -The most common use of upscaling technology is the restoration of old or degraded videos.

  • How does basic upscaling techniques work in terms of pixel manipulation?

    -Basic upscaling techniques work by sampling each pixel and then multiplying it to match the desired new resolution.

  • What company was contacted to understand how a 720P 30 FPS video was enhanced?

    -Topaz, the makers of the machine learning assisted upscaling software, was contacted.

  • What is the name of the person who is speaking in the video?

    -The person speaking in the video is Linus Sebastian.

  • What is the main challenge when upscaling video compared to a still image?

    -The main challenge when upscaling video is dealing with thousands or even tens of thousands of frames, and potentially creating millions of pixels that weren't there before when targeting a modern video resolution like 4K.

  • What is the file size increase like when upscaling from 5 megabytes to 21 gigabytes?

    -The file size increase is the opposite of file compression, making the files 2000 times bigger.

  • What term is used to describe the technique broadcasters used to increase the perceived frame rate and resolution of older footage?

    -The term used is 'interlacing'.

  • What is the difference between interlaced and progressive scan in video?

    -Interlaced video draws half of the picture first with a series of lines, then fills in the gaps with a second series of lines. Progressive scan, on the other hand, refreshes the entire image with each cycle.

  • What is the name of the software used to upscale the video footage in the project?

    -The software used is Video Enhance AI (VEAI).

  • What is the minimum resolution that VEAI claims to handle without too much difficulty?

    -VEAI claims to handle as low as 480i without too much difficulty.

  • What is the main takeaway from the video regarding the upscaling of the original footage?

    -The main takeaway is that while the results are not perfect, there are flashes of brilliance where the upscaled video looks significantly better, especially in areas with less motion and more static elements.

  • What is the name of the laptop used in the video for the upscaling project?

    -The laptop used is the MSI Creator Z16P.

Outlines

00:00

🔍 Upscaling Techniques and Video Restoration

The first paragraph introduces the concept of upscaling and its common uses, such as enhancing photo and game quality and restoring old videos. It highlights a remarkable upscaling example, Rick Astley's 'Never Gonna Give You Up' remastered in 4K 60 FPS. The video's host, Linus Sebastian, discusses reaching out to Topaz, creators of machine learning-assisted upscaling software, to understand how a 720P 30 FPS video could achieve such high-quality results. Linus then mentions his attempt to restore his first YouTube video using this technology, noting the uneven but interesting results. The paragraph also touches on the challenges of upscaling video compared to images, the massive increase in file size when upscaling, and the limitations of basic upscaling techniques.

05:03

📹 Understanding Interlacing and Video Enhancement AI

The second paragraph delves into the technical aspects of video resolution and the challenges of upscaling low-quality footage. It explains the difference between interlaced (I) and progressive scan (P) in video, with the former being an older technique to improve perceived frame rate and resolution. The host shares his experience with a Handycam that produced subpar results. The paragraph then transitions to a higher-resolution example, a firetruck video available in 720P, which is more suitable for the Video Enhance AI software. It outlines the process of upscaling the video to 4K using a powerful GPU and the importance of hardware in rendering speed. The host also discusses the various modes and features of VEAI, the need for multiple runs to achieve desired results, and the importance of managing heat during heavy workloads. The paragraph concludes with the decision on the settings used for upscaling and the challenges of handling large file sizes for high-resolution video processing.

10:06

🎥 Firetruck Video Upscaling and Frame Rate Conversion

The third paragraph focuses on the results of upscaling the firetruck video and the process of frame rate conversion. It describes the visual improvements in the video, such as the clarity of the shirt lines and the smoothing out of low bit rate blocking. The host expresses his satisfaction with the upscaling results, especially with static shots, but notes the challenges when both the camera and the subject are moving. The paragraph also discusses the limitations of the upscaling process and the importance of considering the original footage's quality. It concludes with a teaser for a future video on a DVHS player and a call to action for viewers to share their upscaling experiences and attempts at upscaling the Sunbeam Tuniq Tower video.

Mindmap

Keywords

💡Upscaling

Upscaling is the process of increasing the resolution of a digital image or video. In the context of the video, it refers to enhancing the quality of old or degraded videos to a higher resolution like 4K. The script mentions using upscaling to improve the appearance of various media types, including the restoration of the video of Rick Astley's 'Never Gonna Give You Up' to a 4K 60 FPS version.

💡Machine Learning Assisted Upscaling Software

This refers to software that uses machine learning algorithms to assist in the upscaling process. The video discusses Topaz, a company that makes such software, which was used to upscale the video of the host's first YouTube upload. Machine learning in this context helps in predicting and generating additional pixels to improve the resolution without causing artifacts or loss of detail.

💡Interlaced Video

Interlaced video is a technique where video frames are drawn in two fields, one containing the even lines and the other the odd lines, to create a complete frame. This method was used in older broadcasting to increase the perceived frame rate and resolution. The script explains that the original footage was interlaced and rendered without proper conversion, which posed a challenge for upscaling.

💡Progressive Scan

Progressive scan is a method of displaying, storing, or encoding motion pictures in which the entire image frame is drawn in a single pass or 'cycle'. It is contrasted with interlaced video in the script, where the host explains that progressive scan refreshes the entire image with each cycle, as opposed to interlaced which draws half the picture first and then fills in the gaps.

💡VEAI (Video Enhance AI)

VEAI stands for Video Enhance AI, which is a software mentioned in the script that is capable of upscaling video footage. The host uses VEAI to upscale a 720P video to 4K, demonstrating that the software can handle footage shot at higher resolutions more effectively than very low-resolution footage like 240P.

💡Chronos Options

Chronos is a feature within the VEAI software that deals with frame rate conversion, creating new frames to increase the frame rate of the video. The script discusses using Chronos to convert 4K footage from 30 FPS to 60 FPS by predicting the best intermediate frames between existing ones using machine learning, which helps to reduce motion jitter and pixel occlusion issues.

💡Pixel Occlusion

Pixel occlusion occurs when pixels from one frame block existing pixels in the next frame during the frame rate conversion process. The video explains that traditional methods like optical flow can result in pixel occlusion, but VEAI Chronos uses machine learning to predict intermediate frames more accurately and alleviate this issue.

💡File Compression

File compression is the process of reducing the size of a file to decrease the amount of data that needs to be stored or transmitted. In the context of the video, the host humorously contrasts file compression with the upscaling process, which makes files significantly larger as it increases the resolution and detail of the video.

💡7-Zip

7-Zip is a free and open-source file archiver known for its high compression ratio, but in the video, it's mentioned humorously in contrast to the upscaling process, which increases file size rather than decreasing it. The host jokes about 7-Zip needing a function to make files 2000 times bigger, which is the opposite of its usual compression function.

💡Frame Rate Conversion

Frame rate conversion is the process of changing the number of frames that appear on a screen each second in a video. The script discusses using VEAI to not only upscale the resolution of the video but also to increase its frame rate from 30 FPS to 60 FPS, which can make motion in the video appear smoother.

💡MSI Creator Z16P Laptop

The MSI Creator Z16P Laptop is a high-performance laptop mentioned in the video as the hardware used for the upscaling project. It is noted for its powerful specifications, which allowed for faster rendering of the upscaled videos. The laptop's features, such as its vapor chamber cooler, are highlighted as beneficial for handling the intensive workload of video upscaling.

Highlights

The video discusses the remastering of old videos in 4K resolution using upscaling techniques.

Basic upscaling techniques involve sampling each pixel and multiplying it to match the desired resolution.

The 4K 60 FPS remastered upload of Rick Astley's 'Never Gonna Give You Up' demonstrates impressive results.

Topaz, creators of machine learning-assisted upscaling software, were contacted for insights on the process.

The host, Linus Sebastian, attempts to restore his first YouTube upload using the software.

Results of upscaling are uneven, with some parts showing significant improvement.

The MSI Creator Z16P laptop was used for the restoration project, showcasing its capabilities.

Upscaling video is more complex than images due to the large number of frames and pixels.

The process of upscaling involves creating millions of pixels that did not exist in the original footage.

Original footage from the early videos was of very low resolution, making the upscaling challenging.

Interlaced footage, common in older videos, can cause issues when upscaled without proper conversion.

Video Enhance AI can handle footage as low as 480i, but higher resolution footage yields better results.

Hardware capabilities significantly affect the speed of the upscaling process.

VEAI software offers various modes and features to fine-tune the upscaling process.

High-resolution upscaling requires substantial storage space for the large file sizes.

Chronos options in VEAI use machine learning to create new frames and reduce motion jitter.

The upscaling process can be demanding on hardware, but the MSI Creator Z16P laptop handled the workload well.

The final upscaled video shows improvements in sharpness and detail, despite some motion handling issues.

The video concludes with a discussion on the practical applications and limitations of upscaling low-resolution footage.