New Tech! How I made PRO Level VFX in a BARN!

Compositing Academy
27 Mar 202408:53

TLDRThe video showcases a virtual production process in Canada, highlighting the transformation of a simple barn into a virtual set using innovative technology from lcraft Jet Set Cine. The process requires only an iPhone and a cine camera, proving that high-end virtual production doesn't need expensive LED stages. The video is divided into three parts: set building and scene planning, practical effects and VFX workflow, and the introduction of a new virtual production pipeline that simplifies the entire process. The use of various techniques, including kit bashing, smoke machines, and acid barrels, adds depth and realism to the CG environments. The video emphasizes the creative and cost-effective filmmaking techniques, demonstrating how to achieve a cinematic quality production with limited resources.

Takeaways

  • 🎬 Transforming a simple barn in Canada into a virtual production set using innovative methods.
  • πŸ“± Utilizing a new product from lcraft Jet Set Cine, which only requires an iPhone and a cine camera.
  • πŸš€ Demonstrating that virtual production doesn't need expensive multi-million dollar LED stages.
  • πŸ’‘ Showcasing the entire behind-the-scenes process of creating the virtual production set.
  • πŸ› οΈ Discussing set building, scene planning, kit bashing, practical effects, and the VFX workflow.
  • πŸ”§ Revealing a new virtual production pipeline that simplifies the production process.
  • πŸŽ₯ Filming in multiple set locations virtually by reusing the same set floor pieces.
  • 🌫️ Incorporating various VFX elements like smoke, acid barrels, sparks, and Parallax to add motion and depth.
  • 🎞️ Capturing practical effects using techniques like dry ice and glow sticks mixed with soap for interesting textures.
  • πŸ“± Controlling on-set lighting from an iPhone using aperture lights for cinematic backlit shots.
  • πŸ”„ Using Jet Set's autoshot system to streamline the post-production process and reduce manual, tedious work.

Q & A

  • What is the main goal of the virtual production project described in the transcript?

    -The main goal of the project is to demonstrate that virtual production does not require expensive multi-million dollar LED stages. Instead, it can be achieved with creativity and willpower, using affordable and accessible tools like an iPhone and a cine camera.

  • What new product from lcraft is being used in this virtual production set?

    -The new product from lcraft being used is Jet Set cine, which simplifies the virtual production process by only requiring an iPhone and a cine camera.

  • How did the team address the challenge of creating a catwalk without a large budget?

    -The team found rubber mats with a pattern resembling a catwalk's surface and used wood from eco centers, painted black, to create a structure underneath the rubber mats. This allowed them to mimic the appearance of a catwalk at a fraction of the cost.

  • What is kit bashing, as mentioned in the transcript?

    -Kit bashing is the process of creatively combining various assets, similar to playing with Legos, to form interesting compositions and lighting setups in a virtual environment. It helps in creating 3D layered parallax and connecting the character to the ground in a virtual production.

  • What practical effects were used to add motion and interest to the CG environments?

    -Practical effects included smoke, acid barrels, sparks, and the Parallax of objects passing over each other. These elements were captured using various techniques and equipment, such as smoke machines, dry ice, and Embergen for medium-distance simulations.

  • How did the team utilize the barn provided by the filmmaker's wife's grandparents?

    -The team used the barn as a cinematic backlit shot location because it offered a large, dark space. They also invested in aperture lights to control the on-set lighting from the filmmaker's phone, which allowed them to adjust the lighting based on the actor's position relative to the virtual set.

  • What unique capability does Jet Set offer that differentiates it from traditional LED stages?

    -Jet Set allows for CG assets to pass in front of the character, not just background replacement. It also enables the user to previs or prev visualize scenes using the iPhone's AR scanner, which helps in directing the scene and discovering shots effectively.

  • How does the Cine version of Jet Set differ from the free version?

    -The Cine version of Jet Set includes a lens calibration process that calculates the offset between the iPhone and the cine lens. This allows for more precise tracking and integration of the virtual production elements with the live-action footage.

  • What is the Autoshot system in Jet Set, and how does it benefit the virtual production process?

    -Autoshot is a backend system in Jet Set that streamlines the virtual production pipeline. It simplifies the process of camera tracking and data packaging, allowing for faster delivery and reducing the manual, tedious work typically involved in post-production.

  • What other tools and software were used in conjunction with Jet Set for this virtual production project?

    -In addition to Jet Set, the project utilized Nuke, Blender, and Sony's fx3 camera. Embergen was also used for smoke simulation, and the compositing academy smoke bundle was mentioned for those interested in using the captured VFX elements.

  • What value does the filmmaker see in using Jet Set for virtual production?

    -The filmmaker sees value in Jet Set's ability to provide a sense of space and location without shooting into a green void. It also speeds up the backend process, reducing manual work and allowing for more efficient and creative exploration of scenes.

Outlines

00:00

🎬 Virtual Production Innovation

This paragraph introduces a revolutionary approach to virtual production, highlighting the transformation of a simple barn in Canada into a virtual set using a new product from lcraft Jet Set. The innovative method only requires an iPhone and a cine camera, challenging the notion that virtual production needs expensive LED stages. The video promises to reveal the entire behind-the-scenes process, demonstrating how craftiness and willpower can achieve virtual production. It also touches on the use of tools like Nuke, Blender, and Jet Set, and the filming of The Creator with a Sony fx3 camera. The video is structured into three parts: set building and scene planning, practical effects and VFX workflow, and the introduction of a new virtual production pipeline that simplifies the production process.

05:01

πŸš€ Cost-Effective Filmmaking Techniques

The second paragraph delves into cost-effective filmmaking techniques, emphasizing the use of a barn instead of renting a green screen stage. It describes the process of using various aperture lights for on-set lighting controlled from a phone, and the integration of a CG set into the Jet Set app. The paragraph highlights the unique ability of the app to have CG assets in front of the character, not just background replacement. It also discusses the benefits of the Jet Set app's virtual production pipeline, which includes 3D scanning and autoshot features, making the filmmaking process more efficient and creative. The paragraph concludes with a mention of upcoming tutorials on the YouTube channel and a call to action for viewers to engage with the content.

Mindmap

Keywords

πŸ’‘Virtual Production

Virtual Production refers to the process of creating a film or video using computer-generated environments, characters, or effects. In the video, the speaker is transforming a simple barn into a virtual set, showcasing that high-end production doesn't always require expensive LED stages or multi-million dollar setups. Instead, creativity and the right tools can achieve similar results.

πŸ’‘Set Building

Set Building is the process of constructing the physical environment in which a film or video is shot. In the context of the video, the speaker discusses the creation of a catwalk, which involves finding and repurposing materials like rubber mats and wood from eco centers to mimic the look of an industrial walkway without spending a lot of money.

πŸ’‘Practical Effects

Practical Effects are real-world physical effects that are created and captured on camera, as opposed to being added digitally in post-production. The video emphasizes the use of practical effects like smoke, sparks, and acid barrels to add motion and a sense of realism to the CG environments, enhancing the overall visual appeal and believability of the scene.

πŸ’‘VFX Workflow

VFX Workflow refers to the series of steps and processes involved in creating visual effects for a film or video. The video outlines a cost-effective VFX workflow that includes shooting practical effects, using software like Nuke and Blender, and integrating these elements into a virtual production pipeline to create a seamless final product.

πŸ’‘Green Screen

A Green Screen is a backdrop used in film and video production where a green color is chosen for its difference from human skin tones, allowing for easier removal in post-production to replace with any desired background. In the video, the speaker avoids renting a green screen stage and instead opts for a barn, using the technology to composite the virtual environment with the live-action footage.

πŸ’‘CG Set

CG Set stands for Computer-Generated Set, which refers to the virtual environments or backgrounds created using computer graphics for use in film or video production. The video demonstrates how a CG set can be loaded into an app and used to create a virtual production, allowing filmmakers to visualize and interact with the environment in real-time.

πŸ’‘Autoshot

Autoshot is a system mentioned in the video that simplifies the process of creating and integrating visual effects and camera tracking data. It is part of the virtual production pipeline that streamlines the post-production process by automating certain tasks and reducing the need for manual, tedious work.

πŸ’‘Lens Calibration

Lens Calibration is the process of adjusting and aligning the settings of a camera lens to ensure accurate focus, exposure, and other parameters for optimal image quality. In the video, the speaker mentions a lens calibration process within the Jet Set app, which calculates the offset between the iPhone and the cine lens for precise tracking and integration of the virtual production elements.

πŸ’‘Parallax

Parallax is a visual effect where the position or direction of an object appears to differ when viewed from different positions. In filmmaking, it can be used to create a sense of depth and three-dimensionality. The video discusses using 3D layered Parallax with the catwalk set piece to connect the character's feet to the ground and avoid the common issue of feet appearing to be on a green screen.

πŸ’‘Lighting

Lighting in film and video production is crucial for setting the mood, highlighting subjects, and creating a sense of depth and space. The video emphasizes the importance of controlling lighting to achieve the desired look and feel of the scene, such as backlit shots and the interaction between practical effects and the virtual environment.

πŸ’‘Post-Production

Post-Production refers to the processes and techniques used to finalize a film or video after shooting is completed. This includes editing, visual effects, sound design, and other tasks necessary to assemble the footage into a finished product. The video discusses the post-production process in the context of virtual production, highlighting how certain technologies can streamline and expedite these tasks.

Highlights

Transforming a simple barn in Canada into a virtual production set using a new product from lcraft Jet Set Cine.

The new product from lcraft Jet Set Cine only requires an iPhone and a cine camera, challenging the notion that virtual production needs expensive LED stages.

The video will showcase the entire behind-the-scenes process of creating the virtual production set.

Using a combination of techniques with nuke, blender, and Jet Set on an iPhone to create a unique virtual production experience.

The innovative approach to set building using rubber mats found at different places, looking like the surface of a catwalk.

Solving the problem of raising the walkway off the green screen using wood from eco centers, painted black for a cost-effective solution.

Kit bashing using various assets to create interesting compositions and lighting, similar to playing with Legos.

Utilizing 3D layered Parallax to connect the character's feet to the ground, avoiding feet on a green screen.

Filming in multiple set locations virtually by reusing the same set floor pieces, allowing for varied factory section appearances.

Incorporating practical effects like smoke, acid barrels, sparks, and camera Parallax to add motion and interest to CG environments.

Using a variety of smoke machines and dry ice techniques filmed on black screens to capture different motions for later use.

The cost-effective filming technique of not renting a green screen stage and using a barn for a cinematic backlit shot.

Investing in aperture lights to control the set lighting from a phone, allowing for dynamic relighting based on the actor's orientation to the virtual set.

Loading the CG set into the Jet Set app for easy placement and origin setting, enabling various filming angles.

Jet Set's unique ability to have CG assets pass in front of the character, enhancing the previs and directing process.

The Cine version of Jet Set allows for camera tracking and lens calibration, streamlining the virtual production pipeline.

The autoshot feature in Jet Set simplifies the post-production process by speeding up the backend work and reducing manual, tedious tasks.