ComfyUI Relighting ic-light workflow #comfyui #iclight #workflow
TLDRIn this video, we explore ComfyUI's relighting tool, which offers a unique way to adjust lighting on a specific object while fine-tuning colors and shadows. The workflow is credited to Lias, and a demo is provided for hands-on experience. The process involves loading an image, creating a mask, and adjusting proportions for better results. The mask's position significantly impacts the lighting effect, and the workflow can be customized for more control. The video also discusses the use of an IP adapter to enhance the atmosphere and the importance of the blur radius in the final output. By the end, viewers learn how to achieve a harmonious blend of character and background lighting, adding a new level of control to their creative process.
Takeaways
- π¨ **ComfyUI Relighting Tool Introduction**: The video introduces a new tool for adjusting lighting on objects, affecting colors and shadows, with the ability to consider the background.
- π **Credit and Resources**: Credit is given to Lias for the tool, with a mention of Kaji for making it available on Comfy. Links to the repo and Comfy manager are provided for downloading necessary nodes and models.
- π **Workflow Overview**: The video demonstrates how to use the tool with a workflow from the Kijiji example, including how to load images and adjust settings for better results.
- πΌοΈ **Image and Mask Creation**: A mask is created for the object, which plays a crucial role in the lighting process. The video shows how to adjust the mask and its impact on the final image.
- π **Proportion and Quality Adjustments**: The importance of keeping proportions correct and the impact of image quality on the final result are discussed, with tips on how to improve them.
- π **Background Image Considerations**: The video explores the use of a background image and its effect on the lighting, suggesting that sometimes working without a background can yield better results.
- π **Mask Manipulation**: The presenter manipulates the mask to change the direction of the lighting and demonstrates the effect of the mask's position on the final image.
- ποΈ **Drawing on the Image**: A desire to draw directly on the image for mask creation is expressed, aiming to provide more freedom and comfort in the process.
- π οΈ **Workflow Customization**: The video shows how to customize the workflow for better mask creation, including resizing and connecting nodes for optimal results.
- π€ **IP Adapter and Lighting Effects**: The use of an IP adapter is discussed to adjust the lighting and create a more harmonious image, with tips on how to balance its effect with the desired outcome.
- π **Background and Transparency**: The presenter addresses issues with the transition between the object and the background, suggesting changes to transparency settings for a smoother result.
- β¨ **IC Light Conditioning**: The video concludes with a discussion on IC light conditioning, which allows for further control over the lighting multiplier and contrast of the final image.
Q & A
What is the main purpose of the tool discussed in the video?
-The main purpose of the tool is to allow users to change the lighting on a certain object while adjusting colors and shadows, with the ability to refer to the background and the project.
Who is credited with the development of this tool?
-The credit for the development of this tool goes to Lias.
How can viewers access the demo and the repository mentioned in the video?
-The presenter will leave a link to the demo and the repository in the description of the video.
What is the simplest way to install the necessary nodes for this tool?
-The simplest way to install the necessary nodes is to download them from the Comfy Manager and load the workflows attached to the examples.
How can the models be obtained for use with the tool?
-The models can be found in the Comfy Manager and can be downloaded manually from a specific page, then placed under the 'unet' folder in the 'models' folder.
What is the role of the red node in the workflow?
-The red node is likely from another package and is responsible for disconnecting an object from the background.
How does the presenter adjust the proportions of the image?
-The presenter changes the 'keep proportion' to true and the amount of pixels to 768 lengthwise and widthwise, then presses Q to apply the changes.
Why does the presenter decide to work without a background image?
-The presenter finds that the tool works better without adding a background image, especially when focusing on the character.
What is the purpose of the mask created in the process?
-The mask plays an important role in the process by affecting the lighting and making the image feel more harmonious.
How does the presenter propose to optimize the mask creation process?
-The presenter suggests using a 'load image' node to draw the mask on the image, allowing for more freedom and comfort in the process.
What is the effect of the blur radius on the final image?
-The blur radius affects the lighting and the overall look of the image, with different settings resulting in different levels of softness or sharpness in the lighting.
How does the presenter address the issue of the picture being too dark?
-The presenter connects an IP adapter and adjusts the weights to moderate the effect, aiming to introduce more atmosphere into the picture.
Outlines
π§° Exploring a New Lighting and Color Adjustment Tool
This video introduces a powerful tool developed by Lias, which enhances images by adjusting lighting, colors, and shadows, integrating the background seamlessly. The demo provided shows how to utilize this tool with a repository link included for further exploration. Thanks to Kaji's contribution, the tool is accessible via comfy, where users can download necessary nodes. The video demonstrates a step-by-step guide on how to set up and modify images using this tool, including changing backgrounds, adjusting proportions, and optimizing image quality with various nodes and models.
π Conclusion and Engagement Encouragement
The video wraps up by encouraging viewers to engage with future lessons. The speaker invites the audience to subscribe to the channel, ask questions, and like the video if they found it helpful. The emphasis is on enjoyment and interactive learning in upcoming sessions.
Mindmap
Keywords
π‘ComfyUI Relighting
π‘IC-light
π‘workflow
π‘node
π‘mask
π‘latent
π‘resize
π‘IP adapter
π‘blur radius
π‘multiplier
Highlights
Introduction to a new tool for changing lighting on objects with adjustments for colors and shadows.
Credit is given to Lias for the development and to Kaji for making the project available on Comfy.
The tool allows for experimentation with lighting and understanding its effects through a demo.
Necessary nodes can be downloaded from the Comfy Manager, and workflows can be installed from examples.
Models can be found and downloaded manually for use in the Unet folder under the models folder.
A red node is used to disconnect an object from the background, replaced with 'remove background' in this case.
Loading an image and adjusting the model and prompt to achieve the desired underwater scene.
A mask is created, which plays an important role in the lighting adjustment process.
Proportions are corrected by adjusting the 'keep proportion' to true and the pixel amount.
The tool works better without adding a background image for some cases.
The mask's position significantly affects the lighting and overall image harmony.
Optimizing the mask creation process by allowing direct drawing on the image for more control.
The lighting changes depending on the mask's position and blur radius adjustments.
The prompt and description of lighting are significant in the final image result.
Adjusting the IP adapter weights and 'start at' and 'end at' parameters to moderate effects.
Improving the transition between the subject and background by adjusting transparency settings.
IC light conditioning allows for playing with the multiplier, similar to raising contrast.
The final result showcases the tool's ability to add control to the creative process.
The tool is deemed very interesting and adds value to the creative process.