ComfyUI Tutorial Series: Ep08 - Flux 1: Schnell and Dev Installation Guide
TLDRIn episode eight of the ComfyUI tutorial series, the focus is on Flux, a new AI model developed by Black Forest Labs. The tutorial covers the installation and usage of Flux's dev and Schnell versions, comparing their performance and quality. It discusses the non-commercial dev license and the Apache 2.0 license for Schnell, highlighting key settings for optimal results. The video also demonstrates how to integrate Flux with ComfyUI, offering detailed workflows for both versions and exploring the use of styles and the addition of a realism Laura for enhanced image generation.
Takeaways
- ๐ The tutorial introduces Flux, a new model by Black Forest Labs, favored for its performance and quality.
- ๐ง Flux supports various ratios and resolutions, with capabilities up to 2 megapixels, catering to diverse user needs.
- ๐พ Three versions of Flux are discussed: Pro, Dev, and Schnell, each with different accessibility and licensing terms.
- ๐ The Dev version is noted for its high-quality outputs but requires more computational resources, while the Schnell version offers faster processing at the cost of lower quality.
- ๐ The Dev license is non-commercial, allowing use of outputs for any purpose, including commercially, but restricts the use of the model for commercial purposes or to train competitive models.
- ๐ข In contrast, the Schnell version operates under the Apache 2.0 license, permitting both the model and its outputs to be used commercially.
- ๐ ๏ธ The tutorial provides a step-by-step guide on installing different Flux versions, emphasizing the ease of use for the floating point 8 versions.
- ๐จ Flux's compatibility with styles is demonstrated, showing its ability to incorporate various artistic influences into generated images.
- ๐ A comparison of image quality between the Dev and Schnell versions reveals the Dev version's superiority in detail and realism.
- ๐พ The floating point 8 and nf4 versions are tested, with the former offering more detail but the latter being faster on systems with less VRAM.
- ๐ The tutorial concludes with instructions on integrating a realism-focused Laura with Flux for enhanced image realism.
Q & A
What is the main topic of episode eight of the ComfyUI tutorial series?
-The main topic of episode eight is the installation and usage of Flux, a new model developed by Black Forest Labs, which includes different versions such as dev and Schnell.
Who created the Flux model discussed in the tutorial?
-Flux was created by Black Forest Labs, a team of researchers and engineers who previously worked for Stability AI.
What are the three versions of Flux mentioned in the tutorial?
-The three versions of Flux mentioned are the Pro version, the dev version, and the Schnell version.
What is the difference between the dev and Schnell versions of Flux?
-The dev version of Flux produces the best quality but requires more resources, while the Schnell version is the fastest but has lower quality compared to the dev version.
What license is the dev version of Flux under, and what are its restrictions?
-The dev version of Flux is under a non-commercial license which allows the use of outputs for any purpose, including commercial, but prohibits using the model for commercial purposes or training a new model that competes with Flux.
What does 'Schell' mean in the context of the Flux model?
-In the context of the Flux model, 'Schell' is a German word that means 'fast', indicating that the Schnell version is the faster option.
How can one quickly install the fp8 version of Flux in ComfyUI?
-To quickly install the fp8 version of Flux, download the models and place them in the checkpoints folder, then update ComfyUI to recognize the new nodes, and load the workflow to start using the model.
What is the recommended setting for the CFG parameter when using the Schnell version of Flux?
-The recommended setting for the CFG parameter when using the Schnell version of Flux is set to one, as it ignores the negative prompt.
How does the tutorial suggest improving the realism of generated images with Flux?
-The tutorial suggests using a realism Laura in conjunction with the dev version of Flux to improve the realism of generated images.
What is the recommended sampler and scheduler to fix blurred images when using the dev version of Flux?
-To fix blurred images with the dev version of Flux, the recommended sampler is DPM++ 2m, and the scheduler is sgm uniform.
Where can viewers find the workflows and additional resources mentioned in the tutorial?
-Viewers can find the workflows and additional resources mentioned in the tutorial on the tutorial creator's Discord server.
Outlines
๐ฅ Introduction to Flux Models in Comfy UI
The speaker introduces episode eight of a tutorial series focusing on Flux, a new AI model developed by Black Forest Labs. Flux is favored for its performance and is available in different versions: Pro, Dev, and Schnell, with the Pro version accessible only through API. The tutorial will guide viewers on installing and using these versions, comparing their quality and speed. The Dev version offers high quality but requires more computational resources, while the Schnell version is faster but of lower quality. The video also discusses the non-commercial Dev license and the Apache 2.0 license for Schnell, clarifying their usage rights. The speaker provides practical steps for downloading and setting up the models in Comfy UI, including the floating-point 8 versions for easier use.
๐ ๏ธ Setting Up and Testing Flux Models in Comfy UI
The tutorial continues with a detailed walkthrough on setting up the Flux models in Comfy UI. The speaker explains how to adjust the workflow settings for the Schnell and Dev versions, including the use of an empty latent image, the recommended K sampler, and the necessary steps for the Oiler sampler. The video demonstrates the process of generating images with Flux, highlighting the differences in processing time and image quality between the Schnell and Dev versions. The speaker also shares tips on optimizing the workflow, such as using the Flux Guidance node and experimenting with different values for better results. Additionally, the integration of Styles into Flux is explored, showing how to combine prompts and styles to influence the generated images.
๐จ Exploring Flux's Artistic Capabilities and Workflow Optimization
This section delves into Flux's ability to generate various artistic styles and the optimization of the Comfy UI workflow for beginners. The speaker tests different styles like biomechanical art and portrait cinematic, noting Flux's capacity to understand and apply these styles. A more compact workflow is created for ease of use, with instructions on hiding unused nodes and adjusting settings like width, height, and the order of style importance. The video also addresses the issue of blurred images in Flux, offering a solution by changing the sampler and scheduler. The speaker shares their experiences with Flux's performance on different prompts, emphasizing its strengths in rendering realistic images and handling details like hands effectively.
๐ Advanced Flux Model Setup and Comparative Testing
The speaker discusses the setup for the regular version of Flux, which requires additional CLIP models and a more complex workflow involving the VAE file and the unet folder. The video provides a step-by-step guide on downloading and placing the necessary files, and testing the model in Comfy UI. A comparison between the floating-point 8 and the regular version of Flux is made, noting the differences in detail and generation time. The speaker also introduces new, faster versions of Flux for users with lower VRAM, explaining the installation process for the nf4 versions of Flux and demonstrating their performance in Comfy UI.
๐ Evaluating Flux Model Performance and Realism Enhancement
This part of the tutorial focuses on evaluating the performance of different Flux models and enhancing the realism of generated images. The speaker compares the floating-point 8 and nf4 versions of Flux, discussing the impact of file size on image quality and generation speed. The video also introduces the use of a realism-enhancing Laura model for Flux, demonstrating how it can improve the realism of portraits and other images. The speaker concludes with a summary of the time taken for each model to generate images and provides organized workflows for download on their Discord channel, encouraging viewers to subscribe and engage with the content.
Mindmap
Keywords
๐กFlux
๐กBlack Forest Labs
๐กPro version
๐กDev version
๐กSchnell version
๐กFloating Point8 versions
๐กComfy UI
๐กWorkflow
๐กLicense.md
๐กStyles
๐กRealistic Laura
Highlights
Introduction to Flux, a new model by Black Forest Labs.
Comparison of different Flux versions: Pro, Dev, and Schnell.
Flux supports various ratios and resolutions up to 2 megapixels.
The Dev version offers the best quality but requires more resources.
The Schnell version is the fastest but has lower quality compared to Dev.
The Dev license is non-commercial, while Schnell uses the Apache 2.0 license.
Details on the usage rights and limitations of Flux's commercial applications.
Installation guide for the floating point 8 versions of Flux Dev and Schnell.
Quick workflows for those who are impatient and a detailed explanation to follow.
How to update Comfy UI to recognize Flux models.
Testing the workflow with different Flux models to compare results.
The impact of Flux Guidance on image generation and its differences from CFG.
How to use Styles with Flux and the influence on image results.
Creating a more compact workflow for beginners to use easily.
Testing the regular Dev version against the floating point 8 version for image quality.
How to fix blurred images in Flux by changing the sampler and scheduler.
Installation and testing of the new normalized float 4-bit versions of Flux.
Using the Realistic Laura with Flux for more realistic image generation.
Summary of the video, testing five Flux models and their performance on an RTX 490.
Organization of workflows for easy access on the Discord Channel.
Request for viewers to subscribe and support the channel.