ComfyUI Tutorial Series: Ep08 - Flux 1: Schnell and Dev Installation Guide

pixaroma
13 Aug 202429:55

TLDRIn episode eight of the ComfyUI tutorial series, the focus is on Flux, a new AI model developed by Black Forest Labs. The tutorial covers the installation and usage of Flux's dev and Schnell versions, comparing their performance and quality. It discusses the non-commercial dev license and the Apache 2.0 license for Schnell, highlighting key settings for optimal results. The video also demonstrates how to integrate Flux with ComfyUI, offering detailed workflows for both versions and exploring the use of styles and the addition of a realism Laura for enhanced image generation.

Takeaways

  • 😀 The tutorial introduces Flux, a new model by Black Forest Labs, favored for its performance and quality.
  • 🔧 Flux supports various ratios and resolutions, with capabilities up to 2 megapixels, catering to diverse user needs.
  • 💾 Three versions of Flux are discussed: Pro, Dev, and Schnell, each with different accessibility and licensing terms.
  • 🚀 The Dev version is noted for its high-quality outputs but requires more computational resources, while the Schnell version offers faster processing at the cost of lower quality.
  • 📄 The Dev license is non-commercial, allowing use of outputs for any purpose, including commercially, but restricts the use of the model for commercial purposes or to train competitive models.
  • 🏢 In contrast, the Schnell version operates under the Apache 2.0 license, permitting both the model and its outputs to be used commercially.
  • 🛠️ The tutorial provides a step-by-step guide on installing different Flux versions, emphasizing the ease of use for the floating point 8 versions.
  • 🎨 Flux's compatibility with styles is demonstrated, showing its ability to incorporate various artistic influences into generated images.
  • 🔍 A comparison of image quality between the Dev and Schnell versions reveals the Dev version's superiority in detail and realism.
  • 💾 The floating point 8 and nf4 versions are tested, with the former offering more detail but the latter being faster on systems with less VRAM.
  • 🔗 The tutorial concludes with instructions on integrating a realism-focused Laura with Flux for enhanced image realism.

Q & A

  • What is the main topic of episode eight of the ComfyUI tutorial series?

    -The main topic of episode eight is the installation and usage of Flux, a new model developed by Black Forest Labs, which includes different versions such as dev and Schnell.

  • Who created the Flux model discussed in the tutorial?

    -Flux was created by Black Forest Labs, a team of researchers and engineers who previously worked for Stability AI.

  • What are the three versions of Flux mentioned in the tutorial?

    -The three versions of Flux mentioned are the Pro version, the dev version, and the Schnell version.

  • What is the difference between the dev and Schnell versions of Flux?

    -The dev version of Flux produces the best quality but requires more resources, while the Schnell version is the fastest but has lower quality compared to the dev version.

  • What license is the dev version of Flux under, and what are its restrictions?

    -The dev version of Flux is under a non-commercial license which allows the use of outputs for any purpose, including commercial, but prohibits using the model for commercial purposes or training a new model that competes with Flux.

  • What does 'Schell' mean in the context of the Flux model?

    -In the context of the Flux model, 'Schell' is a German word that means 'fast', indicating that the Schnell version is the faster option.

  • How can one quickly install the fp8 version of Flux in ComfyUI?

    -To quickly install the fp8 version of Flux, download the models and place them in the checkpoints folder, then update ComfyUI to recognize the new nodes, and load the workflow to start using the model.

  • What is the recommended setting for the CFG parameter when using the Schnell version of Flux?

    -The recommended setting for the CFG parameter when using the Schnell version of Flux is set to one, as it ignores the negative prompt.

  • How does the tutorial suggest improving the realism of generated images with Flux?

    -The tutorial suggests using a realism Laura in conjunction with the dev version of Flux to improve the realism of generated images.

  • What is the recommended sampler and scheduler to fix blurred images when using the dev version of Flux?

    -To fix blurred images with the dev version of Flux, the recommended sampler is DPM++ 2m, and the scheduler is sgm uniform.

  • Where can viewers find the workflows and additional resources mentioned in the tutorial?

    -Viewers can find the workflows and additional resources mentioned in the tutorial on the tutorial creator's Discord server.

Outlines

00:00

🎥 Introduction to Flux Models in Comfy UI

The speaker introduces episode eight of a tutorial series focusing on Flux, a new AI model developed by Black Forest Labs. Flux is favored for its performance and is available in different versions: Pro, Dev, and Schnell, with the Pro version accessible only through API. The tutorial will guide viewers on installing and using these versions, comparing their quality and speed. The Dev version offers high quality but requires more computational resources, while the Schnell version is faster but of lower quality. The video also discusses the non-commercial Dev license and the Apache 2.0 license for Schnell, clarifying their usage rights. The speaker provides practical steps for downloading and setting up the models in Comfy UI, including the floating-point 8 versions for easier use.

05:02

🛠️ Setting Up and Testing Flux Models in Comfy UI

The tutorial continues with a detailed walkthrough on setting up the Flux models in Comfy UI. The speaker explains how to adjust the workflow settings for the Schnell and Dev versions, including the use of an empty latent image, the recommended K sampler, and the necessary steps for the Oiler sampler. The video demonstrates the process of generating images with Flux, highlighting the differences in processing time and image quality between the Schnell and Dev versions. The speaker also shares tips on optimizing the workflow, such as using the Flux Guidance node and experimenting with different values for better results. Additionally, the integration of Styles into Flux is explored, showing how to combine prompts and styles to influence the generated images.

10:03

🎨 Exploring Flux's Artistic Capabilities and Workflow Optimization

This section delves into Flux's ability to generate various artistic styles and the optimization of the Comfy UI workflow for beginners. The speaker tests different styles like biomechanical art and portrait cinematic, noting Flux's capacity to understand and apply these styles. A more compact workflow is created for ease of use, with instructions on hiding unused nodes and adjusting settings like width, height, and the order of style importance. The video also addresses the issue of blurred images in Flux, offering a solution by changing the sampler and scheduler. The speaker shares their experiences with Flux's performance on different prompts, emphasizing its strengths in rendering realistic images and handling details like hands effectively.

15:04

🔍 Advanced Flux Model Setup and Comparative Testing

The speaker discusses the setup for the regular version of Flux, which requires additional CLIP models and a more complex workflow involving the VAE file and the unet folder. The video provides a step-by-step guide on downloading and placing the necessary files, and testing the model in Comfy UI. A comparison between the floating-point 8 and the regular version of Flux is made, noting the differences in detail and generation time. The speaker also introduces new, faster versions of Flux for users with lower VRAM, explaining the installation process for the nf4 versions of Flux and demonstrating their performance in Comfy UI.

20:06

📈 Evaluating Flux Model Performance and Realism Enhancement

This part of the tutorial focuses on evaluating the performance of different Flux models and enhancing the realism of generated images. The speaker compares the floating-point 8 and nf4 versions of Flux, discussing the impact of file size on image quality and generation speed. The video also introduces the use of a realism-enhancing Laura model for Flux, demonstrating how it can improve the realism of portraits and other images. The speaker concludes with a summary of the time taken for each model to generate images and provides organized workflows for download on their Discord channel, encouraging viewers to subscribe and engage with the content.

Mindmap

Keywords

💡Flux

Flux refers to a new model developed by Black Forest Labs, which is a team of researchers and engineers. It is highlighted as the favorite model of the tutorial series host due to its performance. Flux is designed to handle different ratios and resolutions up to 2 megapixels and is part of a model family that requires a good computer for decent speed. The video aims to guide users on how to install and use Flux, emphasizing its significance in the context of AI-generated models.

💡Black Forest Labs

Black Forest Labs is the creator of the Flux model. The lab is composed of researchers and engineers who have a history of developing various AI models and previously worked for Stability AI. The company's introduction of Flux showcases their continued innovation in the field of AI, emphasizing their role as key contributors to the technology discussed in the video.

💡Pro version

The Pro version of Flux is mentioned as a high-quality model available exclusively through an API, not for direct download. This version is not intended for general use on personal computers due to its commercial nature, suggesting a tiered approach to the accessibility of Flux's capabilities.

💡Dev version

The Dev version of Flux is described as producing the best quality output but requiring more computational resources. It is available for download and use, contrasting with the Pro version. The video discusses the Dev version's non-commercial license, indicating that outputs can be used commercially, but the model itself cannot be used for commercial purposes, which is a crucial point for users interested in the legal aspects of AI model usage.

💡Schnell version

The Schnell version is portrayed as the fastest of the Flux models but with lower quality compared to the Dev version. The term 'Schnell' is German for 'fast,' which is fitting for this model designed for speed. It operates under the Apache 2.0 license, allowing both the model and its output to be used commercially, making it an attractive option for those prioritizing speed over quality.

💡Floating Point8 versions

Floating Point8 versions of Flux are smaller, easier-to-use models that do not require complicated workflows. Both Dev and Schnell have these smaller versions, which are aimed at making the models more accessible to users with less powerful hardware, demonstrating an effort to cater to a broader range of users with different computational capabilities.

💡Comfy UI

Comfy UI is the user interface where the Flux models are managed and workflows are executed. The video provides a guide on how to update Comfy UI to recognize Flux models and how to load and run workflows using the different versions of Flux. Comfy UI serves as the platform through which users interact with Flux, making it a central component of the tutorial.

💡Workflow

A workflow in the context of the video refers to a series of steps or processes that users follow to generate images using Flux within Comfy UI. The video explains how to create and run workflows for different Flux versions, emphasizing the importance of understanding the workflow to effectively use the AI model for image generation.

💡License.md

License.md is a file mentioned in the video that contains the licensing terms for the Dev version of Flux. It outlines the rights and restrictions regarding the use and commercialization of the model's outputs. The video emphasizes the importance of reviewing this document to understand the legal boundaries of using Flux, which is crucial for users to avoid potential legal issues.

💡Styles

Styles in the video refer to the artistic styles that can be applied to the images generated by Flux. The tutorial demonstrates how to incorporate styles into the workflow, allowing users to influence the aesthetic outcome of the generated images. This feature showcases the versatility of Flux in creating images with different artistic influences.

💡Realistic Laura

Realistic Laura is an additional model mentioned in the video that enhances the realism of the images generated by Flux. It is used in conjunction with Flux to produce more photorealistic outputs. The video includes a demonstration of how to integrate the Realistic Laura into the workflow, highlighting the potential for users to achieve higher levels of detail and authenticity in their image generation.

Highlights

Introduction to Flux, a new model by Black Forest Labs.

Comparison of different Flux versions: Pro, Dev, and Schnell.

Flux supports various ratios and resolutions up to 2 megapixels.

The Dev version offers the best quality but requires more resources.

The Schnell version is the fastest but has lower quality compared to Dev.

The Dev license is non-commercial, while Schnell uses the Apache 2.0 license.

Details on the usage rights and limitations of Flux's commercial applications.

Installation guide for the floating point 8 versions of Flux Dev and Schnell.

Quick workflows for those who are impatient and a detailed explanation to follow.

How to update Comfy UI to recognize Flux models.

Testing the workflow with different Flux models to compare results.

The impact of Flux Guidance on image generation and its differences from CFG.

How to use Styles with Flux and the influence on image results.

Creating a more compact workflow for beginners to use easily.

Testing the regular Dev version against the floating point 8 version for image quality.

How to fix blurred images in Flux by changing the sampler and scheduler.

Installation and testing of the new normalized float 4-bit versions of Flux.

Using the Realistic Laura with Flux for more realistic image generation.

Summary of the video, testing five Flux models and their performance on an RTX 490.

Organization of workflows for easy access on the Discord Channel.

Request for viewers to subscribe and support the channel.