How to Install Krita extension for Stable Diffusion (auto-sd-paint-ext) Automatic1111 WebUI

Rexel Bartolome
25 Jan 202304:56

TLDRThis tutorial demonstrates how to integrate Stable Diffusion into Krita using the auto-sd-paint-ext extension for a streamlined workflow. It guides viewers through the installation of Stable Diffusion, setting up the web UI, and downloading the Krita extension. The process includes creating a symlink and editing the stable diffusion startup script to enable API communication. Once completed, users can access Stable Diffusion tools within Krita for tasks like image-to-image and text-to-image generation, enhancing their creative capabilities.

Takeaways

  • 🔧 Install Stable Diffusion using the one-click install method which takes about 20-30 minutes and requires ~10GB of space.
  • 🌐 After installation, a local URL will be generated (usually starting with 127.0.0.1), which is used to access the Stable Diffusion web UI.
  • 📂 Download the Krita extension for Stable Diffusion from the extensions tab in the web UI by searching for 'auto-sd-paint-ext'.
  • 🔄 Install the extension by clicking 'Load from' and 'Install', then apply and restart the UI to ensure proper loading of the extension.
  • 🔄 Create a symlink between the Krita extension and Stable Diffusion by copying the folder URL from Krita's resource folder and using it in the command prompt.
  • 📋 Edit the 'user.bat' file in the Stable Diffusion installation folder to enable API communication by adding '--api' to the command line arguments.
  • 🚀 Restart Stable Diffusion to activate the API flag, which may change the local URL.
  • 🖌️ Open Krita and access the Stable Diffusion tools through the Dockers in the settings for seamless integration.
  • 🎨 Use the extension for image-to-image or text-to-image generation within Krita, enhancing the workflow.
  • 📷 For image-to-image, create a selection with a feather of about 20 pixels to blend well with the existing image.

Q & A

  • What is the main purpose of the Krita extension for Stable Diffusion?

    -The main purpose of the Krita extension for Stable Diffusion is to seamlessly integrate Stable Diffusion into Krita, allowing for a more streamlined workflow without the need to switch between web UI and Krita.

  • How long does the one-click installation process for Stable Diffusion take?

    -The one-click installation process for Stable Diffusion takes around 20 to 30 minutes.

  • How much space is required on the hard drive for the installation of Stable Diffusion?

    -The installation of Stable Diffusion requires approximately 10 gigabytes of space on the hard drive.

  • What is the URL used for the Stable Diffusion web UI?

    -The URL used for the Stable Diffusion web UI is a local URL, typically starting with '127'.

  • Where can the Krita extension be downloaded from within the Stable Diffusion web UI?

    -The Krita extension can be downloaded from the 'Extensions' tab in the Stable Diffusion web UI, under the 'Available' section.

  • What should be done after installing the Krita extension?

    -After installing the Krita extension, go to the 'Install' tab in the web UI, click 'Apply', and restart the UI to load the extension properly.

  • How can a symlink be created between the Krita extension and Stable Diffusion?

    -A symlink can be created by copying the folder URL of the 'pikrita' folder from the resource folder and using it in the command prompt as instructed in the script.

  • What changes need to be made to the 'user.bat' file to enable communication with the Krita extension?

    -To enable communication with the Krita extension, the 'user.bat' file needs to be edited to include '--api' at the end of the command line arguments.

  • How can the API flag be ensured to be active?

    -The API flag is active when the local URL changes to a different one after reopening Stable Diffusion. If it still shows the original '127' URL, the 'user.bat' file may need to be edited again.

  • What should be done in Krita after setting up the Stable Diffusion extension?

    -After setting up the Stable Diffusion extension, open Krita, go to 'Settings', and then open the 'Dockers' for the extension to access the Stable Diffusion tools within Krita.

  • What is an efficient way to use the Krita extension for Stable Diffusion?

    -An efficient way to use the extension is by executing 'image to image' commands, creating a selection with the rectangular selection tool, and adding a feather to ensure a smooth blend with the existing image.

Outlines

00:00

🎥 Introduction to Stable Diffusion in Krita

This paragraph introduces the viewers to the quick extension for Stable Diffusion and explains how it can be integrated into Krita, a digital painting program. The integration allows for a streamlined workflow, eliminating the need for manual copying and pasting of images between the web UI and platforms like Twitter. The process involves installing Stable Diffusion using a one-click install method, which is recommended for its convenience and because it automatically installs necessary dependencies. The estimated time for the installation is 20 to 30 minutes, and it requires approximately 10GB of space on the hard drive.

🛠️ Installation and Setup of Stable Diffusion

This paragraph provides a step-by-step guide on how to install Stable Diffusion, emphasizing the ease of the one-click install method. After installation, a local URL is generated, which is used to access the Stable Diffusion web UI. The viewer is instructed to download the Krita extension from the web UI and apply it to load the extension properly. The paragraph also explains how to create a symlink between the Stable Diffusion extension and the Krita program by using command prompt and editing the user.bat file located in the Stable Diffusion installation folder.

🎨 Using Stable Diffusion Tools in Krita

The final paragraph focuses on utilizing the Stable Diffusion tools within Krita. It mentions the Dockers that provide access to these tools and encourages the viewer to explore them. The paragraph also describes a preferred method of using the extension, which involves creating a selection with the rectangular selection tool, adding a Feather for smooth blending, and executing image-to-image or text-to-image commands. The speaker promises to go more in-depth about this method in a future video and ends the tutorial by asking for likes and subscriptions.

Mindmap

Keywords

💡Krita

Krita is a free and open-source painting program designed for digital artists. It is the primary software mentioned in the video where the Stable Diffusion extension will be integrated. The integration allows artists to seamlessly use Stable Diffusion's features directly within Krita, enhancing their workflow.

💡Stable Diffusion

Stable Diffusion is an AI model used for generating images from textual descriptions. In the context of the video, it is the technology that the extension will enable within Krita, allowing users to generate images and integrate them into their artwork without leaving the Krita interface.

💡Extension

An extension in software terms is an add-on component that enhances the functionality of a program. In this video, the focus is on installing an extension for Krita that integrates Stable Diffusion, thus providing a more streamlined workflow for artists.

💡Web UI

Web UI stands for Web User Interface, which is a way for users to interact with the backend server through a web browser. In the video, the Web UI is used to manage and install the Krita extension for Stable Diffusion.

💡One-click Install

A one-click install is a simplified installation process that can be initiated with a single action, often a mouse click. In the context of the video, it refers to the recommended method for installing Stable Diffusion, which automates the process and includes all necessary dependencies.

💡Dependencies

Dependencies are software components that another piece of software relies on to function properly. The video mentions that the one-click install method for Stable Diffusion will install all necessary dependencies, ensuring that the software operates as intended.

💡GitHub

GitHub is a web-based platform for version control and collaboration that allows developers to work on projects together. The video instructs viewers to go to GitHub to find the releases and download the executable file for the one-click install of Stable Diffusion.

💡Local URL

A local URL is a Uniform Resource Locator that points to a resource on the same local network or the user's own computer. In the video, after installing Stable Diffusion, a local URL is generated which is used to access the Stable Diffusion Web UI.

💡Command Prompt

The Command Prompt is a command-line interface on Windows operating systems that allows users to execute commands directly. In the video, it is used to create a symbolic link between the Krita extension and Stable Diffusion.

💡Symbolic Link

A symbolic link, often referred to as a symlink, is a file that points to another file or directory. In the context of the video, creating a symlink is a step in the process of linking the Krita extension with Stable Diffusion for seamless integration.

💡Docker

In the context of Krita, a Docker is a panel or workspace that provides access to a set of tools or features. The video mentions that after installing the extension, users should open the Dockers for the extension to access the Stable Diffusion tools within Krita.

💡Image-to-Image

Image-to-Image is a feature of Stable Diffusion that allows users to generate new images based on existing ones. The video describes using this feature by making a selection in Krita and then using the extension to blend the new image into the existing artwork.

Highlights

Seamless integration of Stable Diffusion into Krita for a streamlined workflow.

Easy installation of Stable Diffusion using a one-click install process.

Local URL generation for accessing the Stable Diffusion web UI.

Downloading the Krita extension through the Stable Diffusion web UI.

Installing and applying the extension for proper functionality.

Creating a symlink between the Krita extension and Stable Diffusion.

Editing the user.bat file for Stable Diffusion and Krita communication.

Activating the API flag for Stable Diffusion and Krita integration.

Using the Dockers in Krita for accessing Stable Diffusion tools.

Efficient use of image-to-image and text-to-image tools within Krita.

Creating smooth blends with the rectangular selection tool and feathering.

In-depth explanation of the extension's features in a follow-up video.

Encouragement to like and subscribe for more informative content.

Total installation time for Stable Diffusion is approximately 20 to 30 minutes.

The installation process requires around 10 gigs of space on the hard drive.

Instructions on how to manage and install extensions in the Stable Diffusion web UI.

The importance of restarting the UI to load the extension correctly.

Accessing the Stable Diffusion web UI alongside Krita using the 127 URL.