NEW COMFY ECOSYSTEM! Comfy & mcmonkey QUITS Stability.

Sebastian Kamph
18 Jun 202413:04

TLDRDeveloper Comfy and team member mcmonkey have left Stability AI, raising concerns about the future of the company's AI models. Comfy, who worked on the controversial Stable Fusion 3 model, has criticized management's push for the release of the 2B model over the safer 4B model. The departures have led to uncertainty about licensing and the potential abandonment of the project. Comfy is now focusing on expanding the Comfy ecosystem with a new team, aiming to democratize AI tooling and support the open-source community, while Stability AI faces a PR crisis and the need for transparency and better communication.

Takeaways

  • ๐Ÿ˜€ Comfy, the developer of Comfy UI, has resigned from Stability AI.
  • ๐Ÿ”„ Several employees, including MCMonkey, have left Stability AI, impacting the development of the stable Fusion 3 model.
  • ๐Ÿ’ฌ Comfy expressed his departure and thoughts on Discord and Reddit, indicating issues with the company's management and direction.
  • ๐Ÿค” The 2B model was pushed for release by management despite being considered a failed experiment by the research team that has since left the company.
  • ๐Ÿ›  Comfy was working on a T5 only 4B model which he believed would have been safer and more stable.
  • ๐Ÿ“‰ The departure of key team members and the controversy around the 2B model's release have created a PR nightmare for Stability AI.
  • ๐Ÿ†• Comfy and his team are moving forward to expand the Comfy ecosystem with a focus on democratizing AI tooling.
  • ๐ŸŒ They plan to work with the open-source community and build tools that are accessible to all, not just a select few.
  • ๐Ÿ“ The team has released a manifesto emphasizing their commitment to open-source principles and community-driven development.
  • ๐Ÿ’ผ They intend to monetize through consulting and enterprise support, similar to the Red Hat model, without hiding features behind paywalls.
  • ๐Ÿ”ฎ Despite recent challenges, the team is optimistic about the future of open-source AI models and their role in democratizing AI.

Q & A

  • What is the main topic discussed in the transcript?

    -The main topic discussed in the transcript is the departure of key employees, including Comfy and mcmonkey, from Stability AI and their plans to develop a new ecosystem called Comfy.

  • Why did Comfy resign from Stability AI?

    -Comfy resigned from Stability AI due to disagreements with the management's decision to release the 2B model instead of the 4B model, which he believes was safer and more promising.

  • What was the controversy surrounding the release of the 2B model?

    -The controversy was that the 2B model was pushed for release by the management despite being considered a failed experiment by the research team that worked on it and was no longer employed by Stability AI.

  • What is the core mission of the new Comfy ecosystem?

    -The core mission of the new Comfy ecosystem is to advance and democratize visual AI tooling by iterating and improving Comfy UI and working with open-source model builders and the community.

  • How does the transcript describe the role of mcmonkey in the new ecosystem?

    -The transcript describes mcmonkey as a collaborator in the new ecosystem, working alongside Comfy and others from Stability AI and the Drip community.

  • What is the stance of the new Comfy ecosystem on open-source licensing?

    -The new Comfy ecosystem is committed to keeping their tools open-source and not hiding features behind a paywall or restrictive licenses.

  • What are the future plans for the Comfy UI according to the transcript?

    -The future plans for Comfy UI include continuing its development by a bigger team with more resources and expanding the Comfy ecosystem with a focus on democratization of AI tooling.

  • How does the transcript address the issue of monetization in open-source projects?

    -The transcript acknowledges that there is no free lunch in open-source and that developers need revenue streams to sustain their work, suggesting models like consulting and enterprise support for monetization.

  • What is the significance of the 'democratization of AI tooling' mentioned in the transcript?

    -The significance lies in the belief that AI models should be accessible to all users, not just a few cloud providers or those with access to closed-source tools, emphasizing the need for open and community-driven development.

  • What is the relationship between the departure of key employees and the future of Stability AI's models?

    -The departure of key employees, such as Comfy and mcmonkey, may lead to a shift in the development and support of Stability AI's models, with the possibility of the community moving towards alternative models or platforms.

  • How does the transcript suggest the open-source AI community should approach the future?

    -The transcript suggests that the open-source AI community should continue to fight for democratization, support each other, and work together to build and improve tools and models for the benefit of all.

Outlines

00:00

๐Ÿ˜” Developer Exodus from Stability AI

The script discusses the departure of key employees from Stability AI, including the developer of Comfy UI, who recently resigned. It delves into the internal issues surrounding the release of the Stable Fusion 3 model, which was pushed by management despite being a beta and led to the departure of the research team responsible for it. The narrative highlights the controversy over licensing and the lack of official communication from Stability AI, suggesting a PR nightmare and urging for transparency and better management in the future.

05:01

๐ŸŒ Comfy UI's Commitment to Democratizing AI Tools

This paragraph outlines Comfy UI's mission to democratize AI tooling by improving and iterating on their software, working closely with the open-source community. It introduces the concept of democratization not just in AI models but also in the tools that enable their use. The script mentions the importance of open-source software (OSS) in the visual AI space and the need for community efforts to build efficient OSS tooling. It also touches on the challenges of monetization in the open-source world and the necessity for developers to find sustainable revenue streams.

10:03

๐Ÿ›  Comfy's Future: Open Source and Community-Driven

The final paragraph focuses on Comfy's future plans to remain open source and community-driven, with no intention of paywalling features or introducing restrictive licenses. It discusses potential revenue models, such as consulting and enterprise support, drawing parallels with successful companies like Red Hat. The script also emphasizes the importance of transparency, communication, and the core principles guiding Comfy's development. It concludes with a nod to the potential for advancements in OSS AI models and the team's dedication to bringing the best models to Comfy UI.

Mindmap

Keywords

๐Ÿ’กComfy

Comfy refers to the developer of Comfy UI, who is a central figure in the video's narrative. He has recently resigned from Stability AI, which is a significant event in the AI community. Comfy's departure and subsequent plans to develop the Comfy ecosystem are a major theme of the video. For example, the script mentions 'Comfy the developer, of Comfy UI left Stability AI a few days ago', indicating a shift in the AI development landscape.

๐Ÿ’กStability AI

Stability AI is the company from which Comfy and other key team members have resigned. It is mentioned as the former employer of these individuals and is associated with the development of AI models like Stable Fusion 3. The company's management decisions and licensing issues are criticized in the script, indicating a conflict that led to the departure of key personnel.

๐Ÿ’กStable Fusion 3

Stable Fusion 3 is an AI model developed by Stability AI. It is mentioned as having potential but also being part of the controversy due to management's push for its release despite being a beta model. The script discusses the model's development and the internal conflict over its release, as in 'the 2B model was pushed... management pushed for release and well, we got the 2b1'.

๐Ÿ’กComfy UI

Comfy UI is a user interface developed by Comfy, which is set to continue development with a larger team and more resources, as stated in the script: 'I mainly want to reassure people, that Comfy UI will continue to be developed by a bigger team with more resources than before'. It represents the future direction of open-source AI tooling in the video.

๐Ÿ’กOpen Source

Open Source is a recurring theme in the video, emphasizing the importance of making AI tools and models accessible to all. The script discusses the need for democratization of AI tooling and the challenges of sustaining open-source projects, such as 'there is no free lunch in the world of Open Source'.

๐Ÿ’กAI Democratization

AI Democratization is the concept of making AI technology widely accessible, not just to a select few. The script mentions the mission to 'advance and democratize visual AI tooling', highlighting the goal of the Comfy ecosystem to make AI tools available to a broader audience.

๐Ÿ’กLicensing

Licensing in the context of the video refers to the legal and usage terms associated with AI models and tools. The script criticizes Stability AI's licensing as 'a mess' and suggests that clearer, more open licensing could help in the development and adoption of AI tools.

๐Ÿ’กCommunity-Driven

Community-Driven indicates that the development and direction of AI tools like Comfy UI are influenced by and work closely with the community of users and developers. The script mentions 'organize Community efforts to efficiently build OSS tooling, for all', emphasizing the collaborative nature of the project.

๐Ÿ’กMCM Monkey

MCM Monkey is another key figure who, along with Comfy, is leaving Stability AI to work on expanding the Comfy ecosystem. The script states 'MCM, monkey working with for stable swarm is, leaving', indicating a significant shift in the AI development community.

๐Ÿ’กManifesto

The term Manifesto in the video refers to a public declaration of intentions or principles. The script mentions a 'manifest' by Drip Art, which outlines the team's mission and principles, such as 'democratization of AI tooling' and 'no free lunch in the world of Open Source'.

๐Ÿ’กOSS Models

OSS Models stands for Open Source Software models, which are AI models that are freely available for use, modification, and distribution. The script discusses the importance of these models in the democratization of AI and the need for open-source tooling to utilize them effectively.

Highlights

Comfy, the developer of Comfy UI, has resigned from Stability AI.

The team behind Stability Fusion 3 2B, including MC Monkey, has left the company.

Comfy's departure prompts questions about the future of the stable Fusion 3 model.

The 2B model was developed by a research team no longer employed by Stability AI.

Management pushed for the release of the 2B model over the 4B and 8B, despite internal concerns.

Comfy was working on a T5 only 4B model, which would have been safer without image data issues.

The 2B model's release has been described as a failed experiment by some researchers.

Stability AI has not provided their side of the story, leading to speculation and uncertainty.

Comfy reassures that Comfy UI will continue to be developed by a larger team with more resources.

Comfy and MC Monkey plan to expand the Comfy ecosystem with a focus on democratizing AI tooling.

Their mission is to advance and democratize visual AI tooling through community efforts and open-source collaboration.

Comfy's team includes former Stability AI employees and contributors to the Comfy UI ecosystem.

The team aims to create an open-source environment for AI without paywalls or restrictive licenses.

Comfy's future plans include working closely with open-source model builders to enhance Comfy UI.

The team's core principles include transparency, communication, and community-driven development.

Comfy.org will support the Comfy UI ecosystem and work towards democratizing AI for everyone.

The team acknowledges the challenges of monetizing open-source projects while maintaining development.

Comfy's approach is inspired by successful open-source business models like Red Hat.