Glaze Protection from AI

LightBox Expo
30 Jan 202461:21

TLDRThe panel discussion 'Create Don't Scrape: Glaze Protection Against AI' led by Mia Arahao explores concerns surrounding generative AI technologies like Mid Journey, DALL-E, and Stable Diffusion, which threaten artists' rights by potentially misusing their works online. Panelists including John Lamb, Ben Jiao, Steven Zapata, and Carla Ortiz share their journeys from recognizing the impacts of AI on their fields to actively advocating for protections and solutions. They introduce 'Glaze,' a tool developed to safeguard artists' creations from unauthorized AI use, aiming to shift the conversation and ensure that artists' livelihoods and creative integrity are protected against exploitative tech advancements.

Takeaways

  • 🛡️ The panel discusses concerns about generative AI technologies like MidJourney, DALL-E, and Stable Diffusion affecting artists and other industries.
  • 🗣️ John Lamb started an advocacy movement with the hashtag #createdontscrape after witnessing the impact of generative AI on artists like Carla and Greg, sparked by the posthumous use of Kim Jung Gi's artwork.
  • 🎓 Ben Jiao, a professor of computer science, focuses on AI security and has developed systems like Glaze to protect artistic content from misuse by AI technologies.
  • 🎨 Steven Zapata emphasizes education and advocacy in the artistic community, helping artists understand and navigate the challenges posed by generative AI.
  • 🏛️ Carla Ortiz, an artist and advocate, actively participates in lawsuits against companies misusing artists' work in generative AI models, highlighting the misuse of artists' creativity and the need for protection.
  • 📢 The panelists discuss the unique threats posed by generative AI to creative industries, contrasting it with other technological tools that artists have adapted to over the years.
  • 🔒 Glaze and Nightshade are tools developed to protect artists' rights by modifying images in ways that prevent AI from learning their style without permission.
  • 📊 Ben Jiao mentions that his lab's tools like Glaze are designed to be freely available to artists, emphasizing the community-focused nature of these defenses against AI exploitation.
  • 🚫 Nightshade, described as a 'poison attack,' aims to corrupt the training data for AI models, potentially deterring companies from scraping artists' works without consent.
  • 🌐 The discussion underscores a broader movement within the creative community to safeguard artistic integrity and rights in the face of rapidly advancing AI technology.

Q & A

  • Who is Mia Arahao, and what is her role in the panel discussion?

    -Mia Arahao is the moderator of the panel discussion titled 'Create Don't Scrape: Glaze Protection Against AI'. She guides the conversation and introduces the panelists, who are advocates for artists and various industries affected by generative AI technologies.

  • What concerns does the panel address regarding generative AI technologies like MidJourney, DALL-E, and Stable Diffusion?

    -The panel addresses concerns about the impact of generative AI on the creative industries, particularly how these technologies might use and manipulate artists' works without consent, potentially threatening artists' livelihoods and the originality of their creations.

  • What is the purpose of the hashtag 'create don't scrape' mentioned by John Lamb?

    -John Lamb mentions the hashtag 'create don't scrape' as part of his advocacy to promote the creation of original content over the scraping and unauthorized use of existing artworks by AI technologies. This movement aims to protect artists' rights and their creative outputs.

  • How did Ben Jiao, a professor of computer science, become involved with AI protection for the arts?

    -Ben Jiao became involved with AI protection through his background in security and AI systems. His interest grew after attending a town hall hosted by Carla, which opened his eyes to the misuses of AI in the arts, leading him to develop tools like 'Glaze' to help protect artists.

  • What is 'Glaze', and how does it protect artists' works?

    -Glaze is a technology developed by Ben Jiao and his team that makes subtle changes to images to disrupt how AI models learn and replicate styles from these images. It aims to protect artists' styles from being appropriated by generative AI without affecting the visual integrity of the artworks.

  • Can you explain the significance of the legal actions mentioned by Carla Ortiz in relation to AI technologies?

    -Carla Ortiz highlights her involvement as one of the plaintiffs in class action lawsuits against companies using generative AI technologies like Stable Diffusion. These legal actions aim to challenge the unauthorized use of artists' works and advocate for proper compensation and recognition of artists' rights.

  • What impact did John Lamb's tweet have on the conversation about artists' rights in the context of AI?

    -John Lamb's tweet, which humanized the plight of artists affected by AI, went viral with 60,000 retweets. This massive response highlighted the widespread concern and care people have about the impact of AI on artists, significantly boosting the visibility and momentum of the advocacy against AI's misuse.

  • What new project is Ben Jiao working on to further protect artists from AI misuse?

    -Ben Jiao is working on 'Nightshade', a new project designed to introduce 'poison attacks' into AI training datasets. This approach aims to corrupt the data AI models learn from, preventing them from accurately replicating or stealing artists' styles.

  • How does Steven Zapata use his platform to address issues raised by generative AI?

    -Steven Zapata uses his YouTube channel to educate and advocate on the impacts of generative AI on the arts. He created a video titled 'The End of Art: An Argument Against Image AI', which expresses his concerns and mobilizes support for artists' rights.

  • What future actions are suggested to combat the negative impacts of generative AI on the creative industries?

    -The panel suggests continued advocacy, legal actions, and the development of protective technologies like Glaze and Nightshade. They emphasize the importance of public awareness and legal frameworks to ensure artists and their creations are protected against unauthorized AI exploitation.

Outlines

00:00

📢 Introduction to the Panel Discussion on AI and Art

The panel discussion, titled 'Create Don't Scrape Glaze', focuses on the impact of generative AI technologies like MidJourney, DALL-E, and Stable Diffusion on the art community. The moderator, Mia Arahao, introduces the session, emphasizing the concerns artists have about their work being used without consent by AI technologies. The panel consists of four activists who have been vocal about protecting artists' rights and intellectual property in the face of these emerging technologies. They each share their journey into activism, sparked by personal and communal impacts observed in the art community.

05:01

🎨 Artists' Initial Encounters and Responses to AI in Art

Panelist Steven Zapata discusses his initial reaction to generative AI technologies and how it led him to create advocacy content on his YouTube channel. He talks about the significant anxiety and uncertainty these technologies have introduced among emerging artists. Another panelist, Carla Ortiz, shares her proactive steps in protecting artists' rights, including her involvement in a class-action lawsuit against companies like DeviantArt and Mid Journey. She emphasizes her role in educating and mobilizing the art community to fight for their rights and the authenticity of their creative works.

10:01

🤖 Understanding and Interacting with Generative AI

Steven Zapata explains the basic functionality of generative AI, detailing how users typically interact with these models via prompts to generate images. He highlights the training process of these AIs, which involves massive datasets scraped from the internet, containing billions of images and their descriptions. This training not only uses artists' works without permission but also locks in data, making retraining difficult. The conversation underscores the ethical implications and the irreversible nature of the training data used in AI models.

15:02

🔍 Distinctiveness of Generative AI from Other Art Tools

The discussion shifts to how generative AI fundamentally differs from other technological advancements in art, like Photoshop or digital tools, which traditionally aid artists without replacing their creativity. Carla Ortiz argues that generative AI uniquely exploits and depends on existing artworks to function. This segment of the talk delves into the misconceptions propagated by AI proponents and contrasts them with the actual implications of AI on artists' livelihoods and creative expression.

20:04

🛠️ Technological Solutions and Protective Measures Against AI Exploitation

Ben Jiao, a computer science professor, introduces 'Glaze', a technology developed in collaboration with artists to protect their works from AI misuse. Glaze modifies artwork in subtle ways that prevent AI from learning and replicating the artist’s style. This part of the discussion explores the technical underpinnings and societal implications of deploying such tools. The collaboration between the academic and artistic communities highlights a proactive approach to defending creative works against technological exploitation.

25:06

🚀 Launching Nightshade: A Strategy to Combat AI Training on Artists' Works

The panel introduces 'Nightshade', a new tool designed to inject errors into AI models that train on unauthorized data, effectively 'poisoning' these models. This segment explains the mechanism behind Nightshade and its strategic role in the broader fight against the exploitation of artists' works by generative AI. The conversation covers the technical aspects, potential impacts, and the ongoing commitment of the project team to ensure the tool’s effectiveness and accessibility to the artist community.

30:07

🤝 Final Thoughts and Audience Engagement

The session concludes with the panel addressing questions from the audience, offering insights into further actions artists can take to protect their works and discussing the financial model behind the anti-AI tools like Glaze and Nightshade, which are provided free of charge. The panelists encourage the audience to actively use these tools to safeguard their creative output, highlighting the importance of community and collective action in the ongoing battle against AI exploitation in the arts.

Mindmap

Keywords

💡Generative AI

Generative AI refers to technologies that generate new content based on training from existing data. In the context of the video, it is discussed critically as it relates to tools like MidJourney, DALL-E, and Stable Diffusion, which create artistic outputs from vast databases of artworks. These technologies raise concerns about the rights and livelihoods of artists as they can produce art that mimics the style of existing artists without compensation or consent.

💡Scraping

Scraping is a process where technology is used to extract large amounts of data from websites or databases. In the video, it refers specifically to the practice of harvesting artworks from the internet to train generative AI models. This is controversial as it often involves using artists' works without their permission, affecting their rights and control over their own creations.

💡Advocacy

Advocacy in the video refers to actions and efforts made to support and defend artists against the unchecked use of generative AI. Panelists like John Lamb and Carla Ortiz are highlighted as individuals who have been active in spreading awareness and pushing for legal measures to protect creators from the exploitation of their works by AI technologies.

💡Copyright infringement

Copyright infringement occurs when copyrighted work is used without permission, violating the rights of the original creators. In the video, this concept is crucial as it underpins the legal challenges artists face when their works are used by generative AI without consent, potentially leading to loss of income and control over their creations.

💡Glaze

Glaze is a protective technology mentioned in the video, designed to prevent AI from effectively learning and replicating an artist's style from glazed images. Developed by Ben Jiao and his team, it modifies images in subtle ways that disrupt AI training processes, helping artists safeguard their unique styles and works from being exploited by AI models.

💡Nightshade

Nightshade is described in the video as a more aggressive tool than Glaze, designed to 'poison' AI training data. When AI models are trained on images treated with Nightshade, they produce incorrect outputs, thus making the training data unreliable and protecting the artists' works from being effectively used in training generative AI.

💡Litigation

Litigation refers to the process of taking legal action against individuals or entities. In the video, litigation is discussed as a crucial step taken by artists like Carla Ortiz against companies deploying generative AI technologies that use artists' works without permission, seeking legal remedies and compensation.

💡Humanization

Humanization in the video is discussed as a strategy used by activists like John Lamb to highlight the personal and economic impacts of AI on artists. By sharing stories of individuals affected by AI, they aim to garner public sympathy and support for the cause, emphasizing that artists are not just faceless creators but individuals with livelihoods.

💡Data sets

Data sets are large collections of data used to train AI models. In the video, the creation and use of data sets are critical points of discussion, particularly how they are compiled (often through scraping) and their role in teaching AI models to replicate artistic styles, raising ethical and legal issues regarding the originality and ownership of generated content.

💡Mimicry

Mimicry refers to the action of imitating or replicating something. In the context of the video, it is used to describe how AI models replicate the styles of human artists, often without authorization. This raises concerns about artistic integrity and the reduction of unique styles to mere algorithms, impacting artists' recognition and earnings.

Highlights

Introduction by Mia Arahao, focusing on concerns about the impact of generative AI on artists and other industries.

John Lamb discusses the emotional and financial impact of AI on artists, catalyzed by the passing of artist Kim Jung Gi.

#CreateDontScrape movement highlighted, initiated by John Lamb and his wife Jen, aiming to protect artists' works online.

Ben Jiao explains his transition from a computer science professor unaware of the art world to a key player in AI protection strategies.

Steven Zapata discusses the transformation from art instructor to AI technology researcher in response to student concerns about generative AI.

Carla Ortiz describes her proactive steps in legal actions against companies misusing artists' work through generative AI technologies.

Panel discussion on the ethical implications of AI and its distinct harm compared to previous technologies like Photoshop.

The strategic development of Glaze, an AI protection tool, initiated by collaboration between artists and the University of Chicago.

Debate over AI as a tool or threat, with Carla Ortiz and other panelists providing perspectives on its unique challenges.

Discussion on the collaborative efforts between artists and technologists to develop Glaze, emphasizing community involvement.

Introduction of Nightshade, an advancement in AI protection aimed at poisoning AI training data, detailed by Ben Jiao.

Ben Jiao stresses that Glaze and Nightshade are offered free of charge, funded through grants and designed for public good.

Panel opens floor to audience questions, addressing topics like the long-term societal impacts of AI and ethical use of generative AI.

Question on inter-union collaborations among creative industries to tackle AI-related challenges in contractual negotiations.

Final words emphasize the urgency of protecting artistic work against AI exploitation and the collective effort required to combat it.