Introducing GPT-4o

Mira Murati introduces the event's focus on three main topics, emphasizing the importance of making AI tools like ChatGPT widely available and user-friendly. The launch of the desktop version of ChatGPT is announced, promising a more natural and simpler user experience. The highlight is the unveiling of GPT-4o, a new flagship model that offers advanced intelligence to all users, including those using the free version. Live demos will showcase GPT-4o's capabilities, which will be rolled out progressively. The mission to democratize advanced AI tools by reducing barriers to access is reiterated, with recent improvements like the removal of the sign-up flow and UI refresh to enhance interaction.

The speaker discusses the new GPT-4o model's improved speed and capabilities in text, vision, and audio, marking a significant leap in ease of use. GPT-4o's native reasoning across voice, text, and vision is highlighted as a breakthrough that reduces latency and enhances the user experience. The model's release to free users is a major milestone, as it was previously only available to paid users. The introduction of GPT-4o in the GPT store allows for a broader audience to benefit from custom ChatGPT experiences. The model also brings advanced features like vision, memory, browsing, and data analysis to all users, with improvements in language support to reach a global audience. For paid users, the benefits include higher capacity limits. The API release of GPT-4o is announced, inviting developers to build AI applications with its advanced features.

The script presents a live demo of GPT-4o's real-time conversational speech capabilities. Mark Chen and Barrett Zoph, research leads, demonstrate the model's ability to handle interruptions, respond instantly without lag, and detect emotions through voice cues. The model's versatility in voice generation is showcased through a dramatic bedtime story about robots, adjusting its expression and style according to the user's requests. The interactive and empathetic nature of GPT-4o is highlighted, as it engages with the audience in a natural and dynamic manner.

Barrett Zoph interacts with ChatGPT to solve a linear equation, receiving hints and guidance through the process. ChatGPT demonstrates its ability to understand and respond to written equations, even before they are explicitly shown. It provides real-time feedback and encourages the user, enhancing the learning experience. The conversation also touches on the practical applications of linear equations in everyday life, emphasizing the importance of math skills and offering ongoing support for learning.

The script showcases ChatGPT's capabilities in assisting with coding and data visualization. Barrett Zoph shares a code snippet with ChatGPT, which accurately describes the code's functionality related to temperature data analysis. The model's understanding of the code's purpose and its ability to explain the significance of a specific function in smoothing temperature data is demonstrated. The interaction highlights ChatGPT's utility in providing clear explanations and insights into data trends and coding problems.

The final paragraph features live audience requests for demonstrations of GPT-4o's real-time translation capabilities and its ability to detect emotions from facial expressions. ChatGPT successfully translates between English and Italian and identifies emotions based on a selfie. The script concludes with a teaser for upcoming updates on the next frontier of AI technology, expressing gratitude to the team and partners involved in the development and demonstration of GPT-4o.