OpenAI: ChatGPT Now Has Speech, Audio, and Image Capabilities, 2023.
OpenAI has introduced a major update to its ChatGPT, marking the most significant upgrade since the introduction of GPT-4. The latest version of ChatGPT can now “see, hear, and speak” to some extent.
This development enables users to engage in voice conversations via ChatGPT’s mobile app, offering a choice of five synthetic voices for responses. Additionally, users can share images with ChatGPT and request analyses or descriptions of specific areas within those images.
The rollout of these new features will commence in the coming two weeks, primarily targeting paying users. While voice functionality will be limited to the iOS and Android apps, image processing capabilities will be accessible across all platforms.
This update comes in the midst of intensifying competition in the AI chatbot landscape, with industry leaders such as OpenAI, Microsoft, Google, and Anthropic vying to entice users with innovative features.
This summer, in particular, has witnessed a flurry of announcements from tech giants, including Google’s enhancements to its Bard chatbot and Microsoft’s integration of visual search into Bing.
Microsoft’s substantial investment of an additional $10 billion into OpenAI earlier this year marked the most significant AI investment of the year, highlighting the growing significance of AI in various sectors.
OpenAI itself reportedly conducted a share sale valued between $27 billion and $29 billion, securing investments from prominent firms like Sequoia Capital and Andreessen Horowitz.
However, the introduction of synthetic voices in ChatGPT raises concerns among experts. While synthetic voices can enhance user experiences, they also have the potential to contribute to the creation of convincing deepfakes. Cyber threat actors and researchers have already begun exploring the ways in which deepfakes can be exploited to breach cybersecurity systems.
OpenAI acknowledges these concerns in its announcement, assuring users that its synthetic voices were crafted in collaboration with voice actors with whom the company has direct ties, rather than being sourced from unknown individuals.
Notably, the release needs to provide more extensive information on how OpenAI plans to utilize consumer voice inputs or secure their data.
OpenAI’s terms of service indicate that consumers maintain ownership of their inputs “to the extent permitted by applicable law.”
In summary, OpenAI’s latest update to ChatGPT introduces voice capabilities, synthetic voices, and image processing features. While this positions OpenAI as a prominent player in the evolving chatbot landscape, it also raises concerns about the potential misuse of synthetic voices for creating convincing deepfakes and the security of user-generated data.
As the AI arms race intensifies, these developments underscore the need for responsible AI development and robust data protection measures.
