OpenAI, the developer of the ChatGPT chatbot, has added voice and image recognition capabilities to its generative AI platform.
OpenAI announced on September 25 that these features will be added to paid versions of the ChatGPT service, allowing users to talk to the AI and even show it what they are talking about. “Speech and images open up many ways to use ChatGPT in your life,” OpenAI said.
OpenAI suggests that users could take a photo of a landmark while traveling and chat directly with ChatGPT about what's interesting about that location; take a photo of the contents of the refrigerator to get ChatGPT to suggest a meal recipe, or take a photo of their child's math homework to get answers.
ChatGPT Plus and Enterprise users will get to experience the feature in the coming weeks, according to Open AI. The project is also being developed for Apple and Google smartphone operating systems.
“You can now use your voice to chat back and forth with your assistant,” says ChatGPT’s creator. “Talk to it on the go, ask it to read a bedtime story to your kids, or ask it to settle an argument at the dinner table.”
OpenAI has also partnered with voice actors to make voice interactions via ChatGPT more realistic.
OpenAI's generative AI programs made headlines late last year, when ChatGPT demonstrated its ability to generate essays, poems, and conversations from brief text prompts.
In addition to the startup OpenAI, many technology "giants" such as Google, Meta and Microsoft... are also racing to develop AI, while trying to avoid the potential risks of this technology creating false information and aiding cybercrime.
In an announcement on September 25, Sweden-based music streaming platform Spotify said it is leveraging OpenAI's technology to enable podcast translation into multiple languages, while maintaining the original speaker's language.
“By incorporating the creators’ own voices, Voice Translation gives listeners around the world the ability to discover and be inspired by new podcasts in a more authentic way than ever before,” said Ziad Sultan, Spotify’s VP of Personalization.
In the coming weeks, Spotify will roll out English podcasts translated into Spanish, French, and German, it said.
According to Tin Tuc newspaper