Open AI now enables users to have voice conversations with ChatGPT

This development is coming just weeks after it emerged that the AI platform has lost traffic for the third straight month.
Sam Altman, OpenAI CEO, receives Indonesian's 10-year golden visa
Sam Altman, OpenAI CEO

Open AI, the parent organisation of ChatGPT, is beginning to roll out a new feature that will allow users to have voice conversations with the artificial intelligence solution. This is according to a new blog post published on the Open AI platform. This development is coming just weeks after it emerged that the AI platform has lost traffic for the third straight month.

The AI company said it is beginning to roll out new voice and image capabilities in ChatGPT. It said these capabilities offer a new, more intuitive type of interface by allowing users to have a voice conversation or show ChatGPT what they are talking about.

“You can now use voice to engage in a back-and-forth conversation with your assistant. Speak with it on the go, request a bedtime story for your family, or settle a dinner table debate,” the blog post reads in part.

The new voice capability is powered by a new text-to-speech model which Open AI says is capable of generating human-like audio from just text and a few seconds of sample speech. Users can decide to use the pre-recorded voices or record their own voices which the system would train itself to use in a short time.

“The new voice technology is capable of crafting realistic synthetic voices from just a few seconds of real speech. We collaborated with professional voice actors to create each of the voices. We also use Whisper, our open-source speech recognition system, to transcribe your spoken words into text,” Open AI said.

Open AI now enables users have a voice conversation with ChatGPT

The company is rolling out the feature over the next two weeks. To use the new voice conversation feature, simply head to Settings, click on New Features on the mobile app and opt into voice conversations. Then, tap the headphone button located in the top-right corner of the home screen and choose your preferred voice out of five different voices.

The company, while expecting the innovation to open doors to many creative and accessibility-focused applications, noted that it also presents new risks, such as the potential for malicious actors to impersonate public figures or commit fraud. As such, it is using the technology to power a specific use case.

“This is why we are using this technology to power a specific use case—voice chat. Voice chat was created with voice actors we have directly worked with. We’re also collaborating in a similar way with others. For example, Spotify is using the power of this technology for the pilot of their Voice Translation feature, which helps podcasters expand the reach of their storytelling by translating podcasts into additional languages in the podcasters’ own voices.”

See also: ChatGPT traffic drops for 3rd straight month, records 1.43bn worldwide visits in August

Other features of Open AI

Apart from the voice conversation feature, Open AI is also bringing a voice and image tool to its AI solution. With the feature, users can have a conversation with ChatGPT about anything they intend to do or about their daily activities in a more specific manner. Say if you want to have a conversation about what clothes to wear, you could take a picture of your wardrobe, upload it on the platform and ask ChatGPT for advice.

“Voice and image give you more ways to use ChatGPT in your life. Snap a picture of a landmark while travelling and have a live conversation about what’s interesting about it. When you’re home, snap pictures of your fridge and pantry to figure out what’s for dinner (and ask follow-up questions for a step-by-step recipe). After dinner, help your child with a math problem by taking a photo, circling the problem set, and having it share hints with both of you,” the blog post reads.

Android users to keep waiting as OpenAI launches ChatGPT App for Apple iOS
ChatGPT costs $700,000 daily, OpenAI may go bankrupt in 2024: Report

Speaking on the image model, Open AI admitted that vision-based models also present new challenges, ranging from hallucinations about people to relying on the model’s interpretation of images in high-stakes domains. As such, it said it has tested the model with red teamers for risk in domains such as extremism and scientific proficiency, and a diverse set of alpha testers prior to broader deployment.

“Our research enabled us to align on a few key details for responsible usage,” it said.

The company, again admitted that ChatGPT is not always accurate and as such, it has taken technical measures to significantly limit its ability to analyze and make direct statements about people.

Whether these new measures will stem the tide and see the company ramp up the number of visits is yet to be seen. But so far, it presents an exciting new introduction to the AI battle.

Technext Newsletter

Get the best of Africa’s daily tech to your inbox – first thing every morning.
Join the community now!

Register for Technext Coinference 2023, the Largest blockchain and DeFi Gathering in Africa.

Technext Newsletter

Get the best of Africa’s daily tech to your inbox – first thing every morning.
Join the community now!