OpenAI’s popular AI chatbot, ChatGPT, has undergone significant changes to enhance its capabilities. Previously limited to a text box, ChatGPT can now understand and respond to voice commands and process image searches.
OpenAI has improved the underlying models of ChatGPT, expanding the range of questions it can answer and the information it can access. This update allows users to interact with the AI bot not only by typing sentences but also by speaking aloud or uploading a picture.
The new features are being rolled out to users who pay for ChatGPT, with availability for all users expected in the near future. The voice chat functionality is similar to popular virtual assistants like Alexa or Google Assistant, providing a more natural and intuitive way to interact with the AI bot.
OpenAI has also developed a text-to-speech model that can generate human-like audio from text input. Users will have the option to choose from five different voices for ChatGPT. OpenAI is even working with Spotify to translate podcasts into other languages while preserving the original voice of the podcaster.
While these advancements offer exciting possibilities, they also come with potential risks. OpenAI acknowledges the risk of malicious actors using synthetic voices to impersonate public figures or commit fraud. To mitigate these risks, OpenAI is implementing strict controls and limiting the use of these models to specific cases and partnerships.
The image search feature of ChatGPT allows users to snap a photo and prompt the AI bot to provide information about the subject of the image. Users can also use the drawing tool within the app to further clarify their query. The back-and-forth nature of ChatGPT enables users to refine their questions and receive more accurate answers.
However, there are concerns regarding the use of image search, particularly when it comes to privacy and potential misuse. OpenAI has intentionally limited ChatGPT’s ability to analyze and make direct statements about people to protect privacy and prevent misuse.
OpenAI continues to strive for a balance between expanding the capabilities of ChatGPT and addressing potential challenges. As voice control and image search become more prevalent, it will become increasingly difficult to maintain strict limitations on the AI bot’s functionality. Nevertheless, OpenAI is committed to ensuring responsible and ethical use of its models as it evolves into a truly multimodal virtual assistant.