OpenAI has released a Christmas miracle on Day 6 of its “12 Days of OpenAI” series by giving ChatGPT, vision! Yes, OpenAI has introduced vision capabilities on ChatGPT, upgrading the existing voice chat feature to “advanced voice mode with vision”. This vision feature lets users have a video chat with ChatGPT and even share their screens while on voice chat. These new features broaden the range of use cases of ChatGPT, especially for real-time help on-the-go. In this article, we will first learn how to access these new features on ChatGPT and then explore some of their diverse applications.
Also Read: 12 Days of OpenAI: Bringing AI to your Holidays
How to Access ChatGPT’s Advanced Voice Mode with Vision
Here’s how you can access the advanced voice mode with vision on ChatGPT.
- Login to ChatGPT
Open ChatGPT and login to your Pro or Plus account.
- Start a Voice Chat
Now click on the voice chat icon next to the mic icon on the bottom right corner to start a voice chat.
- Start a Video Chat
a) To start a video chat, click on the camera icon in the bottom left corner of the voice chat window.
b) To share your screen with ChatGPT, click on the 3 dots and choose the ‘Share Screen’ option.
Now that we have all gotten access to ChatGPT’s advanced voice mode with vision, let’s find out what all we can do with it.
Applications of ChatGPT’s Latest Features
1. Everyday Tasks Made Simpler
ChatGPT is now just a video chat away for helping you with any of your everyday activities. Need to fix your printer? Need guidance in cooking something? Want to remove that coffee stain off of your shirt? ChatGPT can help you with all of that! It can tell you how to do it and guide you every step of the way, using its advanced voice mode with vision.
It can even help you with more complex things and difficult situations. Imagine your car breaks down in the middle of nowhere and there is no help to be found around. You can start a video chat with ChatGPT, show it your flat tire or the open bonnet of your car, and it can help you find the issue and fix it! Likewise, if you need help in assembling a new piece of furniture from IKEA, ChatGPT can guide you through with tutorials and instructions over video chat.
Also Read: 7 Out-Of-The-Box ChatGPT Prompts to Try Today
2. Your New-Found Best Friend
ChatGPT is growing to be an always-available, everyday companion for people of all ages and backgrounds. Now with the screen share option, you can ask it for suggestions before doing pretty much anything on your phone. Furthermore, the advanced voice mode with vision makes it feel like you’re video calling your friend, ChatGPT. So, can ChatGPT be your new-found best friend? Probably! Imagine having a friend who you know will always pick your call and help you out, no matter what time it is or what mess you’re in. Isn’t that just wonderful?
3. Roleplaying with ChatGPT
ChatGPT, which until now was just preparing meeting agendas and taking down notes, has now upgraded to a helpful colleague. Using the advanced voice mode with vision, it can now virtually join your office meetings and be a part of your brainstorming activities. Once you introduce all the members in the meeting, ChatGPT can communicate just like a person in the room, taking the names of your colleagues and evaluating the ideas being discussed.
The advanced voice mode with vision feature also helps ChatGPT roleplay in other situations. It can now train you and help you prepare for a job interview, a debate, or even a spelling bee contest, like a friend or coach. It can be your quizmaster or interviewer and ask you questions, score your answers, guide you to the right answer when you go wrong, and help you with tips to improve. A few such practice rounds on video chat with ChatGPT, and you should be ready to ace any interview!
4. Virtual Teaching Assistant
ChatGPT’s vision-powered advanced voice mode can be a great help for students and teachers alike. ChatGPT can now help you solve a math or science problem in real-time as you are trying to solve it on video chat, guiding you through every step of the calculation. It’s like having a personal tutor who is always accessible to you and can explain things according to your needs and level of understanding. Isn’t that great?
5. Personal Stylist
Not sure what to wear today? ChatGPT can be your personal stylist, helping you dress up and accessorize! Simply open ChatGPT’s advanced voice mode with vision and give it a sneak peak into your wardrobe. The chatbot will see what you have, analyze all possible mix-and-match options, and suggest a few best picks. Voila! One simple video chat and you’re probably set for the whole week!
With this new feature, ChatGPT on your mobile phone can now act like a smart virtual mirror, giving you make up and hair-styling suggestions. It can help you choose the right look, pick the right shade of make up, and even guide you on how to apply them. It can also send you links to makeup and hairdo tutorials and guide you through them. The seamless interface makes the video chat feel just like looking into a selfie camera and talking to a friend!
6. Personal Trainer
With New Year around the corner, I’m sure at least some of you are planning to hit the gym starting from Jan. But how many of you are sure you’ll be consistent at it? Finding time, dressing up, and going to the gym to workout may be difficult for some of us, given our busy schedules. How about having a virtual personal trainer who’ll train you at home, and at your convenience? Sounds like the perfect fitness mantra to me!
Well, thanks to the new advanced voice mode with vision, ChatGPT can be your personal fitness trainer at home. It can tell you what exercises to do and guide you in real time, as you do them over video chat. It can watch your moves, correct your mistakes, customize your exercise regime based on your capacity, and even motivate you to go on when you feel like giving up!
Also Read: 5 ChatGPT Prompts To Help Achieve New Year Resolutions
7. Design Your Homes Using ChatGPT
Interior designing and home decoration is now a piece of cake – thanks to ChatGPT’s advanced voice mode with vision. All you have to do is walk into a room with your camera turned on, while on ChatGPT’s voice chat and ask the chatbot to design the space for you. ChatGPT, now with vision capabilities, will look around the room, analyze the spaces, and suggest you interior decor ideas. It can tell you what furniture and accessories go well with what floor and walls. It can also tell you what stores (both online and offline) to buy the suggested decor items from.
8. Social Media Guide
ChatGPt’s new screen sharing feature on voice chat is really helpful to get suggestions and do everyday tasks on your mobile phone. Let me show you a very simple, everyday use case. I often find it hard to write captions for the images I post on social media. Now with ChatGPT’s vision-powered advanced voice mode, I can share the image on my screen with the chatbot, and it can tell me a befitting caption for it, with all the right hashtags and jazz!
This way, you can share your screen while voice chatting with ChatGPT and get help with responding to messages, writing emails, commenting on social media, troubleshooting, and more. You can even open an image on your screen, share it with ChatGPT and ask for editing suggestions. The chatbot can tell you exactly what changes to make and guide you through every step, as you make it the perfect picture!
Also Read: Using ChatGPT to Create YouTube Video Description and Titles
Final Thoughts
OpenAI has truly stepped up its game with ChatGPT’s new advanced voice mode with vision. From helping with schoolwork and styling outfits to designing homes and fixing everyday problems, it feels like there’s almost nothing it can’t do. These updates make ChatGPT more than just a chatbot—it’s like having a helpful and reliable virtual friend!
That being said, while it’s exciting to see how much easier life can get with these features, it’s also important to stay mindful. Sharing too much information or relying entirely on a chatbot for everything might not be the best idea. Do we really need a chatbot to tell us how to text a friend or decide what to eat? After all, as amazing as ChatGPT is, it’s still a virtual assistant, not a real person. So, enjoy these new features, but use them smartly—and let ChatGPT be the handy helper you need, not the one you can’t live without!
Frequently Asked Questions
A. No, Advanced voice mode comes with ChatGPT’s paid plans: Plus and Pro.
A. Yes, with its latest update, you can now chat with ChatGPT over video and get assistance with a range of tasks.
A. No, it can only assist you in writing your emails and messages you still have to press the send button.
A. No, it can’t. You have to switch the advanced voice mode with Vision to allow chatGPT to “see” things around you. To allow chatGPT to read your messages, you will have to use its “share screen” feature.
A. You can use chatGPT’s advanced voice mode for selecting your outfit for the day, guiding you through a recipe, assembling a new piece of furniture, helping you prepare for an interview, and more.
A. To access the advanced voice mode on ChatGPT, ensure you have an active paid subscription. Simply log in to your account and select the voice feature to begin. If you already have a subscription but cannot access the feature yet, don’t worry—OpenAI has announced that it will roll out to all paid subscribers within the next few days. For enterprise accounts, however, this feature is scheduled to become available starting in 2025.
Sabreena Basheer is an architect-turned-writer who’s passionate about documenting anything that interests her. She’s currently exploring the world of AI and Data Science as a Content Manager at Analytics Vidhya.
