- You'll soon be able to pull ChatGPT up on your screen and get real-time feedback on your work.
- ChatGPT was able to suggest fixes to errors in code in a live demo on Monday.
The latest version of ChatGPT could turn the artificial-intelligence tool into a personal assistant — including at work.
Among the new features that OpenAI highlighted on Monday: You can pull up ChatGPT on your computer desktop or smartphone screen and show it whatever you're looking at, whether it's a math problem on a whiteboard or a screen full of code.
In one demo during OpenAI's presentation on its newest model powering the chatbot, GPT-4o (that's the letter O, not zero), ChatGPT suggested changes to code in real time on a user's computer.
At first, ChatGPT was known for its command-prompt-like interface, which allows users to type in questions or requests for images. Last fall, OpenAI added a voice mode, allowing users to ask questions like they would with Alexa or Siri — albeit with a more sophisticated model responding.
But with GPT-4o, users can now show ChatGPT what they're working on and get real-time feedback.
In another example, ChatGPT gave a one-sentence summary of a line graph when an OpenAI employee pulled it up on his desktop.
Damn... the idea of being able to just share your screen natively using the new ChatGPT Mac app and have gpt work with you is freaking awesome pic.twitter.com/mwZvZWVP1u
— Josh Cohenzadeh (@jshchnz) May 13, 2024
With the GPT-4o/ChatGPT desktop app, you can have a coding buddy (black circle) that talks to you and sees what you see!#openai announcements thread! https://t.co/CpvCkjI0iA pic.twitter.com/Tfh81mBHCv
— Andrew Gao (@itsandrewgao) May 13, 2024
For anyone who codes or handles data for a living, it's not hard to imagine how the latest version of ChatGPT could make work easier.
Holy shit ChatGPT can help you fix and write codes in real freaking time, it can see your screen and can talk to you in real time.
— Kuldeep Lather (@Kullthegreat) May 13, 2024
I hope you got an idea about how crazy this shit is pic.twitter.com/ZxqsL2TOje
ChatGPT can also give feedback on work in the real world. In Monday's demo, OpenAI employees showed the tool, via smartphone camera, a simple algebra problem written on a whiteboard.
Eventually, ChatGPT gave them hints on how to solve an unknown variable, giving them feedback at different stages.
GPT-4o marks "the first time that we are really making a huge step forward when it comes to the ease of use," OpenAI's chief technology officer, Mira Murati, told an audience at the company's offices as Monday's presentation kicked off.
Correction: May 13, 2024 — A previous version of this story referred to the latest version of ChatGPT by the wrong name. It is still called ChatGPT, not ChatGPT-4o. GPT-4o is the new model that powers the chatbot.