Like other features of ChatGPT, vision helps you in your daily life. He does this best when he can see what you see.
This approach is based directly on our work with Be My Eyes, a free mobile app for blind and partially sighted people, to understand its uses and limitations. Users have told us that they're happy to have general conversations about images that happen to have people in the background, like if someone pops up on the TV while you're trying to figure out the settings on your remote.
We have also taken technical measures to significantly limit ChatGPT's ability to analyze and make direct statements about people as ChatGPT is not always accurate and these systems should respect the privacy of individuals.
Real-world usage and feedback will help us make these safeguards even better while keeping the tool useful.