This because the social network is now able to "understand" images such as food, people and trees, and will now be able to describe them to visually-impaired smartphone owners using what’s called a screen reader technology. This will tells users what is on the screen with a computer-generated voice.
How is it different from the past? Well previously, Facebook simply described a blind user's News Feed by saying the name of somebody posting the image, and then saying "photo". But from now on it will be able to describe what is in the image by detecting things in it. So it would say "image may contain: two people, smiling, sunglasses, sky, outdoor, water" for a photo of a couple on holiday by the sea beach.
The company expects this technology will do wonders in increasing the user friendliness of the website for blind people because it claims there are 2 billion photos which are shared every day across Facebook,
Recent studies have shown that blind people often feel excluded from conversations on social media centered around photos and videos.
While the company, using image recognition technology, was able to make facebook understand the photos (such as when it suggests you what friends should be tagged in photos), it has been ramping up investment in machine learning to solve the difficult task of getting computers to better recognise objects in photos now.
The work on automatic photo-reading for visually impaired people has been on for close to10 months now. But for a technology of this strength, it seems success has come far too quick than was expected. No doubt it is still in its nascent stages, but can recognise around 100 concepts including babies, beards, mountains, smiling and selfies with a precision of at least 80 per cent. There’ll be more as the technology becomes smarter.
Notably, Twitter also recently introduced a new feature to help blind people understand photos on its network - but Facebook's is far more advanced. While Facebook uses AI to automatically detect what's in a photo, Twitter requires users to manually add a description, which it can then narrate.
As of now, the Facebook feature is being introduced only in English on