Meta's smart glasses will soon provide detailed information regarding visual stimuli

The Ray-Ban Meta glasses are getting an upgrade to better help the blind and low vision community. The AI assistant will now provide "detailed responses" regarding what's in front of users. Meta says it'll kick in "when people ask about their environment." To get started, users just have to opt-in via the Device Settings section in the Meta AI app.

The company shared a video of the tool in action in which a blind user asked Meta AI to describe a grassy area in a park. It quickly hopped into action and correctly pointed out a path, trees and a body of water in the distance. The AI assistant was also shown describing the contents of a kitchen. 

I could see this being a fun add-on even for those without any visual impairment. In any event, it begins rolling out to all users in the US and Canada in the coming weeks. Meta plans on expanding to additional markets in the near future.

It's Global Accessibility Awareness Day (GAAD), so that's not the only accessibility-minded tool that Meta announced today. There's the nifty Call a Volunteer, a tool that automatically connects blind or low vision people to a "network of sighted volunteers in real-time" to help complete everyday tasks. The volunteers come from the Be My Eyes foundation and the platform launches later this month in 18 countries.

The company recently announced a more refined system for live captions in all of its extended reality products, like the Quest line of VR headsets. This converts spoken words into text in real-time, so users can "read content as it's being delivered." The feature is already available for Quest headsets and within Meta Horizon Worlds.

This article originally appeared on Engadget at https://www.engadget.com/ai/metas-smart-glasses-will-soon-provide-detailed-information-regarding-visual-stimuli-153046605.html?src=rss https://www.engadget.com/ai/metas-smart-glasses-will-soon-provide-detailed-information-regarding-visual-stimuli-153046605.html?src=rss
Created 2mo | May 15, 2025, 3:50:15 PM


Login to add comment

Other posts in this group

What the hell is going on with Subnautica 2?

If I had to describe the status of Subnautica 2 in just three words, it would be these: messy, messy, messy. That’s not to say the game itself is in terrible shape — this is actually a piv

Jul 18, 2025, 11:40:14 PM | Engadget
Netflix is already using generative AI in its original shows

Netflix admitted during its

Jul 18, 2025, 9:30:25 PM | Engadget
Microsoft unceremoniously kills off the Xbox Movies & TV store

Microsoft has rather abruptly closed down its Movies & TV app, which is accessible on Xbox and Windows PCs via the Microsoft Store. This allowed people to rent or buy movies or TV shows natively th

Jul 18, 2025, 7:10:23 PM | Engadget
Remedy lays out its plan to fix FBC: Firebreak, which includes improved onboarding

Remedy has announced plans to fix FBC: Firebreak and restore the good will of

Jul 18, 2025, 7:10:21 PM | Engadget
Meta says it won't sign the EU's AI code of practice

Meta said on Friday that it won't sign the European Union's new AI code of practice. The guidelines provide a framework for

Jul 18, 2025, 7:10:19 PM | Engadget
DuckDuckGo now allows you to filter out AI images in search results

DuckDuckGo is making it easier to wade through some of the AI slop that has taken over the internet in recent months. This week, the company

Jul 18, 2025, 4:50:07 PM | Engadget
Engadget Podcast: Ancestra director Eliza McNitt defends AI as a creative tool

Eliza McNitt is no stranger to new media. Her 2017 project, Fistful of Stars, was a fasc

Jul 18, 2025, 4:50:06 PM | Engadget