Meta updates its smart glasses with real-time AI video

Meta's Ray-Ban Meta smart glasses are coming several new AI-powered upgradesincluding the ability to have an ongoing conversation and translate between languages.

Ray-Ban Meta owners in Meta's early access program for the US and Canada can now download firmware v11, which adds "live AI". First introduced this fall, live AI allows users to continuously chat with Meta AI, Meta's AI assistant, to reference topics they've previously discussed in the chat. Users can interrupt Meta AI to ask follow-up questions or change the subject without having to say the wake word “Hey Meta.”

Live AI also works with real-time video. Users can ask questions about what they see in real time (for example, what's happening in their neighborhood).

For Ray-Ban Meta, real-time AI video was a key focus of Meta's Connect development conference earlier this fall. Positioned as an answer to OpenAI's questions Advanced Sound Mode with Vision and Google Astra ProjectThe technology allows Meta's artificial intelligence to answer questions about the appearance of the glasses' front camera.

With Monday's update, Meta became one of the first tech giants to launch real-time AI video on smart glasses. Google Lately He said it plans to sell AR glasses with similar capabilities, but the company hasn't committed to a concrete timeline.

Meta claims that in the future, live AI will even offer “helpful suggestions” before the user asks. What kind of suggestions? The company didn't say.

Firmware v11 also introduces live translation, allowing Ray-Ban Meta users to perform real-time speech translation between English and Spanish, French or Italian. When the user speaks to someone who speaks one of these languages, they will hear what the speaker is saying in English through the glasses' open-ear speakers and receive the transcript on their paired phone.

Ray-Ban Meta also has Shazam support as of firmware v11.0. Users can say "Hey Meta, Shazam this song" to have the glasses try to find the currently playing tune.

Meta warns that the new feature, especially live AI and live translation, may not always get things right. “We continue to learn what works best and improve the experience for everyone,” the company wrote in a statement. blog post.

Ray-Ban Meta recently achieved great success update In November, when Meta began rolling out certain AI capabilities to glasses users in France, Italy and Spain. The glasses continue to sell quite well; EssilorLuxottica, owner of Ray-Ban, in October said Install VR showing that Ray-Ban Meta is the best-selling glasses in 60% of all Ray-Ban stores in Europe, the Middle East and Africa.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *