Ray-Ban’s Meta Smart Glasses: AI-Powered Visual Search Upgrade

Ray-Ban’s Meta smart glasses are set to receive a significant boost by integrating AI-powered visual search features. These enhancements are made possible by advancements in the social network’s AI assistant, bringing real-time information support to the onboard assistant and introducing experimental “multimodal” capabilities for context-based queries.

Key Points

• Transformation of Ray-Ban’s Meta smart glasses with AI-driven visual search capabilities.
• Real-time information support breaks previous knowledge limitations.
• “Multimodal” features were introduced for context-based queries and interactive experiences.
• Overcoming the “knowledge cutoff” barrier with real-time updates.
• Bing collaboration enhances access to up-to-the-minute information.
• Mark Zuckerberg demonstrates practical applications through engaging videos.
• Interactive commands like “Hey Meta, look and tell me” initiate user-friendly experiences.
• The gradual rollout of multimodal functionality begins with an exclusive US beta version.
• Anticipated broader release in 2024 promises an enriched user journey.
• Meta AI showcases image recognition, language translation, and context-aware responses.
• Ray-Ban’s Meta smart glasses blend fashion with cutting-edge AI technology.

Previously, the Meta AI had limitations with a “knowledge cutoff” of December 2022, hindering its ability to provide up-to-date information on current events, game scores, traffic conditions, and other on-the-go inquiries. Meta’s Chief Technology Officer, Andrew Bosworth, announced that all Meta smart glasses in the United States will now be equipped to access real-time information, partially powered by Bing.

Additionally, Meta is delving into the testing phase of “multimodal AI,” a fascinating feature showcased during Connect. This functionality enables the Meta AI to respond to contextual questions about the user’s surroundings and provide answers based on what the glasses capture visually.

These updates address concerns about the Meta AI feeling gimmicky and strive to enhance its practical utility. While the initial review of the smart glasses was largely positive, these improvements intend to make the technology even more valuable. However, the rollout of the multimodal functionality will be gradual. Bosworth mentioned that the early access beta version will initially be available to a limited number of users who opt in, exclusively in the US. A broader release is anticipated in 2024.

Mark Zuckerberg shared glimpses of the new capabilities through videos, showcasing potential applications. Users may engage with the feature by initiating commands such as “Hey Meta, look and tell me.” In one instance, Zuckerberg asked Meta AI to suggest pants matching a shirt he was holding. Screenshots revealed Meta AI identifying objects like a piece of fruit and translating text from a meme.

In a video on Threads, Bosworth emphasized that users could inquire about their immediate surroundings and explore creative questions, such as generating captions for recently taken photos. The ongoing developments suggest that Ray-Ban’s Meta smart glasses are evolving into a more sophisticated and practical tool, combining fashion with cutting-edge AI capabilities.