Meta is rolling out live AI and real-time translations to its smart glasses, alongside Shazam support for hands-free music recognition.
Key Points:
- Live AI and real-time translation are available to Early Access Program members in the US and Canada.
- Shazam integration, which identifies songs hands-free, is rolling out to all users in the US and Canada.
- Live AI enables real-time assistance based on what the glasses’ cameras see.
- Real-time translations currently support English, Spanish, French, and Italian.
The Details: Meta’s latest software update for its Ray-Ban smart glasses brings three standout features aimed at making the wearable more versatile and intuitive. Live AI, real-time translations, and Shazam integration are part of the v11 software update, with availability varying depending on the feature.
Live AI, previewed at Meta Connect 2024, turns the glasses into an always-on personal assistant. The feature allows users to ask questions or get context about their surroundings in a natural, ongoing conversation. For instance, Meta AI can suggest recipes while looking at ingredients, identify plants during a nature walk, or provide details about objects without needing specific prompts like “Hey Meta.” Users can also follow up or interrupt the AI seamlessly, creating a more human-like experience.
Live translation, another Connect 2024 highlight, can translate speech in real time between English and Spanish, French, or Italian. Conversations are delivered through the glasses’ open-ear speakers or shown as transcripts on a connected smartphone. This feature aims to break down language barriers—whether for travelers exploring new regions or professionals engaging with multilingual communities.
Meanwhile, Shazam integration is a win for music lovers. A simple command, like “Hey Meta, what’s this song?” lets the glasses identify music playing nearby. Unlike live AI and translations, this feature is available immediately to all users in the US and Canada.
The new features expand the utility of Meta’s Ray-Ban smart glasses, offering hands-free tools that feel genuinely useful for everyday tasks. With AI-powered assistance, real-time translations, and instant music recognition, the glasses are inching closer to fulfilling their promise of blending digital and real-world interactions effortlessly.