Meta has expanded the capabilities of its wearable devices through a partnership with New York Times Cooking to bring recipe assistance to its smart glasses and AI platform. The integration, first announced during the Meta Connect 2024 event, utilizes Meta AI to assist with meal preparation.
For the millions of users with the current generation of Ray-Ban Meta smart glasses, the experience is strictly audio-based. Because these glasses do not feature a built-in heads-up display, the device relies on its integrated speakers and microphones for recipe instructions.
Multimodal AI Integration
For those using the Ray-Ban Meta models, the NYT Cooking feature is part of a broader push into multimodal AI. This allows the glasses to “see” what the user sees through the camera and provide context. For instance, a user could ask the glasses for a recipe based on ingredients sitting on their kitchen counter.
Broader Ecosystem Updates
The NYT Cooking partnership is rolling out alongside several other third-party integrations and accessibility features designed to make the glasses more functional in daily life. Meta has also added or expanded support for:
- Media Services: New integrations with Spotify, Amazon Music, Audible, and iHeartRadio allow for voice-controlled playback.
- Visual Assistance: A partnership with Be My Eyes enables blind or low-vision users to connect with sighted volunteers who can describe surroundings via the glasses’ live video feed.
- Live Translation: The glasses can now perform real-time language translation, allowing users to hear a translated version of a conversation through the speakers while the other person is speaking.
These updates are being delivered as part of Meta’s software rollout for the Ray-Ban Meta collection. While the audio-only version of the NYT Cooking assistant is the current standard for consumers, the software architecture is designed to support the evolving capabilities Meta is developing for its wearable devices.
