A new video by MKBHD provides an extended look at Google's Gemini experience within Android XR, powered by Project Astra and Gemini 2.0. This offers a glimpse into the future of augmented reality, showcasing Gemini's ability to seamlessly integrate with real-world and virtual environments.
Gemini in Action
Gemini can be activated via Quick Settings and responds to voice commands, understanding both the virtual screen content and real-world input from front-facing cameras. This allows users to ask questions about anything they see, from translations of text to information about locations in Google Maps or details about YouTube videos.
The system can also provide information about the real world. For example, if someone is wearing a soccer jersey, Gemini can provide details about the team's performance and league rankings. This functionality is similar to having another person present to answer questions in real-time.
This natural interaction with Gemini, without needing specific prompts or commands, highlights Google's advancements in large language models (LLMs) and voice interaction. DeepSeek is another example of the progress being made in the AI field.
Availability and Hardware
Currently, Astra is a standalone app for trusted testers, but it will be integrated into the Gemini app for Pixel and Galaxy S25 phones in the coming months. The recent Galaxy S25 launch event provided a closer look at the hardware, which resembles the Vision Pro but is lighter due to its plastic construction. The Galaxy S25 launch also revealed other key details about the device.
The headset's design features a "forehead rest" that distributes weight more effectively, potentially eliminating the need for a top strap. The video also shows the USB-C connection for the battery pack, allowing for extended use with additional batteries. For those interested in other Android developments, Android 16 Beta 1 is now available for Pixel phones.