Naturally, you can work in a mixed-reality environment with a connected Bluetooth keyboard and mouse, and you can put yourself in an immersive environment if you want to focus, or to ensure That you don't have coworkers can leave see-through mode on. Taking pictures and giggling while you wear a ridiculous headset to run errands. It wasn't clear whether you'd be able to connect the headset to a laptop to bring your work into mixed reality, a feature available on the Apple Vision Pro.
Gemini in XR
A tap on the side of the headset brings up an app launcher, and this is where you can toggle the Gemini on if you want it to be constantly “on.” Once it's on, there's an icon at the top of the virtual space so you know that everything you say and see is being registered by Gemini.
In see-through mode, you can walk up to an object and ask Gemini about it – a Googler demoing the headset (before I got to try it) walked up to another guy wearing an FC Barcelona shirt and Gemini Asked to know “its status”. Team.” Gemini instantly registers the team name and returns search results with league standings and scores of recent matches.
You can ask Gemini anything and it will respond with visual results displayed in the headset. I asked him to “take me to Peru” and he opened a 3D version of Google Maps. I was able to move around and center on Lima, and in cities where Maps already has plenty of 3D models, you can explore areas in more detail. You can keep talking to Gemini throughout these experiences, so I asked questions like when would be the best time to travel and got an immediate answer.
In another example, I peeked inside a New York City restaurant to take a virtual tour of the space. Google says it can use AI to stitch together images of a venue's interior and display it so it feels like you're there. This worked great, and I asked Gemini if that place took reservations, without specifically mentioning the name, since I was paying attention to the name of the restaurant. it does Take a reservation, but Gemini couldn't actually make a reservation for me. (That integration may happen later.)
After this, I watched some videos on YouTube, where 2D content looks clear and colorful. The stereoscopic material was even better; My senses felt engulfed. I saw some hikers walking on the trail and asked Mithun where all this was, and he said, “New Zealand.” I couldn't verify it, but it seemed like the right answer. I noticed some more spatial playback of 2D videos as the virtual player added depth and layering to make them feel more like 3D. I went to the Google TV app and enabled “Cinema Mode” to launch a virtual theater for watching movies and shows, like other VR headsets.
circle to findThis feature was introduced by Google earlier this year on android phoneAlso available in Android XR. Simply go to a physical object near you, press the top button on the headset, and then pinch and draw a circle around the thing you want to know more about. You will get a Google search page with results.
smart glasses
Project Mohan feels like Google and Samsung are catching up to the rest of the VR market, though the Gemini integration adds a unique layer to their efforts. However, I'll admit I was far more excited to try out smart glasses, where Gemini thinks it could be even more helpful. He did not disappoint. I went into another room and there were several pairs of glasses in front of me. Some had sunglasses, others had clear lenses. Like headsets, you can get them loaded with your prescription. Google did not provide a name for the prototype glasses.
