Google’s Smart Glass can now Process Video and Speech Simultaneously

Published  May 15, 2024   0
S Staff
Author
Google's Smart Glass

At Google I/O 2024, DeepMind Founder Demis Hassabis introduced their latest work on an advanced AI assistant known as ASTRA. This new technology, built on the latest Gemini model, aims to enhance AI interactions to feel more natural and intuitive. ASTRA processes video and speech simultaneously, organizing them into a timeline of events for efficient recall.

One standout feature is its wide range of intonations in sound, enabling ASTRA to produce highly natural output in real-time conversations. This advancement marks a significant step forward in AI technology, promising more seamless and human-like interactions with AI assistants.

There was a Pre-recorded demonstration of ASTRA, showcasing its versatility in mobile applications. The integration of ASTRA into Google Glasses was particularly fascinating, especially considering its compact form factor that incorporates cameras, microphones, batteries, and other essential components. 

In the Demonstration Video of Project ASTRA, we witness the glasses' seamless real-time capabilities, including high-speed image recognition, efficient recall abilities, three-dimensional object tracking, and the capability to provide real-time feedback—all executed within fractions of a second. Considering these impressive features, Google Glasses holds significant potential for the future Applications.