TECHNOLOGY, DATA & INNOVATION

Is Talking to AI Safe While Driving?

Technologic virtual intelligence car concept.

Evaluating new technology for the real world

Exponent provided Google with a science-backed evaluation of its in-vehicle, voice-based conversational AI feature — Gemini Live — to determine whether their technology conformed to established federal distraction guidelines for use while driving.

THE CHALLENGE

As voice-based conversational AI agents begin to redefine in-vehicle interactions, Google engaged Exponent to evaluate how its Gemini Live AI technology affects driver behavior. Exponent conducted a driver distraction assessment using eye-tracking and cognitive load measures, enabling Google to gauge the distraction potential of its innovation.

EXPONENT'S SOLUTION

Exponent's human factors scientists designed and conducted a driver distraction experiment involving a diverse group of participants driving while interacting with a version of Gemini designed to encourage extended voice-based conversations. 

Our study employed objective metrics, including the detection response task (DRT; ISO 17488:2016), to assess cognitive load. Researchers used eye-tracking technology to quantify visual demand, which they evaluated against established glance criteria from the National Highway Traffic Safety Administration (NHTSA) and guidelines from the Alliance For Automotive Innovation (formerly the Alliance of Automobile Manufacturers). This approach enabled rigorous comparison of driver focus during conversational interactions with Gemini, visual turn-by-turn guidance, and hands-free phone conversations across a range of topics.

Exponent's Impact

Exponent helped Google evaluate its Gemini conversational AI agent for conformance to established federal distraction guidelines. Mean glance durations for all tasks — including Gemini Live — were below NHTSA's recommended two-second safety threshold, indicating visual distraction at levels acceptable per federal guidelines. Both single-turn and multi-turn interactions with Gemini Live produced cognitive load levels similar to hands-free phone calls and lower than high-demand tasks. Importantly, extended multi-turn conversations with Gemini Live did not result in cumulative increases in cognitive load over time, suggesting that sustained interactions do not become more distracting as they continue.

These findings demonstrate that advanced LLM conversational agents implemented via voice interfaces impose demands on attention comparable to established, low-risk hands-free benchmarks. Exponent's experimental data and research has been posted to a pre-print repository in preparation for submission to a peer-reviewed scientific journal, helping establish a foundation for human factors research around voice-based conversational AI technology in vehicles.

What Can We Help You Solve?

Exponent's user experience (UX) and data science teams support clients in identifying and mitigating risks for next generation automotive vehicles, e-mobility devices, consumer electronics, digital health devices, and other technologies, offering rigorous human factors evaluations and actionable insights. 

Get in touch