IntermediateAI

Google Gives Gemini 3.8 Live a Face With Live Avatar

On September 24, 2026, Google released Gemini 3.8 Live with Live Avatar, which adds near real-time generated video to its speech-to-speech dialogue model. The avatar has a face that lip-syncs to the voice, changes expression, and takes turns in the conversation, so an enterprise voice agent can now appear as a video call. The feature is generally available in Gemini Enterprise through US and EU endpoints. Google says it was first previewed at Google Cloud Next 2026.

Several video-call style avatar panels, some photorealistic and one stylised, surrounding the title Gemini 3.8 Live with Live Avatar
Image credit: Google Cloud

What Google Shipped

Gemini 3.8 Live is Google’s native speech-to-speech foundation model. Audio goes in and audio comes out, with no separate transcription and text-to-speech stages in between. Live Avatar adds a video-generation layer on top of that model. According to Google Cloud’s announcement, the combined system offers:

  • Video avatars that lip-sync to the generated speech with “natural expressions and fluid turn-taking.”
  • Interruption handling: the model recovers when a user talks over it, as you would expect from a speech-native model.
  • Asynchronous tool calling: API calls run in the background while the avatar keeps talking, so the conversation doesn’t stall on lookups.
  • Live visual input: the model processes camera feeds and screen shares alongside the audio.
  • 97 languages with automatic detection. The Google blog post says users can switch languages mid-conversation “without video degradation or visual drift,” and lip movements adapt to the new language.
Demo interface showing a live transcript beside a video avatar acting as a virtual bank assistant, with the user's camera feed in the corner
A virtual banking demo: the user shows a card to the camera and the avatar reads the balance. Image credit: Google Cloud

Custom Avatars and Safeguards

Customers can pick from a library of preset avatars. Custom avatars are built from system instructions, a single reference photo, and an audio sample, and they are available only through what Google calls a “strict enterprise allowlisting and verification process.” Organisations request access through Google Cloud sales rather than self-serve.

All generated audio and video carry SynthID watermarks, which Google describes as imperceptible and “woven directly into the audio and video output.” Google has published no latency figures, benchmarks, or pricing for Live Avatar. The Engadget report also notes that pricing was not disclosed.

Early Customers

Google’s announcement names four customers or partners:

  • Cox Automotive (Autotrader) is building a conversational avatar for vehicle discovery that highlights parts of the screen and calls tools for search, comparison, and financing.
  • Equal AI runs a personal assistant that, according to CEO Akhilesh Damaraju, “handles over a million live calls daily across nine Indian languages.” He said Gemini 3.8 Live “improved interruption handling, multilingual conversations, and tool-call reliability.”
  • Salesforce is pairing Gemini 3.8 Live with Agentforce for customer service.
  • Specs pointed to improvements in voice activity detection and overall latency.
Insurance claims intake demo in which a user shows vehicle damage on camera while a claims form fills in automatically
Voice-first claims intake with live video understanding. Google links an open-source ADK implementation. Image credit: Google Cloud

What This Means

The usual way to build a talking-head agent is to chain several systems: speech recognition, a language model, text-to-speech, and then a separate avatar-rendering service. Each step adds latency and another place for audio and video to fall out of sync. Google is folding the video layer into the same speech-native model that already handles turn-taking and interruptions. If that works as described, lip-sync and expression can follow the actual audio being generated rather than being fitted onto it afterwards. That matters most for mid-sentence language switching, which is where chained systems tend to break.

Several things are still unknown. Google has given no latency numbers, no pricing, and no evaluations. For a product whose selling point is “near real-time,” latency is the figure that decides whether a conversation feels natural. The custom-avatar pipeline also raises a likeness question: one photo plus one voice sample is enough to build a speaking video persona. Google’s controls here are the allowlist and SynthID. The allowlist limits who can build an avatar. SynthID only helps if someone actually runs a detector on the output, and an end user on a support call has no easy way to do that. Reception may also be mixed. Engadget’s coverage suggested that, given people’s “distaste for AI slop,” the avatars “may not be universally popular.”

For researchers and developers, the more immediately useful parts are probably underneath the avatar: asynchronous tool calls during speech, camera and screen input in the same session, and the open-source ADK sample agents Google published with the release.

This post was drafted with AI assistance and reviewed by RITS staff.

Sources

Related stories

agentic ai

Gemini Adds Agentic Video Understanding, Cutting Tokens by up to 88%

On September 1, 2026, Google added agentic video understanding to the Gemini API — a processing mode that lets the model decide which parts of a video to actually look at, instead of ingesting the whole thing at a fixed frame rate. On Google’s benchmarks the change cuts token consumption by up to 88% and […]

Audio

OpenAI Launches GPT-Live: Full-Duplex Voice for ChatGPT

OpenAI on July 8, 2026 launched GPT‑Live, a new generation of voice models now powering ChatGPT Voice. Built on a full-duplex architecture that listens and speaks at the same time, GPT‑Live‑1 and GPT‑Live‑1 mini are rolling out globally to ChatGPT users on iOS, Android, and the web starting today. The models replace the turn-based Advanced […]

AI

What is Live Avatar

Key Capabilities & Technical Details What You Can Do with It Because of its real‑time streaming + infinite length + high visual fidelity, Live Avatar enables use cases like: Key points Live Avatar is described as an AI-driven framework for real-time, streaming, infinite-length avatar video generation. It reportedly achieves 20 FPS when run on 5 […]

AI

Introducing MNN TaoAvatar: Photoreal 3D Talking Avatars Offline

Recently, Alibaba’s MNN team released MNN TaoAvatar, a remarkable Android application that lets you interact with photorealistic, full‑body 3D avatars—entirely offline, powered by local AI from ASR, LLM, TTS, and pose/expression control models (github.com). Key points Alibaba’s MNN team released MNN TaoAvatar, an Android application that lets users interact with photorealistic full-body 3D avatars entirely offline, […]

Never miss a RITS update

Subscribe to the RSS feed for AI, emerging technology, and digital scholarship news curated for the NYU Shanghai community, or get in touch to suggest a story.