Assistant Core
Voice

Voice

How people talk to your assistant by voice, the two voice modes, and who configures what.

Voice lets people speak to your assistant and hear it answer, instead of typing. Voice conversations are saved in the same history as text chats.

Where voice works

WhereHow people use it
Web AppThe Voice chat button in the message box. See Voice chat
DevicesESP32 devices talk to the assistant by voice. See Devices
Your own appThe Developer API voice WebSocket. See Voice API

Two voice modes

ModeHow it worksChoose it for
StandardSpeech is transcribed, the chat model answers, and the answer is read aloudAccurate answers, files, the greeting, lower cost
RealtimeOne voice model listens and speaks directlyThe most natural, lowest-latency conversation

See Standard vs Realtime for the full comparison.

Who configures what

WhoWhatWhere
Assistant ownerTurn voice on, default speech models and voices, recordings, response text, greetingEnable voice
Each signed-in userTheir own models, voices, speech speed, and spoken languageModel and voice settings

Voice uses credits for speech recognition, speech output, and Realtime minutes. See Credits.

Last updated on

On this page