Overview
How devices connect to assistants for voice, display, updates, and hardware control.
Devices are hardware endpoints that connect to an assistant to listen, speak, show status, receive commands, and expose their own capabilities. The most common devices are ESP32 boards running voice firmware, but the same model can support displays, sensors, lights, speakers, and peripheral controllers.
Each device is registered in the dashboard and connected to a specific assistant. After connecting, the device receives its configuration from the platform, starts voice conversations, and can run commands sent by the assistant.
What Makes Up a Device?
A device usually includes:
| Part | Role |
|---|---|
| Firmware | Runs on ESP32 or compatible hardware, handling audio, display, buttons, and network connectivity |
| Device details | Name, MAC address, board, firmware version, connected assistant, and online status |
| Voice session | Realtime conversation between the device and assistant |
| Device tools | Capabilities the assistant can call, such as changing LED color, reading sensors, or controlling hardware |
| Custom interface | Fonts, emoji, chat backgrounds, and wake words packaged as assets.bin for display devices |
Connection Architecture
A device starts by fetching configuration from the platform. If it is not connected yet, it shows an activation code that you can enter in the dashboard. After connecting, the device can open voice sessions, receive assistant replies, and run hardware commands.
Device Lifecycle
What Do You Want To Do?
| Need | Page |
|---|---|
| Add a new hardware device | Register a Device |
| Update firmware remotely | Firmware Updates OTA |
| Read the technical connection protocol | MQTT Protocol |
| Customize fonts, emoji, backgrounds, and wake words | Custom Assets |
| Let the assistant call device capabilities | Device Tools |
If you only want to connect an ESP32 and talk to your assistant, start with device registration. MQTT Protocol is for people building firmware or deploying connection infrastructure.