Communication

BBTalkie: A Hands-Free Mini Walkie-Talkie Based on ESP32

A portable ESP32-based walkie-talkie that uses an embedded neural network for voice activity detection and keyword spotting, enabling push-to-talk-free operation.

Communication voice activity detectionkeyword spottingembedded neural networkaudio I/Oportable radio ESP32

Official path: https://oshwhub.com/corebb/bbtalkie

01 Overview

BBTalkie is a compact ESP32-based walkie-talkie designed for hands-free use.

An embedded neural network performs voice activity detection (VAD) and keyword spotting (KWS); transmission is triggered automatically when speech or a wake word is detected.

It is suitable for outdoor activities, construction coordination, cycling communication, and other scenarios where hands-free operation is needed, and also serves as a reference design for learning embedded AI and voice interaction.

It is not a traditional walkie-talkie; it does not rely on dedicated RF chips but uses ESP32's Wi-Fi or Bluetooth for voice transmission, so range depends on the wireless environment.

The hardware is open source: PCB, firmware, CAD drawings, and development tools are all provided in the repository.

02 Hardware

  • MCU: ESP32 family (exact variant per schematic), responsible for audio capture, neural network inference, and wireless transmission.
  • Audio input: Onboard microphone (MEMS or electret, per schematic), connected to ESP32 via ADC or I2S.
  • Audio output: Onboard speaker driver (e.g., Class-D amplifier, per schematic), output via I2S or DAC.
  • RF: Uses ESP32 Wi-Fi or Bluetooth for wireless voice streaming (protocol and band per firmware).
  • Power: Li-ion battery with charging management (voltage and charger IC per schematic), possibly with boost or LDO regulation.
  • Interfaces: Programming/debug header (UART or USB) for flashing and debugging.
  • Other: May include buttons, LEDs, antenna, etc. (see schematic).

03 Software flow

Firmware is built on ESP-IDF or Arduino, handling audio capture, neural network inference, and wireless transmission.

The neural network model performs VAD and KWS; it is quantized for deployment on ESP32.

Software flow: Configure Wi-Fi or Bluetooth connection, initialize audio peripherals (I2S/ADC/DAC), load the neural network model.

Main loop: Continuously capture audio frames, feed into VAD model to detect speech; if speech is present, feed into KWS model to recognize keywords.

If speech or a keyword is detected, trigger transmission: encode audio data and send wirelessly to the peer device.

Receiving end decodes and plays audio, possibly with echo cancellation or noise reduction.

Low-power mode: Enter sleep when no speech, wake via interrupt or timer to check for voice.

Error handling: Reconnect on wireless disconnection, drop or downsample on audio buffer overflow.

04 Core points

Voice activity detection (VAD)

Keyword spotting (KWS)

Hands-free operation

ESP32 audio processing

Low-power design

Real-time wireless voice transmission

中文

通信

BBTalkie:基于 ESP32 的免按键迷你对讲机

一款基于 ESP32 的便携对讲机,内置嵌入式神经网络,自动检测人声并识别关键词,无需按键即可通话。

通信 voice activity detectionkeyword spottingembedded neural networkaudio I/Oportable radio ESP32

官方路径: https://oshwhub.com/corebb/bbtalkie

01 项目概述

BBTalkie 是一款基于 ESP32 的迷你对讲机,主打免按键操作。

通过嵌入式神经网络实现语音活动检测(VAD)和关键词识别(KWS),检测到人声或特定关键词时自动触发发射。

适用于户外活动、施工协作、骑行通讯等需要解放双手的场景,也可作为学习嵌入式 AI 和语音交互的参考设计。

它不是传统意义上的对讲机,不依赖专用射频芯片,而是利用 ESP32 的 Wi-Fi 或蓝牙进行语音传输,因此传输距离受限于无线环境。

硬件开源,包含 PCB、代码、CAD 图纸及开发工具和参考资料。

02 项目硬件描述

  • 主控: ESP32 系列(具体型号见原理图),负责音频采集、神经网络推理和无线传输。
  • 音频输入: 板载麦克风(MEMS 或驻极体,具体见原理图),通过 ADC 或 I2S 接口接入 ESP32。
  • 音频输出: 板载扬声器驱动(如 Class-D 功放,具体型号见原理图),通过 I2S 或 DAC 输出语音。
  • 射频: 使用 ESP32 的 Wi-Fi 或蓝牙进行无线语音传输(具体频段和协议见固件)。
  • 供电: 锂电池供电,带充电管理(具体电压和充电 IC 见原理图),可能包含升压或 LDO 稳压。
  • 接口: 预留编程/调试接口(如 UART 或 USB),用于固件烧录和调试。
  • 其他: 可能包含按键、LED 指示灯、天线等(具体见原理图)。

03 项目软件流程描述

固件基于 ESP-IDF 或 Arduino 框架开发,实现音频采集、神经网络推理和无线传输。

神经网络模型用于语音活动检测和关键词识别,模型量化后部署在 ESP32 上。

软件流程:配置 Wi-Fi 或蓝牙连接,初始化音频外设(I2S/ADC/DAC),加载神经网络模型。

主循环:持续采集音频帧,送入 VAD 模型判断是否有人声;若有人声,再送入 KWS 模型识别关键词。

若检测到人声或关键词,则触发发射:将音频数据编码并通过无线发送到对端设备。

接收端解码并播放音频,同时可进行回声消除或降噪处理。

低功耗模式:无语音时进入睡眠,通过中断或定时唤醒检测语音。

错误处理:无线连接断开时重连,音频缓冲区溢出时丢弃或降采样。

04 项目核心点

语音活动检测(VAD)

关键词识别(KWS)

免按键通话

ESP32 音频处理

低功耗设计

无线语音传输的实时性