Architecture: ESP32 Voice Hardware#

Overview#

Adding voice to the ESP32 robot face requires solving two opposite electrical problems:

• A microphone produces an analog signal too small and noisy for the ESP32 to measure directly.
• A speaker requires far more current, and a smoother waveform, than an ESP32 GPIO can provide.

The project crosses those boundaries with an INMP441 digital microphone and a MAX98357A digital amplifier. Both exchange PCM samples with the ESP32 over I2S, allowing DMA to move audio without consuming the face renderer's 33 ms frame budget.

The two directions are mirror images. Both cross from analog to digital inside a dedicated chip, and everything downstream of that crossing is numbers moving under DMA.

For the firmware boundary and task-level implementation, see ESP32 I2S Audio Runtime. For the timing constraint audio must protect, see ESP32 Parametric Face Animation.

---

Why a Bare Microphone Does Not Work#

Sound pressure is extremely small#

Atmospheric pressure in a room is approximately 101,325 Pa. Ordinary speech at about one metre adds a pressure variation of roughly 0.02 Pa. The microphone must reject the static atmospheric load and detect a variation about five million times smaller.

An illustrative electret microphone sensitivity of -44 dBV/Pa is equivalent to approximately 6.3 mV/Pa:

44 / 20       = 2.2
10^2.2        ≈ 158
1 V / 158     ≈ 0.0063 V
              = 6.3 mV/Pa

At normal speaking pressure:

0.02 Pa × 6.3 mV/Pa ≈ 0.13 mV    speaking about one metre away
                                  0.42 mV    speaking about 30 cm away

The ESP32 ADC is too coarse and noisy for that signal#

An ideal 12-bit conversion across 0 to 3.3 V has 4,096 steps:

3.3 V / 4,096 ≈ 0.8 mV per step

A voice signal around 0.42 mV does not span even one ideal step. Real ESP32 ADC noise is also several steps, so wiring a bare capsule to the ADC produces noise rather than usable quiet speech.

An analog design would therefore require a low-noise preamplifier with roughly 100x to 500x gain before conversion. The INMP441 instead integrates the sensing element, preamplification, and a higher-quality converter, then puts already-digital audio on the wire. This removes the vulnerable low-level analog trace from the ESP32 board and reduces coupling from nearby Wi-Fi activity.

---

Why a GPIO Cannot Drive the Speaker#

For 1 W into an 8-ohm speaker:

RMS voltage = sqrt(1 W × 8 ohm) ≈ 2.83 V
RMS current = 2.83 V / 8 ohm   ≈ 354 mA
Peak current = 354 mA × 1.41   ≈ 500 mA

A single ESP32 pin is expected to supply only about 20 mA in this design. The speaker can demand approximately 25 times more. Attempting to source speaker current from a GPIO can damage the chip.

The signal shape is a separate problem. A GPIO normally switches between off and 3.3 V, while speech and music require continuously varying sample amplitudes. Direct toggling produces a square wave, not intelligible playback.

The MAX98357A solves both constraints:

• Its DAC converts PCM sample values into an analog waveform.
• Its power stage supplies the speaker current.
• It can deliver about 1.8 W into 8 ohms from 5 V.
• Its class-D architecture is efficient enough to operate without a heatsink in this design.

---

Why Both Devices Use I2S#

I2S is a synchronous digital audio bus with three signal roles:

The ESP32 generates the clocks in both directions. The INMP441 drives its data output toward the ESP32; the ESP32 drives a separate data line toward the MAX98357A.

There is no volume wire and nothing analog anywhere on the bus — just numbers marched across one bit at a time, fast enough that the numbers are the sound.

Digital transport prevents analog noise from entering along these connections. More importantly, the ESP32's I2S peripherals have DMA engines. Audio moves between peripherals and memory without waking the CPU for each bit or sample, so capture and playback do not compete directly with 30 fps animation.

---

Capture Data Path#

The microphone runs at 16,000 samples per second. Each retained PCM sample is signed 16-bit data, or two bytes.

1 sample               = 16 retained bits = 2 bytes
16,000 samples/s × 2 B = 32,000 B/s        = 32 KB/s
1 sample interval      = 1 / 16,000        = 62.5 microseconds

The INMP441 produces 24-bit samples inside 32-bit I2S slots. I2S still clocks a left and a right slot per frame even though the microphone is mono. With the INMP441 L/R pin tied to ground, the microphone occupies the left slot and the right slot is empty.

The wire and stored-data rates differ:

clocked on wire = 16,000 × 64 bits = 1,024,000 bit/s = 128 KB/s
retained audio  = 16,000 × 16 bits =   256,000 bit/s =  32 KB/s

Half of the clocked frame is the unused channel, and half of the populated 32-bit slot is precision beyond the selected 16-bit network format. Hardware and DMA discard the unused material; the CPU does not process it sample by sample.

Sixteen-bit signed PCM spans -32768 through 32767, providing 65,536 possible values. The chosen format matches the downstream speech service and uses half the network bandwidth of 24-bit samples.

---

Playback Data Path#

The voice service returns mono speech at 24,000 samples per second. The MAX98357A accepts this rate directly, so the project does not resample it.

1 sample interval      = 1 / 24,000        ≈ 41.7 microseconds
24,000 samples/s × 2 B = 48,000 B/s        = 48 KB/s
I2S clock              = 24,000 × 32 bits  = 768,000 bit/s

The mono sample is presented in both I2S slots. The amplifier combines left and right as (L + R) / 2, recovering the original value.

Before a sample reaches I2S, firmware applies a software volume ceiling:

incoming sample        = 20,000
volume ceiling         = 35%
transmitted sample     = 20,000 × 0.35 = 7,000

The MAX98357A can deliver approximately 1.8 W into a speaker rated for 1 W. Scaling every sample protects the speaker by default rather than relying on the user to maintain a safe volume.

---

End-to-End Data Budget#

Only the endpoints handle sound as a physical pressure wave. Between the microphone and amplifier, the system transports integers through I2S, RAM, encryption, Wi-Fi, and the remote service.

---

Wiring#

The source design reserves GPIO 21 and 22 for the OLED, GPIO 4 for the touch pad, and GPIO 34 for battery sensing. The following audio pins were selected because they were free in that design.

INMP441 microphone#

MAX98357A amplifier#

Verify module labels against the actual board revision before applying power. Similar breakout boards can expose different enable, gain, or supply arrangements.

---

Power Architecture#

Peak current is larger than the average consumption suggests:

If a loud sample coincides with a Wi-Fi burst, an undersized supply can sag and reset the ESP32. The symptom resembles a firmware crash.

Use a regulated 5 V supply rated for at least 1 A; a 2 A phone charger provides additional margin. Place a 470-1000 microfarad electrolytic capacitor across amplifier VIN and GND, physically near the board, to cover short current spikes. Observe capacitor polarity.

---

Component Selection#

The reference build uses:

1. An INMP441 I2S microphone module with VDD, GND, L/R, WS, SCK, and SD pins.
2. A MAX98357A I2S amplifier module rated around 3.2 W into 4 ohms or 1.8 W into 8 ohms.
3. A regulated 5 V supply rated for at least 1 A.
4. A 470-1000 microfarad electrolytic capacitor.
5. Jumper wires and soldered headers appropriate to the modules.

Analog MAX9814 or MAX4466 microphone modules reintroduce the ESP32 ADC and its noise constraints. A PAM8403 analog amplifier requires an analog source, typically the ESP32's limited internal DAC or an external converter. Use those parts only as a fallback when the I2S modules are unavailable and their quality trade-offs are acceptable.

---

Units Reference#

---

Referenced Hardware and Documents#