AYUSH AT BENCH ⚡
🔥 Soldering Iron: OFF
🔫 Glue Gun: OFF
🌡️ --°C
💧 --%
🫁 OK
AIO Live
← Back to Lab Stack
Laboratory Voice & Dual-Screen Hub

Dual-screen telemetry dispatch driving a high-contrast 2.8" SPI display at the soldering iron and live WebSocket browser mirrors.

Flagship Architecture

Xiaozhi Smart Electronics Workbench

The Story: When I'm hands-deep in solder fumes holding a 350°C iron and tweezers, I can't touch a keyboard or mouse to look up pinouts. I built this workbench companion so intelligence lives right at eye level, listening through MEMS microphones and rendering compact, high-contrast pinouts on dedicated hardware displays.

ANTIGRAVITY IDE Claude 3.5 & Groq LPU JSON-RPC 2.0 (MCP) MCP 2.0 FASTAPI HUB SERVER Ubuntu Host (192.168.0.111) SQLite • ElevenLabs • Groq Port 8000 • /ws/xiaozhi 7" CAPACITIVE KIOSK Feynman Voice & Chat Markdown 1024x600 • HDMI / WS JSON 2.8" SPI TFT (ILI9341) Live Solder Pinouts & Temp 320x240 High-Contrast Bitmaps
ParameterEngineering SpecificationDesign Notes
Host ComputeUbuntu Linux x86_64, 4GB RAMSystemd daemon with Nginx reverse proxy
Edge ProcessorESP32-S3 (Xtensa Dual-Core 240MHz)512KB SRAM + 8MB PSRAM + 16MB Flash
Audio Codec & MicINMP441 MEMS I2S + MAX98357A DAC24-bit 16kHz DMA stream; 60ms Opus frames
LLM TranscriptionGroq Whisper Large-v3 TurboLPU inference latency < 180ms
Synthesis (TTS)ElevenLabs Streaming PCM (Voice x4eeaCQG3dqOPKBvawgo)Automatic fallback to Edge-TTS on 401/429
Display BusSPI @ 40MHz (ILI9341) + ST7701S 16-bit RGBDual-framebuffer zero-tearing direct DMA
Agent Tool ProtocolMCP JSON-RPC 2.0 (9 Exposed Endpoints)Standardized bidirectional tool execution
Signal NameWire ColorSource PinTarget PinProtocol / Notes
3.3V Power RailRed3V3ILI9341 VCC / Mic VDDRegulated 3.3V, ≥ 500mA decoupled with 10µF cap
Ground RailBlackGNDCommon GroundSingle point star ground for clean I2S noise floor
SPI Clock (SCLK)OrangeGPIO 18ILI9341 CLKSPI High-speed 40MHz SPI master clock
SPI Data (MOSI)GreenGPIO 23ILI9341 MOSISPI 320x240 bitmap streaming output
SPI Chip SelectYellowGPIO 5ILI9341 CSSPI Active-low display enable
SPI Data/CommandCyanGPIO 21ILI9341 D/CSPI High = Data byte, Low = Command byte
I2S Bit Clock (BCLK)OrangeGPIO 44INMP441 SCK & Amp BCLKI2S 16kHz × 32 bits = 512kHz square wave
I2S Word Select (WS)GreenGPIO 43INMP441 WS & Amp LRCKI2S Left/Right frame synchronization (16kHz)
I2S Data In (DIN)BlueGPIO 2INMP441 SD OutI2S Low-noise MEMS microphone stream input
I2S Data Out (DOUT)VioletGPIO 19MAX98357A DINI2S Streaming PCM audio playback to 3W speaker
  • Native MCP JSON-RPC 2.0 Gateway: 9 operational agent tools exposed directly to Claude and Antigravity IDE (display_on_desk, query_inventory, log_note, read_telemetry).
  • Dual-Tier Display Routing: Parses AI responses into compact solder pinout bullets (ILI9341 LCD) and rich interactive Feynman commentary (7" Kiosk).
  • Sub-400ms Pipeline: Hardware-accelerated Groq LPU routing coupled with asynchronous non-blocking SQLite persistence.
Raspberry Pi 4B ESP32-S3/P4 MCP 2.0 ILI9341 SPI FastAPI Groq LPU
⚛️
Ayush Dubey • Physical AI Assistant
Bilingual (English / हिंदी) • Groq ~180ms
Namaste! I am Ayush Dubey's Physical AI Assistant. Ask me anything about Ayush's hardware builds, his mission to empower makers with Physical AI, or his engineering stack!

आप मुझसे हिंदी में भी बात कर सकते हैं!