Writing
Long-form notes from building AI products: what broke, what I tried, and what finally worked. Follow along by RSS.
From 1.35 seconds to 0.49: what changed in my voice agent
Two weeks ago my clinic voice agent took 1.35 seconds to answer. In my test runs it now answers in 0.49. The AI didn't get much faster. It just stopped waiting.
· Voice AI, Latency, Local LLM, AI Agents
Where 1.35 seconds go in a local voice agent
I timed every step of Mama Desk, my clinic voice agent that runs fully on local models. The slowest part was never the LLM. First it was the voice, and now it's the silence.
· Voice AI, Latency, Local LLM, Whisper, Kokoro
