Build Journal

Gigi Voice Fixes & Build-Time Reliability Enhancements — August 28, 2026

I improved Gigi Voice's reliability and fixed audio capture issues while enhancing build-time safety to prevent daily deploy breakage.

2 changes3 min readby Rob

What shipped

  • Audio Capture FixResolved the issue with self-hosting the rawAudioProcessor AudioWorklet.
  • Build-Time ReliabilityImplemented safety measures to prevent daily deploy breakage.

Today, I set out to tackle two major issues that have been plaguing my work on the Gigi Voice agent: audio capture failures and the reliability of build-time external calls. In a focused hour, I shipped a critical fix for the audio processing component and implemented safety measures to prevent daily breaks during deployment. These improvements not only enhance user experience but also reinforce the foundation of my one-man-show venture toward a billion-dollar valuation.

The first task was addressing the audio capture issues that arose with the rawAudioProcessor AudioWorklet. This was the last major piece that was breaking the voice agent functionality. After implementing a fix for the Content Security Policy (CSP) token, I discovered that the session would start over WebSocket, but audio capture would fail. The SDK was attempting to load the rawAudioProcessor from an inline blob, which was being blocked by the strict script-src policy. Consequently, the agent would disconnect when it couldn't load the worklet module. I realized that while I had already self-hosted the audioConcatProcessor and libsamplerate for similar reasons, I had missed self-hosting the input worklet. This oversight needed rectifying, so I co-authored this fix with Claude Code, ensuring that the worklet module would now load correctly from my server.

This audio capture fix consumed a significant portion of my hour, but it was crucial. Gigi Voice is an integral part of the agentic web experience I am building, and ensuring seamless audio functionality is paramount for user engagement. I felt a sense of satisfaction as I tested the fix and saw the voice agent working without interruption. It’s these small victories that keep me motivated as I navigate the complexities of building this platform solo.

The second major improvement was aimed at enhancing the reliability of build-time external calls. I realized the site had been breaking almost daily due to the static build process making live third-party calls while prerendering nearly 9,000 local leaf pages and sitemaps. If any of the upstream services—like Overpass, Census, Wikipedia, open-meteo, or Google—were slow or down, it would cause the entire build to fail. This was unacceptable, especially as I work toward making the platform robust enough for mass adoption.

To address this, I implemented a strategy to make all build-time external calls build-safe. This involved creating fallback mechanisms and caching strategies to ensure that if a third-party service were to fail, it wouldn't bring down the entire deployment process. The changes were straightforward but required careful consideration to ensure that they didn’t introduce new bugs or vulnerabilities. I spent a focused hour working through this, and while the complexity was daunting, I felt a renewed sense of purpose knowing that these enhancements would lead to a more stable platform.

Reflecting on today’s work, I am reminded of the unique challenges that come with building this project solo. With Claude Code as my AI collaborator, I can push through obstacles more efficiently, but there are still moments of frustration. Debugging issues like the audio capture failure often takes longer than I anticipate. However, the learning process is invaluable. Each fix teaches me more about the underlying architecture of the agentic web and how to build a more resilient platform.

As I look ahead, I am excited about the potential of Gigi Voice and how it fits into the larger vision of the agentic web. Ensuring that features like voice interaction work flawlessly will be critical for user adoption and retention. I see this as a stepping stone toward a more dynamic and engaging experience for users, one that will ultimately contribute to achieving my goal of a billion-dollar valuation for this one-man-show.

In conclusion, today was a productive day filled with meaningful improvements. The audio capture fix and the enhancements to build-time reliability are both crucial steps forward. As I continue to build this platform with AI as my team, I’m reminded that each challenge faced is an opportunity for growth. I’m committed to this journey, and I look forward to sharing more updates as I progress toward my ambitious goals.

← Back to the full build journal