Build Journal
GIGI AI Voice Integration & Portal Enhancements — May 8, 2026
I enhanced the GIGI AI voice capabilities and portal features, tackling bugs and shipping improvements for the agentic web experience.
What shipped
- Portal Call Card Update — Replaced agentic badges with one-line AI capability copy for clarity.
- Enhanced GIGI Voice Functionality — Implemented rich GIGI grounding for better user interactions.
- GIGI Voice Billing System — Developed a credit meter for tracking voice usage and billing.
- Improved Portal Commerce UX — Added hero badges and optimized catalog form during sync.
- AI Availability Fixes — Refined AI mode transitions and fixed bugs for smoother operation.
Today, I set out to improve the GIGI AI voice integration and enhance the overall portal experience. After a long 22-hour grind, I successfully shipped 16 features and improvements, alongside fixing 2 critical bugs. This work matters because it elevates the user experience, enabling seamless interactions and more robust AI capabilities in our agentic web ecosystem.
The first major update was reworking the portal call card. I replaced the existing agentic badges with a more concise one-line AI capability copy. This change not only simplifies the UI but also makes it clearer for users to understand what actions they can take. It took some time to ensure that the new layout aligned with the overall design language of the portal, but the result is a cleaner, more focused interface.
Next, I focused on enhancing the portal voice functionality. I implemented a rich GIGI grounding mechanism that pulls relevant data from various sources, including map pins, categories, links, and social metadata. This involved composing grounding from multiple input points and ensuring that the system could effectively index and retrieve this information. The challenge here was ensuring that the crawl chunks were optimized for both speed and accuracy, as I wanted to make sure that users had quick access to relevant info.
One of the more intricate features I developed was a billing system for GIGI voice duties. I created a meter for tracking GIGI credits based on usage and connected time, including an optional voice override feature powered by ElevenLabs. This was a complex integration that required careful management of user sessions and billing logic to ensure that credits were accurately logged. I stumbled a bit on the disconnect settle ordering, which led to some abrupt drops in service. After some debugging, I managed to fix this issue and finalize the billing flow, which now provides a smoother experience for users.
I also developed a new user interface for the wallet ledger that tracks voice duty usage. This feature allows logged-in visitors to see their credit consumption in real-time, while anonymous users are debited from the owner’s account. It was crucial to build this with a user-friendly design, as I want users to feel in control of their interactions with GIGI.
Another significant enhancement was in the portal commerce UX. I added hero badges and improved the catalog form during synchronization with Stripe. This involved ensuring that product listings remained visible even during data fetches, which required some creative error handling to manage load versus mutation errors effectively. Getting this right took longer than expected, but I believe it will significantly enhance the user experience when adding products.
Of course, no day of development is without its challenges. I faced a particularly frustrating bug with the GIGI map orb during AI voice duties, which required a complete rework of the mic UI during the handshake process. The fix involved merging the GIGI orb with the caller orb when there was an ongoing embed, which I had to track carefully to ensure that mic permissions worked correctly before the AI reported being connected. This debugging took a significant chunk of my time, but it was essential to maintain a high-quality user experience.
Additionally, I addressed several bugs related to AI availability and manual modes in the portal. The fixes included ensuring that the AI mode only activated when the operator was online, and I had to refine how the portal handled video and AI interactions. The result is a more seamless transition between manual and AI modes, which should make the platform feel more intuitive for users.
Reflecting on this long day, I’m proud of the progress I made. Building this solo with Claude Code in VS Code, rather than opting for paid tools like Lovable or Cursor, allows me to keep my overhead low while still delivering a robust product. Each feature I ship brings me one step closer to my vision of a one-man-show company with a billion-dollar valuation. I’m excited to see how these enhancements will improve the agentic web experience for users and provide more value through the GIGI AI concierge.
As I continue to build in public, I hope to inspire other solo builders to embrace the grind and tackle their projects head-on, even when the challenges seem overwhelming. Today was a testament to that ethos, and I’m eager to see where this journey takes me next.