Build Journal
Agentic SEO Enhancements & 404 Fixes for Better User Experience — August 24, 2026
Today, I improved agentic SEO with new features and fixed the 404 errors to enhance user experience. Here’s what shipped during a focused 5-hour session.
What shipped
- Expanded Portal Directory — Added /llms-full.txt for comprehensive public portal access.
- Real 404 Page — Implemented a genuine 404 page to improve user experience.
- CSP Security Enhancements — Updated CSP to allow critical third-party services.
- Sitemap Improvements — Stopped artificial lastModified dates on static routes.
- Authentication Fix — Resolved incorrect status code for anonymous users.
I set out today to enhance the agentic SEO capabilities of my platform while tackling some persistent 404 issues that were affecting user experience. In a focused five-hour session, I shipped ten features and improvements along with a crucial fix. The highlights include a new comprehensive public portal directory, enhanced security policies, and a real 404 page that now accurately reflects the status of dead links.
The first major feature that I implemented was the addition of the /llms-full.txt endpoint. This is an expanded version of the existing llmstxt.org directory, providing a complete public portal directory with detailed links and a cost/metro/industry URL matrix. The agents probing this directory have increasingly favored /llms-full.txt, so it was imperative to link it from /llms.txt to make the information easily accessible. This enhancement is a significant step toward optimizing agentic SEO by ensuring that the most relevant and complete data is available for both users and AI agents.
Next, I tackled some security issues related to my Content Security Policy (CSP). I updated the allowlist to include static.cloudflareinsights.com and Jitsi hosts, which were previously being blocked. This was crucial as both services play a role in enhancing the user experience, particularly with real-user monitoring and video conferencing. I also enforced a nonce-less baseline policy across all script, connect, and frame allowlists, which significantly improves performance by avoiding stale cached HTML against a policy that has no nonce.
On the SEO front, I made a key change to the sitemap generation process. Previously, I was stamping the last modified date on static routes, which caused Google to distrust the field. By stopping this practice, I ensure that evergreen routes are now accurately represented without artificial lastModified dates. This adjustment will help improve indexing and trust with search engines, which is vital for long-term visibility.
One of the most significant fixes I implemented today was for the 404 errors that had been plaguing my site. The previous catch-all redirection turned every dead or mistyped URL into a soft 404, which cluttered Google Search Console with misleading Page-with-redirect noise. Now, with a real 404 page serving an accurate 404 status, I can provide users with a better experience and ensure that crawlers receive honest feedback on dead links. This not only enhances user experience but also cleans up my SEO metrics.
I also made a few adjustments related to authentication and performance. I fixed an issue where the /api/auth/me endpoint was returning a 200 status with a user:null response instead of the intended 401 for anonymous users. This change eliminates the red console errors that signed-out visitors were encountering on every page load. Additionally, I stopped minting the geo_portal_session cookie in middleware to improve caching, further enhancing performance.
Throughout this session, I was reminded of the challenges and triumphs of building solo with AI assistance. Using Claude Code in VS Code has been invaluable, allowing me to iterate quickly without the overhead of managing a larger team or incurring costs for additional resources. The AI acts as a collaborative partner, helping to streamline the development process while I focus on the overarching vision of creating a one-man-show company with a billion-dollar valuation.
In conclusion, today’s focused effort has led to meaningful improvements in both the agentic SEO capabilities and user experience on my platform. As I continue to build out these features, I remain dedicated to ensuring that every aspect of the site reflects the quality and attention to detail that I aspire to achieve. The journey is far from over, but with each commit, I am one step closer to realizing my ambitious goals.