Make Your WebsiteAI Discoverable
Learn how to create an llms.txt file so Claude, ChatGPT, and Gemini can accurately understand and recommend your project.
The Inspiration Behind This Guide
Andrej Karpathy's insights on how AI is changing discovery sparked the creation of this comprehensive guide. Watch his talk that inspired thousands of developers to rethink their approach to AI discoverability.
This talk fundamentally changed how we think about making projects discoverable in the AI era.
What is llms.txt?
A standardized file that provides AI assistants with comprehensive, accurate information about your project, enabling better recommendations and support.
Simple Text File
Just a plain text file at /llms.txtcontaining structured information about your project.
AI Discoverable
LLMs can read and understand your project details, providing accurate information to users who ask about it.
Better Conversations
Every AI conversation about your project becomes informed and accurate, improving user experience and credibility.
4 Simple Steps
Get your website AI-discoverable in under 30 minutes
Define what information to include about your project
- Project overview and value proposition
- Key features and capabilities
- Technical architecture details
- Pricing and contact information
Create llms.txt in your public directory
- Place in /public/llms.txt for Next.js
- Use plain text format with UTF-8 encoding
- Keep it 5,000-15,000 characters
- Use Markdown formatting for readability
Update robots.txt to allow LLM access
- Add 'Allow: /llms.txt$' to robots.txt
- Ensure proper HTTP headers
- Verify file is publicly accessible
- Check content-type is text/plain
Confirm LLMs can access your file
- Test with curl commands
- Ask Claude/ChatGPT to read your file
- Wait 24-48 hours for propagation
- Monitor for accurate AI responses
Why It Matters
The benefits of making your website AI-discoverable extend far beyond just technical implementation
Enhanced Discovery
AI assistants provide accurate information about your project to millions of users
Professional Credibility
Demonstrates technical sophistication and forward-thinking approach
Better Lead Quality
Users arrive more informed about your project and its capabilities
Reduced Support Load
AI handles basic questions, freeing up your team for complex issues
Marketing Advantage
Every AI conversation becomes an informed discussion about your work
Competitive Edge
Most projects don't have llms.txt - be ahead of the curve
Test Your Implementation
Verify that your llms.txt file is working correctly
curl -I https://yourdomain.com/llms.txtShould return HTTP 200 with content-type: text/plain
"Can you read the llms.txt from [yourdomain.com] and tell me about their project?"
Test with Claude, ChatGPT, and Gemini
Resources & Examples
Everything you need to get started with your llms.txt implementation
Real-world llms.txt templates for SaaS apps, open source projects, and e-commerce sites.
Platform-specific implementation guides for Next.js, Vercel, Netlify, WordPress, and more.
Comprehensive documentation with troubleshooting, best practices, and advanced tips.
Ready to Make Your Website AI-Discoverable?
Start with our templates and have your llms.txt file live in under 30 minutes. Join the growing community of AI-ready developers.