GEO checklist for indie founders
"Generative engine optimization" advice tends to arrive as a long list with everything marked urgent. If you run a product on your own, you need the order instead: what to do first, what's documented by the companies that run AI search, and what's still a guess. This checklist is sorted by priority, and every item says which kind it is.
Documented means the provider says it in its own documentation. Research means a study found it, under its own conditions. Unproven means we found no source for it.
Priority 1: Access (documented)
Nothing else matters if the assistants can't fetch your pages.
- Allow the search crawlers in robots.txt. OpenAI says sites opted out of OAI-SearchBot won't be shown in ChatGPT search answers (OpenAI). Anthropic says blocking Claude-SearchBot or Claude-User may reduce your visibility in its search results (Anthropic). Perplexity recommends allowing PerplexityBot (Perplexity). For Google's AI Overviews and AI Mode, robots.txt rules for Googlebot are the control (Google).
- Decide on training crawlers separately. OpenAI says GPTBot (training) and OAI-SearchBot (search) are independent settings (OpenAI), and Anthropic lists ClaudeBot as its training crawler. Blocking training doesn't have to mean leaving search.
- Check your CDN and firewall, not just robots.txt. OpenAI says your host or CDN must allow traffic from its published search-bot IP addresses (OpenAI Help). On Cloudflare, look at the AI Crawler and Agent access policies, which default to allow for new domains but can be changed (Cloudflare). Perplexity notes that Bot Fight Mode can't be skipped with WAF custom rules (Perplexity).
- Make sure key pages can be indexed with a snippet. To be a supporting link in AI Overviews or AI Mode, a page must be indexed and eligible to show in Google Search with a snippet.
nosnippet,max-snippet, andnoindexlimit what Google shows (Google). - Publish a sitemap and reference it in robots.txt. Google calls a sitemap "merely a hint", but submitting it in Search Console lets you see when it was read and any errors (Google).
Priority 2: Content (documented for Google; research elsewhere)
- Put important content in text. Google lists making sure "important content is available in textual form" among the basics for its AI features (Google). If your homepage explains the product only in a video or after JavaScript runs, fix that first.
- Say what the product is and who it's for, early. The practical checks are in why AI answers cite your competitor instead of you.
- Write for people, with clear sourcing. Google's guidance asks whether content is original, whether headings are descriptive without exaggerating, and whether sourcing and background about the author are clear (Google).
- Back claims with sources, quotes, and real numbers. Don't keyword-stuff. Research: in a KDD 2024 lab study, adding citations, quotations, or statistics improved visibility in generated answers by about 30 to 40% on the authors' benchmark, while keyword stuffing gave "little to no improvement" (Aggarwal et al., 2024). That wasn't tested on today's ChatGPT. Only add numbers you can source.
Priority 3: Structured data and llms.txt (documented for Google; unproven for assistants)
- Add
Organizationmarkup to your homepage. Google says it can help it understand your organization and disambiguate it in search results. IncludesameAslinks to your profiles elsewhere, and validate with the Rich Results Test (Google). - Keep markup matching the visible page. Google says structured data should match the visible text, and that there's no special schema.org markup needed for its AI features (Google).
- Treat
llms.txtas optional. It's a proposal, used most heavily for software documentation (llmstxt.org). We found no provider crawler documentation saying it affects citations. Details are in llms.txt and structured data: what actually matters.
Priority 4: Off-site mentions (documented for Google; research for assistants)
This is the slowest part, and often the one that matters most.
- List the third-party pages that answers cite in your category. Use the cited sources from your prompt log.
- Get onto the ones where you belong, with facts. Google says one quality factor is whether "other prominent websites link or refer to the content" (Google). Research: a 2025 University of Toronto preprint found AI search showed "a systematic and overwhelming bias towards Earned media (third-party, authoritative sources)" over brand-owned content (Chen et al., 2025). It isn't peer-reviewed.
- Claim and update your listings. If you have a Google Business Profile or Merchant Center account, Google lists keeping that information up to date among its AI-feature basics (Google).
- Skip anything sold as a shortcut. No source we found supports buying mentions or mass-producing pages. Google says using automation to produce content mainly to manipulate rankings violates its spam policies (Google).
Priority 5: Measurement (documented tools, partial picture)
- Verify your site in Google Search Console. Google recommends it for spotting technical issues. AI Overviews and AI Mode traffic is included in the Performance report's "Web" data, not shown separately (Google).
- Verify in Bing Webmaster Tools and check its AI Performance report, which shows sampled citation counts for Copilot, Bing's AI summaries, and select partners (Bing).
- Keep a weekly prompt log and read your logs for AI bots. The routine is in how to track AI search visibility for a small SaaS.
Documented or not?
| Claim | Status |
|---|---|
| Blocking a provider's search crawler can keep you out of its answers | Documented (OpenAI, Anthropic, Perplexity) |
| Google's AI features need no special files or schema | Documented (Google) |
| Mentions on prominent sites signal quality | Documented for Google Search |
| Citations, quotes, and statistics raise visibility | One 2024 lab study |
| AI search favors third-party sources over brand sites | One 2025 preprint |
llms.txt increases citations |
Unproven |
| Any checklist guarantees you'll be cited | Unproven. Google and OpenAI both say placement isn't guaranteed |
The last row is sourced to Google and OpenAI Help.
Priorities 1 to 3 in one check: the CiteLens free audit reports, with evidence, whether a public page's robots.txt allows documented AI crawlers, and how its llms.txt, sitemap, structured data, title, H1, static text, FAQ coverage, and Open Graph look. It doesn't cover off-site mentions or tell you whether any assistant names you.
Disclosure: Born Bots builds CiteLens.
Start with the free audit.
Sources
- OpenAI, "Overview of OpenAI Crawlers": https://platform.openai.com/docs/bots (opened 17 Nov 2026)
- OpenAI Help Center, "Searching the web with ChatGPT": https://help.openai.com/en/articles/9237897-chatgpt-search (opened 17 Nov 2026)
- Anthropic (Claude Help Center), crawler documentation: https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler (opened 17 Nov 2026)
- Perplexity, "Perplexity Crawlers": https://docs.perplexity.ai/guides/bots (opened 17 Nov 2026)
- Cloudflare, "AI Crawler and Agent access policies": https://developers.cloudflare.com/bots/additional-configurations/block-ai-bots/ (opened 17 Nov 2026)
- Google Search Central, "AI features and your website" (last updated 10 Dec 2025): https://developers.google.com/search/docs/appearance/ai-features (opened 17 Nov 2026)
- Google Search Central, "Build and submit a sitemap": https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap (opened 17 Nov 2026)
- Google Search Central, "Creating helpful, reliable, people-first content": https://developers.google.com/search/docs/fundamentals/creating-helpful-content (opened 17 Nov 2026)
- Google Search Central, "Organization structured data": https://developers.google.com/search/docs/appearance/structured-data/organization (opened 17 Nov 2026)
- Google, "How Search works: Automatically generating and ranking results": https://www.google.com/search/howsearchworks/how-search-works/ranking-results/ (opened 17 Nov 2026)
- Bing Webmaster Tools Help, "AI Performance": https://www.bing.com/webmasters/help/ai-performance-9f8e7d6c (opened 17 Nov 2026)
- Jeremy Howard, "The /llms.txt file, v2": https://llmstxt.org/ (opened 17 Nov 2026)
- Aggarwal et al., "GEO: Generative Engine Optimization", KDD 2024: https://arxiv.org/abs/2311.09735 (opened 17 Nov 2026)
- Chen, Wang, Chen and Koudas, "Generative Engine Optimization: How to Dominate AI Search", arXiv preprint, 2025: https://arxiv.org/abs/2509.08919 (opened 17 Nov 2026)
Last reviewed: 17 Nov 2026.