Home  /  Guides  /  AI & LLM Indexing
Indexing & Sitemaps · Guide #14

AI & LLM Indexing

Make your content discoverable by AI systems like ChatGPT, Claude, Gemini, and Perplexity — generate llms.txt files, structure content for AI crawlers, and preview how LLMs reference your pages.

⏱ 5 min read 👤 Intermediate 📦 v6.5+

Where to Find This Tab

Go to SEO Rank Genius → Indexing & Sitemaps → AI & LLM Indexing (first tab under the “AI & LLM” group). Marked with a NEW badge.

LLM Visibility

Traditional SEO optimizes for Google’s crawler. LLM visibility optimizes for AI systems that read and reference your content when answering user questions. This is a rapidly growing traffic source.

Generate llms.txt
Machine-readable file for AI systems to understand your site
Generate llms-full.txt
Extended version with full content summaries
Include Pillar Hierarchy
Structure content by pillar pages and clusters

llms.txt & llms-full.txt

The llms.txt standard (proposed by the AI community) works like robots.txt but for AI systems. It tells LLMs what your site is about and which pages to reference.

FileURLContents
llms.txtyoursite.com/llms.txtConcise site description, key pages, and topic structure in markdown format
llms-full.txtyoursite.com/llms-full.txtExtended version with full content summaries, semantic markers, and category hierarchy

Pillar Hierarchy

When enabled, the files organize your content by pillar pages and their cluster posts. This helps AI systems understand your topical authority and relationships between pages.

💡
View live: Click the llms.txt or llms-full.txt buttons in the tab header to open them in a new browser tab and verify the output.

AI Crawler Compatibility

The plugin structures your content for optimal comprehension by all major AI systems:

✓
GPT / Claude / Gemini
Content structured for AI comprehension
✓
Markdown-First
Clean markdown for easy parsing
✓
Semantic Markers
Helps AI understand content purpose

LLM Inference Preview

The LLM Inference Preview is a simulator that shows which of your pages an AI system would use to answer a given question.

Simulate
Results show which pages would be referenced, with relevance scores

How to Use It

  1. Type a question your audience might ask an AI assistant.
  2. Click Simulate.
  3. The plugin analyzes your content and shows which pages would be referenced, ranked by relevance.
  4. Use the results to identify content gaps — if no pages match, you need to create content for that topic.

Troubleshooting

llms.txt Returns 404

  • Ensure the toggle is enabled and you’ve clicked Save.
  • Go to Settings → Permalinks and click “Save Changes” to flush rewrite rules.
  • Check if a caching plugin is serving a stale 404.

Inference Preview Shows No Results

  • You need published content for the simulator to work. Drafts are not included.
  • Try broader questions — very specific queries may not match if your content doesn’t cover that exact topic.
  • Ensure your AI provider is configured (the simulator uses AI credits).