{"id":434794,"date":"2025-01-04T08:00:00","date_gmt":"2025-01-04T08:00:00","guid":{"rendered":"https:\/\/www.weixiaoduo.com\/plugins\/website-llms-txt\/"},"modified":"2025-10-24T18:12:00","modified_gmt":"2025-10-24T18:12:00","slug":"website-llms-txt","status":"publish","type":"post","link":"https:\/\/www.weixiaoduo.com\/plugins\/website-llms-txt\/","title":{"rendered":"Website LLMs.txt"},"content":{"rendered":"

Website LLMs.txt<\/strong> generates and manages an llms.txt<\/code> file, a structured, AI-ready index that helps large language models like ChatGPT, Claude, and Perplexity understand your site\u2019s most important content.<\/p>\n

How llms.txt works<\/h3>\n

Traditional sitemaps and robots files guide search engines. But as AI-driven systems such as ChatGPT, Claude, and Perplexity increasingly ingest web content, they benefit from a clear, structured list of a site\u2019s most important URLs.
\n llms.txt offers that: a plain-text or Markdown list of essential public URLs, optionally annotated with titles, descriptions, and grouping, designed for AI consumption rather than general web crawling.<\/p>\n

Key benefits<\/h3>\n

\u2705 AI discovery readiness<\/strong> \u2014 future-proof your site for AI indexing and content retrieval.
\n\u2705 Fully automatic<\/strong> \u2014 the plugin builds and updates your llms.txt<\/code> file on its own schedule.
\n\u2705 SEO plugin integration<\/strong> \u2014 works seamlessly with Yoast SEO, Rank Math, SEOPress, and AIOSEO, automatically excluding content marked as noindex<\/em> or nofollow<\/em>.
\n\u2705 Advanced controls<\/strong> \u2014 choose post types, customize file titles or descriptions, attach optional Markdown files, and trigger manual regeneration.
\n\u2705 Developer-friendly<\/strong> \u2014 includes filters such as llms_generator_get_post_meta_description<\/code> for description logic, performance tuning, and custom indexing behavior.
\n\u2705 AI crawler detection<\/strong> \u2014 opt in to track whether GPTBot, ClaudeBot, or PerplexityBot are actually reading your site\u2019s llms.txt<\/code>.
\n\u2705 WooCommerce & multisite ready<\/strong> \u2014 respects product visibility rules and scales easily across large or networked sites.
\n\u2705 Privacy-first experiment<\/strong> \u2014 anonymous, encrypted telemetry helps reveal which bots are accessing llms.txt<\/code> files across the web.<\/p>\n

Activation & setup<\/h3>\n
    \n
  1. Activate the plugin.<\/li>\n
  2. Visit Settings \u2192<\/span> LLMs.txt<\/em> to configure post types, update frequency (immediate, daily, or weekly), and optional crawler logging.<\/li>\n
  3. The plugin generates llms.txt<\/code> (and optionally llms-full.txt<\/code>) and serves it from your site root.<\/li>\n
  4. Content updates trigger automatic regeneration. All noindex\/nofollow rules from your SEO plugin are respected.<\/li>\n
  5. If you enable AI crawler logging, local and global logs record each visit from known AI bots \u2014 viewable right inside your WordPress dashboard.<\/li>\n<\/ol>\n

    Use cases for llms.txt<\/h3>\n