{"id":394860,"date":"2024-03-13T08:00:00","date_gmt":"2024-03-13T08:00:00","guid":{"rendered":"https:\/\/www.weixiaoduo.com\/plugins\/block-ai-crawlers\/"},"modified":"2025-08-24T00:56:00","modified_gmt":"2025-08-24T00:56:00","slug":"block-ai-crawlers","status":"publish","type":"post","link":"https:\/\/www.weixiaoduo.com\/plugins\/block-ai-crawlers\/","title":{"rendered":"Block AI Crawlers"},"content":{"rendered":"<p>Protect Your Content from AI Scraping<\/p>\n<p>This plugin helps you prevent AI crawlers from using your content as training data for their products. By updating your site\u2019s <code>robots.txt<\/code>, it blocks common AI crawlers and scrapers, aiming to protect your content from being used in the training of Large Language Models (LLMs).<\/p>\n<h3>Features<\/h3>\n<h3>Blocks AI Crawlers<\/h3>\n<p>Includes:<\/p>\n<ul>\n<li><strong>OpenAI<\/strong> \u2013 Blocks crawlers used for ChatGPT<\/li>\n<li><strong>Google<\/strong> \u2013 Blocks crawlers used by Google\u2019s Gemini AI products<\/li>\n<li><strong>Facebook \/ Meta<\/strong> \u2013 Used for Facebook\u2019s AI training<\/li>\n<li><strong>Anthropic AI<\/strong> \u2013 Blocks crawlers used by Anthropic  <\/li>\n<li><strong>Perplexity<\/strong> \u2013 Block crawlers used by Perplexity<\/li>\n<li><strong>Applebot<\/strong> \u2013 Blocks crawlers used by Apple<\/li>\n<li>\u2026 and more!<\/li>\n<\/ul>\n<h3>Experimental Meta Tags<\/h3>\n<p>The plugin adds the \u201cnoai, noimageai\u201d directive to your site\u2019s meta tags, instructing AI bots not to use your content in their datasets. Please note that these tags are experimental and have not been standardized.<\/p>\n<h3>Custom robots.txt Rules<\/h3>\n<p>Have custom entries for your robots.txt file? You can now add them directly through the plugin!<\/p>\n<h3>Usage<\/h3>\n<p>After activation, the plugin will automatically update your <code>robots.txt<\/code> and add the necessary meta tags. No further configuration is required, but you can check the settings page for a full list of blocked crawlers.<\/p>\n<h3>Limitations<\/h3>\n<p>While this plugin aims to block specified crawlers, it cannot guarantee complete protection against all forms of scraping, as some bots may disregard <code>robots.txt<\/code> directives.<\/p>\n<h3>Support<\/h3>\n<p>For questions or support, <a href=\"https:\/\/wordpress.org\/support\/plugin\/block-ai-crawlers\/\" rel=\"ugc\">please post on the forums<\/a> or <a href=\"https:\/\/github.com\/bobmatyas\/wp-block-ai-crawlers\/issues\" rel=\"nofollow ugc\">on GitHub<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.<\/p>\n","protected":false},"author":65,"featured_media":398488,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"slim_seo":{"title":"Block AI Crawlers - \u8587\u6653\u6735\u63d2\u4ef6\u76ee\u5f55","description":"Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products."},"footnotes":""},"categories":[1],"tags":[1566,3854,29423,2429],"class_list":["post-394860","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","tag-ai","tag-chatgpt","tag-crawlers","tag-robots-txt"],"_links":{"self":[{"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/posts\/394860","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/users\/65"}],"replies":[{"embeddable":true,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/comments?post=394860"}],"version-history":[{"count":0,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/posts\/394860\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/media\/398488"}],"wp:attachment":[{"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/media?parent=394860"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/categories?post=394860"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.weixiaoduo.com\/plugins\/wp-json\/wp\/v2\/tags?post=394860"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}