قىستۇرما بەلگىسى:: robots.txt
-
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Forge AI Bot Log – Block AI Bots, Crawler Detection & Verification
Detect, verify and block AI crawlers, bots and scrapers. Vendor IP lists and reverse-DNS checks flag spoofed user agents, not trust them.
-
Check Search Engine Visibility on Migration
Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
-
CeeWP Robots.txt Manager
Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
-
SEO & AI Readiness Check
See what search engines and AI crawlers find on your site: titles, meta, H1, schema, sitemap, GPTBot access and llms.txt. No account needed.
-
Mephivio Robots LLMs
Generates llms.txt, llms-full.txt, JSON-LD and robots.txt discovery files for AI agents and search crawlers, without promising ranking gains.
-
AI Deny
Block 30+ AI crawlers in your robots.txt, including GPTBot, ClaudeBot and CCBot, and choose exactly which bots get in.
-
ProAI TXT Manager for LLMS and Robots
Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.
-
-
GoBookMart Robots Editor
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
ChatBot Blocker by CellarWeb
ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
SEO Auditor Tools
Scan your WordPress site for SEO issues and get actionable fixes. Includes AI Helper, sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analy …
-
Thin Content Manager
See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
HumanGate
Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.
