{"id":11082,"date":"2026-05-26T02:30:03","date_gmt":"2026-05-25T18:30:03","guid":{"rendered":"https:\/\/aeosub.com\/crawlantix-ai-bot-tracker\/"},"modified":"2026-05-26T02:30:03","modified_gmt":"2026-05-25T18:30:03","slug":"crawlantix-ai-bot-tracker","status":"publish","type":"post","link":"https:\/\/aeosub.com\/zh\/crawlantix-ai-bot-tracker\/","title":{"rendered":"Crawlantix AI Bot Tracker"},"content":{"rendered":"<div class=\"plugin-info-card\" style=\"border: 1px solid #e2e8f0;border-radius: 10px;overflow: hidden;margin-bottom: 30px;font-family: -apple-system, system-ui, sans-serif;background: #fff\">\n<table style=\"width: 100%;border-collapse: collapse;font-size: 14px\">\n<tr style=\"border-bottom: 1px solid #edf2f7\">\n<th style=\"padding: 15px 20px;text-align: left;width: 35%;color: #4a5568;background: #fcfcfc\"><img decoding=\"async\" src=\"https:\/\/s.w.org\/plugins\/geopattern-icon\/crawlantix-ai-bot-tracker.svg\" style=\"width: 40px;height: 40px;border-radius: 6px;margin-right: 12px;vertical-align: middle\"> Developer<\/th>\n<td style=\"padding: 15px 20px;font-weight: 500\"><a href=\"https:\/\/profiles.wordpress.org\/crawlantix\/\" target=\"_blank\" rel=\"noopener\">crawlantix<\/a><\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #edf2f7\">\n<th style=\"padding: 12px 20px;text-align: left;color: #4a5568;background: #fcfcfc\">Version<\/th>\n<td style=\"padding: 12px 20px\">v2.0.5<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #edf2f7\">\n<th style=\"padding: 12px 20px;text-align: left;color: #4a5568;background: #fcfcfc\">Active Installs<\/th>\n<td style=\"padding: 12px 20px\">0 +<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #edf2f7\">\n<th style=\"padding: 12px 20px;text-align: left;color: #4a5568;background: #fcfcfc\">Requires \/ Tested<\/th>\n<td style=\"padding: 12px 20px\">5.8 \/ 7.0<\/td>\n<\/tr>\n<tr style=\"border-bottom: 1px solid #edf2f7\">\n<th style=\"padding: 12px 20px;text-align: left;color: #4a5568;background: #fcfcfc\">Last Updated<\/th>\n<td style=\"padding: 12px 20px\">2026-05-25 6:10pm GMT<\/td>\n<\/tr>\n<tr>\n<th style=\"padding: 12px 20px;text-align: left;color: #4a5568;background: #fcfcfc\">Official Link<\/th>\n<td style=\"padding: 12px 20px\"><a href=\"https:\/\/wordpress.org\/plugins\/crawlantix-ai-bot-tracker\/\" target=\"_blank\" style=\"text-decoration: none;color: #4a3bca;font-weight: bold\" rel=\"noopener\">View Details \u2192<\/a><\/td>\n<\/tr>\n<\/table><\/div>\n<div class=\"plugin-short-desc\" style=\"margin: 20px 0;padding: 12px 15px;background: #f9fafb;border-left: 4px solid #4a3bca;border-radius: 6px;font-style: italic;color: #4a5568\">Track 30+ AI crawlers visiting your site with real-time dashboards, logging-only honeypot, and bot verification.<\/div>\n<p>Crawlantix AI Bot Tracker monitors visits from 30+ AI crawlers and gives you visibility into how bots interact with your site. See which bots visit, what pages they crawl, and catch misbehaving bots with a built-in logging-only honeypot. Lightweight, privacy-first, and fully functional out of the box.<\/p>\n<p><strong>Free forever \u2014 no artificial limits on bot detection.<\/strong><\/p>\n<p><strong>Tracked Bots (30+):<\/strong><\/p>\n<ul>\n<li>GPTBot \/ ChatGPT-User \/ OAI-SearchBot (OpenAI)<\/li>\n<li>ClaudeBot \/ Claude-Web \/ anthropic-ai (Anthropic)<\/li>\n<li>Googlebot \/ Google-Extended (Google \/ Gemini)<\/li>\n<li>bingbot (Microsoft \/ Copilot)<\/li>\n<li>PerplexityBot (Perplexity)<\/li>\n<li>DeepSeek, Qwen (Alibaba), Mistral AI<\/li>\n<li>Applebot-Extended (Apple Intelligence)<\/li>\n<li>Meta-ExternalAgent (Meta AI)<\/li>\n<li>Bytespider (ByteDance)<\/li>\n<li>CCBot (Common Crawl), Amazonbot, YouBot, DuckDuckBot<\/li>\n<li>AI2Bot, Diffbot, Timpibot, PetalBot<\/li>\n<li>SemrushBot, AhrefsBot, DataForSeoBot, MJ12bot, DotBot<\/li>\n<\/ul>\n<p><strong>Features:<\/strong><\/p>\n<h4>Lightweight Bot Detection (30+ Bots)<\/h4>\n<p>Hooks into WordPress <code>init<\/code> with a priority-1 action. Bails immediately on non-AI User-Agents \u2014 zero performance cost for human visitors. All 30+ bots tracked.<\/p>\n<h4>Dashboard with Charts<\/h4>\n<p>Clean dashboard with trend chart and provider breakdown pie chart (Chart.js, bundled locally). Summary cards show total visits, unique bots, pages crawled, and daily averages. No external dependencies.<\/p>\n<h4>Bot Activity Table<\/h4>\n<p>Dedicated tab showing all detected bots with visits, bytes transferred, 24h sparklines, verification status, and honeypot hit counts.<\/p>\n<h4>Crawled Pages<\/h4>\n<p>See which pages bots visit most, which bots crawl them, and when they were last seen.<\/p>\n<h4>Honeypot Endpoint (Logging Only)<\/h4>\n<p>A CSS-hidden, aria-hidden, rel=nofollow link is injected in the footer. Only raw link-extracting bots will follow it. Visits are logged for transparency. Active defense (blocking, tarpit, rate-limit, decoy, shadowban) is reserved for the paid build.<\/p>\n<h4>Bot Verification<\/h4>\n<p>Reverse DNS (FCrDNS) verification for major bots \u2014 confirms Googlebot, GPTBot, ClaudeBot, etc. are actually who they claim to be.<\/p>\n<h4>Privacy First<\/h4>\n<p>IP addresses are SHA-256 hashed with a per-install salt before storage. Raw IPs are never saved. Includes WordPress Privacy API exporter and eraser hooks so data-subject access and erasure requests can flow through the standard WordPress Tools <span aria-hidden=\"true\" class=\"wp-exclude-emoji\">\u2192<\/span> Personal Data workflow.<\/p>\n<h4>AI Discovery Layer<\/h4>\n<p>Serves <code>ai-plugin.json<\/code> (a discovery manifest that tells visiting AI agents the site is monitored) and <code>llms.txt<\/code> \/ <code>llms-full.txt<\/code> (text content authored by the admin via WordPress pages with slugs <code>llms-txt<\/code> and <code>llms-full-txt<\/code>) at the site root.<\/p>\n<h4>Data Retention<\/h4>\n<p>Bot visit data is retained for 30 days. Older records are automatically pruned via WP-Cron.<\/p>\n<h3>External Services<\/h3>\n<p>This plugin connects to the following external services:<\/p>\n<h4>Reverse DNS Lookups<\/h4>\n<p>The bot verification feature performs reverse DNS (FCrDNS) lookups using PHP&#8217;s <code>gethostbyaddr()<\/code> and <code>gethostbyname()<\/code> functions to verify that bots are who they claim to be (e.g., confirming a request claiming to be Googlebot actually originates from Google&#8217;s network). These lookups send the bot&#8217;s IP address to your server&#8217;s configured DNS resolver and the authoritative DNS servers for the IP address&#8217;s reverse DNS zone. Under some privacy regimes, IP addresses may be considered personal data. This feature runs automatically when a known AI bot visits your site and cannot currently be disabled via the admin UI (a filter hook <code>crawlantix_enable_verification<\/code> is available for developers).<\/p>\n<p>No other external services, third-party APIs, or remote requests are used by this plugin. All analytics data is stored locally in your WordPress database. Chart.js is bundled locally \u2014 no CDN requests are made.<\/p>\n<h3>Privacy Policy<\/h3>\n<p>Crawlantix AI Bot Tracker is designed with privacy as a core principle:<\/p>\n<ul>\n<li><strong>Bot traffic only.<\/strong> The plugin only tracks automated bot traffic identified by User-Agent strings. Human visitors are not tracked and no cookies are set.<\/li>\n<li><strong>No raw IP addresses stored.<\/strong> All IP addresses are SHA-256 hashed with a per-install random salt before storage (or AUTH_SALT when defined in <code>wp-config.php<\/code>). The original IP address cannot be recovered from the hash. Note: pseudonymous IP hashes may still be considered personal data under GDPR.<\/li>\n<li><strong>Data stored per bot visit:<\/strong> IP hash, User-Agent string, requested URL, HTTP referrer URL, request method, timestamp, and derived fields (bytes transferred, bot verification status). Referrer URLs may contain personal data depending on the referring site.<\/li>\n<li><strong>WordPress Privacy API integration.<\/strong> The plugin registers exporter and eraser callbacks with WordPress core, so data-subject access and erasure requests filed through Tools <span aria-hidden=\"true\" class=\"wp-exclude-emoji\">\u2192<\/span> Personal Data flow correctly.<\/li>\n<li><strong>No external data transmission.<\/strong> All analytics data remains in your local WordPress database. No data is sent to Crawlantix or third-party services. The only external communication is DNS lookups for bot verification (see External Services above).<\/li>\n<li><strong>Data retention controls.<\/strong> Bot visit data is automatically pruned after 30 days. Administrators can delete all collected data on uninstall via the &#8220;Delete Data on Uninstall&#8221; Settings toggle.<\/li>\n<\/ul>\n<p>For sites that require a formal privacy policy disclosure, you may note: &#8220;We use the Crawlantix AI Bot Tracker plugin to monitor automated AI bot traffic to our site. This plugin records bot User-Agent strings, pseudonymous IP hashes, pages visited, referrer URLs, and timestamps for detected bot traffic only. Raw IP addresses are cryptographically hashed before storage. No human visitor data is collected.&#8221;<\/p>\n<h3>Premium Version<\/h3>\n<p>Crawlantix also offers paid tiers at <a href=\"https:\/\/crawlantix.com\" rel=\"nofollow ugc noopener\" target=\"_blank\">crawlantix.com<\/a> for site owners who need active bot defense in addition to monitoring. The paid build adds the following features on top of everything in this free version:<\/p>\n<h4>Protect tier<\/h4>\n<ul>\n<li>Active honeypot responses: HTTP 403 block, tarpit (random 5\u201325s delay with worker-exhaustion safeguards), rate limit 429, decoy content, shadowban.<\/li>\n<li>Auto-block of repeat honeypot offenders, with configurable thresholds.<\/li>\n<li>Per-IP response rules \u2014 apply a chosen response strategy to specific IP hashes (up to 200 rules).<\/li>\n<li>Custom honeypot paths (up to 5) with a reserved-route safety list.<\/li>\n<li>Email alerts for honeypot hits and parameter explosion patterns.<\/li>\n<li>Robots.txt trap entries that catch non-compliant scrapers.<\/li>\n<li>Optional override that suppresses the WordPress core <code>\/wp\/v2\/users<\/code> REST endpoints (username-enumeration hardening, off by default and easy to opt back in).<\/li>\n<\/ul>\n<h4>Optimize tier<\/h4>\n<ul>\n<li>Full REST API at <code>\/wp-json\/ai-tracker\/v1\/<\/code> with API key authentication and 13 endpoints (status, stats, page, trends, bots, top-pages, report, export, alerts, honeypot, crawled-pages, etc.).<\/li>\n<li>GeoIP location tracking with MaxMind GeoLite2.<\/li>\n<li>Crawl Analytics tab with deeper traffic-quality metrics.<\/li>\n<li>Extended data retention up to 365 days.<\/li>\n<\/ul>\n<h4>Scale tier<\/h4>\n<ul>\n<li>Backup &amp; restore \u2014 export all data as JSON; import with merge or replace modes.<\/li>\n<li>Unlimited retention.<\/li>\n<li>Priority support.<\/li>\n<\/ul>\n<p>The paid build is a drop-in upgrade: same plugin slug, same database tables, same option keys, so all your historical bot data carries over with no migration step on your part.<\/p>","protected":false},"excerpt":{"rendered":"<p>Track 30+ AI crawlers visiting your site with real-time dashboards, logging-only honeypot, and bot verification.<\/p>","protected":false},"author":1,"featured_media":9317,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[252],"tags":[550,760,1605,664,554,555],"class_list":["post-11082","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-trends","tag-ai","tag-analytics","tag-bot","tag-security","tag-seo","tag-wordpress-plugin"],"_links":{"self":[{"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/posts\/11082","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/comments?post=11082"}],"version-history":[{"count":0,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/posts\/11082\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/media\/9317"}],"wp:attachment":[{"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/media?parent=11082"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/categories?post=11082"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aeosub.com\/zh\/wp-json\/wp\/v2\/tags?post=11082"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}