waseemnasir2k26

Aeo Crawl Radar — AI skill for Claude Code

AI community

Parse your server logs to see which AI crawlers actually visited - GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 20 more.

How to install Aeo Crawl Radar

This entry records only its repository, not the path inside it, so there is no exact command to give. Open waseemnasir2k26/aeo-crawl-radar and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

What Aeo Crawl Radar does

Parse your server logs to see which AI crawlers actually visited - GPTBot, ClaudeBot, PerplexityBot, Google-Extended and 20 more. Sitemap-gap report shows which pages no AI engine has ever fetched. nginx/Apache/Cloudflare/Vercel, SQLite, optional reverse-DNS verification.

Alternatives in AI

LongHorizon Harness — The long-horizon computer-use harness 1.3k ★
Ralphex — Extended Ralph loop for autonomous AI-driven plan execution 1.1k ★
Gtm Engineer Skills — Claude Code skill for improving website AEO (AI Engine Optimization) and GEO (Generative Engine Optimization) 761 ★

README

aeo-crawl-radar

Parse your own web server logs and see exactly which AI crawlers visited your site, what they fetched, and which pages they have never touched.

AI CRAWL RADAR
==============
window   : 2026-08-04 01:00 -> 2026-08-31 21:19
ai hits  : 388   classic search-bot hits: 103   ai share of bot traffic: 79.0%
served   : 7.0 MB to AI crawlers

AI CRAWLERS
===========
BOT                 VENDOR        PURPOSE       HITS  PATHS     BYTES  FIRST SEEN        LAST SEEN         DNS
------------------  ------------  ------------  ----  -----  --------  ----------------  ----------------  ----------
GPTBot              OpenAI        training        86     14    1.7 MB  2026-08-04 01:00  2026-08-31 04:03  unverified
ClaudeBot           Anthropic     training        61     14    1.1 MB  2026-08-04 06:30  2026-08-31 21:19  unverified
OAI-SearchBot       OpenAI        search-index    54     13  934.8 KB  2026-08-04 01:01  2026-08-30 21:19  unverified
PerplexityBot       Perplexity    search-index    44     13  840.0 KB  2026-08-04 05:37  2026-08-31 02:23  unverified
Bytespider          ByteDance     training        31     14  631.4 KB  2026-08-04 12:34  2026-08-31 11:56  unverified
ChatGPT-User        OpenAI        live-fetch      28     11  495.5 KB  2026-08-06 17:10  2026-08-30 12:46  unverified
Google-Extended     Google        training        22      9  413.4 KB  2026-08-04 16:50  2026-08-31 10:37  unverified
meta-externalagent  Meta          training        19     10  340.2 KB  2026-08-11 01:17  2026-08-31 20:39  unverified
Claude-User         Anthropic     live-fetch      17     10  268.6 KB  2026-08-05 15:37  2026-08-31 11:44  unverified
Amazonbot           Amazon        search-index    14     10  198.1 KB  2026-08-07 18:29  2026-08-30 15:05  unverified
CCBot               Common Crawl  training        12     10  183.7 KB  2026-08-18 06:09  2026-08-30 04:22  unverified

TOP PATHS (ALL AI BOTS)
=======================
PATH                       HITS  BOTS