crawlers

crawlers is a Technical SEO & schema skill for AI agents, published by rainday in the smart-blog-skills repository on GitHub. Skillspace rates crawlers D (66/100) and it passed the safety scan; the rating is based on static analysis only.

AI crawler access analysis for blogs and websites. Checks robots.txt, meta tags, and HTTP headers to determine which AI crawlers can access the site. Provides a complete access map and recommendations for maximizing AI visibility. Use when user says "AI crawlers", "robots.txt", "AI access", "block AI crawlers", "allow AI bots", "GPTBot", "ClaudeBot", "PerplexityBot", "AI crawler audit", or "can AI read my blog".

Grade
D
Quality
66 / 100
Safety
Passed
GitHub stars
35

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
84 / 100
Maturity
Basic: a single SKILL.md
Security scan
No issues found
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.