skill-evaluator

skill-evaluator is a Skill evaluation & testing skill for AI agents, published by HeshamFS in the materials-simulation-skills repository on GitHub. Skillspace rates skill-evaluator F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

Rigorously evaluate an Agent Skill end-to-end across ANY coding-agent CLI — verify its scripts emit the documented numbers (deterministic checks), test whether its description triggers on the right prompts, and measure whether an agent following the SKILL.md beats a no-skill baseline (with/without pass-rate delta, mean ± stddev, benchmarked). Use whenever you need to test, benchmark, validate, grade, or quantify a skill's quality, check if a skill "actually works," compare two skill versions, optimize a skill's triggering, or set up an eval suite — even if the user just says "is this skill any good," "does my skill work," or "benchmark this skill." Drives Claude Code, OpenAI Codex, Antigravity (agy), Cursor, GitHub Copilot, Amp, opencode, or Grok in headless mode.

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
59

Unproven: rated by static analysis only, not yet compared head-to-head.

This rating describes the version of the repository we crawled; it may have changed since.

Our review

Architecture
84 / 100
Maturity
Packaged: licensed, with a version or references
Security scan
High-risk patterns
License
Apache-2.0
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • dynamic code execution (eval/exec)
  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.