eval-run

eval-run is a Skill evaluation & testing skill for AI agents, published by opendatahub-io in the agent-eval-harness repository on GitHub. Skillspace rates eval-run B (81/100) and it passed the safety scan; the rating is based on static analysis only.

Execute an evaluation against test cases (skill or prompt mode), score with judges, and report results. Requires eval.yaml (generated by /eval-analyze). Use when the user wants to test a skill, run eval, benchmark, compare models, detect regressions, check skill quality, or verify changes didn't break anything. Triggers on "run eval", "test the skill", "evaluate", "benchmark", "check for regressions", "how does my skill perform", "score the skill", "run the tests", "run my evals", "compare against baseline", "did I break anything", "test my changes". Also called by /eval-optimize for automated iterations.

Grade
B
Quality
81 / 100
Safety
Passed
GitHub stars
34

Unproven: rated by static analysis only, not yet compared head-to-head.

Not launch-quality. It is graded B with a clean safety verdict, but our quality filters exclude it: it looks like a template or a stub that was never filled in. So it is not in our launch-quality set, the skills our MCP server searches and recommends. How launch-quality is decided

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
100 / 100
Maturity
Structured: ships references or scripts
Security scan
No issues found
License
Apache-2.0
Adoption
Adopted by 0 other repositories, in 0 collections

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.