benchmark

benchmark is a Plan & work review gates skill for AI agents, published by mifunedev in the openharness repository on GitHub. Skillspace rates benchmark F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

Progress-ceiling verdict gate (part of `/spec execute`'s improve tail) — decide whether ONE landed change was actually BENEFICIAL (moved or held the capability-benchmark ceiling without breaking the regression floor, and is worth its complexity), then emit a single BENEFICIAL/NOT-BENEFICIAL verdict. Composes (never forks) the existing instruments: /eval (the regression floor — probes stay green) + the capability-benchmark ceiling delta (.oh/evals/capability/RESULTS.md vs. the counterfactual). Machinery added with no benchmark movement is NOT-BENEFICIAL by definition. Distinct from /audit (per-unit promotability = floor) — this is the ceiling: did the harness get BETTER, not just not-broken. TRIGGER when: a change has landed and the loop needs a benefit-vs-counterfactual verdict before the cycle repeats; the improve tail of `/spec execute` runs; "was <change> beneficial", "score the capability benchmark", "benchmark this cycle".

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
24

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since.

View source on GitHubmifunedev/openharness

Our review

Architecture
84 / 100
Maturity
Basic: a single SKILL.md
Security scan
High-risk patterns
License
MIT
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • dynamic code execution (eval/exec)
  • mentions secrets in text

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Better-rated skills in Plan & work review gates

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.