benchmark-runner

benchmark-runner is a Skill evaluation & testing skill for AI agents, published by RConsortium in the pharma-skills repository on GitHub. Skillspace rates benchmark-runner F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

Auto-discover all skills with evals in RConsortium/pharma-skills, benchmark each with vs. without skill using matched isolated sessions, and post scored results to the linked GitHub issue. Use whenever someone says "run benchmarks", "compare skill performance", "eval the skills", or wants to measure whether a skill improves output quality.

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
85

Unproven: rated by static analysis only, not yet compared head-to-head.

This rating describes the version of the repository we crawled; it may have changed since.

Our review

Architecture
99 / 100
Maturity
Structured: ships references or scripts
Security scan
High-risk patterns
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • references sensitive credential env
  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.