benchmark-run-sizing
benchmark-run-sizing is a Runtime diagnostics & profiling skill for AI agents, published by NomicFoundation in the hardhat repository on GitHub. Skillspace rates benchmark-run-sizing D (62/100) and it passed the safety scan; the rating is based on static analysis only.
Analyzes the Hardhat regression benchmark history (the hardhat-benchmark-results repo's data.js) and recommends how many times each benchmark should run. It reads every commit's individual run times, computes each benchmark's per-commit coefficient of variation, removes outliers, takes the 95th-percentile CV, and sizes run counts for target noise levels (sigma = 3%, 1.5%, 1%, i.e. regression alert limits of 10% / 5% / 3%). Use when asked to right-size benchmark run counts, justify or revisit run counts, assess benchmark variance/noise, or decide whether to add or remove runs after changing the regression alert threshold.
- Grade
- D
- Quality
- 62 / 100
- Safety
- Passed
- GitHub stars
- 8,493
Unproven: rated by static analysis only, not yet compared head-to-head.
Our two independent classifiers differ on this skill's category, so treat the placement as provisional.
This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.
Our review
- Architecture
- 84 / 100
- Maturity
- Structured: ships references or scripts
- Security scan
- Low-risk patterns
- License
- Not declared. Check the repository before reusing it.
- Adoption
- Adopted by 0 other repositories, in 0 collections
- Scope
- Repo-internal: written for the repository it lives in. Maintainer analysis of Hardhat's own benchmark-results repository
What the scanner flagged
- over-broad allowed-tools ('*')
Not checked yet
- Category is a classifier prediction; no model has read this skill yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.