debug-stuck-eval

debug-stuck-eval is a Build, CI & test failure triage skill for AI agents, published by METR in the hawk repository on GitHub. Skillspace rates debug-stuck-eval F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

Debug stuck Hawk/Inspect AI evaluations. Use when user mentions "stuck eval", "eval not progressing", "eval hanging", "samples not completing", "eval set frozen", "runner stuck", "500 errors in eval", "retry loop", "eval timeout", or asks why an evaluation isn't finishing.

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
31

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since.

Our review

Architecture
100 / 100
Maturity
Basic: a single SKILL.md
Security scan
High-risk patterns
License
MIT
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • dynamic code execution (eval/exec)
  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.