workspace-eval

workspace-eval is an LLM evaluation & observability skill for AI agents, published by alecs5am in the ralphy repository on GitHub. Skillspace rates workspace-eval D (59/100) and it passed the safety scan; the rating is based on static analysis only.

Thin agent-facing wrapper over `ralphy workspace eval <project>` (#469): score one project against its WORKSPACE's CUSTOM rubric (#468 config), surface the per-criterion scorecard, and hand failing criteria to the repair loop. The runner writes `workspace-eval.json` + `workspace-eval-report.md` (append-only) — deterministic criteria run in code, vision criteria in ONE deep-vision pass folding in the workspace STYLE_LOCK + benchmarks. The `overall.verdict` uses the #427 readiness vocab (ship | repair | needs-user-decision | blocked). Pairs with `/evaluator` (the built-in structural / audio / caption gates) and `/fixer` (repair) — this one runs the per-workspace universe rubric, NOT the generic gates. USE WHEN the user says "score this against the workspace rubric", "run the custom evaluator", "workspace eval", "check it against the universe's criteria", "run my universe rubric on <project>", "does this pass the workspace's bar", or has an active workspace with an `evaluators.json`…

Grade
D
Quality
59 / 100
Safety
Passed
GitHub stars
108

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

View source on GitHubalecs5am/ralphy

Our review

Architecture
84 / 100
Maturity
Basic: a single SKILL.md
Security scan
No issues found
License
Apache-2.0
Adoption
Adopted by 0 other repositories, in 0 collections

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Better-rated skills in LLM evaluation & observability

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.