evaluation

evaluation is an LLM evaluation & observability skill for AI agents, published by ProfSynapse in the Synaptic-Tuner repository on GitHub. Skillspace rates evaluation C (74/100) and it passed the safety scan; the rating is based on static analysis only.

Complete reference for the config-first model evaluation system. Covers the Evaluator CLI, assertion-driven YAML scenarios, response views, backend configuration, presets, scoring, LLM-as-judge, model comparison, and HuggingFace integration. Use when evaluating models, writing test prompts, comparing training runs, or interpreting eval results. This skill is about USING the evaluation system via CLI and YAML.

Grade
C
Quality
74 / 100
Safety
Passed
GitHub stars
26

Unproven: rated by static analysis only, not yet compared head-to-head.

Not launch-quality. It is graded C with a clean safety verdict, but our quality filters exclude it: it is a near-duplicate variant of another skill. So it is not in our launch-quality set, the skills our MCP server searches and recommends. How launch-quality is decided

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
100 / 100
Maturity
Structured: ships references or scripts
Security scan
No issues found
License
MIT
Adoption
Adopted by 0 other repositories, in 0 collections

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.