agent-eval-flywheel
agent-eval-flywheel is an LLM evaluation & observability skill for AI agents, published by SaschaHeyer in the gen-ai-livestream repository on GitHub. Skillspace rates agent-eval-flywheel D (69/100) and it passed the safety scan; the rating is based on static analysis only.
Use this skill to evaluate an ADK agent with Google's Agent Quality Flywheel, run an evalset, choose the right metric, and read the results. Covers the ADK metric menu and which metrics run locally versus which call an AI judge, how the LLM judge scores meaning rather than words, how a rubric judge writes a plain-English reason for each verdict graded against trusted evidence, and how to close the eval fix loop. SDKs and tools used, agents-cli, adk eval, google-adk[eval], the Gemini API for the agent and the judge.
- Grade
- D
- Quality
- 69 / 100
- Safety
- Passed
- GitHub stars
- 187
Unproven: rated by static analysis only, not yet compared head-to-head.
Our two independent classifiers differ on this skill's category, so treat the placement as provisional.
This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.
Our review
- Architecture
- 78 / 100
- Maturity
- Structured: ships references or scripts
- Security scan
- No issues found
- License
- Not declared. Check the repository before reusing it.
- Adoption
- Adopted by 0 other repositories, in 0 collections
Not checked yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.