benchmark-qed-autoq
benchmark-qed-autoq is an LLM evaluation & observability skill for AI agents, published by microsoft in the benchmark-qed repository on GitHub. Skillspace rates benchmark-qed-autoq D (60/100) and it passed the safety scan; the rating is based on static analysis only.
Generate benchmark questions and assertions from input data using benchmark-qed. Use when: generating local, global, linked, or activity questions for RAG benchmarking, creating assertions for existing questions, computing assertion statistics, or running the autoq question generation pipeline. Also use when the user wants to create a benchmark question set, build evaluation questions from a dataset, or generate ground-truth assertions — even if they don't say "autoq" explicitly.
- Grade
- D
- Quality
- 60 / 100
- Safety
- Passed
- GitHub stars
- 92
Unproven: rated by static analysis only, not yet compared head-to-head.
This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.
Our review
- Architecture
- 82 / 100
- Maturity
- Structured: ships references or scripts
- Security scan
- Low-risk patterns
- License
- MIT
- Adoption
- Adopted by 0 other repositories, in 0 collections
What the scanner flagged
- mentions secrets in text
Not checked yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.