run-ablation
run-ablation is an LLM evaluation & observability skill for AI agents, published by Kaggle in the kaggle-environments repository on GitHub. Skillspace rates run-ablation D (62/100) and it passed the safety scan; the rating is based on static analysis only.
Run a prompt-ablation study on a kaggle-environments game's LLM harness. Use when the user mentions "ablation", "prompt sensitivity", "test prompt variants", "compare prompts", "ablate the prompt", "prompt rewrite study", or asks whether their prompt wording is doing real work. Bootstraps a prompt_variants.py if missing, proposes new variants interactively, then runs a paired-seat tournament and reports the leaderboards.
- Grade
- D
- Quality
- 62 / 100
- Safety
- Passed
- GitHub stars
- 432
Unproven: rated by static analysis only, not yet compared head-to-head.
Our two independent classifiers differ on this skill's category, so treat the placement as provisional.
This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.
Our review
- Architecture
- 96 / 100
- Maturity
- Basic: a single SKILL.md
- Security scan
- Low-risk patterns
- License
- Apache-2.0
- Adoption
- Adopted by 0 other repositories, in 0 collections
What the scanner flagged
- mentions secrets in text
Not checked yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.