inspect-ai

inspect-ai is an LLM evaluation & observability skill for AI agents, published by JackHopkins in the factorio-learning-environment repository on GitHub. Skillspace rates inspect-ai F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

Use this skill whenever asked to run Inspect AI evaluations, analyze .eval or .json log files, read trajectory data, or work with the Inspect AI Python API. Triggers include mentions of "inspect eval", ".eval files", "eval logs", "trajectory", "EvalLog", "samples", "scores", or references to the inspect_ai Python package. Also use when asked to analyze agent behavior from evaluation runs, extract scores/metrics, retry failed evals, or compare evaluation results programmatically.

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
1,034

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since.

Our review

Architecture
98 / 100
Maturity
Structured: ships references or scripts
Security scan
High-risk patterns
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • references sensitive credential env
  • dynamic code execution (eval/exec)
  • mentions secrets in text

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.