phoenix-error-analysis

phoenix-error-analysis is an LLM evaluation & observability skill for AI agents, published by Arize-ai in the phoenix repository on GitHub. Skillspace rates phoenix-error-analysis D (67/100) and it passed the safety scan; the rating is based on static analysis only.

Find out what is going wrong in LLM or agent traffic by reading sampled Phoenix traces, spans, or sessions, writing free-form notes (open coding), then grouping the notes into a few narrow annotations, one per failure dimension with a small label set and counts, that pick eval targets and fix priorities (axial coding). Use for "what's going wrong with this agent", "I just instrumented my app, where do I start", "review these traces", "the chatbot keeps losing context", "what kinds of mistakes is the model making", "what categories of failures do we have", "what should I build evals for", "how do I prioritize fixes", "group these notes", "MECE breakdown" — or any framing that needs observations or categories grounded in real traces rather than invented top-down, even without naming the technique.

Grade
D
Quality
67 / 100
Safety
Passed
GitHub stars
11,439

Unproven: rated by static analysis only, not yet compared head-to-head.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

View source on GitHubArize-ai/phoenix

Our review

Architecture
94 / 100
Maturity
Basic: a single SKILL.md
Security scan
Low-risk patterns
License
Not declared. Check the repository before reusing it.

What the scanner flagged

  • mentions secrets in text

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Better-rated skills in LLM evaluation & observability

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.