posthog-analyst
posthog-analyst is an LLM evaluation & observability skill for AI agents, published by aryaniyaps in the ultimate-pi repository on GitHub. Skillspace rates posthog-analyst F (51/100) and it passed the safety scan; the rating is based on static analysis only.
Analyze pi agentic conversations, errors, and misalignments using PostHog MCP. Queries $ai_generation, $ai_span, $ai_trace events, segments by model, detects failure patterns, cross-references the wiki's model-adaptive harness research, and generates model-specific recommendations filed to the wiki. Use this skill when the user wants to analyze agent performance, understand where the harness breaks per model, audit LLM errors or tool failures, improve model profiles based on real data, or run a postmortem on agentic sessions. Trigger on: "posthog analyze", "/posthog-analyze", "analyze agent sessions", "audit llm errors", "postmortem", "what's failing per model", "harness performance analysis", "find misalignments", "model error patterns", "agent conversation audit".
- Grade
- F
- Quality
- 51 / 100
- Safety
- Passed
- GitHub stars
- 23
Unproven: rated by static analysis only, not yet compared head-to-head.
This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.
Our review
- Architecture
- 77 / 100
- Maturity
- Basic: a single SKILL.md
- Security scan
- Low-risk patterns
- License
- Not declared. Check the repository before reusing it.
- Adoption
- Adopted by 0 other repositories, in 0 collections
What the scanner flagged
- mentions secrets in text
Not checked yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.