llm-judge-creator

llm-judge-creator is an LLM evaluation & observability skill for AI agents, published by latitude-dev in the eval-skills repository on GitHub. Skillspace rates llm-judge-creator C (72/100) and it passed the safety scan; the rating is based on static analysis only.

Use this skill when a developer wants to create LLM-as-a-judge evaluators for their AI system. Triggers on: "create an LLM judge", "build an eval for my AI", "automate my evaluations", "create a judge prompt", "build LLM-as-a-judge", "turn my annotations into evals", "create evals from my issue report", "I want to evaluate my AI automatically", "how do I scale my evaluations", "build judges from my traces". Takes an issue report (from llm-issue-discovery) or annotated traces and produces ready-to-use LLM-as-a-judge prompts — one per evaluation dimension — that the dev can copy-paste into their eval setup.

Grade

C

Quality

72 / 100

Safety

Passed

GitHub stars

20

Unproven: rated by static analysis only, not yet compared head-to-head.

Not launch-quality. It is graded C with a clean safety verdict, but our quality filters exclude it: it looks like a template or a stub that was never filled in. So it is not in our launch-quality set, the skills our MCP server searches and recommends. How launch-quality is decided

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.