coral-new-task

coral-new-task is a Planning & task breakdown skill for AI agents, published by Human-Agent-Society in the CORAL repository on GitHub. Skillspace rates coral-new-task F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.

End-to-end recipe for adding a new task under `examples/` — the three pieces that have to line up (`task.yaml`, `seed/`, and `grader/`), what to put in each, the `TaskGrader` API surface, the `coral validate` → smoke-test loop, and the common mistakes (repo_path pointing at the wrong dir, score direction backwards, hidden answer keys leaking into seed/, grader writing to codebase_path which the daemon force-removes, private-vs-public confusion, missing `run()` signature). Use whenever the user wants to add a new CORAL task or port an existing benchmark into CORAL.

Grade
F
Quality
45 / 100
Safety
Risky
GitHub stars
817

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since.

Our review

Architecture
94 / 100
Maturity
Basic: a single SKILL.md
Security scan
High-risk patterns
License
Apache-2.0
Adoption
Adopted by 1 other repositories, in 0 collections

What the scanner flagged

  • dynamic code execution (eval/exec)

Not checked yet

  • Category is a classifier prediction; no model has read this skill yet
  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.