datagen-job-cleanup

datagen-job-cleanup is an MLOps & model serving skill for AI agents, published by open-thoughts in the OpenThoughts-Agent repository on GitHub. Skillspace rates datagen-job-cleanup F (15/100) and the safety scan rated it unsafe; the rating is based on static analysis only.

Post-run cleanup for a datagen (trace-generation) job on an HPC cluster (Jupiter/Leonardo/Perlmutter): get the generated traces onto HF (penfever org) and free disk. There is NO model checkpoint — the artifact is the trace dataset. Covers the TIMEOUT-strands-traces gotcha (uploads silently never run), the ONE-level trace_jobs nesting (vs RL's double-nest), the real-vs-failed sanity check (avg_turns ≈ 1.0 = dead run, don't upload), the otagent-env uploader, the non-empty HF verify, and safe disk cleanup (one-off task dirs vs shared canonical tasks; leave Daytona snapshots). Use when a datagen/trace job finishes (COMPLETED or TIMEOUT) and its traces need uploading + verifying, or when consolidating a chunked datagen run. Distinct from RL/SFT cleanup (those publish a model checkpoint).

Grade
F
Quality
15 / 100
Safety
Unsafe
GitHub stars
259

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since.

View source on GitHubopen-thoughts/OpenThoughts-Agent

Our review

Architecture
84 / 100
Maturity
Basic: a single SKILL.md
Security scan
Critical-risk patterns
License
Apache-2.0
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • destructive rm -rf on home/root
  • references sensitive credential env
  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Better-rated skills in MLOps & model serving

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.