data-juicer

data-juicer is a Fine-tuning & training data skill for AI agents, published by datajuicer in the data-juicer-agents repository on GitHub. Skillspace rates data-juicer D (57/100) and it passed the safety scan; the rating is based on static analysis only.

Full data processing harness based on Data-Juicer for cleaning, filtering, deduplicating, and transforming JSONL/JSON datasets. Trigger keywords: data cleaning, data filtering, deduplication, dedup, dataset, dataset processing, JSONL processing, text cleaning, HTML cleaning, low-quality filtering, data preprocessing, ETL, data pipeline. Error triggers: dj-process failure, operator not found, plan validation failure, recipe execution timeout, OOM, permission denied, apply_recipe error. Related skills: djx_install (installation), djx_auth (authentication), djx_local_model (private data), djx_context (dataset inspection), djx_retrieve (operator search), djx_plan (plan building), djx_apply (execution), djx_dev (custom operators). Note: Simple statistics (wc -l, head) do not require this skill — use shell commands directly.

Grade

D

Quality

57 / 100

Safety

Passed

GitHub stars

50

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.