flagevalmm-add-dataset

flagevalmm-add-dataset is an LLM evaluation & observability skill for AI agents, published by flageval-baai in the FlagEvalMM repository on GitHub. Skillspace rates flagevalmm-add-dataset F (53/100) and it passed the safety scan; the rating is based on static analysis only.

Integrate new evaluation datasets into FlagEvalMM as benchmark tasks. Use when adding a dataset from HuggingFace or other sources to FlagEvalMM, creating task configs, writing data processors, building custom evaluators, setting up prompt templates, or running evaluation benchmarks on VLMs. Trigger on: "add dataset to FlagEvalMM", "create a new task", "integrate benchmark", "evaluate model on [dataset]", "write process.py", "write evaluator", or any request involving the tasks/ directory of FlagEvalMM.

Grade
F
Quality
53 / 100
Safety
Passed
GitHub stars
107

Unproven: rated by static analysis only, not yet compared head-to-head.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
80 / 100
Maturity
Basic: a single SKILL.md
Security scan
Low-risk patterns
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections

What the scanner flagged

  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.