test-model-qwen3-vl-8b-mmmu-val
test-model-qwen3-vl-8b-mmmu-val is an LLM evaluation & observability skill for AI agents, published by ModelTC in the LightLLM repository on GitHub. Skillspace rates test-model-qwen3-vl-8b-mmmu-val F (45/100) and the safety scan rated it risky; the rating is based on static analysis only.
Risky. This skill has patterns associated with unsafe behaviour. Read the source carefully before running it.
LightLLM Qwen3-VL-8B-Instruct: api_server tp 2 on port 8089, then lmms-eval CLI (python -m lmms_eval, model openai_compatible, tasks mmmu_val, batch_size 900) with OPENAI_API_BASE pointing at LightLLM OpenAI-compatible /v1. Restore https_proxy for Hub while no_proxy includes 127.0.0.1. Requires lmms-eval install, OPENAI_API_KEY placeholder, LOG_DIR and MODEL_DIR, nvidia-smi GPU choice, pipefail with tee, summary.txt. No wrapper script; use command line only.
- Grade
- F
- Quality
- 45 / 100
- Safety
- Risky
- GitHub stars
- 4,169
Unproven: rated by static analysis only, not yet compared head-to-head.
Our two independent classifiers differ on this skill's category, so treat the placement as provisional.
This rating describes the version of the repository we crawled; it may have changed since.
Our review
- Architecture
- 84 / 100
- Maturity
- Basic: a single SKILL.md
- Security scan
- High-risk patterns
- License
- Apache-2.0
- Adoption
- Adopted by 0 other repositories, in 1 collections
What the scanner flagged
- references sensitive credential env
Not checked yet
- Not judged on the rubric yet (not a contender in its category)
- No blind task eval yet
- Scope (portable / vendor / repo-internal) not assessed; only the top of each category is read for scope
- Sibling files (scripts, references) not fetched; security scan covers SKILL.md only
Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.