compileiq-validate-result

compileiq-validate-result is an Experimentation & statistics skill for AI agents, published by NVIDIA in the CompileIQ repository on GitHub. Skillspace rates compileiq-validate-result C (72/100) and it passed the safety scan; the rating is based on static analysis only.

Use AFTER a Search has completed and BEFORE claiming any speedup or shipping an ACF. Loads the dump_results CSV, extracts top-K candidates (single-objective) or the Pareto front (multi-objective), re-measures each against the no-ACF baseline with 100+ trials on fresh caches, runs Welch's t-test plus Cohen's d, rejects three classic false-positive patterns (lucky-min / higher-variance / multiple-comparisons-of-N), and saves the validated winner as best.acf. Triggers on "validate result", "extract best config", "Welch's t-test", "is my speedup real", "save best ACF", "pareto front", "claim speedup", "ship config".

Grade
C
Quality
72 / 100
Safety
Passed
GitHub stars
107

Unproven: rated by static analysis only, not yet compared head-to-head.

Our two independent classifiers differ on this skill's category, so treat the placement as provisional.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
84 / 100
Maturity
Structured: ships references or scripts
Security scan
No issues found
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections
Scope
Vendor-specific: built around one product. Validates results from NVIDIA CompileIQ's own search tool

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.