llama.cpp

llama.cpp is a Local & open models skill for AI agents, published by agentic-in in the elephant-agent repository on GitHub. Skillspace rates llama.cpp C (72/100) and it passed the safety scan; the rating is based on static analysis only.

Run LLM inference with llama.cpp on CPU, Apple Silicon, AMD/Intel GPUs, or NVIDIA — plus GGUF model conversion and quantization (2–8 bit with K-quants and imatrix). Covers CLI, Python bindings, OpenAI-compatible server, and Ollama/LM Studio integration. Use for edge deployment, M1/M2/M3/M4 Macs, CUDA-less environments, or flexible local quantization.

Grade
C
Quality
72 / 100
Safety
Passed
GitHub stars
574

Unproven: rated by static analysis only, not yet compared head-to-head.

This rating describes the version of the repository we crawled; it may have changed since, so go by its current files.

Our review

Architecture
91 / 100
Maturity
Structured: ships references or scripts
Security scan
Low-risk patterns
License
Not declared. Check the repository before reusing it.
Adoption
Adopted by 0 other repositories, in 0 collections
Scope
Vendor-specific: built around one product. Running inference and quantization with public llama.cpp and GGUF

What the scanner flagged

  • mentions secrets in text

Not checked yet

  • Not judged on the rubric yet (not a contender in its category)
  • No blind task eval yet
  • Sibling files (scripts, references) not fetched; security scan covers SKILL.md only

Skillspace indexes and rates this skill; it does not host or endorse it. Run third-party skills at your own risk.