Llama Cpp

Reame — CPU-first LLM inference server on llama.cpp: disk KV cache, self-regulating speculation, generation archive, interleaved multi-user, the Conclave. Your hardware, your realm.

Run a local coding model in Cursor chat & agent on macOS. Load it when you need it; free memory when you don't.