"AI shouldn't be controlled by two companies": local AI engine llama.cpp hits 1.0 after three and a half years

llama.cpp, the open-source engine many people use to run AI models on their own computers, has shipped its first stable 1.0 release.

Creator Georgi Gerganov announced "llama.cpp v1.0.0 is now available" on X on Nov. 13, drawing nearly 2,900 likes. According to the ggml team's post on Hugging Face, both the inference library libllama and the underlying tensor library ggml reached 1.0 the same day. Both now follow semantic versioning, so API and ABI breaking changes will only arrive with major-version bumps, letting app developers who build on the engine plan for them. The release also removed 35 deprecated public API functions.

Started in 2023, llama.cpp now supports more than 150 model architectures and all mainstream speculative-decoding methods, with builds for Linux, macOS, Windows, Android and iOS and packages on Debian, Homebrew and more. Many local AI apps run on it.

Hugging Face co-founder Julien Chaumond marked the release by saying "it is more important than ever to fight for a future where AI is not controlled by just two companies." The release post also made r/LocalLLaMA's top posts of the day. Coverage noted that 1.0 is a contract with developers and doesn't change the apps people use today.