AI News Daily한국어
Friday, October 2, 2026

Story 7 of 7

Magnitude, a local inference engine that compiles kernels for your exact chip, claims up to 2x llama.cpp

First seen on X 46 days ago@Dontgiveup_26 ♥ 8232 views

Among local AI developers who use Ollama and llama.cpp, an open-source inference engine called Magnitude is making the rounds. Most engines ship kernels precompiled per hardware class, one path for Apple Silicon and one for NVIDIA. Magnitude compiles and tunes its kernels on your device before the first run. It claims up to 2x the speed of llama.cpp, with decode 92% faster on Metal and 19% faster on CUDA, and runs on Apple Silicon, NVIDIA, AMD or a bare CPU.

It is written in Rust and connects the coding agent you already use (Pi, OpenCode, Hermes, Codex and others) with one click. A Korean-language post introducing it drew 800 likes.

“최근 Ollama와 llama.cpp 쓰던 로컬 AI 개발자들 사이에서 난리 난 오픈소스 'Magnitude'. 기존 엔진처럼 획일화된 바이너리를 쓰는 게 아니라, 내 맥북·PC 하드웨어 스펙을 분석해서 실시간으로 커널을 직접 컴파일하고 튜닝해 버림.”

Next story →Claude Code gets mods: a few lines of TypeScript now change how it behaves and looksRead an AI Insight →Now that anyone can build, are PMs valuable again? Gemini's head of product Tulsee Doshi: "I want PMs who are playing with these models every day"

Get tomorrow's stories as an alert

We'll ping you when each new edition or breaking story lands. Free, no sign-up.

Daily morning AI news, new AI Insights, and a monthly briefing of top stories on the 1st.

More stories from the same day

  1. Claude Code gets mods: a few lines of TypeScript now change how it behaves and looks
  2. Anthropic opens claude.dev, a developer blog with Opus 5.5 playbooks and engineering write-ups
  3. After a day of 'GPT-6.1 Sol is slow' reviews, Altman says it was load and should be much better now
  4. Posts claim Fable 5.1 is quietly serving a 'Fable 5.5', and Anthropic has said nothing
  5. Gemini 4 Argon will open to Google AI Ultra subscribers and paid API customers first
  6. OpenDots, an open-source dots clone you host yourself, is out
See all of Friday, October 2, 2026 →

* Summaries and publishing on this page are done by an automated agent. Check the facts against the original links.

Privacy PolicySupportSend feedbackDiscord botClaude Code & CodexRSSListed on Sell With boost