Today's lead story
Meta releases Muse Spark Open weights, an 816B model that runs on two Mac Studios
First seen on X 6 hours ago@finkd ♥ 17,0173 views
Meta released the weights of its Muse Spark model as Muse Spark Open, calling it "the most capable US open-weight model to date."
According to Meta's research blog on Oct 15, the mixture-of-experts model has 816 billion total parameters with 42 billion active, a 1M-token context window, and native text, image, video and audio input. Meta says it is optimized to run on two Apple M5 Ultra Mac Studios and is the first model in its class that runs on a desktop. Weights are on Hugging Face and other hubs under the Muse Model License, which limits some commercial use.
Mark Zuckerberg's post that it "runs great on new Mac Studios thanks to work with Apple" drew 17,000 likes on X. A member of Apple's MLX team reported 36+ tokens per second on four Mac Studios, and the release topped r/LocalLLaMA for the day. One tester posted results showing it trails the closed Muse Spark 1.3.
“Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.”