GitHub - gavamedia/deltafin: Run Kimi K3, a 2.8T-parameter Mixture-of-Experts LLM, on a single Apple Silicon Mac. Streams MXFP4 experts on demand over HTTP into a local disk cache — fused NEON kernels, Metal/MPS compute, exact reproducible decoding, and an OpenAI-compatible API server for local chat and coding agents.
____ _ _ __ _
| _ \ ___| | |_ __ _ / _(_)_ __
| | | |/ _ \ | __/ _` | |_| | '_ \
| |_| | __/ | || (_| | _| | | | |
|____/ \___|_|\__\__,_|_| |_|_| |_|
An experiment in running Kimi K3 (2.8T parameters) on one Apple Silicon Mac
Deltafin is a small research project that runs a Mixture-of-Experts model far
larger than the machine it sits on. It is not fast — about 16 seconds per token
on our M1 Max — but it is exact, reproducible, and it works on a 64 GB laptop.
Newer chips and mo...
Read more at github.com
© News Score score the news, sort the news, rewrite the headlines