mit licensed open model with o1 performance from deepseek dropped

https://x.com/deepseek_ai/status/1881318130334814301

people are already running deepseek r1 at home with mac minis

https://x.com/alexocheema/status/1881561143736664180

https://warpcast.com/anurajenp/0x669e4b51

AGI at home

Running DeepSeek R1 across my 7 M4 Pro Mac Minis and 1 M4 Max MacBook Pro.

Total unified memory = 496GB.

Uses @exolabs distributed inference with 4-bit quantization.

Next goal is fp8 (requires &gt;700GB) https://t.co/Sqn3doiBEG

Alex Cheema - e/acc

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed.

Getting close to open-source O1, at home, on consumer hardware.

With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw) https://t.co/RnkYxwZG3c

Awni Hannun

Curious | building robots | https://anurajrp.io/about/

smaller model also running 

https://x.com/awnihannun/status/1881412271236346233