open-source-ai

What Open Source AI tools are you using this week?

My usage this week:
- 80% Deepseek v3 / R1, I'd say mainly R1
- 15% Claude Sonnet until I run out of tokens
- leftovers go to ChatGPT
- playing around on runpod / local model for random experimentation etc, LM studio, ollama, stable diffusion, etc

I can't believe how much i'm using DS

creating and destroying; built flying cars & autonomous vehicles, now building roc.camera, writings: july.rocks

Give me an idea of what you estimate the costs to be.

Internet Explorer, Frank & Eileen CTO, into skateboarding, hardware, software, neurotech and the future of health. IRL > URL

xSonos xOura

bradbarrish.me

Running the full R1 671B fp16, sparse activated (9 x H200s on Lambda) is about ~$50/hr but prob things you can do to bring it down, or go slower toks/sec