typeof

Staff Eng at Iron Fish 🐟 • Building BlockSocks 🧦 • Denver, CO 📍

Farcaster Development Boutique @ https://dTech.vision 💜 in love with tech 🤓decentralization, fitness and oldschool rap 😎

I've got the DeepSeek-R1-Distill-Llama-70B-GGUF with Q4_K_M quantization loaded right now. It's generating ~10 tokens/sec. RAM usage is at 57%

what's the biggest r1 that comfortably works? R1 70b crashes Zed on my 64GB

I wanted something that could load the 70b parameter LLMs and I wanted to future proof a bit

Probably overkill but wanted to play it safe

that’s crazy! I’m very curious about your usage, what sorts of things make you justify the price of these specs?

co-founder @chaindrop § software engineer § privacy wonk § music head § theoretical memeticist

*slaps top of macbook*

This bad boy can fit so many parameters

I am a Canadian investor passionate about exploring and advancing the potential of digital assets and emerging technologies.

Perfect to run that one LLM in full as your whole system. 😎