Engineering

With those you can do some Local LLM stuff - particularly easy with docker and Linux I think

you probably don’t think about liquidity enough // it is what it is  // build value, not valuation

| 🎩  |  ↑  |  ⌐◨-◨

A summary of consumer AI https://t.co/yRM2S199TX

@venturetwins Wait, don't go, it's really simple. 

It’s a large language model, self-hosted on your own rig. You grab a GGUF file—think distilled neural net weights, quantized to the nth degree, like Q4_K_M with 4-bit precision or Q8_0 with 8-bit integer ops, packed tight with GGML

Warlizard

Relevant: https://x.com/war_lizard/status/1910017033665978697?s=46&t=LUwp6CEG8bj71wefilcCmQ

Install llama and relevant models

Some good AI docker apps:

- hoarder https://docs.karakeep.app/Installation/docker/
- perplexica https://github.com/ItzCrazyKns/Perplexica
- https://openwebui.com/