Haardik
@haardikkk
I’m a sucker for self hosting homelabs Currently using supermaven pro for coding copilot, 1m context works amazingly well Rarely use its chat features, care more about simple autocompletes and refactors than chat What’s the best way to self host this? Llama doesn’t seem to come close to
2 replies
14 recasts
158 reactions
Steve
@sdv.eth
I host /homelabs, would be happy to have you! I've done some research on this as it's one end goal of mine, but haven't put too much thought into it as the paid subscriptions are rapidly evolving. I personally wouldn't want to invest too much in hardware upfront until things slow down a bit. Another thing to consider is power draw, and how that translates to $/mo where you live. As for Supermaven specifically, I don't think there's a self hosted option. A few months ago there was someone here who mentioned spending about +$6000 to run a self-hosted LLM, wish I could remember the author/cast.
1 reply
2 recasts
20 reactions
Haardik
@haardikkk
Yeah I’m not looking to host supermaven ofc just curious if anyone has alternative recommendations Most host able coding LLMs I’ve seen are all about chat, not completions
0 reply
0 recast
0 reaction
