rocketman
@rocketman
the degree to which ai is destroying barriers to user interaction on the web is insane don't fill out a form, edit complex UX, just chat
1 reply
1 recast
9 reactions
Cool Beans 🌞
@coolbeans1r.eth
The main pushback I get from fellow ecowarriors is power usage. I find it to be irrelevant since it cuts down time spent doing shit. How much compute power is behind Flo?
2 replies
0 recast
0 reaction
rocketman
@rocketman
we use claude 3.5, not sure off top of my head tbh, i'd ask chatgpt if you're curious :D
1 reply
0 recast
1 reaction
Cool Beans 🌞
@coolbeans1r.eth
Ok, Claude requires some power. I am running local LLMs up to 32b right now, need way more power to compete with Claude that is for sure. Considering your usage doesn't require much power I might suggest looking at running a lighter weight model on a much cheaper piece of equipment. (Not sure how you get billed for Claude usage)
1 reply
0 recast
0 reaction