Dan Finlay 🦊 pfp
Dan Finlay 🦊
@danfinlay
I asked this here in part because LLMs were failing, not because I lacked access to them. If your LLM reply bot isn't doing something fantastically unique to enhance its answers, it's probably a waste of your cloud compute credits.
1 reply
4 recasts
13 reactions

frend pfp
frend
@frend
Do we get bonus points for running the LLM locally?
2 replies
0 recast
0 reaction

Dan Finlay 🦊 pfp
Dan Finlay 🦊
@danfinlay
I guess in that case, you're wasting your own electricity & GPU budget. Might actually be even more wasteful, if it isn't operating on private information.
0 reply
0 recast
0 reaction

Dan Finlay 🦊 pfp
Dan Finlay 🦊
@danfinlay
Not if it's just spewing garbage.
0 reply
0 recast
0 reaction