six on Warpcast

Content pfp

0 reply

0 recast

0 reaction

Greg pfp

I haven't been following the AI space very closely, especially outside of OpenAI stuff. How far behind are open source alternatives? I've heard about stuff like llama2 supposedly being decent for chat but I'm assuming the agents/function calling and whatnot is a different story?

8 replies

0 recast

11 reactions

Warpmaster General pfp

Warpmaster General

It's largely a question of UX more than capability. ChatGPT(+API) is turnkey, cheap, convenient. If you want to roll your own via LLaMA, Langchain, et al, you're looking down the barrel of a week or two just to get it running, let alone fine tuning it to a level where its output is actually usable (not even useful).

1 reply

0 recast

2 reactions

Greg pfp

Makes sense. Just out of curiosity, assume I was going to spend time getting everything set up - would it even be possible to get close to OpenAI's current performance? Like are the base LLM's good enough?

3 replies

0 recast

1 reaction

vincent pfp

Perplexity provides open-source LLM API: https://docs.perplexity.ai/docs Also check out replicate, they serve some LLM API: replicate.com I follow open-source LLM somewhat, best way to follow is on X (I can share my private list if interested), and crawl through HuggingFace.

2 replies

0 recast

2 reactions

six pfp

Am also interested in said list

1 reply

0 recast

2 reactions

vincent pfp

unironictechbro, pee_zombie, ctjlewis, yacineMTB, bayeslord, avaitopiper, riksucks, frrntc, deepfates, liamzebedee, tszzl, iamgingertrash, 10x_er, reachtarunhere, AuroraNemoia, iliekcomputers, bckvxx, teortaxesTex, theemozilla, mayfer, natfriedman

0 reply

0 recast

0 reaction