I was building a demo app and first I used a locally running instance of Llama 3.1. I was not happy with the results, so I swapped it out for API calls to OpenAI’s GPT-4o model. The results were significantly improved. Open source has reduced the gap, but there is still a gap.

Writer. Building @pinatacloud. Tinkering with a Farcaster native alternative to GoodReads: https://readcast.xyz \ https://polluterofminds.com

i'd rather kill the radio and listen to the rain hit

Yep should have clarified. Open source that you can reasonably run yourself. You’re right it’s a compute problem, which means the service providers like OpenAI still lead and still win.

that's not an open source gap, that's a compute gap. were you running the 405B model? if not, it's apples to oranges. 

also... yes, there's still a gap.