What are the best resources for mobile LLMs?

do you mean running a LLM on device or connecting to one?

if you're just talking about talking to a llm via a mobile app, i've heard good things about vercel's ai package

do you mean running a LLM on device or connecting to one?

if you're just talking about talking to a llm via a mobile app, i've heard good things about vercel's ai package

https://github.com/vercel/ai

building products /neynar, hacking /farhack, sharing thoughts /dylan | dylansteck.com

gotcha -- have only used one TestFlight with a local LLM and it was extremely slow

hoping to see advancements though, on device mobile LLMs are going to be a *huge* unlock