Content pfp
Content
@
https://warpcast.com/~/channel/homelabs
0 reply
0 recast
0 reaction

chris ๐Ÿค˜๐Ÿป pfp
chris ๐Ÿค˜๐Ÿป
@ckurdziel.eth
Apollo app on iOS is awesome - you can install and run Deepseek R1 locally. Highly recommend playing with this - it will also connect to your own self hosted AI stack. https://apps.apple.com/us/app/apollo-ai-private-local-ai/id6448019325
2 replies
2 recasts
22 reactions

Elie pfp
Elie
@elie
But only runs small models?
1 reply
0 recast
0 reaction

chris ๐Ÿค˜๐Ÿป pfp
chris ๐Ÿค˜๐Ÿป
@ckurdziel.eth
Yeah, if you want to run locally. Itโ€™s the distilled models that run on iPhone. But you can also point that app at a self hosted instance of R1.
1 reply
0 recast
0 reaction

Elie pfp
Elie
@elie
Self hosting 670b is hard.
1 reply
0 recast
1 reaction

chris ๐Ÿค˜๐Ÿป pfp
chris ๐Ÿค˜๐Ÿป
@ckurdziel.eth
Seems like there are folks figuring out how to do it, though!
1 reply
0 recast
1 reaction

Elie pfp
Elie
@elie
Are there ๐Ÿค” think itโ€™s a very heavy setup. Most of what you see is the small models which a laptop can run
1 reply
0 recast
0 reaction

chris ๐Ÿค˜๐Ÿป pfp
chris ๐Ÿค˜๐Ÿป
@ckurdziel.eth
https://x.com/carrigmat/status/1884244369907278106
1 reply
0 recast
0 reaction