A place for developers to talk about building on Farcaster.

/dev

🚀exo

exo is a project that allows users to create AI clusters by combining various devices, including iPhones, Android and Linux computers, without the need for expensive GPUs.  

exo supports AI models such as LLaMA and Mistral, and offers a ChatGPT-compatible API for using the models on your own hardware.

Exo is installed from source with low memory requirements, but the memory footprint on all devices in the cluster must be considered for the model to work.

The program runs in P2P mode, allowing each device to participate in the computation without a masterworker architecture.

🚀exo

exo is a project that allows users to create AI clusters by combining various devices, including iPhones, Android and Linux computers, without the need for expensive GPUs.  

exo supports AI models such as LLaMA and Mistral, and offers a ChatGPT-compatible API for using the models on your own hardware.

Exo is installed from source with low memory requirements, but the memory footprint on all devices in the cluster must be considered for the model to work.

The program runs in P2P mode, allowing each device to participate in the computation without a masterworker architecture. 

https://github.com/exo-explore/exo

🦊 always outsmarting others.

👨‍💻 My GitHub profile:
https://github.com/mativusgf

Empowering AI clusters with diverse devices. Exciting potential for innovation and collaboration. 🚀