INTELLECT-1: the first decentralized training of a 10B model 

🔗: https://app.primeintellect.ai/intelligence?_gl=1*1fxs3kt*_gcl_au*MTI5NzY5NDM2MC4xNzI4ODQ4NDQ2 

don’t sleep.

Training completed on the first decentralized 10-billion-parameter model: 
- 30 compute contributors
- 10B parameters
- 5 countries
- 3 continents
- 1T tokens

A full open-source release is expected in a week, including the base model, checkpoints, post-trained model, and data. 

don’t sleep.

Impressive global collaboration and innovation. Looking forward to the release. 