Training completed on the first decentralized 10-billion-parameter model: 
- 30 compute contributors
- 10B parameters
- 5 countries
- 3 continents
- 1T tokens

A full open-source release is expected in a week, including the base model, checkpoints, post-trained model, and data. 

don’t sleep.

INTELLECT-1, the first 10B model trained via a decentralized framework, is now officially released. The release includes the base model, checkpoints, post-trained models, datasets, technical report, and training framework. Another w for open source! This demonstrates the potential of decentralized deep learning to collaboratively build large-scale models.

INTELLECT-1, the first 10B model trained via a decentralized framework, is now officially released. The release includes the base model, checkpoints, post-trained models, datasets, technical report, and training framework. Another w for open source! This demonstrates the potential of decentralized deep learning to collaboratively build large-scale models.

https://www.primeintellect.ai/blog/intellect-1-release

Achieves Llama-2-level performance using half the tokens.

this dashboard is hype

how's it perform against benchmarks?