Mamdouh
@mamdouhh
DBRX (https://huggingface.co/spaces/databricks/dbrx-instruct) - the new leader in open models from Databricks Outperforms all open models on most benchmarks, including Grok, which is twice as large. A license similar to a llama license. Architecturally, this is a Mixture of Experts (16 experts, of which 4 are active), 132 billion parameters (of which 36 billion are active)
0 reply
0 recast
0 reaction