𝚐𝔪𝟾𝚡𝚡𝟾

DeepSeek-V3

Reasoning and Coding benchmarks:

BigCodeBench-Hard:
- 🥇 1st Overall
- Complete: 40.5%
- Instruct: 28.4%
- Average: 34.5%
> Comparisons: Gemini-Exp-1206 (34.1%), o1-2024-12-17 (32.8%)

Aider Polyglot Leaderboard:
-🥈 2nd Place
- o1: 62%
- DeepSeek-V3 Preview: 48%
- Sonnet: 45%, Gemini-Exp-1206: 38%, o1-Mini: 33%

SWE-Bench Lite:
- Performance: 23.00%

LiveBench Results:
- All Groups Average: 60.4
- Reasoning: 50.0
- Coding: 63.4
- Mathematics: 60.0
- Data Analysis: 57.7
- Language: 50.2
- Instruction Following: 80.9

Key Architecture Upgrades (V3 vs. V2):

60 tokens/second (3x faster than V2!)

> Vocab Size: 129,280 (↑ from 102,400)
> Hidden Size: 7,168 (↑ from 4,096)
> Layers: 61 (↑ from 30)
> Attention Heads: 128 (↑ from 32)
> Max Position Embeddings: 4,096 (↑ from 2,048)

… 

https://huggingface.co/collections/deepseek-ai/deepseek-v3-676bc4546fb4876383c4208b