𝚐𝔪𝟾𝚡𝚡𝟾

Phi-4: Microsoft’s compact SLM 

Phi-4, a 14B parameter SLM, delivers sota performance in advanced reasoning tasks, especially in mathematics. It achieves 56% on GPQA, 80% on MATH, and an impressive 91.8% accuracy on AMC 10/12 math problems.

Recipe—the big three:
> high-quality synthetic datasets
> curated organic data 
> advanced post-training techniques 

Now available on Azure AI Foundry & Hugging Face.

You might recall this release from NeurIPS—well, the weights dropped on the hub today.

Note: Phi-4 is capable of functioning as a chatbot but has been fine-tuned specifically to excel in single-turn queries.

release: https://techcommunity.microsoft.com/blog/aiplatformblog/introducing-phi-4-microsoft’s-newest-small-language-model-specializing-in-comple/4357090
https://huggingface.co/microsoft/phi-4

This model didn’t quite pass my vibe check back in December, so I held off on sharing. That said, there’s still something to learn from this release, even if it’s not my top pick among SLMs right now.