Meet Sohu, the fastest AI chip of all time.

With over 500,000 tokens per second running Llama 70B, Sohu lets you build products that are impossible on GPUs. One 8xSohu server replaces 160 H100s.

Sohu is the first specialized chip (ASIC) for transformer models. By specializing, https://t.co/IndYfP2CN0

Etched

https://x.com/etched/status/1805625693113663834

Curious | building robots | https://anurajrp.io/about/

Do you think etched would be able to power the recently announced Llama upgrade by Mark Zuckerberg ?