Venkatesh Rao ☀️ pfp
Venkatesh Rao ☀️
@vgr
Yet another generation learns about Jevon’s Paradox this week. Ask Deepseek to explain it to you if you don’t get it. Cuda moat is down for the count, but AI hardware prospects have never been more bullish. Nvidia will peak later than people expect, but they’re no longer synonymous with the sector. https://en.wikipedia.org/wiki/Jevons_paradox
1 reply
0 recast
6 reactions

will pfp
will
@w
wait what's the connection between the deepseek stuff and cuda specifically?
1 reply
0 recast
0 reaction

Venkatesh Rao ☀️ pfp
Venkatesh Rao ☀️
@vgr
They apparently did a lot of low-level kernel optimizations and hacks bypassing cuda to get their high efficiency results. Basically bare metal. And in the process showed that the overhead of using cuda may be a huge performance drag on what the hardware can actually do. Cuda is a code swamp everyone I know hates and tries to work around. OpenAIs Triton is basically an imperfect wrapper/partial workaround. It is a moat because Nvidia throws a lot of labor at it not because it is sound. 70% confidence opinion that I may revise based on what more knowledgeable people conclude.
1 reply
0 recast
1 reaction