Over the past few weeks, I’ve tested 18 leading AI models on their crypto knowledge and capabilities. Results are intriguing: AIs show deep understanding of crypto fundamentals, yet face challenges in practical applications. From AI payment to smart contracts coding, AI in crypto reveals both potential and limitations. 

The experiment comprises two key parts:

A MVP dataset of ~700 multiple-choice questions, co-created by AI and humans, then refined by human experts. Despite some quality constraints, this enables rapid model testing and basic scoring to show a baisc idea of a benchmark in Crypto Domain. 

Then there is a growing set of ~100 complex tasks created by crypto experts, covering simulations, calculations, code audits, and tool usage. These add depth and authenticity to the assessment.

Full findings in the article below 👇

Over the past few weeks, I’ve tested 18 leading AI models on their crypto knowledge and capabilities. Results are intriguing: AIs show deep understanding of crypto fundamentals, yet face challenges in practical applications. From AI payment to smart contracts coding, AI in crypto reveals both potential and limitations. 

The experiment comprises two key parts:

A MVP dataset of ~700 multiple-choice questions, co-created by AI and humans, then refined by human experts. Despite some quality constraints, this enables rapid model testing and basic scoring to show a baisc idea of a benchmark in Crypto Domain. 

Then there is a growing set of ~100 complex tasks created by crypto experts, covering simulations, calculations, code audits, and tool usage. These add depth and authenticity to the assessment.

Full findings in the article below 👇
https://chaow.xyz/p/will-ai-survive-in-the-crypto-world

Observing the co-evolution of culture and algorithm.