https://x.com/PratyushRT/status/1873428775171670435

Things like this are a big part of why I'm skeptical of just putting a single AI in charge of things (eg. DAOs, funding mechanisms), and favor an open market where many AIs can participate and humans judge AIs based on some sample of outcomes.

Backdoor attacks: The hidden threat to open-source LLMs

Open-source LLMs efforts are very important as they democratize access to intelligence. But there is a catch we need to talk about more - especially as more organizations rush to release open-source models. For models…

Pratyush Ranjan Tiwari

Had to deal with some open source AI for specific tasks at a previous job and had severe difficulty with political bias in the training. If you just put an off the shelf AI in charge of something you will probably get a lowest common denominator result.