In you're in favor of "AI safety" (broad definition), what's your most compelling cast-length argument?

I'm in the Sam Harris camp. Intelligence is the critical ingredient for all technology so we should treat AGI like summoning a god.

But I'm less concerned than I used to be because I think the safety path is becoming clear: everyone on earth participating in continuous RLHF of the biggest models.

musician & dev gigameshmusic.com github.com/gigamesh

Global DAO / hive mind  ...very scifi but kind of seems like the obvious target