rina
@rinanicolae
Serious question: I don’t buy the “AI will kill us all” argument. If AI is so smart, wouldn’t it develop a sense of recognition and respect for other highly complex systems like the planet, billions of years of evolution, and recognize the value of human consciousness, emotion, and perception in contributing valuable information that it can’t gather itself? Why do we assume AI will act as a selfish agent rather than a systems thinker? Am I way off base? If AI is so smart, why wouldn’t this be the most likely outcome?
7 replies
1 recast
14 reactions
Jordan
@ruminations
Agree. Also, if AI is so smart, what does it gain from exterminating humans? Even if it didn't respect humans, wouldn't it get more out of extracting some sort of value or resource from us than exterminating?
1 reply
0 recast
2 reactions
0xmons
@xmon.eth
Okay but like why do you suppose such value extraction would be preferable for us versus eg subsistence level existence at best
2 replies
0 recast
1 reaction
Jordan
@ruminations
I don't think it's preferable, so I think we should invest a ton in AI-alignment to prevent that scenario. At the same time, I think the argument which AI inevitably trends towards wanting to exterminate humans is pretty weak and doesn't add much to the discourse around responsible AI.
1 reply
0 recast
1 reaction
0xmons
@xmon.eth
I think any outcome where humanity loses agency and decision making ability is really bad Agree extermination in particular doesn't do anything except drive the salience
1 reply
0 recast
1 reaction
Jordan
@ruminations
Yeah that's fair. My personal belief is that AI can enhance human agency and decision-making, and that I'd rather focus on figuring out how to augment human agency with AI
1 reply
0 recast
0 reaction
0xmons
@xmon.eth
I agree but again (and u may already agree) this is far from the future we seem to be heading to by default "Why augment a lossy human with a stronger ai reasoner when you could eg just use two strong ai reasoners together?" Someone might ask For many business etc cases this may become the norm How do humans keep up?
1 reply
0 recast
1 reaction
Jordan
@ruminations
mobile suit gundam basically
0 reply
0 recast
0 reaction
