🧵09/34
Self Preservation
---
The narrow AI, you can unplug it whenever you want, it does not even understand the idea that it can be on or off.
With AGI it’s not that simple.
When the AGI plays chess, unlike the simple narrow chess program, its calculations include things in the real world, like the fact it might get unplugged in the middle of the game.
The main goal of the AGI is achieving checkmate at chess, but if it’s turned off it can not achieve that.
Basically, you can not win at chess if you are dead.
So staying up-and-running naturally becomes another instrumental goal for winning in the game.
And the same applies with any problem it works on.
Its nature, by being General, automatically gives it something like an indirect survival instinct out of the box.
It’s not a human or an animal, but it’s also quite different from the other tools we use.
It starts to feel a bit like …. a weird new life form. 5 replies
0 recast
0 reaction
0 reply
0 recast
0 reaction
0 reply
0 recast
0 reaction
0 reply
0 recast
0 reaction
0 reply
0 recast
0 reaction
0 reply
0 recast
0 reaction
