༺writer on the internet༻
i write about culture, technology, power, and consciousness
https://terrraincognita.substack.com

We care about biodiversity because we evolved in it. We are ‘ecologically entangled’ you could say. We will die if there’s no breathable air and if the soil is too unhealthy to grow food. 

An AI by default may not share these concerns because none of that stuff has value to it. It doesn’t need any of that crap. Its survival goals may be entirely at odds with biodiversity 

We care because we must. It won’t care unless we make it. (We might not be able to make it)

https://warpcast.com/roadu/0x9d04df33

Thank god we got one sane person here explaining evo psych and how it ties into our sense of exceptionalism

You can already see stuff like reward hacking across deepmind and anthropoc research

Any extrapolation you make from biology presupposes an incredibly different set of optimization pressures than what we use to develop today's cutting edge systems

Regrettably “they” tell me I might be insane. 😂 but thank you 💕

The Farcaster formerly known as Kchamp. Books, beats, bodybuilding, bright ideas and beautiful things.

katherinechampagne.com

I think most rebuttals of ai doomerism are either not keen to extrapolate (all the issues we see today are just toy issues), pessimistic about even long-future capabilities of automated systems (ai will never get to the point where we have to worry, it will never get too smart), or misguided philosophically (eg it's okay if the ai kills us all, we deserve it, ai will never decide to act improperly etc etc)

I saw you saw my reply but I’ll echo what I said there — I often find them arrogant or, to add, naive 

(I used to be in camp naive)