I find that P(doom) has nothing to do with how likely the world is going to end -- (obv no one can predict this with any remotely accurately take) 

I think it's a metric of how much existential angst that an AI Researcher is feeling on that particular day

creating and destroying; built flying cars & autonomous vehicles, now building /faust, more here: /july, web: july.rocks

I absolutely agree. I believe it is quite common and part of human thinking that artificial intelligence could replace us and even eliminate us. It reminds me of what a person who works on an assembly line, or a taxi driver, might think of a more remote but still possible future. However, this remains very unlikely if we bring everything back to an earthly level, where beliefs and hatred between peoples will do an even more disturbing job than what artificial intelligence could do.