To read Part One, click here.
Nick Bostrum’s Superintelligence is considered to be a seminal work in the artificial intelligence community. In it, he paints a rather dystopian view about where AI-empowered computers and robots are going to take us (or, more precisely, how they’re going to shove us all over a cliff).
One of the reasons these machines are supposed to be so terrifying is that they have nothing to lose. They don’t feel pain. They have no familial connections. You can’t threaten them, bribe them, or coerce them. As Bostrum puts it, these machines “might not have anthropomorphic goals”, which essential means that humanity’s final achievement will be to create the world’s biggest asshole. An object that will ruthlessly destroy its creator.
(more…)