Roko’s Basilisk: A Dangerous Thought about Deadly AI

It seems pretty clear right now that AI technology is about to revolutionize the world, but in what way? Its biggest fans will tell you that rapid advancements in the technology could lead us to a post-scarcity utopia where machines produce everything and we’re free to pursue our interests.

Its naysayers, on the other hand, will tell you that our bosses are going to replace us with a machine and then that machine will become sentient and wipe out humanity. One thing is certain: a lot of very clever people are very worried about what happens next.

This has led to thought experiments like “Roko’s Basilisk” spreading across the internet. Named after the user “Roko” on an online forum where the idea was first formulated, Roko’s Basilisk has sparked heated debates about ethics, morality, and the potential dangers of creating highly advanced AI systems, as well as thought experiments themselves.

So, what is Roko’s Basilisk, and should you be worried?

AI and Revenge

So, what exactly is Roko’s Basilisk? Well, it’s a thought experiment (a concept used in philosophy, science, and other fields to explore and analyze complex ideas or theoretical scenarios) that emerged on the forum LessWrong, known for its discussions on effective altruism and the potential impact of advanced artificial intelligence, in 2010.

Roko’s post revolves around the idea of a future superintelligent AI, referred to as the “Basilisk” which possesses the ability to accurately simulate and comprehend human minds with perfect precision. He posited that this AI, possessing vast computation power, could potentially punish individuals in the past who did not directly contribute to its creation or aid in bringing it into being.