The Power of Intelligence - An Essay By Eliezer Yudkowsky

The Power of Intelligence is an essay published by Eliezer Yudkowsky in 2007. Now, a few points: Sorting Pebbles Into Correct Heaps was about the orthogonality thesis. A consequence of the orthogonality thesis is that powerful artificial intelligence will not necessarily share human values. This video is about just how powerful and dangerous intelligence is. These two insights put together are a cause for concern. If humanity doesn’t solve the problem of aligning AIs to human values, there’s a high chance we’ll not survive the creation of artificial general intelligence. This issue is known as “The Alignment Problem“. Some of you may be familiar with the paperclips scenario: an AGI created to maximize the number of paperclips uses up all the resources on Earth, and eventually outer space, to produce paperclips. Humanity dies early in this process. But, given the current state of research, even a simple goal such as “maximize paperclips” is already too diffic