First we recaptulate standard x-risk argument: we build AI substantially smarter than humans → it becomes an autonomous optimizing agent → its goals are misaligned → instrumental convergence makes it seek power and resist…
A long, fascinating review of a book on what was perhaps the most horrible “civilization” in history.
This thought experiment has stuck with me ever since I read it. I think of it whenever I encounter a system that everybody hates but everybody is powerless to change, or some other stuck equilbrium or multipolar trap. When I first read it, the society he described sounded contrived and outlandish, but later I was to learn from my dear wife that the real world is far more outlandish than that thought experiment. The thing is that each of the societies chronicled in that book Jane reviewed is very small, very primitive, and very dysfunctional. What is so disturbing about the Mexica is that they were large, sophisticated, and oh-so-terribly functional. The streets of Tenochtitlan, as my elementary school textbooks told me, were wider and more beautiful than those of Paris or Seville. Their art, music, and poetry were sublime, their theology was subtle, and their intellectual life was vibrant. The Mexica would seem horrifying to us if they were barbarians. But I think they should be more horrifying precisely because they were not.
I knew they were awful, but hadn’t realized the extent of their cruelty. And the comparison with the Holocaust seems apt, except this was not just against a few disfavored groups, but all of society. It’s not clear whether that’s better, or worse.
This may be the most visionary and sensible NASA administrator ever.
[Update a while later]
Jared’s post was presumably in response to this:
Reading this is incredibly radicalizing. I want to do the exact opposite after reading this. It also oozes with AI-written prose. Fitting, as it’s anti-human and is intended to stop settlement of Mars. https://t.co/tHunJ5UX6s
I just watched Christopher Nolan’s #TheOdyssey and I left the cinema with a deep sense of disappointment. I entered expecting Homer’s world to breathe: salt in the air, darkness over the sea, gods watching from a distance, and a wounded man struggling to return home. Instead,… pic.twitter.com/qeoryve9b6
Groundhog Day is one of the most beloved films ever made. And yes, Andie MacDowell is cute and charming. But that is not why it hits a chord thirty years later with people who can’t quite explain why they keep rewatching it.
An interesting discussion on the implications of AI and robots. Read the whole thread.
Maybe unpopular opinion? I think an age of abundance via AI might cause more war instead of less, because the value of land on earth will trend toward infinity (there is finite land on earth), while the cost of creating robot armies to fight over it will trend toward zero.