Superintelligence and the Ethics of Autonomous Systems



1)     How do humans make ethical decisions (cross-cultural vs culture specific)?

2)     Interactions within human-machine teams must be comprehensible, predictable and intuitive (natural language interaction, common mental models, learning).

3)     What is the path to machine superintelligence and does it need emulate human intelligence? Will we recognize it when it occurs?


Background Materials focus on what the issues are when we get there, not on how to get there:

1)     The Robot Car of Tomorrow May Just Be Programmed To Hit you. Patrick Lin, WIRED, May 6, 2014
Systematically lays out issues and scenarios possible in the relatively short-term.

2)     Elon Musk and Bill Gates on Dangers of Artificial Intelligence. 
Bill Gates’ 2 minutes of worthwhile comments start at 2’20” into the video and sets up the Nick Bostrom TED talk in supplemental materials.


‪Supplemental Materials:

1)     Future of Machine Intelligence. Nick Bostrom TED talk, What happens when our computers get smarter than we are? .
Bostrom’s linear thinking assumes human-level artificial intelligence is on the critical path to superintelligence. However there are many probable paths that are unlike human AI.

2)     Excellent but long New Yorker article puts Bostrom and the “transhumanists” in a much larger scientific / technical context. The Doomsday Invention: Will artificial intelligence bring us utopia or destruction? Raffi Khatchadourian, November 23, 2015.