Superintelligence and the Ethics of Autonomous Systems
1) How do humans make ethical decisions (cross-cultural vs culture specific)?
2) Interactions within human-machine teams must be comprehensible, predictable and intuitive (natural language interaction, common mental models, learning).
3) What is the path to machine superintelligence and does it need emulate human intelligence? Will we recognize it when it occurs?
Background Materials focus on what the issues are when we get there, not on how to get there:
Robot Car of Tomorrow May Just Be Programmed To Hit
you. Patrick Lin, WIRED, May 6, 2014
Systematically lays out issues and scenarios possible in the relatively short-term.
Musk and Bill Gates on Dangers of Artificial Intelligence. https://youtu.be/qetcWN8iWT0
Bill Gates’ 2 minutes of worthwhile comments start at 2’20” into the video and sets up the Nick Bostrom TED talk in supplemental materials.
of Machine Intelligence. Nick Bostrom TED talk, What happens when our computers get smarter than we are? https://youtu.be/MnT1xgZgkpk .
Bostrom’s linear thinking assumes human-level artificial intelligence is on the critical path to superintelligence. However there are many probable paths that are unlike human AI.
2) Excellent but long New Yorker article puts Bostrom and the “transhumanists” in a much larger scientific / technical context. The Doomsday Invention: Will artificial intelligence bring us utopia or destruction? Raffi Khatchadourian, November 23, 2015.