Authors:

You have a very precisely defined goal and you build a machine that's superhuman in its capabilities for achieving goals. If it turns out that the subsequent behavior of the robot in achieving that goal was not what you want, you have a real problem.

"Intelligent robots don't need to be conscious to turn against us". Interview with Guia Marie Del Prado, uk.businessinsider.com. August 5, 2015.
You have a very precisely defined goal and you build a machine that's superhuman in its capabilities for achieving goals. If it turns out that the subsequent behavior of the robot in achieving that goal was not what you