When – not if – the machines became more intelligent than humans, might they turn on their creators? Could we unintentionally create a self-aware AI that has its own motivations and goals? These queries, while they may seem the realm of dystopian science fiction, are now full front and center in the debates about the dangers of giving AI systems autonomy, demanding answers about how to ensure that AI systems remain aligned with human values and objectives.