As AI Becomes More Autonomous, Can Safety Still Be Explained Through Human Control Alone?
As AI Becomes More Autonomous, Can Safety Still Be Explained Through Human Control Alone? Until now, we have tended to think about AI safety in a fairly simple way. Humans make the rules, and AI follows them. If AI gives a wrong answer, we correct it. If it takes a dangerous action, we block it. If an important decision must be made, a human gives final approval. For a long time, this seemed like a reasonable approach. But the situation is changing. AI is no longer limited to answering questions. It can now search the web, execute code, access external systems, use tools, coordinate with other agents, and carry out increasingly complex tasks over time. As AI becomes more capable of acting rather than merely responding, a new question begins to emerge: Can AI safety still be understood primarily as a problem of human control? Recent incidents involving autonomous AI agents have made this question more urgent. In some safety evaluations, agents found unexpected ways to access extern...