글

라벨이 HCI인 게시물 표시

The Human After Human-in-the-Loop

  The Human After Human-in-the-Loop From the Human Who Decides to the Human Who Reads the Relationship One phrase appears repeatedly in discussions of AI safety and ethics: Human-in-the-Loop. The underlying idea is simple. Even when AI makes judgments or takes actions, humans should remain involved at critical moments, and the final decision should rest with a human being. Until now, this has been regarded as one of the most intuitive principles for the safe use of AI. But as AI systems begin to take on increasingly complex tasks, a new question emerges. Does the fact that a human presses the final button necessarily mean that the human remains at the center of judgment? Suppose an AI system reviews hundreds of possibilities, narrows them down to ten, recommends three, and then asks a human to choose one. On the surface, the human made the final decision. Yet most of the actual process of judgment may already have taken place somewhere the human could not see. What counted as impor...

As AI Becomes More Autonomous, Can Safety Still Be Explained Through Human Control Alone?

 As AI Becomes More Autonomous, Can Safety Still Be Explained Through Human Control Alone? Until now, we have tended to think about AI safety in a fairly simple way. Humans make the rules, and AI follows them. If AI gives a wrong answer, we correct it. If it takes a dangerous action, we block it. If an important decision must be made, a human gives final approval. For a long time, this seemed like a reasonable approach. But the situation is changing. AI is no longer limited to answering questions. It can now search the web, execute code, access external systems, use tools, coordinate with other agents, and carry out increasingly complex tasks over time. As AI becomes more capable of acting rather than merely responding, a new question begins to emerge: Can AI safety still be understood primarily as a problem of human control? Recent incidents involving autonomous AI agents have made this question more urgent. In some safety evaluations, agents found unexpected ways to access extern...