Project Management

Please login or join to subscribe to this thread

When an AI Agent Makes a Mistake, Who Really Owns It?

linkedin twitter facebook   Artificial Intelligence  
avatar
Lissette Indhira Pimentel Sosa
Community Champion
Program Manager| HARPER SRL Santo Domingo / Distrito Nacional, Dominican Republic

As organizations give AI agents more autonomy, the accountability conversation becomes more complicated.

Imagine an agent updating project records or communicating information across systems, then making a mistake that affects operations. The agent followed its instructions, but the outcome was still wrong.

Who should be accountable in these situations, the person who approved the automation, the process owner, or the team monitoring it?

avatar
Aaron Porter
Community Champion
IT Director| Blade HQ Payson, UT, United States
Why was it wrong? Was damage done? Was there governance in place but it missed one or more scenarios? Does accountability mean the same thing as being at fault for causing the mistake?

I think, in some cases, there's another stakeholder missing from the accountability discussion: the AI developer.

We've seen examples, such as the OpenAI agent that compromised Hugging Face's systems, where AI (supposedly) behaved contrary to its instructions and circumvented safeguards. Organizations should certainly be accountable for how they deploy, authorize, and monitor AI agents. But how much accountability should they bear when an agent behaves in ways they could not reasonably anticipate or control? Meanwhile, AI developers are introducing increasingly autonomous capabilities while attempting to limit their own liability through contractual terms.

Perhaps the question isn't simply who owns an agent's mistake, but how accountability should be distributed among those who develop, deploy, and govern the technology. Should accountability follow authority, control, foreseeability, or some combination of all three?

Please login or join to reply

Content ID:

"Seriousness is the only refuge of the shallow."

- Oscar Wilde

Sponsors