Project Management

Please login or join to subscribe to this thread

What auditability challenges have you encountered when developing AI systems iteratively?

linkedin twitter facebook   Agile   Artificial Intelligence   Ethics  
avatar
Stelian ROMAN Project Manager| MicroSafety Carlingford, New South Wales, Australia

The acceleration of artificial intelligence (AI) development has made Agile methodologies, especially Scrum Sprints, a common approach for building and refining AI models. While Sprints offer rapid iteration and delivery, they also present unique risks—chief among them is the potential for bias to creep into AI models. Bias can undermine model fairness, erode user trust, and cause real-world harm when deployed. As teams race against the clock, vigilance is required to detect and mitigate biases before models reach production. This blog post explores the challenges posed by bias in sprint-driven AI development, offers practical recommendations, and closes with key takeaways and reflective questions for practitioners.

  1. What auditability challenges have you encountered when developing AI systems iteratively?
  2. Which tools or practices have you found most effective in maintaining a clear audit trail?
  3. How do you see auditability requirements evolving as AI systems become more complex and autonomous?

Blog post: Auditability of AI Systems Developed Iteratively

ProjectManagement.com - The Agile Enterprise

Sort By:
avatar
Luis Branco CEO| Business Insight, Consultores de Gestão, Ldª Carcavelos, Lisboa, Portugal
An important question.
I wonder whether the greatest auditability challenge is not reconstructing how an AI system evolved, but understanding why it evolved that way.

Version histories, datasets, model artefacts and deployment logs are essential.
Yet an audit often becomes far more meaningful when it can also trace the reasoning behind key decisions: why certain objectives were prioritised, why specific trade-offs were accepted, why one model was chosen over another, or why a particular level of risk was considered acceptable at that point in time.

Perhaps the future of AI auditability is not just preserving evidence of change, but preserving the decision rationale that shaped those changes.
After all, true accountability requires more than knowing what happened.
It requires understanding the judgment that made it happen.
avatar
Lissette Indhira Pimentel Sosa
Community Champion
Program Manager| HARPER SRL Santo Domingo / Distrito Nacional, Dominican Republic
I think maintaining version history for models, datasets, prompts, and key decisions will become increasingly important as AI systems become more autonomous.
Good traceability will be just as important as model performance for governance, compliance, and trust.

Please login or join to reply

Content ID:
ADVERTISEMENTS

"One man alone can be pretty dumb sometimes, but for real bona fide stupidity there ain't nothing can beat teamwork."

- Mark Twain

ADVERTISEMENT

Sponsors