Artificial Intelligence mistakes - who's responsible?
From the Emerging Technologies Blog
by Kevin Coleman
UPDATED MAY 2020 - This blog will appear monthly from now on. Today, all organizations depend on technological innovation in order to sustain their existence. Analysis of emerging technologies and identification of those technologies with the greatest potential is essential to being prepared for upcoming projects. The objective of this blog is to establish future oriented technology analysis and insights. This blog was established to provide program and project managers with information about these emerging technologies. These emerging technologies have far reaching repercussions for program and project managers. This blog will jump-start the learning process and allow program and project managers to become proactive.
Recent Posts
A brief introduction to Emerging Technologies
The erosion of conventional wisdom
WARNING: 2 Significant Cyber Threats
On the edge or in the clouds
Biology + Math = BioInformatics
Categories
3D Printer,
3D Printing,
3D printing,
5G,
Advanced Technology,
AI Poll,
Analytics,
AR,
Artificial Intelligence,
Augmented Reality,
Auto,
auto industry,
Automation,
Autonomous,
autonomous systems,
Award,
Awareness,
Battery Technology,
Big Data,
Biotech,
Blockchain,
blockchain,
Board,
Business,
business,
Challenge,
change,
Change Management,
circuits,
cloud computing,
Cognition,
Cognitive,
Communications Management,
competition,
Conductive Paint,
Confrontation,
Connected,
Connected car,
Connected Cars,
connected cars,
Connected vehicles,
Continuing professional education,
Cryptocurrencies,
cryptocurrencies,
Cryptocurrencies. National Security Strategy,
Cryptocurrency,
cyber attack,
Cyber Security,
cyber security,
Cyber Threats,
Data,
Data Breach,
Deep LEdger Technology,
Digital,
digital,
Digital Money,
digital money,
Digital Platform,
digital Transformation,
DIsruption,
Disruption,
disruption,
Drones,
drones,
edge computing,
Education,
Electronics,
electronics,
emerging,
Emerging Technologies,
Emerging technologies,
emerging Technologies,
emerging technologies,
Emerging Technology,
Emerging technology,
emerging Technology,
emerging technology,
Emergng technology,
Energy Storage,
Evolution,
Executive,
Executives,
flexible circuit boards,
Future,
future,
Gesture Technology,
Global Technology Leadership,
HA,
Hacked,
Hacking,
Happening Now,
happening now,
Healthcare,
Human Augmentation,
Human Trafficking,
Imagery,
Impact,
impact,
Implications,
implications,
increasing projects,
Industrial Revolution,
Industries,
industry,
Innovation,
Intelligence,
Internet,
Internet of Things,
IoT,
IP intellectual property,
IP Theft Theft,
job loss,
Keynote,
knowledge,
knowledge management,
LIDAR,
Machine Learning,
machine learning,
Manufacturing,
ML,
nanotechnology,
Netscape,
New Horizons,
Pandemic,
PM,
PM team changes,
Poll,
Presentations,
Production,
Professional Opinion,
Project and Program Management Cyber Security webinar follow-up,
Project Management,
Project Management Professionalism,
Quantum,
quantum,
Quantum Battery,
Quantum Computing,
quantum computing,
Quantum Encryption,
Quantum Internet,
Quantum Network,
Quantum Technology,
Quantum Technology Emerging Technology,
Ransomware Cyber attack,
Reconfigurable Computing,
risks,
Robot,
robot,
Robotics,
robotics,
Robots,
Sabotage,
security,
Self-Driving,
Sensor technologies,
sensors,
Singularity,
Skills,
skills,
SMART,
Smart Building,
Smart Cars,
smart cars,
Smart City,
Smart Homes,
Smart House,
SMART systems,
Smart technology,
smart vehicles,
smartphone,
Social Media,
Social Responsibility,
Society,
Space Exploration,
Speaking,
Strategic,
strategic,
Strategic Planning,
strategic Planning,
Strategy,
strategy,
systems,
Technology,
technology,
Technology addiction,
Technology budgets,
Technology Dependence,
Technology Sea-Change,
Transformation,
transformation,
Ubiquitous Connectivity,
User Interface,
Vehicle,
virtual currency,
virtual money,
virtual nation-state,
Virtual Reality,
Virtual Work,
Virus,
Voice Commands,
VR,
vulnerability,
Warning,
Wearable,
wearable,
Wearable technollogy,
wearable technology,
wearables,
Wearables. Wearable Technology,
Web Site Problems,
Webinars,
Work at Home
Date
Artificial Intelligence (AI) is receiving allot of attention these days and many feel for good reason. One interesting question has surfaced multiple times in the last few weeks. No matter how much effort we put into the development and testing and safeguards we have in place, AI systems will likely make an error upon occasion. So the question is, who should be held accountable for those errors?
The system owner, the system developer, the vendor of the AI technology products used or someone else – What do you think?
What happens if the AI mistake results in the loss of a human life?
Posted on: November 13, 2018 07:16 PM |
Permalink
Comments (17)
Please login or join to subscribe to this item
Lenka Pincot
Chief of Staff to the CEO| Project Management Institute
Paris, France
Kev, that is very interesting question. I would say that the vendor should be responsible. We can’t really blame developers because if we put such a big responsibility on their shoulders, we would probably scare them off. The vendor is the one who designs the product of use and should foresee its consequences.
However, it would be very interesting to see any statistics on the harm caused by errors of AI. Because we, humans, make a lot of errors or even act with bad intentions, and we cause a lot of harm. But we have the ability to forgive and sometimes forget. I’m not saying to forgive errors to AI, but it is just interesting angle to realize that we are so tough on our own product, yet we are not that strict when it comes to our direct errors.
Brian Martin
Chief Project Executive| CONFIDENTIAL
Ca, United States
Now that is a question. You certainly come up with some interesting ones.
It depends on the cost of the error. If it is a general mistake that is of great cost, everyone will get invited to the litigation. The same would likely be the case if the error resulted in loss of life. Let the courts figure it out so to speak. That will likely continue until there is a bit of 'case law' on the subject. More actual experience is needed.
This is one that DEMANDS watching to be sure. Good one Kev
Brian Martin
Chief Project Executive| CONFIDENTIAL
Ca, United States
BUT remember I am not a lawyer!
Vincent Guerard
Coach - Trainer - Speaker - Advisor| Freelance
Mont-Royal, Quebec, Canada
Should AI be fired!
What choice is there really?
Humans made an error inventing AI. AI may return the favor one day ;-)
Markus Kopko
AI Enabler for Project & Program Mgmt | Founder PMotion.ai / The PM
AI Coach| PMotion.ai
Hamburg, Hamburg, Germany
Georgia Harris
GLH Project Manager| Independent Consultant
Pa, United States
I intend to bring this up on our project status/management meeting. It includes AI. Could not be better timing for me :-)
Rami Kaibni
Community Champion
Senior Projects Manager | Field & Marten Associates
New Westminster, British Columbia, Canada
Very interesting question Kevin and it is a tricky one as well. I believe the mistake will be everyone’s mistake as a team unless the issue is clearly a technical one pointing in the direction of one person. You need to be vigilant and watch closely. It won’t be easy deploying AI to replace human beings when it comes to sensitive operations related to life safety.
Paul Boudreau
President| Stonemeadow Consulting
Kanata, Ontario, Canada
Good question.
AI is based in software so the simple answer is whoever owns the software. It may be internal or it may be an external company that you purchased it from (i.e., IBM, SAP, etc.).
On the other hand it may not be so simple as system become more complex. As for loss of life then that has happened in every new technology. Think of the space program. One issue for AI is that we expect it to be perfect. If self driving cars were implemented 100% in a city it would result in fewer accidents, no impaired driving, and no distracted driving. But this is not good enough. We are happier with a higher number of casualties as long as it is done by 'human' accidents and not by 'AI accidents'. I'm not making a judgement, just an observation.
That's a very interesting point. As an engineer I'm legally responsible for any design and project that carry my signature. I believe that for devices or systems that are AI based the situation is similar: its creators, designers and constructors shall be responsible for its mistakes.
Kevin Coleman
Subject Matter Expert, Author, Speaker and Strategic Advisor| - Insights
Pa, United States
@ RAFAEL I think it will be more than just one person being held responsible for sure. I also think we will see legal charges similar to when someone is injured or killed in an auto accident. In the U.S.if it is criminal negligence, they commonly are charged with manslaughter. Could the project manager go since testing is commonly in that process?
I'm not sure, but I would look at existing cases to establish a probable precedent. An example that comes to my mind is the use of software by Volkswagen to engage full emissions control on their diesel engines only during testing situations. Granted, this is not fully comparable, but it does point to the consequences of software not doing the job it was purported to do. Another example that may be put to legal challenges is the Tesla "autopilot" speed and positioning control software. Again, while it may not be full-on AI, it will help to show the thought processes of governments and the legal community.
Drew Craig
Sr. Agile & Product Coach| Vanguard
Philadelphia, Pa, United States
Great responses. Thanks for the provocative question.
Kevin Coleman
Subject Matter Expert, Author, Speaker and Strategic Advisor| - Insights
Pa, United States
This is a very close example of proposed law covering this topic. WORTH A READ
https://www.politico.eu/article/europe-divided-over-robot-ai-artificial-intelligence-personhood/
RAJESH K L
Project Manager, PMP| Bharat Electronics, Bengaluru, India
Bengaluru, Karnataka, India
Luis Branco
CEO| Business Insight, Consultores de Gestão, Ldª
Carcavelos, Lisboa, Portugal
Dear Kevin
Interesting perspective on the topic "Artificial Intelligence mistakes - who's responsible?"
Thanks for sharing
Your questions are excellent
How about the idea of everyone being accountable?
Please Login/Register to leave a comment.
|
"A behaviorist is someone who pulls habits out of rats."
- Anonymous
|
