AI Product Manager (B2B) for PMI| Project Management Institute (PMI)Middletown, DE, United States
Hi PMI Community! I'm Kerry Brooks, a Product Manager at PMI, and we're looking to use your feedback to identify opportunities and gaps as we build a risk sentiment tool for project managers.
Risk management is widely considered one of the most important aspects of a project manager's role.
Effectively identifying, assessing, and mitigating risks can significantly impact the success of a project. It involves anticipating potential issues, analyzing their potential impact on the project's objectives, and developing strategies to minimize or eliminate these risks.
Imagine you have an AI-assisted risk application that can help you. How do you think it could be your secret weapon in handling risks?
From predicting hiccups to offering solutions, share your wildest AI-assisted risk management dreams! Saving Changes...
AI Product Manager (B2B) for PMI| Project Management Institute (PMI)Middletown, DE, United States
Mar 07, 2024 3:13 PM
Replying to George Freeman
...
Hi Kerry,
An “AI-assisted risk application” will/can only provide generic value, as it would require the following to surpass generalities:
[1] Cross-functional SME-level knowledge of the domains that will be traversed in the project. [2] A life-cycle-based understanding (development and business) of the proposed and/or running project. [3] A contextual understanding of the intersection of [1] and [2] across all phases of the project
That said, the generic (i.e., non-contextual) value of an “AI-assisted risk application” can still assist a project manager by challenging deeper contextually based dives into the stated generalizations. However, if one accepted the generalities as their definitive risk statements, this “secret weapon” would lend itself to the mass destruction side of the equation versus the positively formed secret weapon you referenced.
George Freeman - absolutely! Generic can provide direction, but true context and understanding is key. We're hoping to develop an organizational tool, that teams, product leaders, and executives feel comfortable sharing their project, program, and portfolio info so we can summarize project risks based on team sentiment and provide mitigation strategies to thwart or reduce those risks. To start, the risk mitigation steps may be high-level, but leveraging our Infinity AI platform in the background will hopefully help us provide more robust responses. Saving Changes...
AI Product Manager (B2B) for PMI| Project Management Institute (PMI)Middletown, DE, United States
Mar 07, 2024 2:25 PM
Replying to Rami Kaibni
...
Kerry Brooks: Good Question. An AI-Assisted Risk Application can help in many ways but it will be so valuable if it can do the following:
1) Customized Risk Profile tailored towards different stakeholders. This will ensure that the RM Strategies are aligned to the priorities of the different stakeholders.
2) Scenario Planning and Simulation: Providing different scenarios will enhance decision making and allow the team to assess the potential impact of different responses.
3) Automated Risk Responses: Not for everything, but for certain mitigation measures, the automation will help reduce the time lag between risk detection and remediation.
Rami Kaibni I appreciate your thoughts and input on ideas. We'll take note of those for future exploration. Your third point though, does match up with a hypothesis we're testing around capturing team sentiment on project progress and meeting those goals, identifying risks to getting there and then providing recommended mitigation steps. We'll definitely need to learn and evolve the tool to support, but it's a problem we're trying to address. Saving Changes...
Kiron Bondale - thanks for your thoughts on this topic. Identifying, managing and mitigating risks are so critical to the success of the project, yet, as you mention is a challenge for project leaders and their organizations. Our goal with our tool we'd like to test is to see if we can make that job a bit easier, build confidence in the project leader and organization around managing risks, and help them to mitigate risks early and often.
I'd definitely be interested in a risk-focused AI capability which could write risk event descriptions clearly articulating the cause and effect and in terms which would make risk response owners sit up and pay attention. It would also be ideal to have support in identifying hidden risks - shedding light on more of the unknown-unknowns.
Kiron Saving Changes...
Hong Jone WongProduct Manager| Centre for Strategic Infocomm TechnologiesSingapore, Singapore
I am thinking of using its ability to help us with Data Analysis and Predictive Modeling would be really great! Gen AI can analyze vast amounts of historical project data to identify patterns and predict potential risks. By analyzing past project outcomes, we can possibly use Gen AI to help anticipate similar risks in current projects, allowing us to proactively develop mitigation strategies. Or maybe even get it to propose some risk mitigation strategies too. Saving Changes...
Jari AnttilaPrincipal Consultant and Founder| Anttila ConsultingHelsinki, Finland
Mar 14, 2024 3:13 PM
Replying to Kerry Brooks
...
Hi Sergio - thanks for your response. We are looking to test a tool that helps us get to the unknown-unknowns. Our hypothesis is if we can synthesize project team sentiment to get to those "underlying uneasy feelings and issues" about how the project is progressing, and provide mitigation steps to manage them early, we may be able to help our project leaders keep the project on-track.
Hi Kerry Brooks,Sounds very interesting when trying to capture risk based on project team sentiment. Do you have ideas on how to collect the data that could be used to identify risks?
...
2 replies by Aung Sint and Sergio Luis Conte
Mar 16, 2024 6:25 AM
Sergio Luis Conte
...
Sorry for intervene. The key for using generative AI (ChatGPT for example) is to design the prompts (answers) in the right way. If you create a prompt in the right way generative AI can say you the sentiment (that is the word it is used. I do not like it) expressed in the text you add to the prompt or when generative AI analyze documents.. For example, this is widely used to analize customer feedback in service desk answers. Other example: we use it to calculate NPS (net promoter score) from surveys. For an AI entity (software or whatever) this is the most simple thing to do because is a matter of clasification. Remember: all in AI is probabilistic based on the knowledge base and to inference the best way to add existing text to the result, then what most companies forget is, when you use things like generative AI, almost a new business unit has to be created to work on results quality, including it lawyers, diversity specialist, etc. In the case of working with risks as Kerry wrote just to have people that validate the answers in terms of you are looking for is enough.
Mar 16, 2024 2:07 PM
Aung Sint
...
Assuming we have a large amount of data, for example, lessons learned database from past projects, it would help, but getting enough data to identify risks is a challenging task, in my opinion.
Saving Changes...
Sergio Luis ConteHelping to create solutions for everyone| Worldwide based OrganizationsBuenos Aires, Argentina
Mar 15, 2024 11:05 AM
Replying to Jari Anttila
...
Hi Kerry Brooks,Sounds very interesting when trying to capture risk based on project team sentiment. Do you have ideas on how to collect the data that could be used to identify risks?
Sorry for intervene. The key for using generative AI (ChatGPT for example) is to design the prompts (answers) in the right way. If you create a prompt in the right way generative AI can say you the sentiment (that is the word it is used. I do not like it) expressed in the text you add to the prompt or when generative AI analyze documents.. For example, this is widely used to analize customer feedback in service desk answers. Other example: we use it to calculate NPS (net promoter score) from surveys. For an AI entity (software or whatever) this is the most simple thing to do because is a matter of clasification. Remember: all in AI is probabilistic based on the knowledge base and to inference the best way to add existing text to the result, then what most companies forget is, when you use things like generative AI, almost a new business unit has to be created to work on results quality, including it lawyers, diversity specialist, etc. In the case of working with risks as Kerry wrote just to have people that validate the answers in terms of you are looking for is enough.
...
1 reply by Jari Anttila
Mar 16, 2024 4:06 PM
Jari Anttila
...
Thank you Sergio. We have the tools, but I was more referring the way of gathering the data to find out the current project sentiment and possible hidden risks. As you referred, we already analyze the sentiment of customer feedbacks. Now, how do do that for our internal project team. One way could be to collect feedback similarly as we do with customers, but getting answers can be challenging. To really dig the silent risks, we would need to access the raw data like meeting transcripts or Teams channel discussions.
Hi Kerry Brooks,Sounds very interesting when trying to capture risk based on project team sentiment. Do you have ideas on how to collect the data that could be used to identify risks?
Assuming we have a large amount of data, for example, lessons learned database from past projects, it would help, but getting enough data to identify risks is a challenging task, in my opinion.
...
1 reply by Jari Anttila
Mar 16, 2024 3:54 PM
Jari Anttila
...
Yes, I agree that the lessons learned from the past projects are important data to gain more insight to possible risks that you might face and how to potentially mitigate those. Instead, this approach don't identify the specifc risks that there in the current project. This is the aspect that I'm interested in and working with.
Saving Changes...
Jari AnttilaPrincipal Consultant and Founder| Anttila ConsultingHelsinki, Finland
Mar 16, 2024 2:07 PM
Replying to Aung Sint
...
Assuming we have a large amount of data, for example, lessons learned database from past projects, it would help, but getting enough data to identify risks is a challenging task, in my opinion.
Yes, I agree that the lessons learned from the past projects are important data to gain more insight to possible risks that you might face and how to potentially mitigate those. Instead, this approach don't identify the specifc risks that there in the current project. This is the aspect that I'm interested in and working with. Saving Changes...
Jari AnttilaPrincipal Consultant and Founder| Anttila ConsultingHelsinki, Finland
Mar 16, 2024 6:25 AM
Replying to Sergio Luis Conte
...
Sorry for intervene. The key for using generative AI (ChatGPT for example) is to design the prompts (answers) in the right way. If you create a prompt in the right way generative AI can say you the sentiment (that is the word it is used. I do not like it) expressed in the text you add to the prompt or when generative AI analyze documents.. For example, this is widely used to analize customer feedback in service desk answers. Other example: we use it to calculate NPS (net promoter score) from surveys. For an AI entity (software or whatever) this is the most simple thing to do because is a matter of clasification. Remember: all in AI is probabilistic based on the knowledge base and to inference the best way to add existing text to the result, then what most companies forget is, when you use things like generative AI, almost a new business unit has to be created to work on results quality, including it lawyers, diversity specialist, etc. In the case of working with risks as Kerry wrote just to have people that validate the answers in terms of you are looking for is enough.
Thank you Sergio. We have the tools, but I was more referring the way of gathering the data to find out the current project sentiment and possible hidden risks. As you referred, we already analyze the sentiment of customer feedbacks. Now, how do do that for our internal project team. One way could be to collect feedback similarly as we do with customers, but getting answers can be challenging. To really dig the silent risks, we would need to access the raw data like meeting transcripts or Teams channel discussions.
...
1 reply by Sergio Luis Conte
Mar 17, 2024 6:50 AM
Sergio Luis Conte
...
For us, "client/customer is the next on the process chain" so we collect feedback from all customers in the same way. In the other side, for example, you can use meetings recording (video and transcripts) to collect feedback BUT IF AND ONLY IF you put in place policies and rules about that and each time you will start the recording you notice to everybody about that. You can collect feedback from emails and from comments in project site (yammer, ms team, whatever you use). There are lot of way to collect feedback. The generative AI architecture published by Google in 2015 has democratized the information and is just a matter to imagine it. BUT because of that I wrote in my first comment that one thing is mostly forgotten is that when organizations start using generative AI almost a new business unit has to be created (I am using almost for not being category) where you have to put there not only technical people but other roles like lawyers, diversity and inclusion specialist, linguistic, etc, etc. The cost is higher not because the tools, the tools are for free, because the associated structured you need to create not matter you use it internally.
AI will help Project Managers in multiple areas inclusive of Risk Management. It primarily helps to save our effort on thinking and identifying the risks for the given project type (of course based on its trained data) along with the mitigation and contingency actions.
PM can review them and choose the most appropriate risks. If any additional risks PM / Team can find they can add them also to the risk register.
One caveat:
Employers/customers may not allow PMs to use generic AI tools (due to data leakage concerns) available on the Internet like ChatGPT. If any internally used tools have AI capabilities then this capability provides a fast working arm to PM. Saving Changes...