Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 200 201 202 203 204 205 206 207 208 209 210 ... 219 >
avatar
Sanjay Singal Surrey, British Columbia, Canada

1. Iterative Refinement

2. Clear and Specific Instructions

3. Structured Formulas: RTF (Role, Task, Format) or CREATE (Character, Request, Examples, Adjustments, Types of output, Evaluation)

4. Validation Checks

5. Provide Context and Eliminate Irrelevant Information

6. Confidential and Ethical Use

7. Regular Feedback for Continuous Improvement

avatar
Amal Kumar Sahu Bangalore, India
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.

Everything you said is correct in theory. In practice, I see organizations fail because they treat this as a technology roadmap item instead of an organizational transformation. They hire lawyers after the model breaks. They bring in diversity consultants after the bias incident. By then, trust is already damaged. The sequencing matters.

avatar
Navid Majidinejad TORONTO, ONTARIO, Canada
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.

avatar
Gabriela Rubio Carbajal Project Manager| Universidad Panamericana Mexico, D.F., Mexico
Jun 12, 2024 1:31 AM
Replying to Jabin Geevarghese George
...

When using AI systems is very hard to set the precision or accuracy of the responses. I love bringing in the Agile mindset here pretty much imagine if you are mentoring someone you do a Q&A and based on the reponses of your Mentee you give the feedback so that Mentee can align his/her thoughts in the direction that we hint similarly review the AI responses and using our rationale judgement





1- Give Feedback to the AI system



2- Rework on your promp and be specific on what is expected



3- Keep it short and conscise, guage the responses and slowly we can tune the AI system in a way to get the best output



4- Now the Tech. Solution that comes in for accuracy is havig specific set of APIs that talk to real and accurate data sources or use 2-3 outputs of LLMs and then analyze and bring the best in output.

I agree, I feel more confident with this strategic, I'm just starting with AI help for my projects and probably i the future I'll try diferrents aproach, so far this is the best way for me
avatar
Tushar Matkar Mississauga, Ontario, Canada
Give the best possible prompt to start with and then ask it to adjust according to your need.
avatar
Bassam Alwarith Knowledge Economic City Vienna, Va, United States
Jun 12, 2024 1:31 AM
Replying to Jabin Geevarghese George
...

When using AI systems is very hard to set the precision or accuracy of the responses. I love bringing in the Agile mindset here pretty much imagine if you are mentoring someone you do a Q&A and based on the reponses of your Mentee you give the feedback so that Mentee can align his/her thoughts in the direction that we hint similarly review the AI responses and using our rationale judgement





1- Give Feedback to the AI system



2- Rework on your promp and be specific on what is expected



3- Keep it short and conscise, guage the responses and slowly we can tune the AI system in a way to get the best output



4- Now the Tech. Solution that comes in for accuracy is havig specific set of APIs that talk to real and accurate data sources or use 2-3 outputs of LLMs and then analyze and bring the best in output.

good analogy .. the ones who have good communication skills, such as clearly stating whats needed and providing the right context along with giving feedback and generously collaborate in the iterations will do best in prompts effectiveness and efficiency.
avatar
Abder Rauf Khraim Project Management| Kiewit Construction Vaudreuil-Dorion, QUEBEC, Canada
It’s important to start with a clear goal and provide the AI with enough detail and context so it understands what we are trying to achieve. Using a structured prompt framework, such as the CREATE formula, can help organize the information and provide a strong starting point. The results should always be reviewed rather than accepted automatically. I would also verify important information using reliable sources, ask follow-up questions when something is unclear, and refine the prompt if the response is too broad or off target. AI can be a very useful support tool, but human judgment is still essential to make sure the final result is accurate, relevant, appropriate for the situation, and to the point.
avatar
Anonymous

Fully agree with the thoughts shared by Managers above. Our prompts should be clear, concise and mention how the outcome we want.

avatar
Ugochukwu Lean Asiegbu Senior Project Management| The Presidential Concierge Johannesburg, GT, South Africa
Start with clear objective and provideAi with the right context.
Always validate the output against reliable infomation, check for inaccuracys and ensure it aligns with the original goal.
Ai can support better decisions but human judgement and accountability should remain at the centre.
avatar
Angela De Padova Data Governance specialist | Master Data Manager | IT Project Manager| freelance Milano, Italy

Checking response based on my experience/Knowledge and giving suggestion to avoid same mistakes in next iteration

< 1 ... 200 201 202 203 204 205 206 207 208 209 210 ... 219 >

Please login or join to reply

Content ID:

"If you don't know where you are going, you might wind up someplace else."

- Yogi Berra

Sponsors