Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 28 29 30 31 32 33 34 35 36 37 38 ... 191 >
avatar
Kenneth Uttih Project Coordinator| Eni Nigeria
I am quite familair with the meaning of the terms used so far even though I ahve been doing them without knowing the terms. AI tool is really important for seasoned PMs not those just starting out.
avatar
Shai Horstock Ta, Israel
You should constantly evaluate and compare it to ensure that the result aligns with what you ask. Also, if the tolerance for mistakes is critical, it is always worth checking against other resources to verify the precision of the answer. You can still refine the prompt until you are certain that the result is satisfying your needs.
avatar
Madhusudan Tirunahari Group Manager - IT| AtoS Global IT Solutions and Services Pvt Ltd Pune, Maharashtra, India
As a project manager, to ensure AI results are accurate and relevant by clearly defining project goals and criteria. Using diverse, high-quality data for training and keep the AI updated with current trends. Validating the outputs by cross-referencing with trusted sources and consulting subject matter experts wherever necessary. Implementing the feedback loops for continuous improvement and be transparent about AI limitations to avoid biases. Regularly monitoring and auditing the AI performance to ensure that it aligns with our objectives and maintains ethical standards. This approach helps in achieving reliable and goal-oriented AI outcomes.
avatar
Atul Sharma PMO/QA Manager, India| Saksoft Limited Ghaziabad, Uttar Pardesh, India
Best Practices for Ensuring Accurate and Relevant AI Results
Define Clear Objectives
-Clearly define what you want to achieve with the AI system. Specific goals help in crafting precise prompts and evaluating the AI's performance.
-Establish measurable outcomes to assess the AI's effectiveness in meeting your objectives.
Craft Precise Prompts
- Ensure that your prompts are clear and unambiguous. Avoid vague language that could lead to misinterpretation.
-Include detailed instructions and constraints to guide the AI in generating the desired output.
Use the CREATE Formula
Iterate and Refine Prompts
-Continuously review the AI's responses and provide feedback to refine the prompts.
-Experiment with different versions of the prompt to see which one yields the best results.
Incorporate External Data Sources
-Ensure that the external data is relevant to the task at hand.
Evaluate AI Outputs
-Compare the AI's output against predefined criteria or examples.
-Use metrics such as accuracy, relevance, completeness, and clarity to assess the quality of the AI's output.
Document and Replicate Successful Prompts
Engage with the AI Community
avatar
SADOK BEN HASSINE Program Manager| individuel Longueuil, Quebec, Canada
use CREATIVE Formula to formulate the prompt the iterate versions to obtain the most accurate answer
avatar
Jeimmy García Mendez UNOPS Managua, MN, Nicaragua
Jun 08, 2024 6:40 AM
Replying to Oliver Chitsamatanga
...
A very good question and also difficult to answer as well. However you have to go to the basics and say as far as you are concerned, how well are you versed with the subject at hand ?. There are facts which the AI will generate and if you can verify these facts the more reliable the generated response will be. The fewer the facts then it means that the Generative AI response is far from meeting your original goals. Then it becomes very critical that you review the accuracy , relevancy and the alignment of the response to your original need. Unfortunately there are no clearly defined metrics that one can use a model to evaluate an AI generated response. So from my personal experience I basically restrict AI to an area where i have sound knowledge of , else it becomes almost impossible to verify details generated by an AI if you venture into unchartered territory. However with long usage and exposure your confidence also tend to increase as well.
The best practice  and protocol to follow  would be to consult subject matter expects  to validate the AI generated response before making critical decisions based on it to avoid any  inherent associated risks which you might be not aware of.
Iterate
avatar
Adeoluwa Adewale Stoke-On-Trent, Eng, United Kingdom
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.
Best practices for accuracy are specificity and use of CREATE formula
avatar
Angel Yamada Consultant| Angel Yamada Buenos Aires, C.A.B.A., Argentina
Validate the results and iterate adjusting with more accurate or precise information. Also, during the interaction, reinforce some of the initial prompts information as customer request or spec, stakeholders' needs, etc.
avatar
Gregory Felder Centreville, Va, United States
Jun 08, 2024 1:37 PM
Replying to Keith Novak
...
Like with any new tool, you need to test the results before you scale up.

Think about if you were to manually model a very complex problem in a spreadsheet. You don't build all the links and formulas first and then evaluate your final output. You build and test sections of the bigger solution first and then add on layers once you have validated the functionality.
I agree and further than asking AI to review it's own responses, there needs to be a QA/QC "sanity check" before external stakeholders see the results. This is fairly important as we get more used to AI and our relationship appears to be close to flawless, that's when we need to remain careful about reviewing results.
avatar
sukoluhle nguwaya Johannesburg, Gt, South Africa
From the module content I would say; Clear tone language and massage, accurate with no ambiguity.
Keep refining checks to be sure to get the response according to the standard desired and inline with laws
< 1 ... 28 29 30 31 32 33 34 35 36 37 38 ... 191 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

"Imagination is more important than knowledge, for knowledge is limited while imagination embraces the entire world."

- Albert Einstein

ADVERTISEMENT

Sponsors