Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 91 92 93 94 95 96 97 98 99 100 101 ... 191 >
avatar
John Mazzaferri PM III| Fast Switch Prospect Heights, Il, United States
You will need to validate the output to ensure that they are in sync with the company standards, ethics, and goals. Refine the prompts as necessary.
Jun 08, 2024 6:40 AM
Replying to Oliver Chitsamatanga
...
A very good question and also difficult to answer as well. However you have to go to the basics and say as far as you are concerned, how well are you versed with the subject at hand ?. There are facts which the AI will generate and if you can verify these facts the more reliable the generated response will be. The fewer the facts then it means that the Generative AI response is far from meeting your original goals. Then it becomes very critical that you review the accuracy , relevancy and the alignment of the response to your original need. Unfortunately there are no clearly defined metrics that one can use a model to evaluate an AI generated response. So from my personal experience I basically restrict AI to an area where i have sound knowledge of , else it becomes almost impossible to verify details generated by an AI if you venture into unchartered territory. However with long usage and exposure your confidence also tend to increase as well.
The best practice  and protocol to follow  would be to consult subject matter expects  to validate the AI generated response before making critical decisions based on it to avoid any  inherent associated risks which you might be not aware of.
SME verification sounds about right in that context.
avatar
NATHALIA PADILLA Manta, M, Ecuador

To ensure AI-generated results are accurate, relevant, and aligned with original goals, project leaders should apply four key best practices:



Define Clear Objectives – Start with well-scoped prompts that reflect business context and intended outcomes.



Use Iterative Prompting – Refine inputs progressively to steer the AI toward higher-quality outputs.



Validate with Domain Expertise – Cross-check AI results against real data, stakeholder expectations, and subject-matter knowledge.



Monitor for Bias and Drift – Regularly assess outputs for consistency, especially when dealing with evolving project goals.



When used responsibly, these practices position AI not just as a tool, but as a strategic partner in decision-making and value delivery

As a relatively young person who grew up in an era where everything revolved around searching on Google, I remember that the better you were at finding the right combination of words—short and focused enough on your problem—the more of a 'Googling master' you were. Now, it’s quite the opposite, and shifting that mindset feels strange. We've gone from trying to search with 3 to 10 keywords on Google to sharing an entire context, where the hard part is figuring out what's enough.


 

What has worked for me is focusing my prompts based on the area where the information will be used. In other words, it’s not the same if a developer is reading it versus the QA team. That way, even though the tasks are used across teams, each prompt is shaped for the specific audience to properly cover all aspects of a task.

avatar
Santosh Giri Functional Manager| WSP Consultants India Private Limited Bangalore, India
I found the response from GenAI sometime generic to specific question coz LLM may not have such specific data. In this scenario user should do through check the response and finetuned to suit the requirement. Most of the time user should rephrase the prompt very specific and clear to get the relevant response.
avatar
Mohamed E Makki Abu Dhabi, AZ, United Arab Emirates
reviewing what the AI generated and checking
avatar
Anonymous
reviewing what the AI generated and checking
avatar
YU-LING HSIAO Project Manager| OmniHealth Group Inc. Taiwan
Jun 08, 2024 1:37 PM
Replying to Keith Novak
...
Like with any new tool, you need to test the results before you scale up.

Think about if you were to manually model a very complex problem in a spreadsheet. You don't build all the links and formulas first and then evaluate your final output. You build and test sections of the bigger solution first and then add on layers once you have validated the functionality.
This is not a reasonable approach because it is too risky to directly build all the connections and formulas without being able to confirm that each step is correct. You should first test each part in sections, verify the functions, and then gradually expand the entire model.
avatar
Ileana Stanciu SAP Senior Project Management| Siemens Healthcare
Adress a clear request providing information on the context, check the answer and iterate if needed.
Always verify the correctness of the answer provided
avatar
Valerian Andrews Project Management| Fresenius Kabi Etobicoke, ONTARIO, Canada

When providing instructions to AI, we need to ensure Instructions are clear structured and descriptive.



●Instruction - a specific task or instruction you want the model to perform
●Context - external information, Persona or additional context that can steer the model to better responses
●Input Data - the input or question that we are interested to find a response for
●Output Indicator - the type or format of the output
●Response Tone – Tone of the response

< 1 ... 91 92 93 94 95 96 97 98 99 100 101 ... 191 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

"The man who does not read books has no advantage over the man that can not read them."

- Mark Twain

ADVERTISEMENT

Sponsors