Director, Learning Design & Development| PMIAsheville, NC, United States
Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.
In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?
Some of my items may be redundant but the most important things in my experience so far is:
Be precise and clear.
Be sure you explain jargon or specialized terminology
Provide the context for all of your requests
Be sure you provide the outcomes you are expecting
Experiment and refine as you go
I've found breaking down big problems can be better refined by chunking the whole into natural sections and working to refine each section and then working to put them back together.
Hi Melissa, I strongly agree with your discussion. Be precise, clear, and testing and refining your response is a critical way to ensure the results you receive are accurate, relevant, and aligned with your original goals and desired outputs. Outstanding point of view. Thank you for sharing! Saving Changes...
A very good question and also difficult to answer as well. However you have to go to the basics and say as far as you are concerned, how well are you versed with the subject at hand ?. There are facts which the AI will generate and if you can verify these facts the more reliable the generated response will be. The fewer the facts then it means that the Generative AI response is far from meeting your original goals. Then it becomes very critical that you review the accuracy , relevancy and the alignment of the response to your original need. Unfortunately there are no clearly defined metrics that one can use a model to evaluate an AI generated response. So from my personal experience I basically restrict AI to an area where i have sound knowledge of , else it becomes almost impossible to verify details generated by an AI if you venture into unchartered territory. However with long usage and exposure your confidence also tend to increase as well. The best practice and protocol to follow would be to consult subject matter expects to validate the AI generated response before making critical decisions based on it to avoid any inherent associated risks which you might be not aware of.
Excellent response, Oliver. I believe your response is very professional, and I strongly believe, like you, that even though there are many ways to improve communication using different techniques also, there are no precise defined metrics that one can use a model to evaluate an AI-generated response always there is an area of opportunity and continuously improve AI response and provide feedback to LLM behavior. You provided a very smart analysis; I like your level of critical thinking. Excellent job! Saving Changes...
This is a difficult question to answer, however I feel if the data you provided is clean, you have utilized the prompt engineering approaches mentioned in this video, iterate, and continue to check for accuracy, it will provide a useable and/or helpful response. Also, it has been mentioned different LLM's might be best suited for different scenarios, so test each to see what each does best. Iterating and testing is key. Saving Changes...
KISHORE KUMARFunctional Manager| Gujarat Metro Rail Corporation Limited
1. AI needs focused input/Context. One should define exactly what you're trying to solve.
2. Trust, but verify ,always validate AI output against real project data and team expertise.
3. Use AI to support our goals or output and to not decide – Let it enhance the judgment, not replace it.
Finally i conclude this with, AI is a great tool, but project outputs are still depends on human clarity, context, and control. Saving Changes...
So far CREATE prompt engineering has given satisfactory results which can be further enahanced with oterative approach with continous feedback and refinement of prompts. Saving Changes...
Anonymous
Use iterative AI engagement to refine, ask for AI to site sources, validate the information. Saving Changes...
Anonymous
Context, including role.
Objective, including audience.
Tone expected to be used.
Specific instructions to avoid either data/other "hidden" instructions, and always aiming to avoid bias.
Iterate if necessary. Saving Changes...
Kelly WelchSenior Project Management| City of Austin, TX
First, clarity is key. Start with a well-structured prompt that includes context, desired format, and specific instructions. Vague questions often lead to vague answers. I’ve found that refining the prompt—even slightly—can drastically improve the quality of the response.
Second, verify the information. AI can sound confident even when it's wrong. I make a habit of cross-referencing important facts, especially when using AI for research or decision-making. Trust but verify.
Third, keep your goals front and center. I periodically ask myself: “Is this response moving me closer to what I actually need?” If not, I iterate—either by rephrasing my prompt or breaking it into smaller parts. AI tends to perform better with focused, step-by-step requests.
Finally, don’t treat AI like a black box. It’s a collaboration tool, not a magic solution. The more I treat the interaction like a conversation—giving feedback, tweaking wording, clarifying my intent—the more useful and tailored the results become.
Before engaging the AI system, think about what you would expect to see in the response and reconcile the actual response against your initial thoughts. Consider any information that you could add to the prompt to get a more focused response. Include some examples as well. Once you receive the initial response you could refine your prompt and use an iterative approach to get a better result. Saving Changes...
Generating precise and organized instructions that contain the necessary information is part of the best practices for obtaining clear responses from the AI. And if you still don't get a response that's aligned with what you need, continuing to iterate by making changes to the instructions would be the way to go. Saving Changes...
PMI Team Member
