Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 55 56 57 58 59 60 61 62 63 64 65 ... 191 >
avatar
Gina Arbogast Bellevue, Ne, United States
Regardless of the task or approach we initially use, we always have AI verify the responses against reliable sources or standards before human review. I would say we are still very early in the implementation phase - identifying more opportunities to leverage AI and have incorporated robust checks and balances relational to the complexity of the task. By consistently following the process and refining our prompt formulas, our team has seen consistent improvement in the quality of the outputs.
avatar
Anonymous
You always need to validate the information and sanity check it to ensure it is accurate.
avatar
Jerzy Zanowski MR| Kapsch Telematic Services Krakow, Poland
Expected top quality output requires solid inputs and agile iterative steps with results validation on each stage

- Clear and Specific Input: Provide precise and well-defined prompts or queries. The more context and clarity you can provide, the more likely the AI will generate relevant and accurate responses.
- Iterative Refinement: If the initial results are not quite what you need, refine your input. AI systems often improve with clearer or more detailed instructions, so iterating on the prompt helps narrow down the most useful information.
- Cross-Check Information: AI outputs can be incorrect or biased. Cross-check the information it provides with reliable sources, especially when it's related to factual accuracy or important decision

avatar
Anna Pavlova Project Manager| DXC Technology Sofia, Bulgaria
I look at the sources used by the GenAI. Also, read the provided answer/content and in case of doubts make additional checks - asking questions to AI and checking other sources.
avatar
Giancarlo Patino Program Manager| Freese and Nichols, Inc.
Certainly using the formulas learned in this course (RTC & CREATE), verifying the outcome through additional research or senior experts in the subject matter, and drilling down in your request to AI.
avatar
Rahmath Jahan United States
I believe as Artificial intelligence works basically on the input of data, therefore to obtain accuracy and relevant response in the desired alignment , the input of data must be specific and to the point . The outcome must be clearly defined which can be in the form of RTF Role , Task and Format or in a more detailed input CREATE for Character , Relevance, Examples, Adjustment, Task , Evaluate all these in compliance with input and output ethical data and practices.
avatar
Christina Dietrich Customer Project Manager| Nokia of North America Seattle, Wa, United States
Jun 08, 2024 6:40 AM
Replying to Oliver Chitsamatanga
...
A very good question and also difficult to answer as well. However you have to go to the basics and say as far as you are concerned, how well are you versed with the subject at hand ?. There are facts which the AI will generate and if you can verify these facts the more reliable the generated response will be. The fewer the facts then it means that the Generative AI response is far from meeting your original goals. Then it becomes very critical that you review the accuracy , relevancy and the alignment of the response to your original need. Unfortunately there are no clearly defined metrics that one can use a model to evaluate an AI generated response. So from my personal experience I basically restrict AI to an area where i have sound knowledge of , else it becomes almost impossible to verify details generated by an AI if you venture into unchartered territory. However with long usage and exposure your confidence also tend to increase as well.
The best practice  and protocol to follow  would be to consult subject matter expects  to validate the AI generated response before making critical decisions based on it to avoid any  inherent associated risks which you might be not aware of.
I appreciate your explanation, Oliver; as I've been wondering this myself. Restricting AI to an area where I have sound knowledge would seem to ensure I could validate it's output based on personal experience.
avatar
Bhanuudas Shhedgay Director of Operations| Shivrai Technologies Pvt Ltd Pune, MH, India
1. Be Specific About the Issue or Concern

When giving feedback, try to describe exactly what went wrong or how the result didn’t meet your expectations. For example, “The response was too vague” or “It didn’t take into account the specific date I provided.”


2. Clarify the Expected Outcome

Let the AI or its developers know what you expected. For instance, if you're using an AI for generating content, feedback like “I wanted the tone to be more formal” or “I needed more detailed explanations” can help refine future interactions.


3. Explain What Worked Well

Positive feedback is just as important! If something worked well, say so. It helps the AI (and developers) understand which aspects are meeting your needs. For example, “The answer was quick and accurate” or “The formatting was great.”


4. Provide Suggestions for Improvement

Offering suggestions for improvement can help guide future versions of the AI. For example, “It would be helpful if you could provide a summary at the end” or “The response could benefit from more specific examples.”


5. Contextualize the Feedback

If possible, describe the context of your task. For example, “I was using this for a research project” or “I was generating a blog post about cooking.” This helps ensure the feedback is tailored to a specific use case.


6. Consider the Limits of the AI

Acknowledge that AI may not always be perfect, and some errors may arise from inherent limitations. Offering feedback with this in mind can make your responses more constructive, such as “It’s understandable that the AI couldn’t provide all the details, but it would be great if there was more information on X.”

avatar
Manohara Sampathila Director Program Management| IQVIA Puttur, Karnataka, India
Providing Concice and clear input is very much needed.
< 1 ... 55 56 57 58 59 60 61 62 63 64 65 ... 191 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

"If a man will begin with certainties, he shall end in doubts; but if he will be content to begin with doubts, he shall end in certainties."

- Francis Bacon

ADVERTISEMENT

Sponsors