Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 196 197 198 199 200 201 >
avatar
Christopher Danvers Senior Product Manager| Visa Dallas, TX, United States

avatar
Anonymous

avatar
Bryan Cedeño Ecuador
To ensure outputs are accurate, relevant, and aligned with your original objectives, best practices include defining a clear role and context, breaking complex tasks down using prompt chaining with explicit constraints, and implementing a human-in-the-loop verification process that cross-checks AI outputs against trusted sources to catch and correct hallucinations before implementation.
avatar
David Yatsu VIRGINIA BEACH, VA, United States
Jun 08, 2024 6:40 AM
Replying to Oliver Chitsamatanga
...
A very good question and also difficult to answer as well. However you have to go to the basics and say as far as you are concerned, how well are you versed with the subject at hand ?. There are facts which the AI will generate and if you can verify these facts the more reliable the generated response will be. The fewer the facts then it means that the Generative AI response is far from meeting your original goals. Then it becomes very critical that you review the accuracy , relevancy and the alignment of the response to your original need. Unfortunately there are no clearly defined metrics that one can use a model to evaluate an AI generated response. So from my personal experience I basically restrict AI to an area where i have sound knowledge of , else it becomes almost impossible to verify details generated by an AI if you venture into unchartered territory. However with long usage and exposure your confidence also tend to increase as well.
The best practice  and protocol to follow  would be to consult subject matter expects  to validate the AI generated response before making critical decisions based on it to avoid any  inherent associated risks which you might be not aware of.
Oliver, I feel similar to you in my experience with AI thus far. I would say that the more confidence I have that the AI will be able to handle or accurately handle my problem I am working on, the more likely I am to use it. I have found thus far, that it has been most successful in troubleshooting technical issues with computers and software, like an IT assistant. It seems to be well trained already in this area and far exceeds my expectations ( a kind of Geek Squad if you know what that was). For problems dealing with current events, history, etc that are not technical it seems to not have a grasp of the social issues that broadly frame and put into context historical events.
avatar
Anonymous
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.

A good rule of thumb is to treat AI as a thought partner, not an authority. The more clearly you define your goal, audience, context, and desired output, the more useful the response will be. Ask specific questions, break complex problems into smaller steps, and refine the output through follow-up prompts rather than accepting the first answer. At the same time, approach AI responses with a critical mindset: verify important facts, ask for sources, challenge assumptions, and look for gaps or alternative perspectives. AI can be a powerful tool for brainstorming, analysis, drafting, and problem-solving, but human judgment, accountability, and adherence to organizational policies for privacy, security, and responsible AI use remain essential.

< 1 ... 196 197 198 199 200 201 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

"Of all the 36 alternatives, running away is best."

- Chinese Proverb

ADVERTISEMENT

Sponsors