Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 21 22 23 24 25 26 27 28 29 30 31 ... 191 >
avatar
Gayrol Taylor Monitoring and Evaluation Specialist| Ministry of Finance St. Catherine, Jamaica
I've found that it helps to know a little about what you are asking the AI for so that you can correct it when it goes off the rail.
avatar
Anonymous
I think using AI as a support tool and not as the ultimate decision-maker is crucial.
Being specific about your request, providing relevant information and continuous interaction to validate the AI's outputs will aid accurate and relevant results from AI systems. Basically, using the CREATE strategy can enable the AI systems fine tune its responses to provide accurate and relevant information that aligns with your request.
avatar
Scott Randall Houston, Tx, United States
Most of the responses above focus on the user input, i.e. the way you are crafting the prompt. The flip side is when you have a solid prompt, but the LLM itself starts to drift off topic with each refinement (and even contradict some of boundary conditions you've specified and cite from completely irrelevant sources!). The best way I've found is to go back to the basics of information integrity and critical thinking that were once used by journalists and academics: 1. what is the quality and timeliness of the references it cites? 2. Within the reference, what is the competence of the experts that developed the analysis? 3. Is this a "one-off" reference, or are there lots of validating references of the same output information? 4. One commenter mentioned statistical validation-since the model inherently uses statistics and confidence intervals to select the "best fit" answer-probe it on its confidence!
avatar
Vanessa Eldridge In, United States
Jun 10, 2024 5:03 PM
Replying to Elmar Saenger
...
That's a very good question. In my response, I am assuming that the question refers to an LLM-based chatbot.
From my experience, the best results are achieved the more context I provide to the LLM. This means providing as much information as possible that describes both the project itself and the project context.
A second very important step is the quality of the request, also known as the prompt for the LLM. This is similar to human communication, where the quality of the question determines the quality of the answer. Therefore, a good prompt strategy is required, for example:
1. Data and context about the project
2. The goal of the request
3. The task that the LLM should fulfill
4. The format in which the output should be delivered.

In subsequent requests, it is possible to build on the context and results of the previous request. It is important that this process takes place within a chat, as otherwise the context is lost.
Yes, the old saying, 'garbage in, garbage out." If you want clear, concise outputs, you have to be sure that what you are putting in is accurate and your goals are clearly defined.
avatar
Erick A. Candanedo S. Lead Researcher| PMRD Program
As explain in this module, iterations are crucial to have more exact anwers, I might add a quality revision and improvement of answer, and update assurance are also mandatories.
avatar
Tom Gibbins Management| None Perth, Australia
It is a good idea to use a winning example in your prompt eg. a winning tender or a project that delivered in full and on time.
avatar
Anonymous
I am not yet experienced with using AI.
avatar
Angel Romero Sacramento, Ca, United States
Jun 10, 2024 5:03 PM
Replying to Elmar Saenger
...
That's a very good question. In my response, I am assuming that the question refers to an LLM-based chatbot.
From my experience, the best results are achieved the more context I provide to the LLM. This means providing as much information as possible that describes both the project itself and the project context.
A second very important step is the quality of the request, also known as the prompt for the LLM. This is similar to human communication, where the quality of the question determines the quality of the answer. Therefore, a good prompt strategy is required, for example:
1. Data and context about the project
2. The goal of the request
3. The task that the LLM should fulfill
4. The format in which the output should be delivered.

In subsequent requests, it is possible to build on the context and results of the previous request. It is important that this process takes place within a chat, as otherwise the context is lost.
I agree with Elmar's response. You need to be specific. I would use CREATE to ensure I get the best response and continue to refine until I have what I am looking for from AI.
avatar
Md. Golam Rob Talukdar
Community Champion
Project Manager| AWR Development (BD) Ltd. Cox's Bazer , Bangladesh
When providing feedback to the AI system, it's essential to be clear and specific. Could you refine your prompt and ask for feedback to ensure you get the desired output? Additionally, utilizing multiple AI tools to validate the results can help ensure accuracy.
< 1 ... 21 22 23 24 25 26 27 28 29 30 31 ... 191 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

I hate asking for change. They always make a face. It's like asking them to donate a kidney.

- George Costanza

ADVERTISEMENT

Sponsors