Project Management

Please login or join to subscribe to this thread

When using AI systems, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

linkedin twitter facebook   Artificial Intelligence  
avatar
Sarah Philbrick
PMI Team Member
Director, Learning Design & Development| PMI Asheville, NC, United States

Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.

In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?

Sort By:
< 1 ... 61 62 63 64 65 66 67 68 69 70 71 ... 191 >
avatar
Leslie Ríos Program Manager| Aristeia Corporation Guayaquil, Guayas, Ecuador
You have to be clear and precise and also avoid to be too generic with the request
avatar
Anonymous
You have to have an understanding of the way the "AI" will respond and the information that you feed will greatly affect the response. Proofread everything that it outputs, never rely on it 100%. Changing the tone of the response to something more organic and human is also a great thing to do to its responses.
avatar
Kiana Jefferson Chief Project Officer| Firmtec SLL
Jun 08, 2024 11:44 AM
Replying to Giorgos Sioutzos
...
Providing the specific context in clear and consise way is essential.
One has to know their expectations of the creation they wish the ai to fulfill. I don’t mind spending time to reach perfection. It’s much better to train especially while hypothetically implementing optional strategies. I do so for my personal portfolio. On the contrary if a person types a generalized prompt such as “build me a project plan” and has minimal experience in the field, it can be difficult to assume ai generates the correct answer. It surely will not be at its highest potential given this is a broad statement. Ai performs as accurately as it was created. I would advise to try and build one if the time permits the pm. Build, build, build! 😊
avatar
Xiaogang Han Lanzhou, Gansu, China, Mainland
Jun 08, 2024 1:37 PM
Replying to Keith Novak
...
Like with any new tool, you need to test the results before you scale up.

Think about if you were to manually model a very complex problem in a spreadsheet. You don't build all the links and formulas first and then evaluate your final output. You build and test sections of the bigger solution first and then add on layers once you have validated the functionality.
GOOD
avatar
Melissa Kaiza Project Manager| Harford Community College Nottingham, Md, United States

Ensuring AI-generated results are accurate, relevant, and aligned with your goals requires a structured approach. Best practices include:



Define Clear Objectives – Clearly outline what you want AI to accomplish. Ambiguity leads to misaligned outputs.



Use High-Quality Data – AI models are only as good as the data they process. Ensure inputs are clean, unbiased, and representative of your needs.



Validate and Cross-Check Outputs – AI can generate plausible but incorrect information. Always verify results with trusted sources or subject matter experts.



Apply Human Oversight – AI should complement, not replace, human judgment. Regularly review AI recommendations before acting on them.



Refine Prompts and Parameters – Iteratively adjust your inputs to fine-tune results, especially in generative AI applications.



Monitor for Bias and Ethical Considerations – AI can reinforce biases if not carefully managed. Use diverse datasets and test outputs for fairness.



Ensure Compliance with Policies and Standards – Follow organizational, legal, and industry guidelines (e.g., PMI's Code of Ethics) when using AI in decision-making.



AI is a powerful tool, but its effectiveness depends on how well it is integrated into structured project management processes.

avatar
Uttam Kumar Engineering Manager| American Eagle Outfitters Pittsburgh, PA, United States
Achieving accurate, relevant, and goal-aligned results from AI systems requires a meticulous and iterative approach.
1) Prioritize data quality; ensure your datasets are comprehensive, clean, and free from biases, as flawed data will inevitably produce flawed outputs.
2) Establish clear and measurable goals before deploying any AI tool. Define specific metrics that directly correlate with your desired outcomes, allowing for objective evaluation of the AI's performance.
3) Implement a robust validation process, regularly comparing AI-generated results against real-world data or established benchmarks. This helps identify discrepancies and refine the model's accuracy.
4) Maintain human oversight; AI should be viewed as a tool to augment, not replace, human judgment. Experts should review critical decisions and interpret AI outputs within the context of the project.
5) Embrace iterative refinement; AI models learn and improve over time, so continuously monitor performance, gather feedback, and adjust parameters or retrain the model as needed.
6) Prioritize transparency and explainability, especially in complex AI systems. Understanding how the AI arrives at its conclusions allows for better troubleshooting and builds trust in the system's reliability.
7) Establish clear ethical guidelines for AI use, addressing issues like data privacy and potential biases.
Finally, build a culture of continuous learning within your team, encouraging them to stay updated on the latest AI advancements and best practices. By adhering to these principles, you can maximize the effectiveness of AI systems and ensure they contribute meaningfully to your project's success.
Many have been using the CREATE methodology without even realizing it, as AI only gives best result on iteratively refined prompting.
avatar
Sourabh Gupta Pune, Mh, India
The basic principle of AI is junk in - junk out. In order to have the accurate, relevant and aligned output, make sure that your prompts are crisp and clear. LLMs can play multiple roles, make sure that you ask it to put on a hat before asking question.
avatar
Yau Chang Siew Head of Digital Business and Services | Agrobank Kuala Lumpur, Malaysia
Jun 08, 2024 11:44 AM
Replying to Giorgos Sioutzos
...
Providing the specific context in clear and consise way is essential.
I usually just use the Question Refinement method on a conversational style. The AI's response then makes me think (and learn) how to ask better questions (ie provide detail, structure, context).
avatar
Nazir Uddin Portfolio Manager| NOKIA Melbourne, Australia
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.
In my experience GenAI models available in market vary in terms of their accuracy as they are built (trained) differently. Some are more suited to certain fields like technology etc. Having this knowledge helps to select a model. During the prompting I found providing context as the most effective way followed by providing examples and reflection of my visual representation that we may have in our minds. Additionally asking AI to summarize helped since it extracted what it thought was key part of its response. Once it reached a certain level then I could trigger the "unpack"
< 1 ... 61 62 63 64 65 66 67 68 69 70 71 ... 191 >

Please login or join to reply

Content ID:
ADVERTISEMENTS

"I would never die for my beliefs, cause I might be wrong."

- Bertrand Russell

ADVERTISEMENT

Sponsors