Director, Learning Design & Development| PMIAsheville, NC, United States
Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.
In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?
Roland SilvaBusiness Operations Project Mangaer| Texas Department of TransportationElgin, Tx, United States
AI response validation is critical. Using examples of policy or legal constraints, in-house templates when permissable, and Chain of feedback or other methods of refinement are helpful tools for mitigating off-the-mark responses or hallucinations from AI--and it saves time. Saving Changes...
Having some idea of what result I am looking for helps determine the prompt details I will include. I've gotten the best results by taking the time to understand my own request. The other best practices that were outlined in the training can then be applied accordingly. Saving Changes...
Izegaegbe AseinOther| Intel CorporationMckinney, Tx, United States
While employing standard validation and automated checks are very important. the ultimate goal will be to ensure that you have that feedback from your stakeholders and align with the project objectives all the time. Saving Changes...
Izegaegbe AseinOther| Intel CorporationMckinney, Tx, United States
While employing standard validation and automated checks are very important. the ultimate goal will be to ensure that you have that feedback from your stakeholders and align with the project objectives all the time. Saving Changes...
Robert PrestonProject Implementations| SouthShore Software, Inc (S3i)Apollo Beach, Fl, United States
in its simplest form, data, data and data that is clean and groomed will deliver your best results in the real world. Getting the correct data out is your query or prompt that is specific and targeted to what is being asked. Saving Changes...
Paul HillWarranty Administrator| Haselwood Auto GroupBremerton, WA, United States
In this case, AI provides results based on what you ask for. Using the prompt formulae may increase the specificity you are looking for, but it may have to be adjusted iteratively. Look at the results in detail and note any areas that are lacking. Refine your prompts from there. Saving Changes...
Trevor KigenyiManager Territory Operations| Uganda Electricity Distribution Company LtdKampala, Uganda
When engaging AI assigning AI a role within the context of the requirement is key, breaking down your requests into bullets rather than one entire paragraph, working with it iteratively almost as you would in developing a product in an agile project, to incrementally improve the AIs out put, while also availing it examples, data, and ensuring it provides references to avoid hallucination, and enable you validate that the output legitimate. Saving Changes...
To ensure accurate AI results, provide clear, specific prompts with relevant context. Verify outputs against reliable sources, especially for factual claims. Break complex tasks into smaller steps and iterate based on initial results. Cross-reference information when possible, and maintain awareness of the AI system’s limitations and knowledge boundaries for your specific use case.​​​​​​​​​ Saving Changes...
Mahamudul HasanProject Management| Orange Business Development LimitedDhaka, Bangladesh
When working with AI systems, I always stress the importance of starting with a clear business case. Knowing exactly what problem we are solving helps avoid wasted effort. From there, I make sure the prompt design and data inputs are organized, as this directly affects the quality of results. I also establish validation checkpoints with the team, so we can test outputs against real scenarios before adoption. Another important practice is to track performance metrics over time. This ensures the system continues to meet our changing goals. Lastly, I involve stakeholders from different areas early on. This way, the solution stays practical, ethical, and meets organizational standards. Saving Changes...
Mahamudul HasanProject Management| Orange Business Development LimitedDhaka, Bangladesh
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.
Thank you for your detailed perspective. I agree that the breakthrough with transformers in 2017 fundamentally changed the scope of generative AI. Your point about keeping humans involved and the important role of data is very valid. Without them, the system can’t deliver meaningful results. I also appreciate your focus on “prevention” through statistical methods instead of fixing issues after deployment. The idea of forming a dedicated business unit with diverse roles like legal, linguistic, and inclusion specialists is insightful. AI's impacts go beyond just technology. This complete approach seems essential for sustainable adoption. Saving Changes...
PMI Team Member
