Director, Learning Design & Development| PMIAsheville, NC, United States
Validating and checking outputs is critical when working with AI systems like Generative AI. Such validation approaches may include establishing clear criteria, implementing strong testing protocols, and continuous refinement.
In your experience with AI, what are some best practices for ensuring the results you receive are accurate, relevant, and aligned with your original goals?
To get accurate and relevant AI results, I provide clear context and define my goal upfront. I break tasks into smaller steps, specify the desired format, and review outputs carefully. I also iterate with follow-up prompts to refine the response and ensure it aligns with my objectives.
Some of the steps I normally take to ensure my output is accurate, relevant and aligned with my expectations are as follows:1..Be clear and concise that LLM can understand the prompt. 2.Provide illustration to guide the LLM of what is your expectations. 3.Iterate the prompt until I get my desired output.
An effective approach is iterative: evaluate the output generated by the LLM, identify precisely what needs to be refined in the prompt, and apply only targeted adjustments. Avoid introducing unnecessary changes that do not influence the outcome.
Additionally, each domain should begin with a well-defined template to guide prompt design. Just as project managers rely on structured templates for deliverables, we should also establish standardized templates for prompts and inputs to ensure consistency and quality in the resulting outputs.
An effective approach is iterative: evaluate the output generated by the LLM, identify precisely what needs to be refined in the prompt, and apply only targeted adjustments. Avoid introducing unnecessary changes that do not influence the outcome.
Additionally, each domain should begin with a well-defined template to guide prompt design. Just as project managers rely on structured templates for deliverables, we should also establish standardized templates for prompts and inputs to ensure consistency and quality in the resulting outputs.
We’ve found that AI is most effective when it’s used with the same discipline we apply to engineering work. That starts with being clear about the purpose—what decision we’re trying to support and what constraints matter. Clear intent drives better output. AI results should never be taken at face value. They need to be reviewed through the lens of professional judgment, firm standards, and project context. In our environment, accountability always stays with experienced engineers, not the tool. Context is also critical. The more we anchor AI inputs in real project conditions, client expectations, and applicable standards, the more relevant the results become. Finally, AI should fit within our existing quality and governance frameworks. When used thoughtfully, it can improve efficiency and insight. When used casually, it can introduce risk. The value comes from disciplined use—not automation for its own sake. Saving Changes...
Provide the clearly defined prompt with accurate details. Validate and check the output while working with AI .system.
Saving Changes...
Ignacio MadorranDigital IT Manager| Mayoral Moda InfantilTorremolinos (Malaga), Spain
The right prompt is key. It should include all relevant aspects that require a customized answer. To achieve this, you should provide your specific context and details. Saving Changes...
Paul WaggonerProgram Manager| Consultant - FreelancePapillion, Ne, United States
Jun 07, 2024 9:24 AM
Replying to Sergio Luis Conte
...
AI is a broader term. Generative AI is just an ancient model but everything "explode" when Google published the new architecture called transformer in 2017. So, with that said, take into account that generative AI is just "predictive test with steroids" just simplifying the model. With that said, two key points has to be taking into account when somebody works with AI: 1-human in the loop. 2-AI without Data (today called data science discipline or big data or whatever) is the same thing that live without oxygen. Talking about generative AI all related to technology has almost not impact with relation to all related to non-technological roles and activities. What you stated about accuracy and things like that are easy to implement because there are a lot inside disciplines like statistics. Most of them to make things "a priori" to prevent instead of cure. Few organizations taking into account that when generative AI environments are put in place almost a new business unit has to be created where roles like lawyers, linguistic, diversity and inclusion specialist must be hire to help on put it in place.
Note that a project manager should be working with a team that also adds unique project details and business requirements. Not every detail will need to come from AI via prompt engineering.