Project Management

Please login or join to subscribe to this thread

Considering that every project is different and the data used to train a GenAI platform - PMI Infinity, for project management will vary based on these differences,

linkedin twitter facebook   Artificial Intelligence   Complexity   Information Technology  
Considering that every project is different and the data used to train a GenAI platform (i.e- PMI Infinity) for project management will vary based on these differences, What strategies can be employed to ensure that the model provides relevant and accurate insights across different types of projects regardless of the prompt ?
Sort By:
avatar
Aaron Porter
Community Champion
IT Director| Blade HQ Payson, UT, United States
In addition to rewording your prompt and asking your question in different ways, understanding prompt engineering and using prompt patterns CAN help. However, if you're talking about USING a model, you have no control over the relevance or accuracy of the responses - if the model has irrelevant training data, you can count on irrelevant results.

If you're talking about BUILDING a custom GenAI, ChatGPT recommends the following:

- Train the LLM on a wide variety of high quality, domain specific data that covers different industries, project types, and use cases.
- Curate the dataset carefully to filter out unreliable or biased data.
- Periodically retrain the model with updated data to ensure that it incorporates the latest information, trends, and best practices from various domains.
- Fine-tune the LLM on specific datasets that align with the project's focus areas.
- Engage with subject matter experts to evaluate the outputs during the model’s testing and validation phase.
- Craft prompts that guide the model toward delivering the most relevant and accurate insights.
- Incorporate context from the user (such as the type of project or industry) into the prompts.
- Implement feedback mechanisms to capture user evaluations of the AI's outputs. Continuously use this feedback to refine the model, improving its understanding of specific project needs and adjusting any biases or blind spots in its predictions.
- Design the system to capture and retain project-specific context when interacting with users.
- Provide an option to personalize the AI for particular industries, regions, or project types, allowing users to set parameters that influence the nature of insights provided.
- Integrate ethical AI principles to ensure fairness and inclusivity across different project domains, while maintaining compliance with industry-specific regulations, such as data privacy standards (GDPR, HIPAA, etc.).
- Regularly audit the model for bias, especially if dealing with sensitive or regulated industries, to ensure that its insights are fair and non-discriminatory.
- Ensure the model has built-in mechanisms to scale its insights depending on the complexity or size of the project.
...
1 reply by Getnet Shimels Tafese
Oct 23, 2024 11:44 AM
Getnet Shimels Tafese
...
My question is from the user perspective not building custom genAI model.
thank you for your response !
Oct 23, 2024 10:46 AM
Replying to Aaron Porter
...
In addition to rewording your prompt and asking your question in different ways, understanding prompt engineering and using prompt patterns CAN help. However, if you're talking about USING a model, you have no control over the relevance or accuracy of the responses - if the model has irrelevant training data, you can count on irrelevant results.

If you're talking about BUILDING a custom GenAI, ChatGPT recommends the following:

- Train the LLM on a wide variety of high quality, domain specific data that covers different industries, project types, and use cases.
- Curate the dataset carefully to filter out unreliable or biased data.
- Periodically retrain the model with updated data to ensure that it incorporates the latest information, trends, and best practices from various domains.
- Fine-tune the LLM on specific datasets that align with the project's focus areas.
- Engage with subject matter experts to evaluate the outputs during the model’s testing and validation phase.
- Craft prompts that guide the model toward delivering the most relevant and accurate insights.
- Incorporate context from the user (such as the type of project or industry) into the prompts.
- Implement feedback mechanisms to capture user evaluations of the AI's outputs. Continuously use this feedback to refine the model, improving its understanding of specific project needs and adjusting any biases or blind spots in its predictions.
- Design the system to capture and retain project-specific context when interacting with users.
- Provide an option to personalize the AI for particular industries, regions, or project types, allowing users to set parameters that influence the nature of insights provided.
- Integrate ethical AI principles to ensure fairness and inclusivity across different project domains, while maintaining compliance with industry-specific regulations, such as data privacy standards (GDPR, HIPAA, etc.).
- Regularly audit the model for bias, especially if dealing with sensitive or regulated industries, to ensure that its insights are fair and non-discriminatory.
- Ensure the model has built-in mechanisms to scale its insights depending on the complexity or size of the project.
My question is from the user perspective not building custom genAI model.
thank you for your response !
avatar
Sergio Luis Conte Helping to create solutions for everyone| Worldwide based Organizations Buenos Aires, Argentina
My recommendation is taking a look to basic information about how a generative AI product works and it is created, just in case you did not do that yet. Nobody will train a product, except some exceptions. Products are based on what is called foundational model where all the knowledge reside. Over that, some customizations can be made using different methods but mainly fine tunning and RAG. This type of things customize the model with specific knowledge. So, I do not know the path taken by the PMI with Infinity and no matter the path I do not know what additional information has been uploaded to customize the model. By the way, your question is a great and important question. Thanks a lot.

Please login or join to reply

Content ID:
ADVERTISEMENTS

"Nothing worth learning can be taught."

- Oscar Wilde

ADVERTISEMENT

Sponsors