Project Management

AI IQ

by
Technology offers an incredible opportunity to improve project performance. This blog shares the latest research and how organizations are implementing AI into their project methodology. Come with an open mind, increase your knowledge, share your concerns, and become a project manager with new skills to offer an organization.

About this Blog

RSS

Recent Posts

How NLP Evolved into ChatGPT

PMI Romania Annual Conference

Four Steps to Increase Your Project Data IQ

Comparing PMI Infinity Responses to Three Other Large Language Models

Comparing ChatGPT to Two Other LLMs

Categories

AI, Artificial Intelligence, Ethics, Machine learning, Natural language processing, procurement, Scope

Date

How NLP Evolved into ChatGPT

Generative AI models such as ChatGPT are part of an ongoing evolution of AI capability. The development of natural language processing (NLP) began simply with what is known as a “bag of words.” A paragraph or block of text is tokenized, which means breaking the content into linguistic units. A count is calculated for each word. If the word “sad” appears ten times and the word “happy” appears once, then the content has a negative sentiment. A subsequent development was the ability to identify parts of speech, known as parts of speech tagging. This became essential for language translation. Understanding nouns, verbs, adjectives, and adverbs provides a way to interpret a sentence.

Recurrent neural network (RNN) algorithms allow software to evaluate a sentence from right to left and left to right and remember sequential dependencies. A recent software development is transformers. A generative pre-trained transformer (GPT) adds self-attention capability, which is identifying keywords or phrases. Parallel processing is also included and performs faster analysis. The pretraining part of GPT means it accesses a volume of content that has already been analyzed. At the core of a GPT model, such as ChatGPT, are machine learning models that predict the next word or phrase and determine how to respond to a query.

Many people may find AI capability a mystery, but it is based on statistical models and highly evolving algorithms that take advantage of logical sequences. ChatGPT does not provide perfect answers. Understanding how to interact with the software improves the accuracy and relevance of responses, which is why prompt engineering is becoming an important skill for project managers.

Posted on: October 21, 2024 12:00 AM | Permalink | Comments (2)

PMI Romania Annual Conference

Last week, I was in Bucharest to deliver a workshop at the PMI Romania Chapter Conference. I enjoy sharing my knowledge and experience of applying AI in project management with participants who are eager to learn and open to embracing AI-based solutions. This was an extremely well-organized event, and every member of the volunteer staff made me feel welcome. They exuded professionalism along with their excitement to host such a well-attended (sold-out) event.

I noticed the engaged attention of participants throughout my interactive presentation and was pleased that my 90-minute workshop received positive feedback. These project management practitioners have a thirst for knowledge and a desire to improve the projects they manage. The additional value was networking with like-minded individuals from many distinct project areas.  

This event may not be as large as a PMI Global Congress, but I encourage all project subject matter experts to accept the invitation to speak at local chapter events when an opportunity arises. It is very rewarding.

I want to extend my heartfelt thanks to all the outstanding individuals I had the pleasure of meeting at the PMI Romania Chapter. Your warm welcome and enthusiasm made my workshop experience truly memorable.

Posted on: October 01, 2024 06:17 PM | Permalink | Comments (2)

Four Steps to Increase Your Project Data IQ

Project managers have a significant opportunity to increase the value they bring to an organization by embracing AI. This is especially relevant to data management. Making a machine learning algorithm effective requires determining the best set of project features to use as input. Data scientists are now a scarce resource. Yet, it is doubtful that a data scientist is prepared to understand the nuances of project data.

Here are four practical steps for successful data management when using AI. These steps are designed to be straightforward and manageable, empowering project managers to take control of their data.

  1. Determine what project data is available, how it can be accessed, and the format for the files being accessed.
  2. Understand how to perform data wrangling. Ensure there is structured project data. This means consistency in the format, and resolving any anomalies, such as blank data fields, multiple entries for a single field, and inconsistent meaning for entries within a field.
  3. Become familiar with feature engineering. Determine how to manage data fields that have the same meaning, add data fields that are missing, and improve the details of data that is captured and used by AI-based software
  4. Improve your knowledge of basic statistics. Be able to analyze outliers and decide on appropriate action. Understand probability, sample distributions, and causal correlation. You don’t need to be an expert, but basic knowledge is essential.

With increased skills in basic data management, the project manager becomes an integral part of the organization's successful adoption of AI-based tools. Their role becomes significantly more valuable, and their contributions will be recognized as they help navigate the complexities of AI.

Posted on: September 23, 2024 12:00 AM | Permalink | Comments (1)

Comparing PMI Infinity Responses to Three Other Large Language Models

Here is a comparison of large language model (LLM) responses to the same prompt. The scenario is a project manager asking for suggestions to recover a project schedule from being late. The input is simple as if the project manager had no time to perform extensive prompt engineering or provide specific current and historical project data. The comparison was made on the same day (June 20) for all LLMs.

The first row is the LLM used. The second row indicates the number of steps in the suggested process, although some had sub-steps or additional suggestions. The recommendations are listed with similar content in the same row. Although the responses are summarized, the wording is intended to reflect the responses as accurately as possible.   

INPUT: “My project completion date is late to schedule. How can I recover the time?”

The table is a summary of each set of responses.

PMI Infinity

ChatGPT

Google Gemini

MS CoPilot

Six steps

Ten steps

Five steps (with sub-steps)

Four steps

 

Determine the cause and impact.

Identify the root cause

Make a list of schedule delay causes

Consider parallel processing for tasks (fast-tracking)

Consider parallel processing for tasks (fast-tracking)

 

Crash the schedule

Focus on the critical path.

Focus on critical tasks

Focus on the critical path

 

Increase resources

Increase or reallocate resources

Reallocate resources

 

Renegotiate the scheduled due dates.

Renegotiate scope requirements

Renegotiate scope and schedule

Prioritize scope requirements

Develop strategies to mitigate risks.

Develop strategies to mitigate risks.

 

 

 

Optimize workflow. Reduce bottlenecks and improve efficiency

Optimize workflow. Reduce bottlenecks and improve efficiency.

 

 

 

Develop a recovery plan.

 

Monitor progress

Monitor progress

Monitor progress

Use Agile (daily meetings) to monitor progress

Communicate

Communicate

Communicate

Communicate

 

Motivate the team. Add training if helpful

Don’t overburden the team

 

 

Seek expert advice

 

 

 

Use technology to improve technology and communications.

 

 

Observations

According to PMBOK 7th ed., the two main schedule compression methods are crashing and fast tracking. Crashing is a specific technique that determines the most effective schedule reduction at the least cost for tasks on the critical path. Fast tracking evaluates if tasks normally performed in sequence, a finish-to-start relationship, can have some or all of a task done in parallel with another task on the critical path. None of the LLMs suggested both of these. CoPilot was the only LLM that used the term “crashing” the schedule. It was disappointing that PMI Infinity did not include this. PMI Infinity and ChatGPT included risk management. ChatGPT and Gemini were the only LLMs that responded with a social concern for the well-being of the project team.

It is important to remember that LLM responses, like those of other AI-based solutions, are determined by the data accessed. From my perspective, ChatGPT offered the most comprehensive recommendations, and CoPilot had the weakest response.

What observations do you think are relevant in this comparison?

Posted on: September 09, 2024 12:00 AM | Permalink | Comments (7)

Comparing ChatGPT to Two Other LLMs

In a previous blog titled, An Empirical Study Comparing ChatGPT to Project Managers, I described a scope document study comparing the results of ChatGPT to the ability of project management students. In my research, ChatGPT was faster at identifying errors and more accurate, but it was only about 80 percent accurate. The study also revealed that some errors in the document were not listed by the large language model (LLM).

One of my student groups at the business college in France performed a variation on my work and included it in their major assignment. They compared three LLMs by requesting them to identify errors in a scope document.

 

Observations

The first observation is that LLMs perform at different speeds, although all are very fast compared to humans. The next observation is that each LLM had a different result. The explanation for different results should be obvious. Since the input document was identical for each LLM, the different results are based on what data each LLM could access. The quality and quantity of data used to train machine learning models are significant factors in producing accurate and reliable results. Acquiring high-quality data is becoming a priority for organizations that train machine learning models.     

I want to thank the students for allowing me to use their assignment content for my blog: Dalton Bent, Carlos Carlson, Allen Jomy, and Vishal Venkata Penjarla.

Their study is one more example of the significance of data for AI technology to be successful.

 

Posted on: August 26, 2024 12:00 AM | Permalink | Comments (3)
ADVERTISEMENTS

"The only way to keep your health is to eat what you don't want, drink what you don't like and do what you'd rather not."

- Mark Twain

ADVERTISEMENT

Sponsors