Project Management

Comparing PMI Infinity Responses to Three Other Large Language Models

From the AI IQ Blog
by
Technology offers an incredible opportunity to improve project performance. This blog shares the latest research and how organizations are implementing AI into their project methodology. Come with an open mind, increase your knowledge, share your concerns, and become a project manager with new skills to offer an organization.

About this Blog

RSS

Recent Posts

Using AI to Improve Team Communication (Without Losing Trust)

Start with AI, not a Project Framework.

Will the PMO Become the Center of AI Adoption in Organizations?

Project Manager Accountability in the Era of AI

Reference Class Forecasting Depends on How You Define “Similar”

Categories

AI, Artificial Intelligence, Ethics, Machine learning, Natural language processing, procurement, Scope Management

Date

linkedin twitter facebook Request to reuse this  


Here is a comparison of large language model (LLM) responses to the same prompt. The scenario is a project manager asking for suggestions to recover a project schedule from being late. The input is simple as if the project manager had no time to perform extensive prompt engineering or provide specific current and historical project data. The comparison was made on the same day (June 20) for all LLMs.

The first row is the LLM used. The second row indicates the number of steps in the suggested process, although some had sub-steps or additional suggestions. The recommendations are listed with similar content in the same row. Although the responses are summarized, the wording is intended to reflect the responses as accurately as possible.   

INPUT: “My project completion date is late to schedule. How can I recover the time?”

The table is a summary of each set of responses.

PMI Infinity

ChatGPT

Google Gemini

MS CoPilot

Six steps

Ten steps

Five steps (with sub-steps)

Four steps

 

Determine the cause and impact.

Identify the root cause

Make a list of schedule delay causes

Consider parallel processing for tasks (fast-tracking)

Consider parallel processing for tasks (fast-tracking)

 

Crash the schedule

Focus on the critical path.

Focus on critical tasks

Focus on the critical path

 

Increase resources

Increase or reallocate resources

Reallocate resources

 

Renegotiate the scheduled due dates.

Renegotiate scope requirements

Renegotiate scope and schedule

Prioritize scope requirements

Develop strategies to mitigate risks.

Develop strategies to mitigate risks.

 

 

 

Optimize workflow. Reduce bottlenecks and improve efficiency

Optimize workflow. Reduce bottlenecks and improve efficiency.

 

 

 

Develop a recovery plan.

 

Monitor progress

Monitor progress

Monitor progress

Use Agile (daily meetings) to monitor progress

Communicate

Communicate

Communicate

Communicate

 

Motivate the team. Add training if helpful

Don’t overburden the team

 

 

Seek expert advice

 

 

 

Use technology to improve technology and communications.

 

 

Observations

According to PMBOK 7th ed., the two main schedule compression methods are crashing and fast tracking. Crashing is a specific technique that determines the most effective schedule reduction at the least cost for tasks on the critical path. Fast tracking evaluates if tasks normally performed in sequence, a finish-to-start relationship, can have some or all of a task done in parallel with another task on the critical path. None of the LLMs suggested both of these. CoPilot was the only LLM that used the term “crashing” the schedule. It was disappointing that PMI Infinity did not include this. PMI Infinity and ChatGPT included risk management. ChatGPT and Gemini were the only LLMs that responded with a social concern for the well-being of the project team.

It is important to remember that LLM responses, like those of other AI-based solutions, are determined by the data accessed. From my perspective, ChatGPT offered the most comprehensive recommendations, and CoPilot had the weakest response.

What observations do you think are relevant in this comparison?


Posted on: September 09, 2024 12:00 AM | Permalink

Comments (8)

Please login or join to subscribe to this item
avatar
Smit Shah Project Manager| Navitas Lifesciences Banglore, Karnataka, India
even i found the Chat GPT is more reliable than other LLMs. this was the example.
ChatGPT provided more comprehensive than others.

avatar
Luis Branco CEO| Business Insight, Consultores de Gestão, Ldª Carcavelos, Lisboa, Portugal
"Consider parallel processing for tasks (fast-tracking)" and "Increase or reallocate resources" is Fast tracking and Crashing

avatar
Aaron Porter
Community Champion
IT Director| Blade HQ Payson, UT, United States
Of the four you tested, ChatGPT has performed the best as a generative AI with the testing I've done. Claude has performed as well, or better, than ChatGPT and needed less fine tuning of the prompt, in some cases.

Depending upon the browser I'm using, I'll search with gemini or copilot when I need to find something specific and regular search doesn't seem to grasp the context, returning a lot of unrelated results.

avatar
Paul Boudreau President| Stonemeadow Consulting Kanata, Ontario, Canada
@Luis. I agree with your interpretation but since this is PMI Infinity I expected it to use PMI standards and PMI standard terms which are "fast-tracking" and "crashing." In PMBOK 7th edition, the terms are defined. Crashing is defined on page 238 and fast-tracking on page 240. It suggests the question of what PMI Infinity is using as a resource.

avatar
Tim Rumbaugh Vice President, Program Management| Edwards Lifesciences Irvine, Ca, United States
Hey Paul, all of us should certainly assume that PMI Infinity is using PMI literature as a primary source. Is there any way for you to have them confirm that assumption and whether it’s a matter of your prompt being properly correlated to the PMBOK content?

avatar
Paul Boudreau President| Stonemeadow Consulting Kanata, Ontario, Canada
@Tim. Great question for PMI Infinity developers. I am sure they are making ongoing improvements. The engine is powered by ChatGPT but the sources need to be managed so that the prompt is classified to access a good section of PMI content. There is probably no way to guarantee a good PMP-like answer. The prompt (question) is also important but one of my assumptions was a typical hurried (harried?) project manager who needed a quick answer and spent little time with learning and understanding the impact of prompt guidelines.

avatar
Mohammad Javid Hussain Retired Hyderabad, India
Chatgpt provides better updates

avatar
Abolfazl Yousefi Darestani Manager, Quality and Continuous Improvement| Hörmann-TNR Industrial Doors Newmarket, Ontario, Canada
I think we should check/review the AI responses. Sometimes, they make a bad mistake.

Please Login/Register to leave a comment.

ADVERTISEMENTS

"It is hard to fight an enemy who has outposts in your head."

- Sally Kempton

ADVERTISEMENT

Sponsors