The Ultimate PM Quality Test
| I love reading Nassim Taleb’s books. I’m currently devouring Skin In The Game (Random House, 2018), where Taleb passes along this gem (among many): on the basalt slab that contains the Code of Hammurabi, it is written that if a builder builds a house for someone, and that house later collapses and kills its owner, then the builder shall be put to death. This brings a couple of things to mind:
Meanwhile, Back In The Project Management World… According to zdnet.com[i], 68% of Information Technology (IT) projects fail. And before the non-IT PM members of GTIM Nation roll their eyes and think “Yeah, well, that’s why they invented Agile/Scrum,” consider: virtually all of the management information you use to make the decisions that allow your projects to succeed is the product of one of the residual 32% of IT projects. Critical Path and Earned Value Management Systems don’t simply fall off the management information system tree into their consumers’ outstretched hands. Even if the existing systems appear to be sustainable, it doesn’t necessarily mean that they were successful. There must have been quite a few Babylonians who moved into seemingly sound houses who were ultimately disappointed (or dead) in order for the kill-the-builder law to have entered the Code of Hammurabi, after all. So, how do we know if our Project Management Information Systems (PMISs) are of reliably quality? There are a bunch of software programs out there that purport to conduct a quality control check of Critical Path networks or EV systems’ output, and in some cases they do a pretty good job. I can’t say “most cases,” because I am not convinced that in most cases they perform a relevant function. Some of the systems that I find to be particularly disappointing perform functions such as checking for the number of start-to-start logical links among activities in a Critical Path network, and express the results as a percentage. For some reason, the conventional wisdom has averred that a percentage of such logic ties above a certain (rather low) threshold should be considered evidence of poor quality. Why? Because of the narrative that a high percentage of start-to-start logic links carries with it an enhanced possibility of returning artificial schedule variances. Do I have to say it? This is just plain wrong, an attempt to slather on yet another layer of complexity in the name of PM maturity or quality. Clearly the primary quality test for any PM information system is whether or not the information system provided prior warning of a task at the reporting level coming in late or overrunning its budget. Now, had some researcher conducted an analysis of hundreds of projects that had actually come in late or overrun, and had traced a common pathology of their PMISs to artificially-generated positive schedule variances masking real negative ones until it was too late to efficiently correct[ii], then I would have no objections. But if that’s what happened, this researcher has not shown his work. Here’s the kicker: if this speculated fear were true, it would mean that those projects with “excessive” start-to-start logic ties would tend to report artificial negative variances, as those activities that could start with others actually didn’t. It’s analogous to the ancient Babylonian house appearing to be on the verge of collapse without ever actually losing structural integrity, and the law changing to “Whomsoever builds a house that the owner perceives is about to collapse, causing death, but never actually falls down or injures anyone, well, that builder should be put to death anyway.” Well, enough of this “put to death” business. In its place, though, can we have the start-to-start logic ties Ringwraiths replaced with proponents of a real QC standard, like “did the PMIS accurately predict the overrun or delay?”
[i] Retrieved from https://www.zdnet.com/article/study-68-percent-of-it-projects-fail/ , which itself cited an article entitled The Impact of Business Requirements on the Success of Technology Projects; however, the link doesn’t appear to work, 9:39 MDT 27 May 2019. [ii] Similar to the approach that the excellent David Christensen used when researching the stability of projects’ Cost Performance Index in his now famous study. |
Project Management Information Systems’ Fatal Quality Flaw
| The primary information systems that allow PMs to make, well, informed decisions are predicated on two methodologies: Earned Value for cost and Critical Path for schedule (anyone expecting me to include the risk management guys in this list hasn’t been reading this blog for very long). While many pieces of insight flow from these systems when they are operating properly (or even a little improperly – these systems have amazing self-correcting capabilities), their primary outputs deal with the ability to accurately forecast when your project will finish up, and how much it will cost when it does. Because of these capabilities, those PMs who eschew EVM or CPM rarely stay within the ranks of management for very long, being easily out-performed by their better-informed competitors. However, like any other Management Information System (MIS), Critical Path and Earned Value are susceptible to what is colloquially known as the garbage-in, garbage-out phenomena. As my regular readers know, I maintain that all valid MISs have the same basic architecture, comprised of the following three steps:
Based on this basic, three-step MIS architecture, any information system that messes up Step 1 is going to be vulnerable to the information delivered in Step 3 being inaccurate and, therefore, not actionable. So, is there an aspect of PM that can have an influence on the quality of the data being collected for Earned Value or Critical Path analysis? Sadly, yes, and this aspect is captured in the old, cynical observation “All projects proceed on-time to the 95% complete point, and then stay at 95% complete forever.” The percent complete parameter is central to both EVM and CPM. It’s how they produce all of their usable information. In the original Cost/Schedule Control System Criterion there were seven approved methods for collecting the percent complete figure:
If one of your CAMs is manifesting the behavior of passing along a percent complete that is known to be overstating progress in order to avoid the scrutiny that would otherwise come from honestly reporting a negative variance, then neither your EVM nor CPM will deliver accurate information about the impacted Control Accounts. Fortunately, there are two effective fixes (and one hack) for this fatal MIS quality issue. First, minimize the number of Control Accounts or Work Packages that use the Milestone Estimate method. Level-of-Effort is routinely avoided, but even it doesn’t present the system-blasting capabilities of a mis-used ME technique. Second, only allow highly-trusted CAMs to be in charge of tasks being measured with the ME technique. And when I say “highly-trusted,” I do not mean “well-regarded.” I mean, if the CAM in question has ever indulged in that whole “projects proceed on schedule to 95%, and stay at 95% forever” business, they are removed from the trusted ranks forever. The hack I referred to is this: never allow any task to claim over 85% complete until it is completely done. I know, I know, this will introduce a few artificial negative cost and schedule variances in to some long-lived tasks. But it will also give you, the PM, a usable warning when one of your Cost Account Managers have been gaming the Milestone Estimate method, and exploiting Project Management Information Systems’ fatal flaw.
|
Okay, Who’s Actually AGAINST Quality?
| Well, I am, for one. Don’t misunderstand – for any given good or service I procure, I want the highest possible quality version, and become quite frustrated when the things I buy end up failing in executing their purposes, either in effectiveness or lack of longevity. Like anyone else, I tend to avoid those vendors who sharply disappoint me, usually forever. “So,” I can hear GTIM Nation say, “why do you claim to be against quality?” Because of the way it has been shoe-horned into the Project Management codex, that’s why. Examples follow. The first reason I find Quality Management experts highly off-putting has to do with their tools, especially the Ishikawa, or fishbone diagram. According to WhatIs.com, a fishbone diagram … is useful in brainstorming sessions to focus conversation. After the group has brainstormed all the possible causes for a problem, the facilitator helps the group to rate the potential causes according to their level of importance and diagram a hierarchy. The design of the diagram looks much like a skeleton of a fish. Fishbone diagrams are typically worked right to left, with each large "bone" of the fish branching out to include smaller bones containing more detail.[i] Note the use of the term “brainstorm” in the first two sentences – clearly it’s a large part of creating the diagram. But science is not consensus, and consensus is not science, not even management science. If you are relying on the subjective opinions of the members of your team in order to uncover some hidden truth or insight, you’re doing it wrong. And, as if that wasn’t bad enough, the “facilitator helps the group rate the potential causes according to their level of importance.”[ii] Rate the level of importance? Based on what, exactly? It’s yet another opportunity for subjective inputs to influence the direction of the analysis of the problem under investigation. Then there’s the whole issue of identifying causality. I’ve been in my share of Six Sigma quality reviews, and never, not even once, heard the facilitator mention the distinction between proximate and material causes. The short answer is that a proximate cause is clear and direct, as in the first domino caused the second one to fall over by being, itself, tipped over. The material cause would be that the second domino fell over because it had been stood up on edge right next to the first domino, thereby qualifying for the “if-not-for” test. This may seem to be mere semantics at first glance, but the distinction in properly identifying remedies to the problems being investigated is huge. For example, one tactic in filling out the fishbone diagram is to ask “Five Whys.” An example I’ve used before involved the sinking of the Titanic. The cause of the Titanic’s sinking, of course, was that it hit an iceberg on the night of 14 April, 1912. One line of the “Five Whys” can go like this:
So, based on this “analysis,” some useful strategies in the avoidance of similar maritime disasters would include:
I could go on (and often do), but you see my point. Without a clearly articulated distinction between proximate and material causality, all the Ishikawa diagram does is help structure a conversation. It doesn’t really help identify the optimal Project Management strategy to either an experienced or looming PM disaster stemming from poor quality. The other reason I’m opposed to the way Quality Management has been pushed onto the PM universe is due to the notion that those doing the pushing are somehow automatically afforded the intellectual high ground. Touching on the title of this blog, there’s a definite stigma attached to anyone who actually comes out and challenges the notion that Quality Management-types could ever be mistaken in their recommended strategies. But as I’ve been reminding GTIM Nation over the past few months, the old PM saw “Quality, Affordability, Availability: pick any two” is unavoidable. For the Quality guys to automatically assume that their favorite aspect of project delivery is a foregone conclusion strikes me as, well, lacking perspective. Think about it: you don’t see Affordability or Availability getting their own sections in the PMBOK Guide®, do you?
[i] Retrieved from https://whatis.techtarget.com/definition/fishbone-diagram on May 12, 2019 at 17:14 MDT. [ii] Ibid. |
Why Do We Even Do Project Management?
| A lot of pixel ink has been spilled on the topic of Project Management, but most of what I’ve read has to do with what it is, or how to do it. There’s been some additional content on where and when to do it (i.e., which situations call for a PM approach), but one topic I do not remember seeing is: why? Why should we do Project Management? (And, no, I don’t accept “because it’s the right way of doing management” as a valid driver.) I think an examination of motives here will help shed some light on the other, more often-addressed questions. There are a few reasons, to be sure, but before we tackle them let’s define some terms. A first-person transaction occurs when you purchase a good or service for yourself. Depending on which parameters are more important to you (remember: Quality, Availability, Affordability: pick any two), you will select a vendor and a price, and your first-person transaction is complete. In the PM world, this is the kind of transaction that occurs, say, when an airline contracts with an aerospace company to create an airplane that they will use for their routes. Second-person transactions are a bit different. This is when you are buying a good or service for someone else, like a gift. Even in those instances where you are well acquainted with the gift recipient’s wishes, the purchaser’s parameters (particularly cost) are far more likely to become the deciding factor(s). The PM example here is when a city counsel arranges to repair roads. Sure, the counselors use those roads, but the most usage comes from the population of the city in general. Since the budget issue is usually already fixed, the question comes down to: Should the road repair be of just-good-enough quality, or will the populace be okay with orange barrels and lane closures for an extended period (one would hope that both won’t occur)? Here’s where the examination of PM motives gets gnarly. In third-person transactions, the person performing the transaction neither pays for the good or service, nor do they receive the benefits. It’s one of the reasons why government-provided services fail so often: the bureaucrat deciding how much money to fund the provider facility isn’t spending his own money, nor is he the person seeking help at the moment the transaction is occurring. Due to this lack of alignment in setting the consumers’ desired parameters against the providers’ goal in providing the service(s), the odds of developing (much less implementing) the optimal management approach are extremely low. Meanwhile, Back In The Project Management World… What are the implications for Project Management? Well, in first-person transactions, the customer would be interested in the robustness of their subcontractors’ PM expertise in order to avoid overruns or delays in critical projects, particularly in Cost Plus Fixed Fee (CPFF) or Cost Plus Award Fee (CPAF) contracts. The suppliers of such project work would be motivated to support some level of PM expertise in order to prove to their current or prospective clients that they aren’t complete dufuses when it comes to managing large projects, and are deserving of the contract award. Both customer and supplier are strongly motivated to request and provide some level (note: not necessarily highly advanced) of PM expertise, and demonstrably so. For second-person transactions, there’s still some level of motivation, albeit a bit lessened from first-person. People purchasing goods or services on behalf of a government, for example, are usually keenly aware of the need to spend taxpayer monies efficiently, if for no other reason than cases of foolish government expenditures tend to make for very bad press (the “bridge to nowhere” scenario, for example). But now we come to the scenario where much PM chicanery is not only possible, but basically invited. In third-party transactions, where the PM practitioners are neither spending their own money for managerial expertise, nor receiving any goods or services from the contractors, I have to ask: what is their motivation? For example, when one of my favorite targets, the nefarious-but-unnamed guidance-generating organizations, pushes out another document stating that risk management is a really swell idea, and everyone in the PM world ought to do it, I have to ask: why? What business is it of theirs in the first place? What do they have to gain? These guidance-generating “experts” are the equivalent of a self-proclaimed know-it-all hanging around the electronics section of a major retailer, scolding customers if they don’t seek the same options or features the know-it-all thinks matter. Such a one would be sent packing by (real) managers in short order for being insufferable meddlers. In my opinion, the exact same thing should happen to these guidance-generating organizations. “But Michael!” I can hear GTIM Nation say. “Didn’t you just indict legit professional organizations, like the Project Management Institute®?” No, and here’s why. While PMI® certainly does generate guidance, they have skin in the game via the Certification Department. If someone with a PMI® credential asserts some truly dopey stuff (I’m not saying it never happens, but it’s far from common) then the entire brand suffers, from membership all the way up to the top execs. Conversely, risk managers can point to their allies in the guidance-generating world who assert any project bereft of RM is doing PM “wrong,” and pointing out the percentage of successful projects also bereft of RM will not overturn these assertions. It’s immune to real-world evaluation and analysis, because neither the consumer nor the supplier gains or loses a thing based on the validity of the “guidance.” So, which PM techniques are most appropriate, efficient and effective for a given project? I have a good idea what the answers are. But first, I need to know: why do you want to do PM in the first place? |
Sustainability’s Human Element
| For my last blog on Sustainability (ProjectManagement.com’s theme for April), I want to get away from analyzing the more technical aspects of the Project Management Information Systems that comprise a mature, sustainable PMO, and focus instead on another key element: organizational behavior and performance. After all, even the best, most efficient system, implemented with the optimal strategy, is going to fail if the personnel involved can’t (or won’t) make it work. While modelling human behavior can be very tricky, there are some usable insights that can be gleaned from the available scholarship, mixed with my own observations. For example, I’ve often referred to Michael Maccoby’s excellent book The Gamesman: The New Corporate Leaders (Simon and Schuster, 1977), and the organizational archetypes he discusses, particularly the Jungle Fighters. I have come across more than my share of this type (or, perhaps, I’ve become sensitized to them, and more readily recognize when they’re around), and it seems to me that they can be sub-categorized so:
I genuinely hope that the vast majority of GTIM Nation is now thinking “ProjectManagement.com clearly does not care if its bloggers are from the universe where Spock has a beard, ‘cuz I have never encountered any of the archetypal behaviors that Hatfield is ranting about.” But my sense is that at a significant percentage is thinking “Michael just described one of my (former or current) co-workers to a tee.” What to do about it? First off, Jungle Fighters cannot advance at all in a pure meritocracy. Unfortunately, the only large organization that I’m aware of that operates as a pure meritocracy is the United States Chess Federation (US Chess®), where your point ranking is your value to the organization, and Jungle Fighters can slander away without ever changing a thing. If the target can consistently point to an objective record of scope accomplishment and/or high performance, some level of JF insulation can be had. Another very effective anti-Jungle Fighter strategy is the elimination of ex parte conversations. If any employee engages any manager on the topic of another Project Team member, the manager must stop such conversations until the third party being discussed is present. The first time the PM does this, the Jungle Fighters will have one of their key tactics ripped away from them, and they will become far less effective. Unfortunately, this counter has to come from management, and a lot of managers are either unaware of this type of toxin, or they do not care. A third strategy is to make other Project Team members aware of the existence of Jungle Fighters within the organization. But don’t use ex parte discussions to do so – that’s a marker of the Jungle Fighter. Instead, copy this blog’s link, and send it to the members of your team. The beautiful part of this action is that the Craftsmen, Company Men, and Gamesmen will either ignore the link, or read it with casual interest. The Jungle Fighters, though, will become agitated, thereby revealing their true natures. Alternately, one could hang a full-length mirror in the Program Office, and note those who do not cast a reflection.
|





