Project Management

Please login or join to subscribe to this thread

Realistic Forecasting Models

linkedin twitter facebook   Estimating  
avatar
Cynthia Adams Downers Grove, Il, United States
Earned Value has its limitations. I am seeking a statistical model/tool to enable more accurate EAC estimates. Currently we apply Earned Value to compute new Estimate to Complete values and add them to the Actuals. Of course the EAC then changes each week as actuals do not always equal estimated. Now we have been told our estimates must be 100% accurate for at least 1 month IN ADVANCE. For example, if I estimate project costs to be $50,000 on the first of the month, my actuals at the end of the month must equal $50,000. I can see how this may work on longer term projects, but most of our projects only span 1 to 2 months. Even if I figure in risk and probabilities for the few risks we identify, if something hits, the cost of that risk is 100% X the estimated impact, which is still not going to give me a 100% accurate forecast value.
Anybody have any better models for computing 100% accurate estimates for 30 days at a time? Or other ideas for meeting this requirement of 100% accuracy in advance. We have been told that if we cannot do this, we are in the wrong job. True?
Sort By:
avatar
Frank Patrick Boonton, Nj, United States
I'll start off with a complete agreement with Cyntihia's first sentence. "Earned Value has its limitations." And to go further, the cost-centric view of EV and the questionable promises of the approach can lead to the very kind of quandary that she finds herself in.

I don't want to get off on a rant here, but . . .

I've been sitting on this thread for a few weeks now, trying to come up with a civil response. It's difficult enough to get beyond the idea of discussing "accurate estimates" or forecasts on a supposedly professional PM conversation without gagging. But to listen to an expectation of 100% accurate forecasts of project performance even only 30 days out is downright nauseating. (I won't even go into the question of using past (even EV-based) performance to predict future events.)

A friend of mine recently said "Tell me how you'll measure me, and I'll tell you what damned stupid things I'll do to make that measurement look good."

If your job is (and if you are going to be judged on) predicting costs with 100% accuracy, I'm sure you can find good creative ways to do just that. But I would predict that the time, effort, and attention to the manipulation of costs and cost reporting will severely impact your ability to address what is really important in the project management context.

One way of doing so would be to put plenty of safety in your estimates, then use that safety whether it's needed or not. That's about the easiest way of doing what is wanted, but I'm sure everyone reading this thread can predict what that will do to your project lead times and to the ability to get more real work done.

This is one of those situations that force me to ask what the goal of your PM effort is. Is it to meet financial estimates, or is it to get your e-commerce sites up and running as quickly as possible? What contributes more value to the organization, controlling costs to the penny or turning on revenue-generating or process-improving systems? The inane request for 100% accuracy at a project level demonstrates an all-too common "penny/cost wise - pound/benefit foolish" attitude. (I'll bet that concurrent with this attitude is a perceived need to keep everyone busy, which leads to cross-project interference and multi-tasking, which leads to things taking longer than planned, which leads to added unpredictability. I'll bet there are also pressures to launch projects before the resources are prepared to take them on as well, further exacerbating the situation.)

I have to admit that looking at Cynthia's profile, and with an awareness of the financial straits that the company mentioned in her email address is in these days, I can understand where this penny-pinching attitude might be coming from. But I think the questions in the previous paragraph are still valid. If the portfolio of projects is appropriately chosen for real value, the faster they get implemented, the sooner the company will get real benefits that should far outweigh costs to implement. If the projects are not truly valuable to the bottom line, then I can understand the cost focus. If they are, "damn the cost, full speed ahead!"

Come to think of it, I would expect that in aggregate your total project costs are pretty well fixed (or can be) for the next month out, so at a portfolio-wide level, the demand for accuracy is really not a problem. The only problem is that unless someone repeals Murphy's Law, individual projects will vary in the ability to predict what gets done in that period.

If you're forced, promise costs at an aggregate portfolio level, and forget them. Then track the projects with an eye on what matters -- the schedule -- and use the resources where they best contribute to moving the projects to completion and creating value for the company. Cost is merely an effect of schedule and scope once a schedule and scope have be agreed to. You can't maange effects -- you can only manage the causes. Assuming scope is fixed, that leaves you with the schedule. Manage it and costs will be what they need to be. And whatever you do, don't rely on some bogus formula based on past performance to predict future events. Ask the resources regularly, frequently, and directly what their time estimate to complete their task is. Don't accept answers like "we're on track." Demand numbers that reflect reality. Then and only then will you have information useful for reasonable prediction.

Your job is not, can not, and should not be to predict anything perfectly. It is to provide information and guidance regarding options and strategies for dealing with the variation that will exist, no matter what the estimate or forecast says.

. . . Of course, that's just my opinion. I could be wrong.

avatar
Michael Reed Columbus, Oh, United States
Once my project managers have their projects planned (scope defined, risks identified, schedule developed, cost budgeted) I expect them to be within 5% of cost and time for the defined scope for a vast majority of their projects (depending on type of projects). I want them to manage their scope accurately and religiously. I get very suspicious when their ESTIMATES match their actuals exactly all of the time. I also don't expect them to over or under estimate.
avatar
Michael Wood Project Manager / Business Analyst / Business Process Improvement Guru| Independent Contractor Gig Harbor, Wa, United States
Interesting concept of being 100% accurate on predicting the future.

First, that requirement only results in people padding their estimates and budgets. A 100% accurate estimating model does not exist. It is folly to think that anyone can plan out a project in such away that every variable and unknown is planned for and controllable. This is especially true of people’s time to complete a task. There appears to be an underlying issue at the heart of management’s requirement that there be flawless estimates for each 30 day window. I wonder if your company places the same requirement for precision on sales or operations. Or even on their forecast on the price of its stock.

As for earned value, I have never liked it. I would rather develop models that factor in the estimating error rate of people to complete their tasks as estimated. When I manage projects I am constantly looking for weekly estimates to complete tasks that are in progress. I compare the time to complete with the effort expended to date and the original estimate to project probable time to complete. Over time I develop factors for each project member and am able to help them make improvements to their estimating by giving them feedback on their hit and miss rate. I also design away complexity by breaking tasks down to single person, single deliverable components as much as possible. Rarely will there be a task that is greater than a week’s effort. That way, earned value never comes into play on partially completed tasks since none is long enough to cause a need to understand its percent complete.

There seems to be no end to how complex the project management world can make the PM process. Simple is always better and yields less stress and sleepless nights.

Please login or join to reply

Content ID:
ADVERTISEMENTS

"I must say that I find television very educational. The minute somebody turns it on, I go to the library and read a book."

- Groucho Marx

ADVERTISEMENT

Sponsors