An appropriate priority process is defined, in my world, as one that identifies projects that best support the organization's efforts for increasing its ability to achieve its goals. Assuming that we are talking about a for-profit organization, the goal is probably defined chiefly in terms of making (more) money now and in the future.
Every organization, at any point in time, has some primary source of limitation - a primary constraint - impeding its ability to do more of what it's trying to do. "Improvement" efforts (and the projects that implement them) are too often spread all around the organization, strengthening all of the links in the "value chain." The problem is that this is a significant waste of time and attention, because only those efforts that address the constraint (the weak link) are worthy of being called improvements. Improvement is not related to local changes in the individual links, functions, or processes, but only in the ability of the organization -- the entire chain -- to lift more weight, so to speak. Improvement only comes from the ability of the organization to get more of its goal stuff.
Understanding this aspect of organizational systems and this definition of improvement, it becomes obvious that the projects that should be highest on the list should be those that address the major constraint. Even more important, and useful to us as I will point out later, is the fact that this constraint colors the policies, practices, and resulting problems found throughout the organization.
The first step, then, is to identify the organization's primary constraint and an appropriate direction for an organization-wide strategy for dealing with it. Then, identify the projects that are most directly related to that strategy, and to the ability of other aspects of the organization to support it.
From this 'ranking' list of projects we can assign the required resources to progress them quickly rather than to projects with the highest profile which may not satisfy the criteria for the highest priority. Note that by foucusing on organizational constraint issues, the ranking is a qualitative, intutive process more than a pure mathematical. Obviously, the returns may come into play for fine-tuning, but if you start with addressing the constraint, the returns will be real and significant.
My suspicion is that of the most projects in the typical portfolio, there are actually very few that address more than just local cost-cutting efforts of questionable value and instead actually support growing your ability to attract demand from your market and deliver against it reliably and profitably. Without an understanding of your major constraint and some rational direction for addressing it, any simplistic effort at rating or ranking your list of projects will probably fall short of what is needed.
The good news is that getting a handle on the constraint and a strategy for dealing with it is easier than it sounds, as long as the right people are involved. Since I would expect that unexamined portfolios cover most if not all of the functional areas of the organization, those areas all have an interest in the process for determining the priorities. Even more than that, the management team has the RESPONSIBILITY for being involved. If a Program Office can provide a process for understanding the constraint and prioritizing projects, but the top management responsible for the functions and processes have to provide the intuition and input regarding what is important to them.
This works in our favor, because TOC provides a process for quickly identifying the organization's real constraint for and aligning the individual functions with the efforts required to address it. This process is based on identifying the top functional problems and putting them in context with that constraint.
Remember that the existence and the nature of the constraint is linked to most major issues faced throughout the organization. Once management understands how the constraint is at the root of their own individual problems, they will quickly come to agreement on what projects are needed to address it, and more importantly which projects are NOT appropriate efforts for your the attention of scarce resources. What better way is there to get an group of people behind an effort than to bring them to understand what is in it for them individually are solutions to their major headaches.
The process for doing the above can usually be facilitated with about a week of effort, assuming a typical participating management team of 8-12 executives with some minimal pre-preparation. Once an appropriate mind-set is developed through an introduction to the concept of the constraint as the appropriate center of management attention and to how it can be applied to a variety of typical organizational functions and processes, the actual process of understanding the organization's situation can start.
The first actual step is aimed at understanding the individual pains felt by the management team and the functions they represent, and from that understanding, dig down to identify the core, constraining issue. Frem there, directions for dealing with that constraint and for for the original individual problems that align to it, and through it, to each other. It is expected that a number of projects in the incoming portfolio will surface as supportive of these solutions, and a number of others will be obviously seen as of questionable value. After that, we assess any remaining "borderline" projects, identify precedences that will also guide priority, and finalize buy-in to the list as an appropriate portfolio for meaningful organizational improvement.
As a result of this effort, management participation assures appropriate input on what needs changing and informed intuition for developing what might be considered strategic directions. It also yields clear and consistent messages regarding the appropriate project priorities across the organization.