How we thinkIn practice

Four decisions come before the ranking.

Most groups start by ranking the list. Four earlier decisions get made anyway, and it is better to make them on purpose.

In this piece
  1. Who takes part, and who decides
  2. What is eligible to be ranked
  3. What matters, and how much
  4. What each item is worth against each criterion
  5. Then rank

Most groups start at the ranking. A list exists, a meeting is called, and the items start to move.

Four decisions come before that one. They get made whether or not anyone makes them deliberately. Left alone, they are made unconsciously, inconsistently, or by whoever spoke first. The result is a list nobody can defend the first time it is questioned.

Who takes part, and who decides

These are two different lists of people. The first is everyone whose knowledge should shape the outcome. The second is whoever can commit the organization to it. Write both down before the meeting, and say which is which.

What is eligible to be ranked

Decide what is in the set and what is not, and note what was left out and why. A ranking only means something when the things in it are the same kind of thing at the same level. A goal beside a task, or a problem beside one of its own solutions, cannot be put in order, because there is no common measure between them.

What matters, and how much

Agree on the criteria and the weight each one carries. Do it before scoring, while nobody yet knows which item a given weight will favor.

What each item is worth against each criterion

Score the items. People who know the work score it. Where they disagree, record what evidence would settle it.

Then rank

Ranking is the fifth step. It is only as sound as the four before it. If the order that comes out looks wrong, the fault is in one of the four, and that is where to go back.