All posts

Heuristic evaluation: how to run one in an afternoon

A heuristic evaluation is a review of an interface by a few people who check it against a set of usability rules, called heuristics, and write down every place it breaks one. It is quick and cheap. You do not need users, a lab or a budget, and one afternoon is enough for a single flow such as checkout or sign-up.

Most teams use Nielsen's 10 usability heuristics as the rules. This guide covers the six steps, how to score what you find, a worked example, and where the method stops being useful.

What a heuristic evaluation is, and what it is not

Jakob Nielsen and Rolf Molich formalised the method in 1990. A small group of evaluators each inspect the interface alone, compare it against the heuristics, and list the problems they find. The evaluators are the testers, so there is nobody to recruit or schedule.

It finds likely problems. It does not prove that users struggle. For that you need to watch real people, which is what a usability test does. If you are unsure how many people that takes, see Nielsen's 5-User Rule.

How to run a heuristic evaluation in six steps

  1. Pick one flow, not the whole product. Checkout, sign-up or the first-run experience. A flow you can walk through in 10 to 15 minutes keeps the review focused.
  2. Choose three to five evaluators. A single evaluator finds only about a third of the problems, while three to five together find most of them. Designers, researchers and engineers all work, and people who did not build the screen see more than the people who did.
  3. Agree on the rules. Use Nielsen's 10 heuristics unless your product has its own list, and give everyone the same one.
  4. Inspect alone, at least twice. Use the first pass to get a feel for the flow and the second to check each screen against the list. Do not compare notes until everyone has finished, or the first opinion will colour the rest.
  5. Log every problem the same way: where it is, which heuristic it breaks, what you saw, and a severity from 0 to 4.
  6. Merge and fix. Combine the lists, remove duplicates, agree on the severity of each issue, and fix the worst first. Then check the fixes with real users.

How to rate severity

Nielsen's scale runs from 0 to 4. Rate each problem on how often it happens, how badly it hurts, and whether people can get past it.

RatingWhat it means
0Not a usability problem
1Cosmetic only. Fix it if there is time
2Minor. Low priority
3Major. Important to fix
4Catastrophe. Fix it before release

A worked example: a food-delivery checkout

Imagine three people reviewing the checkout of a delivery app. This is a made-up example, but the findings are the kind you will see in real products.

What the evaluator sawHeuristic it breaksSeverity
Tapping Pay shows no sign of progress for several secondsVisibility of system status4
A declined card shows the message "Error 402"Help users recognise, diagnose and recover from errors3
The phone field rejects (415) 555 0132 and accepts only 415-555-0132Error prevention3
Removing an item reloads the cart, with no undoUser control and freedom2
The same charge is called "Tip" on one screen and "Driver bonus" on the nextConsistency and standards2
A promo banner pushes the Pay button below the fold on small phonesAesthetic and minimalist design2

The first finding gets fixed today. The last can wait for the next design pass. Three evaluators will not agree on every number, and that is expected. Settling those differences is the point of the merge step.

How to turn findings into fixes

Each finding points to a fix, and often to a UX law that explains why it matters. A missing status message is a Doherty Threshold problem: people expect a response within about 400 milliseconds. An unhelpful error is a Design Every State problem. A rejected phone number is a Postel's Law problem, because the form should accept what people reasonably type.

A crowded screen is an Aesthetic-Usability Effect and Density Matches Context problem. Naming the law gives you a reason to put in front of the team, not just an opinion.

When a heuristic evaluation is the wrong tool

  • You need to know whether people can finish a task. Only watching users answers that.
  • The product has no flows yet. Evaluators need something to walk through.
  • Your evaluators are the people who built it. They know too much to see what a newcomer sees.
  • You expect it to find every problem. It also raises false alarms, issues no real user would hit, so treat the output as a list to check, not a verdict.

Use it early, cheaply and often, then use user tests to confirm the problems that matter most.

Practise spotting problems

Reading about heuristics is the easy part. The skill is looking at a screen and naming what is wrong. In UX Quest, each UX law comes with a real screen to judge. Design Every State is a good place to start for status and error problems, and Postel's Law covers forgiving forms. Each law page says whether its challenge is free or part of Pro.

Common questions

What is a heuristic evaluation?

A heuristic evaluation is a usability review in which a few evaluators inspect an interface against a set of rules, called heuristics, and list every problem they find. Jakob Nielsen and Rolf Molich formalised the method in 1990.

How many evaluators do you need?

Three to five. One evaluator finds only about a third of the problems, and each extra evaluator adds less than the one before, so more than five is rarely worth it.

How long does a heuristic evaluation take?

It depends on the size of the flow. A single flow such as checkout fits in an afternoon, including the meeting where the evaluators merge their findings.

What is the difference between a heuristic evaluation and usability testing?

In a heuristic evaluation, evaluators inspect the interface against rules. Usability testing watches real users try to complete tasks. The first finds likely problems cheaply, and the second shows which ones actually hurt.

What is a severity rating in a heuristic evaluation?

A score from 0 to 4 that says how serious a problem is, where 0 is not a problem and 4 is a catastrophe that must be fixed before release. Use it to decide what to fix first.

Sources

  • Nielsen Norman Group: How to conduct a heuristic evaluation
  • Nielsen Norman Group: 10 usability heuristics for user interface design
  • Wikipedia: Heuristic evaluation

Keep reading

  • Nielsen's 10 usability heuristics, with a real example of each
UX QuestUX LawsPricingAboutBlogContactPopular UX laws:60-30-10 RuleDesign every stateStatistical PowerFunnel TriageAccessible contrastDensity Matches ContextHick's LawFitts's LawAll UX laws