The idea
Evaluating the work itself and understanding its consequences provide different information. Learning requires enough visibility into downstream use, difficulties, and outcomes to investigate how the contribution mattered.
Worked example · illustrative
Signs that look clear but leave people lost
Situation. You’ve made signs to help people find registration at an event. The text is easy to read, the arrows are clear, and the organizer likes them. You’re pleased with how they turned out.
The tempting conclusion. The signs look good and everyone’s happy with them. That job’s done.
What changes the view. At the event, you notice visitors stopping to ask where registration is. You walk in from the entrance and realize the first sign is after the turn where people get confused. A volunteer moves it before the turn, and you watch the next arrivals to see whether they can find their way more easily.
What this supports. Seeing people arrive tells you something the design review couldn’t: where they need help. If fewer people stop to ask after the sign moves, that suggests the new position helps. A volunteer giving directions could also make a difference, so it’s worth noticing what else is happening. For the next event, you have a clearer idea of where to put the signs and what to check.
Useful when
Watch for
Outcomes alone do not establish the quality of a decision or an individual's contribution. Other people, external conditions, chance, and delayed effects can influence what happens.
Where this came from
Research, Product work, Startups, Mentoring