What makes a case study credible?

Role, constraints, evidence and uncertainty

Draft awaiting approval

This article is a draft awaiting approval. The text may still change, and search engines are asked not to index it yet.

A case study is credible when the reader can tell exactly who did what, under which constraints, what can be shown as evidence and what remains uncertain. Polished outcomes without those four things read as marketing, and experienced readers discount them.

The short answer

A case study earns trust when it answers four questions plainly: what was my role, what limited the work, what evidence can you inspect, and what do we still not know. Leave any of them out and an experienced reader fills the gap with doubt.

Why it matters

People who hire leaders or advisers read many case studies. Most of them sound the same: a big problem, a clean solution, an impressive percentage. Readers have learned to skim past that. What they look for are signs that the author understands how hard the work actually was, and is honest about their part in it.

Role: say exactly who did what

Enterprise products are built by teams. Product managers, analysts, engineers, testers, vendors and business owners all shape the result. Writing “I built the platform” may be shorter, but it is rarely true, and the people who know the project will notice.

A credible case separates “my contribution” from “the team’s contribution”. For example: I defined the scope and release stages, the team built and tested it, and a vendor supplied one component. That sentence makes the author smaller and the story more believable.

Constraints: show what limited the work

Every real project runs into fixed budgets, legacy systems, regulation, competing stakeholders and deadlines that do not move. Constraints explain the decisions. Without them, a reader cannot tell whether the result was good judgement or simply what anyone would have done with unlimited time.

Naming a trade-off, such as phasing a rollout instead of switching everything at once, shows the reasoning behind the work. That reasoning is usually what the reader wants to hire.

Evidence: separate what is documented from what is hoped

Numbers are useful only when the reader knows what they count. “Used by 22,000 people” might mean eligible employees, registered accounts or weekly active users. Those are very different claims.

A credible case keeps three things apart:

  • Coverage: documented scope, such as how many sites or companies a system served, with a date and a definition.
  • Measured change: improvements with a baseline and a method.
  • Intended value: what the work was designed to achieve, clearly labelled as intent.

When permission to share evidence is limited, which is common with former employers, it is better to say so than to round up.

Uncertainty: say what is still unknown

Few projects end with a clean verdict. Some features shipped and others stayed planned. Some benefits were observed, but never measured. Saying this openly does not weaken a case study. It tells the reader that the rest of the page can be trusted.

Qualifications

None of this means case studies should be dull or full of disclaimers. A clear narrative, good visuals and a confident voice still matter. The point is that confidence should come from precision, not from inflation.

  • Service: Product strategy

All insights

An 1897 architectural blueprint: white line drawings of building cross-sections on deep blue paper, with handwritten Dutch titles.
Sections for four villas, a blueprint from 1897.Credit: "Architectural drawing from the Engetrim archive, ref. obj-0000187" by Jules Bilmeyer Joseph Van Riel, CC0, via Wikimedia Commons
Steel engraving of Constantinople: figures in Ottoman dress rest on a hillside among cypress trees, with domes and minarets across the water beyond.
Constantinople, engraved by William Miller after Thomas Allom, 1847.Credit: "Constantinople engraving by William Miller after T Allom" by William Miller, public domain, via Wikimedia Commons