A metric improved after we changed its definition. Can we claim success?

Broken metric comparability

Separate the effect of the definition change from actual performance change. Preserve the old definition and explain any restated series rather than presenting an artificial trend.

What to do now

  1. Document the old and new definitions
  2. Assess whether historical data can be restated
  3. Mark the comparison break clearly
  4. Evaluate real change using comparable evidence
Recommended action flow for broken metric comparability: Document the old and new definitions then Assess whether historical data can be restated then Mark the comparison break clearly then Evaluate real change using comparable evidence. Escalate when the claim materially misleads stakeholders or public reporting.

When to escalate

Escalate when

The claim materially misleads stakeholders or public reporting.

Who decides

The metric owner and relevant decision maker

Example

A completion-rate chart marks the date when canceled requests were excluded from the calculation.

Mistake to avoid

Presenting a lower denominator as operational improvement.

Prevent a repeat

Check data freshness and meaning, and verify that the measure improves decisions rather than encouraging cosmetic progress.

Suggested ApprovedFlow setup

  • Projects
  • Tasks
  • Timesheets
  • Documents

Use the underlying named records and evidence when explaining a metric; validate any dashboard behavior against the current implementation. See the platform

Related cases

Practice references