Why measurement systems are no longer capturing reality — and what happens when they start managing it instead
FROM THE CRAIG BUSHON SHOW MEDIA TEAM
Customer feedback systems were originally designed to answer a simple question: did the experience meet expectations?
In their early form, these systems functioned as a feedback loop. Organizations could identify breakdowns, adjust processes, and improve outcomes over time. The data had value because it was relatively unfiltered.
That is no longer how most systems actually operate.
Today, feedback metrics are often tied directly to financial, operational, and reputational consequences. Compensation structures, performance evaluations, funding decisions, and even resource allocation are influenced by these scores. When a measurement becomes embedded in incentives, its function changes.
It stops being a neutral measurement and becomes a managed outcome.
This shift alters behavior across entire organizations. Leadership relies on the data to evaluate performance. Management relies on the data to maintain control and consistency. Employees operate within systems where the metric itself carries consequences.
But once pressure is attached to the measurement, the system begins to optimize for the score rather than the underlying reality.
That is why a pattern has emerged across industries: people are increasingly coached—directly or indirectly—on how to produce the desired outcome within the measurement system.
Customers are coached on how to respond. Patients are influenced by how care is delivered. Students are prepared to perform on specific assessments. Employees are trained to align with metrics rather than outcomes.
From a data integrity standpoint, this introduces a structural problem.
If responses and behaviors are shaped before they are recorded, the measurement no longer reflects an independent assessment of reality. It reflects a guided outcome. The signal becomes distorted at the point of collection.
The result is a feedback loop that appears stable on the surface but is increasingly disconnected from what is actually happening underneath.
Organizations receive strong scores and interpret them as improvement. Systems appear to be functioning efficiently. Reports show consistency and progress.
But the underlying data has been conditioned — which reduces its usefulness for decision-making.
Problems don’t disappear. They get harder to detect early.
This dynamic also has a direct effect on the workforce.
In any skilled profession, performance improves through experience — through judgment, timing, and the ability to adapt to real-world conditions. The difference between average and high-level performance is rarely adherence to a script. It is the ability to navigate complexity with precision.
When experienced professionals are required to operate within rigid, metric-driven systems, the nature of the work changes. The emphasis shifts from judgment to compliance.
For less experienced individuals, structured systems can provide guidance. For those with deep expertise, over-standardization introduces friction. It reduces autonomy without necessarily improving results. In some cases, it actively interferes with processes that are already effective.
This pattern is not isolated to one field. It appears wherever measurement becomes tied to consequence.
In healthcare, patient satisfaction scores are linked to reimbursement models and institutional performance. While intended to improve care quality, this structure can create pressure to optimize satisfaction even when it conflicts with clinical judgment. A widely cited national study published in JAMA Internal Medicine found that higher patient satisfaction was associated with increased healthcare utilization, higher costs, and higher mortality risk—highlighting how systems optimized for satisfaction can diverge from those optimized for outcomes.
In education, standardized testing has become a primary tool for evaluating schools, teachers, and districts. When funding and accountability are tied to those scores, behavior reorganizes accordingly. Curriculum narrows. Instruction shifts toward tested material. In extreme cases, performance metrics themselves become the focus rather than the learning they were meant to represent.
In financial services, incentive-driven metrics have produced even more visible distortions. The Wells Fargo account fraud scandal demonstrated how systems tied to aggressive targets can lead to outcomes where the metric improves while the underlying reality deteriorates.
These examples differ in context but share a common structure. A measurement is created to reflect something real. That measurement is tied to meaningful consequences. The system adapts by optimizing for the measurement itself. Over time, the measurement becomes separated from what it was designed to represent.
This is Goodhart’s Law in action: when a measure becomes a target, it ceases to be a good measure. The information produced still looks like data — clean, consistent, reportable. But its connection to reality has been quietly severed at the source.
In each case, the mechanism is the same. A measurement tool becomes a target. Behavior reorganizes around that target. The original purpose of the measurement — to provide insight — becomes secondary.
This does not produce immediate failure. In the short term, it often produces the opposite. Metrics stabilize. Reports improve. Systems appear to be performing at a high level.
The consequences emerge more gradually.
When data is shaped to meet expectations, leadership loses visibility into real conditions. Decisions are made based on information that appears accurate but is structurally unreliable. Over time, this can lead to misallocation of resources, flawed evaluations, and declining trust within organizations.
At the individual level, the effect is more immediate. High performers—particularly those with experience—recognize when metrics no longer align with reality. When that gap widens, engagement shifts. The work becomes more transactional, less connected to craftsmanship or professional identity.
The experience for those on the receiving end—customers, patients, students—also changes. Interactions become more standardized, less adaptive, and increasingly focused on producing a favorable outcome within the system rather than addressing underlying needs in a durable way.
None of this suggests that measurement itself is the problem. Data remains essential in complex systems.
The issue is how measurement is integrated into incentives — and how aggressively organizations attempt to control outcomes rather than interpret them.
Systems that recognize this distinction can recalibrate. They can separate evaluation from incentive pressure and allow experienced professionals to operate with appropriate autonomy while maintaining accountability for results.
Systems that do not make that adjustment will continue to see a widening gap between reported performance and actual conditions.
Ultimately, this is not just a story about flawed feedback systems. It is about how modern institutions increasingly prioritize control, predictability, and measurable outputs — even in domains that depend on human judgment, variability, and hard-won experience.
That approach can produce clean metrics. It does not always produce accurate ones.
Disclaimer This opinion piece reflects general observations and structural analysis based on widely reported practices across multiple industries. It is not intended to make claims about any specific organization or individual. Examples referenced are illustrative of broader incentive-driven systems and are used for analytical and educational purposes.
