Find Yourself

Explore

Thinking & Practice

Current Thinking

About

Work With David

Your AI Found 200 Anomalies Overnight. Now What?

Your AI Found 200 Anomalies Overnight. Now What?

CURRENT THINKING · DAVID TALLMAN

AI is rapidly reducing the cost of detecting what is unusual.


A management team can now scan operational data, project information, financial performance, customer activity, service incidents, meeting transcripts, risk logs, and other management information at a scale that was previously impractical. Patterns can be identified earlier, weak indicators can be combined, and inconsistencies can be surfaced before they become obvious through conventional reporting.


That creates real value. It also changes the management problem.


If an AI system identifies 200 anomalies overnight, the organization still has to determine which of them matter, what they mean, who should pay attention, and what response is appropriate.


The emerging constraint is therefore not necessarily sensing. It is evaluation.


AI can scale detection much faster than organizations can expand their capacity to evaluate what it finds and ensure that appropriate judgment and authority are available when needed. The result is a shift in the management bottleneck: from finding information to deciding what deserves attention.

1. When detection stops being the constraint

Many established management mechanisms developed under conditions in which collecting, consolidating, and interpreting information was relatively expensive. Weekly reporting, exception processes, dashboards, management reviews, and escalation routines did more than communicate status. They reduced a complex operating environment into a volume of information that management could reasonably consider.


AI changes that operating condition.


It can examine large volumes of heterogeneous information continuously and identify changes, patterns, inconsistencies, or emerging conditions that might previously have remained hidden between reporting cycles. Problems may become visible earlier. Similar developments across different parts of the organization can be connected. Reported status can be tested against underlying evidence.


But management capacity does not expand simply because sensing improves.


Executives still have finite time. Specialists still have limited capacity to investigate. Managers still have to interpret evidence within context, make trade-offs, and exercise judgment. If every detected deviation becomes a management issue, the organization replaces information scarcity with attention overload.


The value of better sensing therefore depends on what happens after detection.


2. From anomaly to management signal

An anomaly is evidence that something differs from an expected pattern. It is not, by itself, evidence that management should act.


The distinction matters because unusual conditions can have very different meanings. A detected variance may reflect a real emerging problem, normal operating variation, poor data quality, an expected exception, or a condition with little business consequence.


The reverse is also true. A small deviation may deserve immediate attention because of where it occurs. A modest schedule movement on an internal task may have little significance. The same movement on the critical path of a regulatory commitment or major customer migration may materially change the situation.


Several weak indicators may also become significant when viewed together. Delivery delay, declining resource availability, changing customer sentiment, and more defensive language in management discussions may each appear manageable in isolation. In combination, they may indicate deterioration that no single metric reveals.


AI can help identify those relationships, but detecting a potentially significant condition is only the beginning of the management process.


The management task is to determine whether the detected condition is material in its operating context and, if so, what level of attention and response it warrants.


The relevant question is therefore not simply whether something unusual has been found. It is:

What does this condition mean in the context of the situation we are managing, and does it deserve management attention?


That is the transition from detection to interpretation.


3. Management needs disposition, not just prioritization

A common response to a growing volume of signals is to rank them. Scores are assigned, the highest items move to the top of a dashboard, and management focuses on the first few.


Prioritization is useful, but it is not sufficient. Management must determine how the matter should be handled.

Depending on the situation, the appropriate next handling step may be to continue observing, validate the evidence, investigate further, increase monitoring, seek specialist review, escalate the matter, intervene where authorized, or deliberately take no further action.


That last option matters. Where the signal has been evaluated and there is a legitimate, intentional basis for not progressing it further, no action can itself be a governed management response.


The purpose of evaluation is therefore not to force every signal toward action. It is to determine the response appropriate to the evidence, context, and consequence.


Several dimensions help structure that judgment

  • Impact: What happens if the organization is wrong or fails to respond? The consequence may be operational, financial, customer-related, regulatory, reputational, or safety-related.

  • Confidence: How reliable is the signal and its interpretation? Data quality, source reliability, corroborating evidence, assumptions, and historical false positives all matter. Model confidence is not the same as management confidence.

  • Velocity: How quickly could the condition deteriorate? A stable problem and a rapidly worsening one may require very different responses even when their present state appears similar.

  • Exposure: Is the organization still operating within an acceptable boundary? A threshold may have been crossed, a dependency may have become fragile, or reversibility may be declining.

  • Context: What changes the meaning of the signal? Customer importance, project phase, regulatory obligation, decision history, dependencies, and prior assumptions can all alter significance.


These are best treated as management considerations, not as another scoring bureaucracy. Their purpose is to make judgment more disciplined and to explain why one signal deserves attention while another does not.

They also help determine whose attention is required.


An effective management system should not route every important signal upward. The objective is to place the issue at the appropriate level, with sufficient context and legitimate authority to deal with it, escalating when consequence, uncertainty, dependency, or authority requires a broader response.


That is as much an attention-allocation problem as a prioritization problem.


4. Intelligence does not become action automatically

Better dashboards will not solve this problem by themselves.


Dashboards improve observability. AI can improve synthesis. Neither determines the management consequence of what has been detected.


The critical mechanisms sit between visibility and action:

  • Who evaluates the signal?

  • What context and evidence are required?

  • What determines its disposition?

  • When is escalation or intervention required?

  • Who holds the authority to act?


Without clear answers, an organization can become highly informed without becoming better managed.

There is also no reason AI should stop at detection. It can participate in evaluation by comparing a new condition with prior situations, retrieving relevant decision history, identifying related developments elsewhere, testing consistency across evidence, or highlighting assumptions that may no longer hold.


That can materially improve both the speed and quality of evaluation.


But there is an important distinction between AI participating in evaluation and AI being delegated authority over consequential action.


A system that identifies a condition and recommends investigation is performing a different management function from one that reallocates resources, suspends activity, changes a customer commitment, or triggers another consequential action.


The closer AI moves toward consequence, the more clearly the organization must define the relationship between recommendation, judgment, decision, authority, and execution.


The boundary between recommendation and consequential action should be an explicit management design decision, not an accidental consequence of automation.


5. The management bottleneck moves

Organizations have spent decades improving access to management information for a simple reason: managers cannot respond effectively to conditions they cannot see.


AI may remove a significant part of that constraint.


But removing one constraint does not remove constraint from the management system. It often moves it.

If AI can generate signals faster than management can interpret them, evaluation becomes the bottleneck.


If evaluation improves but nobody has sufficient authority to respond, authority becomes the bottleneck.


If authority exists but the organization cannot execute quickly enough, execution becomes the bottleneck.


This is why AI should not be treated only as a technology capability. It changes the operating conditions of management.


It changes how much the organization can observe, how quickly evidence can be synthesized, and how rapidly a signal can reach the point where a management response is required. If the surrounding management mechanisms remain unchanged, better intelligence can simply expose the next constraint more quickly.


The practical implication is that management systems need to adapt as sensing improves.


6. Governing management attention

The objective is not for managers to pay attention to more things.


It is to become better at determining where management attention creates value.


Some conditions should remain under automated observation. Some belong with local management. Some require specialist review. Some should be validated before they move further. A relatively small number may warrant immediate senior-management attention because the consequence, uncertainty, or authority requirement justifies it.

Management systems have always had to make these distinctions in one form or another. AI makes the requirement more explicit because the supply of potential intelligence can now grow much faster than the supply of management attention.


The opportunity is not to help management see everything. It is to identify what is material, establish an appropriate response, and route the issue to the level where judgment and legitimate authority can be applied while there is still time to make a difference.


AI makes intelligence more abundant. It does not make management attention unlimited.


When intelligence becomes abundant, management attention becomes a governed allocation decision.


Menu

Create a free website with Framer, the website builder loved by startups, designers and agencies.