How AI works
Is it predicting something, or making something?
Short answerPredictive AI scores something that already exists, and the real answer eventually arrives to check it against. Generative AI produces something new, where there is usually no answer to check. That one difference sets how each is tested, what it runs on, and where its return can be measured.
| Predictive | Generative | |
|---|---|---|
| What it does | Assigns a number or a label to something that exists | Produces new text, images, code, audio, or video |
| Examples | Fraud, credit risk, demand, machine failure | Drafts, summaries, code, images |
| Ground truth | Arrives eventually, so accuracy is measurable | Often absent, so accuracy is often undefined |
| Hardware | Modest, often an organization's own machines | Frontier models need hyperscale facilities |
Ground truth is the whole difference
A fraud model flags a transaction. Weeks later the record shows whether it was fraud, and the model has been scored. That loop is what makes a predictive system testable: you can measure its accuracy, watch it drift, and compare it with whatever it replaced.
A generative model drafts a paragraph. No record will later say what the right paragraph was. "Accuracy" is frequently not even well defined, so evaluation becomes judgment: did a reviewer accept it, did it state anything false, did it break a rule.
Why the infrastructure differs
Predictive systems run on modest hardware and have been in production in banking and insurance for years, under existing regulation. Frontier generative models are what require hyperscale data centers, and most public argument about AI's energy and cost concerns them, usually without saying so. More in Does all AI need a hyperscale data center?
Where the measurable return sits
Predictive systems already do bounded work such as fraud detection, forecasting, underwriting, and maintenance, where later outcomes can measure performance. Generative deployment is also growing, but its returns are often measured through review, acceptance, or time saved without a single ground-truth outcome.
Where returns are measurable, they concentrate in predictive systems doing bounded, repetitive work with a ground truth to check against. Generative deployment is real and growing, and its returns are harder to attribute. That is a measurement problem, and it is no evidence of failure.
What this means for an organization
- Ask which kind a proposal is. A predictive project should arrive with a baseline and an accuracy target, because the answer will come in to check it. A generative one needs a different measure, such as time saved or the share of drafts accepted.
- Expect different evidence from vendors. For a predictive system, ask for accuracy measured against outcomes. For a generative one, ask how outputs are reviewed and what gets recorded.
- Give generative work a fair clock. Gains spread thinly across many people are real and slow to show up in a six-month payback.
Sources
- MIT Project NANDA, The GenAI Divide: State of AI in Business 2025. Preliminary, non-peer-reviewed findings based on more than 300 public initiatives, 52 interviews, and surveys of 153 senior leaders.
- NIST, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile, July 2024. Primary guidance on the distinct risks and measurement needs of generative AI.
Reviewed