Week 16 · lesson
The Model Is Only One Component
It is tempting to draw an AI system as one box labeled MODEL. That picture hides most of the engineering.
A more useful view is:
input → validation → preprocessing → model → decision policy → action → logging/monitoring
Human review, fallback behavior, and override authority may sit beside several of those stages.
The same model can live inside very different systems
Imagine a classifier that returns a score from 0 to 1.
System A displays the score to a technician.
System B automatically stops a machine when the score exceeds 0.70.
System C sends scores from 0.40–0.80 to a human and acts automatically only outside that uncertain band.
The model can be identical in all three systems. The consequences are not.
Suppose the model returns 0.74.
- In System A, the output is information.
- In System B, it becomes an automatic action.
- In System C, it triggers human review.
The model output did not change. The system policy changed what the output meant operationally.
Interfaces create new failure modes
Each boundary can fail independently:
- input schema changes;
- units change from centimeters to meters;
- preprocessing code is updated incorrectly;
- model service times out;
- a threshold configuration changes;
- logging stops;
- a fallback path is missing;
- human override becomes unavailable.
A high evaluation score does not test all of these conditions.
Build a system map before claiming system quality
For any AI application, identify:
- where data enters;
- what validates it;
- what transforms it;
- where inference occurs;
- how scores become decisions;
- what happens when a component fails;
- who can stop or override the system;
- what evidence is logged.
That map is the beginning of AI systems engineering.
Before moving on
Take a model you encountered earlier in the course and name three non-model components required to turn its prediction into a usable application.
Experiment pipeline
From a fixed model result to a bounded system decision
Follow one fixed result through expected and failure traces to a bounded system decision.
Input preparation
Fixed Request and Model Result
Hold one fictional request and the plastic-like 0.78 model result fixed across every architecture trace.
Model configuration
Architecture Configuration
Choose model-only or bounded-review architecture and select one incident to inject.
Evaluation
Expected Request Trace
Follow the clean request through contracts, features, model serving, monitoring, and review.
Injected Failure Trace
Follow schema drift, network loss, or model age to a stop, fallback, warning, or unsafe continuation.
Safeguard Comparison
Compare what each architecture validates, records, withholds, and exposes.
Decision
Authority Decision
Name who may accept, reject, pause, or change the system and what evidence remains missing.
Read this concept flow as plain text
- Fixed Request and Model Result. Hold one fictional request and the plastic-like 0.78 model result fixed across every architecture trace. FIXED EVIDENCE: 1 REQUEST · SCORE 0.78.
- Architecture Configuration. Choose model-only or bounded-review architecture and select one incident to inject. CONTROL: ARCHITECTURE + INCIDENT.
- Expected Request Trace. Follow the clean request through contracts, features, model serving, monitoring, and review. CLEAN PATH: REVIEW CARD · 42 MS.
- Injected Failure Trace. Follow schema drift, network loss, or model age to a stop, fallback, warning, or unsafe continuation. FAILURE PATH: VISIBLE RESPONSE.
- Safeguard Comparison. Compare what each architecture validates, records, withholds, and exposes. BOUNDARY CHECK: DETECT · STOP · FALL BACK.
- Authority Decision. Name who may accept, reject, pause, or change the system and what evidence remains missing. ACTION RULE: HUMAN REVIEW REQUIRED.