Week 12 · lesson

Checklist Failure Review

A checklist can fail even when every box is checked.

That sounds ridiculous until you remember that a checklist is software written for humans. It contains assumptions, sequence, wording, versions, and dependencies. Bad logic can hide inside paper just as easily as inside code.

This lesson reviews a fictional mission where the crew followed the checklist and still reached an avoidable no-go condition.

The supplied event

The classroom packet says:

mission: simulated roof inspection
checklist revision: 2.1
current aircraft configuration: 3.0
weather: inside approved classroom limits
site: clear at initial briefing
airspace evidence: current in packet
payload: recently moved to a new mount
preflight checklist: all boxes checked
result: payload view was obstructed during final mission simulation

Nobody skipped the checklist.

The checklist did not contain a verification that matched the new payload configuration.

First question: was the item missing or weak?

Two different checklist defects can create failure.

Missing item

The procedure never asks about the condition.

Weak item

The condition appears, but the wording does not prove the right thing.

Example weak item:

□ Camera installed

The camera is installed. The box is true.

But the mission needs:

□ Camera field of view is unobstructed for all required capture directions in the current payload configuration.

The original item tested presence. The mission needed usable geometry.

Second question: did the checklist match the configuration?

The checklist was revision 2.1. The aircraft/payload configuration was revision 3.0.

That mismatch is already a warning.

A configuration-sensitive checklist should identify which system revision it applies to.

Otherwise the team can execute an obsolete procedure perfectly.

This is the paperwork version of running old software against a new interface.

Third question: was the check performed at the right time?

Suppose a site-clear check occurs at the morning planning meeting, but the mission runs after lunch.

The item was completed.

The evidence expired.

Time-sensitive checks need to occur close enough to the operation to still mean something.

Examples include:

  • current weather;
  • operating-area occupancy;
  • temporary restrictions/notices;
  • final aircraft condition after transport/setup;
  • crew availability.

The checklist must encode when the condition matters.

Fourth question: what happened when an item failed?

A checklist line says:

□ Telemetry link stable

A student notices intermittent dropouts but marks the item with a note:

Mostly okay.

The procedure never defines what failure means.

A strong checklist has a response:

If NOT verified → mission status HOLD; diagnose link before proceeding.

Without that response, the checklist identifies a problem but does not control it.

Build the failure chain

For the supplied payload incident, trace:

configuration changed
→ checklist version did not change
→ old item verified camera presence only
→ field-of-view requirement remained unchecked
→ crew completed every listed item
→ mission reached final simulation with obstructed data

The crew behavior was consistent with the procedure.

The procedure was incomplete.

That is why process review must look beyond “did they follow the checklist?”

Corrective action should target the mechanism

Weak correction:

Just pay more attention to the camera next time.

Stronger corrections:

  • tie checklist revision to aircraft/payload configuration;
  • replace “camera installed” with an observable field-of-view check;
  • add checklist review to configuration-change workflow;
  • require final payload-data sample before mission-ready state.

Those changes make the system less dependent on memory.

Another case: skipped inspection after interruption

A second fictional packet shows:

  1. crew begins checklist;
  2. announcement interrupts the team;
  3. work resumes;
  4. one line is skipped;
  5. no restart marker exists;
  6. missing fastener is found during later review.

The defect is not necessarily the wording of the item.

It is interruption recovery.

Possible system controls include:

  • visible current-step marker;
  • restart from a defined checkpoint after interruption;
  • challenge-response confirmation for critical blocks;
  • second-person verification where appropriate.

Again: fix the failure mechanism.

Review a checklist like code

Use these categories:

Coverage

Does it contain the critical failure modes?

Observability

Can the item actually be verified?

Sequence

Does it occur before the dependent action?

Freshness

Is time-sensitive evidence checked at the right time?

Configuration

Does the checklist match the current system revision?

Failure response

Does a failed item produce an explicit hold/no-go/escalation state?

Human usability

Can the crew use it under interruption and time pressure?

Your checklist failure review

Choose one supplied failure and produce:

  1. Observed failure — what reached the mission?
  2. Checklist defect — missing, weak, stale, wrong sequence, wrong version, or unclear response.
  3. Why the box could still be checked — explain the gap.
  4. Rewritten item — observable and configuration-aware.
  5. Failure response — what state should occur if verification fails?
  6. Regression test — what future scenario proves the checklist revision actually catches the old failure?

Yes, regression test.

A checklist revision should be tested against the failure that motivated it, just like a software bug fix.

Misconception: more checklist items always makes the checklist safer

Not necessarily.

Long checklists can create fatigue, rushed scanning, and meaningless box-checking.

The goal is not maximum length.

The goal is high-value controls at the right points in the workflow.

Unit 4 conclusion

Weeks 10–12 moved from external authority to operational conditions to human procedure:

airspace evidence → weather/site/crew readiness → checklist/emergency/incident control.

A professional operation depends on all three layers.

The next unit shifts from operating the aircraft to producing a technical data product: mapping and photogrammetry.