All terms
Glossary
Human in the loop
A flow in which a person confirms, corrects or rejects at defined points before an action takes effect.
Confirmation makes sense where a decision moves money, reaches the outside world, or cannot be undone. Confirming everything else creates fatigue and leads to rubber stamping.
As a by-product it creates the most valuable data such a system has: the corrections. They show where the model is reliable and where it is not.
How you notice it
- A wrong decision would be expensive or irreversible.
- The model is good but not in every case.
- A department still has to learn to trust the system.
Frequently asked
How do you move from review to automation?
Through confidence scores. Everything below a threshold goes to review, everything above passes through. If reviewed cases are confirmed 98 per cent of the time over weeks, the threshold can drop. Without those numbers review stays forever.