Human in the loop

Confirmation makes sense where a decision moves money, reaches the outside world, or cannot be undone. Confirming everything else creates fatigue and leads to rubber stamping.

As a by-product it creates the most valuable data such a system has: the corrections. They show where the model is reliable and where it is not.