https://pluralistic.net/2023/08/23/automation-blindness/

Een fijne uiteenzetting van de briljante Cory Doctorow over waarom menselijke controle op AI niet kan werken. De reden? Automatiseringsblindheid.

#Pluralistic #automationblindness

This is an inescapable, biological aspect of human cognition: we *can't* maintain vigilance for rare outcomes. This has long been understood in automation circles, where it is called "#AutomationBlindness" or "#AutomationInattention":

https://pubmed.ncbi.nlm.nih.gov/29939767/

Here's the thing: if nearly all of the time the machine does the right thing, the human "supervisor" who oversees it becomes *incapable* of spotting its error.

10/