Arbeitspapier

Putting a Human in the Loop: Increasing Uptake, but Decreasing Accuracy of Automated Decision-Making

Are people algorithm averse, as some previous literature indicates? If so, can the retention of human oversight increase the uptake of algorithmic recommendations, and does keeping a human in the loop improve accuracy? Answers to these questions are of utmost importance given the fast-growing availability of algorithmic recommendations and current intense discussions about regulation of automated decision-making. In an online experiment, we find that 66% of participants prefer algorithmic to equally accurate human recommendations if the decision is delegated fully. This preference for algorithms increases by further 7 percentage points if participants are able to monitor and adjust the recommendations before the decision is made. In line with automation bias, participants adjust the recommendations that stem from an algorithm by less than those from another human. Importantly, participants are less likely to intervene with the least accurate recommendations and adjust them by less, raising concerns about the monitoring ability of a human in a Human-in-the-Loop system. Our results document a trade-off: while allowing people to adjust algorithmic recommendations increases their uptake, the adjustments made by the human monitors reduce the quality of final decisions.

Sprache
Englisch

Erschienen in
Series: Discussion Paper ; No. 438

Klassifikation
Wirtschaft
Technological Change: Choices and Consequences; Diffusion Processes
Design of Experiments: General
Micro-Based Behavioral Economics: General‡
Thema
automated decision-making
algorithm aversion
algorithm appreciation
automation bias

Ereignis
Geistige Schöpfung
(wer)
Sele, Daniela
Chugunova, Marina
Ereignis
Veröffentlichung
(wer)
Ludwig-Maximilians-Universität München und Humboldt-Universität zu Berlin, Collaborative Research Center Transregio 190 - Rationality and Competition
(wo)
München und Berlin
(wann)
2023

Handle
Letzte Aktualisierung
10.03.2025, 11:42 MEZ

Datenpartner

Dieses Objekt wird bereitgestellt von:
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.

Objekttyp

  • Arbeitspapier

Beteiligte

  • Sele, Daniela
  • Chugunova, Marina
  • Ludwig-Maximilians-Universität München und Humboldt-Universität zu Berlin, Collaborative Research Center Transregio 190 - Rationality and Competition

Entstanden

  • 2023

Ähnliche Objekte (12)