Change in Human (Moral) Decision-Making and Performance with Automation: The Good, the Bad, and the Ugly in Human-Automation Interaction

Automation technologies are present in almost every domain of human activity and they are now more and more present in our everyday life. The reason for this massive deployment of automated systems would reside in all the benefits they offer to the users. In experimental settings, multiple studies have demonstrated the positive effects the introduction of automation can have on human decision-making and performance. However, studies have also demonstrated that the introduction of automation can have important negative effects as well. Considering that automation is now introduced in sensitive domains like military defense or medicine, more than ever we need a complete understanding of the effects caused by these systems on human performance and decision-making, and particularly in tasks and contexts with social or moral dimension. In this paper we will firstly review the main effects produced on a human agent’s behaviors by the introduction of automation. Then, we will review the conditions identified as underlying factors of these effects, and see how they are currently integrated in models of human – automation interaction. We will conclude this review by highlighting new directions for future investigations on human – automation interaction.