Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Trust in Artificial Intelligence: Modelling Human Operators’ Decision-Making in Highly Dangerous Situations

Version 1 : Received: 29 September 2023 / Approved: 29 September 2023 / Online: 29 September 2023 (10:03:36 CEST)

A peer-reviewed article of this Preprint also exists.

Venger, A.L.; Dozortsev, V.M. Trust in Artificial Intelligence: Modeling the Decision Making of Human Operators in Highly Dangerous Situations. Mathematics 2023, 11, 4956. Venger, A.L.; Dozortsev, V.M. Trust in Artificial Intelligence: Modeling the Decision Making of Human Operators in Highly Dangerous Situations. Mathematics 2023, 11, 4956.

Abstract

Here, we propose a prescriptive simulation model of a process operator’s decision-making assisted by artificial intelligence (AI) algorithm in a technical system control loop. We analyze situations fraught with a catastrophic threat that may cause unacceptable damage. Operators’ decision-making is interpreted in terms of a subjectively admissible probability of disaster and subjectively necessary reliability of its assessment. We distinguish four extreme decision-making strategies corresponding to different ratios between the above variables. An experiment simulating a process facility, an AI algorithm and operator's decision-making strategy was held. It showed that depending on the properties of a controlled process (the speed of hazard onset) and the AI algorithm characteristics (Type I and II error rate), each of such strategies or some intermediate strategy may prove to be more beneficial than others. The same approach is applicable to the identification and analysis of sustainability of strategies applied in real-life operating conditions, as well as to the development of a computer simulator to train operators to control hazardous technological processes using AI-generated advice.

Keywords

human operator; trust in artificial intelligence; recommender systems; intelligent decision-making systems; admissible probability of disaster; and equipment predictive analytics

Subject

Engineering, Industrial and Manufacturing Engineering

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.