Version 1
: Received: 24 August 2021 / Approved: 27 August 2021 / Online: 27 August 2021 (13:05:02 CEST)
How to cite:
Krstajic, D. The Costs and Potential Benefits of Introducing the “I Don’t Know” Answer in Binary Classification Settings. Preprints2021, 2021080521. https://doi.org/10.20944/preprints202108.0521.v1
Krstajic, D. The Costs and Potential Benefits of Introducing the “I Don’t Know” Answer in Binary Classification Settings. Preprints 2021, 2021080521. https://doi.org/10.20944/preprints202108.0521.v1
Krstajic, D. The Costs and Potential Benefits of Introducing the “I Don’t Know” Answer in Binary Classification Settings. Preprints2021, 2021080521. https://doi.org/10.20944/preprints202108.0521.v1
APA Style
Krstajic, D. (2021). The Costs and Potential Benefits of Introducing the “I Don’t Know” Answer in Binary Classification Settings. Preprints. https://doi.org/10.20944/preprints202108.0521.v1
Chicago/Turabian Style
Krstajic, D. 2021 "The Costs and Potential Benefits of Introducing the “I Don’t Know” Answer in Binary Classification Settings" Preprints. https://doi.org/10.20944/preprints202108.0521.v1
Abstract
We are of the opinion that during the design of a binary classifier one ought to consider adding an “I don’t know” answer. We provide the case for the introduction of this third category when a human needs to make a decision based on the answer from a binary classifier. We discuss the costs and potential benefits of its introduction. Colloquially, we have used the term “I don’t know”, but formally we refer to it as NotAvailable. A procedure to define NotAvailable predictions in binary classifiers, called all leave-one-out models (ALOOM), is presented as proof of the concept. Furthermore, we discuss the potential benefits of applying ALOOM in real life applications.
Computer Science and Mathematics, Probability and Statistics
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
