Preprint
Article

Performance of a Chest Radiography AI Algorithm for Detection of Missed or Mislabeled Findings: A Multicenter Study

Altmetrics

Downloads

142

Views

121

Comments

0

A peer-reviewed article of this preprint also exists.

Submitted:

05 August 2022

Posted:

10 August 2022

You are already at the latest version

Alerts
Abstract
Purpose: We assessed if a CXR AI algorithm can detect missed or mislabeled chest radiographs (CXRs) findings in radiology reports. Methods: We queried multi-institutional radiology reports search database of 13-million reports to identify all CXRs reports with addendums from 1999-2021. Of the 3469 CXR reports with an addendum, a thoracic radiologist excluded reports where addendum was created for typographic errors, wrong report template, missing sections, or uninterpreted signoffs. The remaining reports with addendum (279 patients) with errors related to side-discrepancy or missed findings such as pulmonary nodules, consolidation, pleural effusions, pneumothorax, and rib fractures. All CXRs were processed with an AI algorithm. Descriptive statistics were performed to determine the sensitivity, specificity, and accuracy of AI to detect missed or mislabeled findings. Results: AI had high sensitivity (96%), specificity (100%), and accuracy (96%) for detecting all missed and mislabeled CXR findings. The corresponding finding-specific statistics for AI were nodules (96%, 100%, 96%), pneumothorax (84%, 100%, 85%), pleural effusion (100%, 17%, 67%), consolidation (98%, 100%, 98%), and rib fractures (87%, 100%, 94%). Conclusion: The CXR AI could accurately detect mislabeled and missed findings. Clinical Relevance: The CXR AI can reduce the frequency of errors in detection and side-labeling of radiographic findings.
Keywords: 
Subject: Medicine and Pharmacology  -   Other
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2024 MDPI (Basel, Switzerland) unless otherwise stated