Bernard, A.; Cottenet, J.; Quantin, C. Is the Validity of Logistic Regression Models Developed with a National Hospital Database Inferior to Models Developed from Clinical Databases to Analyze Surgical Lung Cancers? Cancers2024, 16, 734.
Bernard, A.; Cottenet, J.; Quantin, C. Is the Validity of Logistic Regression Models Developed with a National Hospital Database Inferior to Models Developed from Clinical Databases to Analyze Surgical Lung Cancers? Cancers 2024, 16, 734.
Bernard, A.; Cottenet, J.; Quantin, C. Is the Validity of Logistic Regression Models Developed with a National Hospital Database Inferior to Models Developed from Clinical Databases to Analyze Surgical Lung Cancers? Cancers2024, 16, 734.
Bernard, A.; Cottenet, J.; Quantin, C. Is the Validity of Logistic Regression Models Developed with a National Hospital Database Inferior to Models Developed from Clinical Databases to Analyze Surgical Lung Cancers? Cancers 2024, 16, 734.
Abstract
In medico-administrative database, certain prognostic factors cannot be taken into account. The main objective was to estimate the performance of two models based on two databases: Epi-thor clinical and medico-administrative databases.
For each of the two databases, we randomly sampled a development dataset with 70% of the data and a validation dataset with 30%. Performance of models was assessed by Brier score, the area under the receiver operating characteristic (AUC ROC) curve and the calibration of the model.
For Epithor and medico-administrative databases, the development dataset included 10,516 patients (with resp. 227 (2.16%) and 283(2.7%) deaths) and the validation dataset included 4,507 patients (with resp. 93 (2%) and 119 (2.64%) deaths). 15 predictors were selected in the models (including FEV, Body Mass Index, ASA score and TNM stage for Epithor). The Brier score values were similar in the models of the two databases. For validation data, the AUC ROC curve was 0.73 [0.68-0.78] for Epithor and 0.8 [0.76-0.84] for medico-administrative databases. The slope of the calibration plot was less than 1 for the two databases.
This work shows the good performances of a model developed from a medico-administrative database, despite the absence of clinical variables used in practice by surgeons, such as FEV1, ASA score or TNM stage.
Keywords
Model performance; medico-administrative database; clinical database; Brier score; area under the receiver operating characteristic; discrimination; calibration
Subject
Medicine and Pharmacology, Epidemiology and Infectious Diseases
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
