Submitted:
18 April 2025
Posted:
21 April 2025
You are already at the latest version
Abstract
Keywords:
- Level of Evidence: Level IV; original research; case-control
1. Background
2. Methods
2.1. Data Collection
2.2. Univariable Analyses
2.3. Multivariable Analyses
- Weighting using inverse class frequencies–balancing by scaling the weight of each class to the inverse of its frequency, thereby assigning higher weights to the minority class and lower weights to the majority class;
- Weighting using means–balancing by scaling the weight of each class to the inverse of its frequency, similarly assigning higher weights to the minority class and lower weights to the majority class;
- Downsampling (undersampling)–randomly subsetting (removing or reducing) the majority classes in the training set so that their class frequency matches the minority class;
- Upsampling (oversampling)–randomly subsetting (and replacing with artificial or duplicate data points) the minority classes in the training set so that their class frequency matches the majority class;
- Synthetic Minority Over-sampling Technique (SMOTE)–a hybrid method that downsamples the majority class and synthesizes new data of the minority class using the k-nearest neighbor algorithm;
- Random Oversampling Examples (ROSE)–a hybrid method that utilizes majority downsampling and minority upsampling to synthesize new data of both classes.
2.4. Performance Evaluation
3. Results
4. Discussion
4.1. Age, Transfusion, and Mortality
4.2. Sex, Transfusion, and Mortality
4.3. Age, Ethnicity, Race, and Insurance Status
4.4. Strengths
5. Limitations
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Acknowledgments
Conflicts of Interest
References
- Ang D, Fakhry SM, Watts DD, et al. Data-Driven Blood Transfusion Thresholds for Severely Injured Patients During Blood Shortages. J Surg Res. 2023;291:17-24. [CrossRef]
- Patil V, Shetmahajan M. Massive transfusion and massive transfusion protocol. Indian J Anaesth. 2014;58(5):590. [CrossRef]
- Bawazeer M, Ahmed N, Izadi H, McFarlan A, Nathens A, Pavenski K. Compliance with a massive transfusion protocol (MTP) impacts patient outcome. Injury. 2015;46(1):21-28. [CrossRef]
- Hsu YM, Haas T, Cushing M. Massive transfusion protocols: current best practice. International Journal of Clinical Transfusion Medicine. Published online 2016:15. [CrossRef]
- Guerado E, Medina A, Mata MI, Galvan JM, Bertrand ML. Protocols for massive blood transfusion: when and why, and potential complications. European Journal of Trauma and Emergency Surgery. 2015;42(3):283-295. [CrossRef]
- Wijaya R, Cheng HMG, Chong CK. The use of massive transfusion protocol for trauma and non-trauma patients in a civilian setting: what can be done better? Singapore Med J. 2016;57(5):238-241. [CrossRef]
- Jebbia M, Nguyen J, Marty M, et al. Predictors of Mortality in Trauma patients Receiving massive Transfusion Protocol. Am Surg. Published online 2023:000313482311755. [CrossRef]
- Nunez TC, Voskresensky I V., Dossett LA, Shinall R, Dutton WD, Cotton BA. Early prediction of massive transfusion in trauma: Simple as ABC (Assessment of Blood Consumption)? Journal of Trauma - Injury, Infection and Critical Care. 2009;66(2):346-352. [CrossRef]
- Ogura T, Nakamura Y, Nakano M, et al. Predicting the need for massive transfusion in trauma patients. Journal of Trauma and Acute Care Surgery. 2014;76(5):1243-1250. [CrossRef]
- Schroll R, Swift D, Tatum D, Couch S, Injury JH, 2018 undefined. Accuracy of shock index versus ABC score to predict need for massive transfusion in trauma patients. Elsevier. Accessed October 22, 2023. https://www.sciencedirect.com/science/article/pii/S0020138317306253?casa_token=XD5Y3OWKOhEAAAAA:QrMQMDgzBd9DEOoaOnnH2jLUtfQmrO_hr4MNp8wXC8N3AOPUNMVOhKLFM-tswlGEbqY8QoZuDAo.
- Lo BD, Merkel KR, Dougherty JL, et al. Assessing predictors of futility in patients receiving massive transfusions. Transfusion (Paris). 2021;61(7):2082-2089. [CrossRef]
- Mladinov D, Frank SM. Massive transfusion and severe blood shortages: establishing and implementing predictors of futility. Br J Anaesth. 2022;128(2):e71-e74. [CrossRef]
- Yücel N, Lefering R, Maegele M, et al. Trauma Associated Severe Hemorrhage (TASH)-score: Probability of mass transfusion as surrogate for life threatening hemorrhage after multiple trauma. Journal of Trauma - Injury, Infection and Critical Care. 2006;60(6):1228-1236. [CrossRef]
- Haider AH, Chang DC, Efron DT, Haut ER, Crandall M, Cornwell EE. Race and Insurance Status as Risk Factors for Trauma Mortality. Archives of Surgery. 2008;143(10):945-949. [CrossRef]
- Lunardon N, Menardi G, Torelli N. ROSE: A Package for Binary Imbalanced Learning.
- Menardi G, Torelli N. Training and assessing classification rules with imbalanced data. Data Min Knowl Discov. 2014;28(1):92-122. [CrossRef]
- Kuhn M. Building Predictive Models in R Using the caret Package. J Stat Softw. 2008;28(5):1-26. [CrossRef]
- Chawla N V., Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research. 2002;16:321-357. [CrossRef]
- Brown 4th CH, Savage WJ, Masear CG, et al. Odds of transfusion for older adults compared to younger adults undergoing surgery. Anesth Analg. 2014;118(6):1168-1178. [CrossRef]
- Murry JS, Zaw AA, Hoang DM, et al. Activation of Massive Transfusion for Elderly Trauma Patients. Am Surg. 2015;81(10):945-949. [CrossRef]
- Lim G, Harper-Kirksey K, Parekh R, Manini AF. Efficacy of a massive transfusion protocol for hemorrhagic trauma resuscitation. Am J Emerg Med. 2018;36(7):1178-1181. [CrossRef]
- Morris MC, Niziolek GM, Baker JE, et al. Death by Decade: Establishing a Transfusion Ceiling for Futility in Massive Transfusion. Journal of Surgical Research. 2020;252:139-146. [CrossRef]
- Kojima M, Endo A, Shiraishi A, Shoko T, Otomo Y, Coimbra R. Association between the plasma-to-red blood cell ratio and survival in geriatric and non-geriatric trauma patients undergoing massive transfusion: a retrospective cohort study. J Intensive Care. 2022;10(1):2. [CrossRef]
- Paganini M, Abowali H, Bosco G, et al. Quality Improvement Project of a Massive Transfusion Protocol (MTP) to Reduce Wastage of Blood Components. Int J Environ Res Public Health. 2021;18(1):274. [CrossRef]
- Consunji R, Elseed A, El-Menyar A, et al. The effect of massive transfusion protocol implementation on the survival of trauma patients: a systematic review and meta-analysis. Blood Transfusion. 2020;18(6):434. [CrossRef]
- Baraniuk S, Tilley BC, del Junco DJ, et al. Pragmatic Randomized Optimal Platelet and Plasma Ratios (PROPPR) Trial: design, rationale and implementation. Injury. 2014;45(9):1287-1295. [CrossRef]
- Barbosa RR, Rowell SE, Sambasivan CN, et al. A predictive model for mortality in massively transfused trauma patients. Journal of Trauma - Injury, Infection and Critical Care. 2011;71(2 SUPPL. 3). [CrossRef]
- Buchmueller TC, Levinson ZM, Levy HG, Wolfe BL. Effect of the affordable care act on racial and ethnic disparities in health insurance coverage. Am J Public Health. 2016;106(8):1416-1421. [CrossRef]
- Kirby JB, Taliaferro G, Zuvekas SH. Explaining racial and ethnic disparities in health care. Med Care. 2006;44(5 SUPPL.). [CrossRef]
- Lillie-Blanton M, Hoffman C. The role of health insurance coverage in reducing racial/ethnic disparities in health care. Health Aff. 2005;24(2):398-408. [CrossRef]
- Zuvekas SH, Taliaferro GS. Pathways to access: Health insurance, the health care delivery system, and racial/ethnic disparities, 1996-1999. Health Aff. 2003;22(2):139-153. [CrossRef]
- Hargraves JL, Hadley J. The Contribution of Insurance Coverage and Community Resources to Reducing Racial/Ethnic Disparities in Access to Care. Health Serv Res. 2003;38(3):809-829. [CrossRef]
- Medicare Beneficiaries at a Glance - Centers for Medicare & Medicaid Services Data. Accessed January 18, 2024. https://data.cms.gov/infographic/medicare-beneficiaries-at-a-glance.
- Profile of Medicare Beneficiaries by Race and Ethnicity: A Chartpack | KFF. Accessed January 18, 2024. https://www.kff.org/medicare/report/profile-of-medicare-beneficiaries-by-race-and-ethnicity-a-chartpack/.
| MTP Activated? | MTP Transfused? | ||||
|---|---|---|---|---|---|
| Characteristic | Overall, N = 8,6701 | NO, N= 84051 | YES, N= 2651 | NO, N= 86181 | YES, N= 521 |
| AGE | 53.05 (24.23) | 53.64 (24.30) | 38.60 (19.43) | 53.11 (24.26) | 43.81 (17.22) |
| SEX | |||||
| Female | 2,909 (34%) | 2,851 (34%) | 58 (22%) | 2,896 (34%) | 13 (25%) |
| Male | 5,761 (66%) | 5,554 (66%) | 207 (78%) | 5,722 (66%) | 39 (75%) |
| RACE | |||||
| American Indian | 5 (<0.1%) | 5 (<0.1%) | 0 (0%) | 5 (<0.1%) | 0 (0%) |
| Asian | 1,138 (13%) | 1,109 (13%) | 29 (11%) | 1,131 (13%) | 7 (13%) |
| Black | 809 (9.3%) | 780 (9.3%) | 29 (11%) | 805 (9.3%) | 4 (7.7%) |
|
Native Hawaiian or Another Pacific Islander |
7 (<0.1%) | 6 (<0.1%) | 1 (0.4%) | 7 (<0.1%) | 0 (0%) |
| Other | 4,843 (56%) | 4,681 (56%) | 162 (61%) | 4,811 (56%) | 32 (62%) |
| White | 1,868 (22%) | 1,824 (22%) | 44 (17%) | 1,859 (22%) | 9 (17%) |
| ETHNICITY | |||||
| Hispanic Origin | 3,154 (36%) | 3,041 (36%) | 113 (43%) | 3,133 (36%) | 21 (40%) |
| Non-Hispanic Origin | 5,516 (64%) | 5,364 (64%) | 152 (57%) | 5,485 (64%) | 31 (60%) |
| INSURANCE STATUS | |||||
| Medicaid | 2,818 (33%) | 2,717 (32%) | 101 (38%) | 2,797 (32%) | 21 (40%) |
| Medicare | 2,338 (27%) | 2,309 (27%) | 29 (11%) | 2,334 (27%) | 4 (7.7%) |
| No Charge | 889 (10%) | 847 (10%) | 42 (16%) | 879 (10%) | 10 (19%) |
| Other | 1,059 (12%) | 1,022 (12%) | 37 (14%) | 1,054 (12%) | 5 (9.6%) |
| Private | 1,566 (18%) | 1,510 (18%) | 56 (21%) | 1,554 (18%) | 12 (23%) |
| TRAUMA TYPE | |||||
| Blunt | 7,789 (90%) | 7,623 (91%) | 166 (63%) | 7,752 (90%) | 37 (71%) |
| Penetrating | 881 (10%) | 782 (9.3%) | 99 (37%) | 866 (10%) | 15 (29%) |
| PROBABILITY OF SURVIVAL | 0.98 (0.10) | 0.98 (0.08) | 0.96 (0.29) | 0.98 (0.09) | 0.70 (0.33) |
| ISS | 4.00 (6.92) | 4.00 (6.27) | 17.00 (13.25) | 4.00 (6.71) | 25.50 (13.23) |
| PRBC | 0.00 (0.67) | 0.00 (0.16) | 2.00 (2.66) | 0.00 (0.38) | 5.00 (2.93) |
| IN-ED MORTALITY | |||||
| N | 8,647 (100%) | 8,392 (100%) | 255 (96%) | 8,603 (100%) | 44 (85%) |
| Y | 23 (0.3%) | 13 (0.2%) | 10 (3.8%) | 15 (0.2%) | 8 (15%) |
| MTP TRANSFUSED? | 52 (0.6%) | 0 (0%) | 52 (20%) | ||
| MTP ACTIVATION? | 213 (2.5%) | 52 (100%) | |||
| 1Median (SD); n (%) | |||||
| In-ED Mortality | |||
|---|---|---|---|
| NO | YES | p-value1 | |
| MTP Activation? | <0.001 | ||
| NO | 8,392 (99.8%) | 13 (0.2%) | |
| YES | 255 (96.2%) | 10 (3.8%) | |
| Total | 8,647 (99.7%) | 23 (0.3%) | |
| MTP Transfusion? | <0.001 | ||
| NO | 8,603 (99.8%) | 15 (0.2%) | |
| YES | 44 (84.6%) | 8 (15.4%) | |
| Total | 8,647 (99.7%) | 23 (0.3%) | |
| 1Fisher's exact test |
| MTP Activation | MTP Transfusion | |||||||
|---|---|---|---|---|---|---|---|---|
| Characteristic | OR1 | SE1 | 95% CI1 | p-value2 | OR1 | SE1 | 95% CI1 | p-value2 |
| Age | 0.98 | 0.003 | 0.98, 0.99 | <0.001*** | 0.99 | 0.006 | 0.98, 1.00 | 0.042* |
| Race = White | 0.14 | 0.96 | ||||||
| White | — | — | — | — | — | — | ||
| American Indian | 0 | 239 | 0 | 1,073 | ||||
| Asian | 1.08 | 0.242 | 0.67, 1.73 | 1.28 | 0.505 | 0.46, 3.44 | ||
| Black | 1.54 | 0.243 | 0.95, 2.47 | 1.03 | 0.602 | 0.28, 3.16 | ||
| Native Hawaiian or Other Pacific Islander | 6.91 | 1.09 | 0.36, 41.6 | 0 | 907 | |||
| Other | 1.43 | 0.172 | 1.03, 2.03 | 1.37 | 0.378 | 0.68, 3.06 | ||
| Sex = Male | 1.83 | 0.15 | 1.37, 2.48 | <0.001*** | 1.52 | 0.321 | 0.83, 2.96 | 0.18 |
| Ethnicity = Non-Hispanic Origin | 0.76 | 0.126 | 0.60, 0.98 | 0.033* | 0.84 | 0.284 | 0.49, 1.49 | 0.55 |
| Mechanism = Penetrating Trauma | 5.81 | 0.132 | 4.47, 7.52 | <0.001*** | 3.63 | 0.308 | 1.93, 6.50 | <0.001*** |
| ISS | 1.13 | 0.006 | 1.12, 1.15 | <0.001*** | 1.12 | 0.01 | 1.10, 1.15 | <0.001*** |
| Ps | 0.01 | 0.256 | 0.01, 0.02 | <0.001*** | 0.01 | 0.364 | 0.00, 0.02 | <0.001*** |
| Medicare | 0.32 | 0.198 | 0.22, 0.47 | <0.001*** | 0.22 | 0.521 | 0.07, 0.55 | <0.001*** |
| Medicaid | 1.3 | 0.129 | 1.00, 1.66 | 0.046* | 1.42 | 0.284 | 0.80, 2.46 | 0.22 |
| 1OR = Odds Ratio, SE = Standard Error, CI = Confidence Interval | ||||||||
| MTP Activation | MTP Transfusion | |||||||
|---|---|---|---|---|---|---|---|---|
| Characteristic | OR1 | SE1 | 95% CI1 | p-value2 | OR1 | SE1 | 95% CI1 | p-value2 |
| (Intercept) | 2.72 | 0.75 | 0.62, 11.8 | 0.18 | 0.26 | 1.16 | 0.03, 2.48 | 0.24 |
| Age | 0.99 | 0.004 | 0.98, 1.00 | 0.006** | 1 | 0.009 | 0.98, 1.02 | 0.94 |
| Race = White | ||||||||
| White | — | — | — | — | — | — | ||
| American Indian | 0 | 387 | 0.98 | 0 | 1,048 | >0.99 | ||
| Asian | 0.84 | 0.269 | 0.49, 1.41 | 0.51 | 0.82 | 0.537 | 0.27, 2.34 | 0.71 |
| Black | 0.89 | 0.284 | 0.50, 1.54 | 0.68 | 0.68 | 0.654 | 0.17, 2.31 | 0.55 |
| Native Hawaiian or Other Pacific Islander |
2.51 | 1.39 | 0.09, 25.2 | 0.51 | 0 | 788 | 0.99 | |
| Other | 0.76 | 0.233 | 0.48, 1.20 | 0.23 | 0.81 | 0.488 | 0.31, 2.15 | 0.66 |
| Gender = Male | 0.84 | 0.179 | 0.60, 1.20 | 0.34 | 0.8 | 0.365 | 0.40, 1.69 | 0.55 |
|
Ethnicity = Non-Hispanic Origin |
0.87 | 0.189 | 0.60, 1.25 | 0.45 | 1.14 | 0.4 | 0.51, 2.47 | 0.74 |
| Medicaid | 0.9 | 0.156 | 0.66, 1.22 | 0.5 | 1.38 | 0.326 | 0.72, 2.61 | 0.33 |
| Medicare | 0.69 | 0.266 | 0.41, 1.16 | 0.17 | 0.37 | 0.621 | 0.10, 1.18 | 0.11 |
| Mechanism = Penetrating | 9.79 | 0.183 | 6.86, 14.0 | <0.001*** | 3.92 | 0.391 | 1.79, 8.36 | <0.001*** |
| ISS | 0.98 | 0.017 | 0.95, 1.01 | 0.27 | 0.99 | 0.02 | 0.95, 1.03 | 0.69 |
| PS | 0 | 0.646 | 0.00, 0.01 | <0.001*** | 0 | 0.871 | 0.00, 0.01 | <0.001*** |
| ISS * PS | 1.19 | 0.019 | 1.15, 1.24 | <0.001*** | 1.19 | 0.028 | 1.13, 1.26 | <0.001*** |
| 1OR = Odds Ratio, SE = Standard Error, CI = Confidence Interval | ||||||||
| 2*p<0.05; **p<0.01; ***p<0.001 | ||||||||
| MTP Activation | MTP Transfusion | |||
|---|---|---|---|---|
| Model Sensitivity | AUC (95% CI) | Precision | AUC (95% CI) | Precision |
| Original | 0.876 (0.850–0.902) | 0.974 | 0.935 (0.895–0.974) | 0.994 |
| Weighting Using Frequency | 0.875 (0.848–0.901) | 0.97 | 0.933 (0.893–0.973) | 0.994 |
| Weighting Using Means | 0.881 (0.856–0.905) | 0.992 | 0.946 (0.919–0.972) | 0.999 |
| Downsampling | 0.876 (0.850–0.902) | 0.992 | 0.939 (0.914–0.964) | 1 |
| Upsampling | 0.880 (0.856–0.905) | 0.992 | 0.945 (0.918–0.972) | 0.999 |
| SMOTE | 0.881 (0.856–0.905) | 0.992 | 0.945 (0.918–0.972) | 0.999 |
| ROSE | 0.876 (0.852–0.901) | 0.992 | 0.944 (0.914–0.974) | 0.999 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).