Submitted:
31 August 2023
Posted:
04 September 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Study Design and Population
2.2. Data Collection, Mortality Estimation Risks, and Definitions
2.3. Statistical Analysis
3. Results
3.1. Study Population and Comparison with VOCAL-Penn Cohort
3.2. Clinical Events and Mortality after Surgery
3.3. Variables Related to Mortality after Surgery
3.4. Diagnostic Accuracy and Calibration of Surgical Risk Scales
3.5. Diagnostic Accuracy of VOCAL-Penn in Different Scenarios.
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Conflicts of Interest
References
- Johnson:, K.M.; Newman, K.L.; Green, P.K.; Berry, K.; Cornia, P.B.; Wu, P.; Beste, L.A.; Itani, K.; Harris, A.H.S.; Kamath, P.S.; et al. Incidence and Risk Factors of Postoperative Mortality and Morbidity After Elective Versus Emergent Abdominal Surgery in a National Sample of 8193 Patients With Cirrhosis. Ann Surg 2021, 274, e345–e354. [Google Scholar] [CrossRef] [PubMed]
- Ziser, A.; Plevak, D.J.; Wiesner, R.H.; Rakela, J.; Offord, K.P.; Brown, D.L. Morbidity and mortality in cirrhotic patients undergoing anesthesia and surgery. Anesthesiology 1999, 90, 42–53. [Google Scholar] [CrossRef] [PubMed]
- del Olmo, J.A.; Flor-Lorente, B.; Flor-Civera, B.; Rodriguez, F.; Serra, M.A.; Escudero, A.; Lledo, S.; Rodrigo, J.M. Risk factors for nonhepatic surgery in patients with cirrhosis. World J Surg 2003, 27, 647–652. [Google Scholar] [CrossRef] [PubMed]
- Telem, D.A.; Schiano, T.; Goldstone, R.; Han, D.K.; Buch, K.E.; Chin, E.H.; Nguyen, S.Q.; Divino, C.M. Factors that predict outcome of abdominal operations in patients with advanced cirrhosis. Clin Gastroenterol Hepatol 2010, 8, 451–457. [Google Scholar] [CrossRef]
- Jacob, K.A.; Hjortnaes, J.; Kranenburg, G.; de Heer, F.; Kluin, J. Mortality after cardiac surgery in patients with liver cirrhosis classified by the Child-Pugh score. Interactive cardiovascular and thoracic surgery 2015, 20, 520–530. [Google Scholar] [CrossRef] [PubMed]
- Northup, P.G.; Wanamaker, R.C.; Lee, V.D.; Adams, R.B.; Berg, C.L. Model for End-Stage Liver Disease (MELD) predicts nontransplant surgical mortality in patients with cirrhosis. Ann Surg 2005, 242, 244–251. [Google Scholar] [CrossRef] [PubMed]
- Charlson, M.E.; Pompei, P.; Ales, K.L.; MacKenzie, C.R. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 1987, 40, 373–383. [Google Scholar] [CrossRef]
- Horvath, B.; Kloesel, B.; Todd, M.M.; Cole, D.J.; Prielipp, R.C. The Evolution, Current Value, and Future of the American Society of Anesthesiologists Physical Status Classification System. Anesthesiology 2021, 135, 904–919. [Google Scholar] [CrossRef] [PubMed]
- Jepsen, P.; Vilstrup, H.; Lash, T.L. Development and validation of a comorbidity scoring system for patients with cirrhosis. Gastroenterology 2014, 146, 147–156. [Google Scholar] [CrossRef]
- Bilimoria, K.Y.; Liu, Y.; Paruch, J.L.; Zhou, L.; Kmiecik, T.E.; Ko, C.Y.; Cohen, M.E. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 2013, 217, 833–842. [Google Scholar] [CrossRef] [PubMed]
- Teh, S.H.; Nagorney, D.M.; Stevens, S.R.; Offord, K.P.; Therneau, T.M.; Plevak, D.J.; Talwalkar, J.A.; Kim, W.R.; Kamath, P.S. Risk factors for mortality after surgery in patients with cirrhosis. Gastroenterology 2007, 132, 1261–1269. [Google Scholar] [CrossRef]
- Mahmud, N.; Fricker, Z.; Hubbard, R.A.; Ioannou, G.N.; Lewis, J.D.; Taddei, T.H.; Rothstein, K.D.; Serper, M.; Goldberg, D.S.; Kaplan, D.E. Risk Prediction Models for Post-Operative Mortality in Patients With Cirrhosis. Hepatology 2021, 73, 204–218. [Google Scholar] [CrossRef] [PubMed]
- Mahmud, N.; Fricker, Z.; Panchal, S.; Lewis, J.D.; Goldberg, D.S.; Kaplan, D.E. External Validation of the VOCAL-Penn Cirrhosis Surgical Risk Score in 2 Large, Independent Health Systems. Liver Transpl 2021, 27, 961–970. [Google Scholar] [CrossRef] [PubMed]
- Augustin, S.; Millan, L.; Gonzalez, A.; Martell, M.; Gelabert, A.; Segarra, A.; Serres, X.; Esteban, R.; Genesca, J. Detection of early portal hypertension with routine data and liver stiffness in patients with asymptomatic liver disease: a prospective study. J Hepatol 2014, 60, 561–569. [Google Scholar] [CrossRef] [PubMed]
- Lin, Z.H.; Xin, Y.N.; Dong, Q.J.; Wang, Q.; Jiang, X.J.; Zhan, S.H.; Sun, Y.; Xuan, S.Y. Performance of the aspartate aminotransferase-to-platelet ratio index for the staging of hepatitis C-related fibrosis: an updated meta-analysis. Hepatology 2011, 53, 726–736. [Google Scholar] [CrossRef]
- Procopet, B.; Berzigotti, A. Diagnosis of cirrhosis and portal hypertension: imaging, non-invasive markers of fibrosis and liver biopsy. Gastroenterol Rep (Oxf) 2017, 5, 79–89. [Google Scholar] [CrossRef] [PubMed]
- de Franchis, R.; Bosch, J.; Garcia-Tsao, G.; Reiberger, T.; Ripoll, C.; Baveno, V.I.I.F. Baveno VII - Renewing consensus in portal hypertension. J Hepatol 2022, 76, 959–974. [Google Scholar] [CrossRef]
- de Franchis, R.; Baveno, V.I.F. Expanding consensus in portal hypertension: Report of the Baveno VI Consensus Workshop: Stratifying risk and individualizing care for portal hypertension. J Hepatol 2015, 63, 743–752. [Google Scholar] [CrossRef] [PubMed]
- Kamath, P.S.; Wiesner, R.H.; Malinchoc, M.; Kremers, W.; Therneau, T.M.; Kosberg, C.L.; D'Amico, G.; Dickson, E.R.; Kim, W.R. A model to predict survival in patients with end-stage liver disease. Hepatology 2001, 33, 464–470. [Google Scholar] [CrossRef]
- Kim, W.R.; Biggins, S.W.; Kremers, W.K.; Wiesner, R.H.; Kamath, P.S.; Benson, J.T.; Edwards, E.; Therneau, T.M. Hyponatremia and mortality among patients on the liver-transplant waiting list. N Engl J Med 2008, 359, 1018–1026. [Google Scholar] [CrossRef]
- Russ, K.B.; Stevens, T.M.; Singal, A.K. Acute Kidney Injury in Patients with Cirrhosis. J Clin Transl Hepatol 2015, 3, 195–204. [Google Scholar] [CrossRef]
- Swets, J.A. Measuring the accuracy of diagnostic systems. Science 1988, 240, 1285–1293. [Google Scholar] [CrossRef] [PubMed]
- Hanley, J.A.; McNeil, B.J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 1983, 148, 839–843. [Google Scholar] [CrossRef] [PubMed]





| H. MAR COHORT (N=512) |
VOCAL-PENN COHORT (N=4712) |
P | |
|---|---|---|---|
| Age (years) | 66 (57 – 75) | 64 (60 – 69) | <0.001 |
| Male sex, n (%) | 332 (64.8) | 4582 (97.2%) | <0.001 |
| Etiology of liver disease, n (%) (n=510) | |||
| Hepatitis C | 149 (29.2) | 612 (13.0) | <0.001 |
| Hepatitis B | 11 (2.2) | 73 (1.5) | 0.227 |
| Alcohol | 231 (45.3) | 1662 (35.3) | <0.001 |
| MAFLD | 52 (10.8) | 585 (12.4) | 0.255 |
| Hepatitis C + Alcohol | 36 (7.1) | 1388 (29.5) | <0.001 |
| Other | 28 (5.5) | 392 (8.3) | 0.020 |
| Creatinine (mg/dl) | 0.87 (0.69 – 1.16) | 1.0 (0.8 – 1.2) | <0.001 |
| Total bilirubin (mg/dl) (n=454) | 0.82 (0.50 – 1.39) | 0.8 (0.5 – 1.1) | <0.001 |
| Albumin (g/dl) (n=447) | 4.0 (3.3 – 4.4) | 3.7 (3.2 – 4.1) | 0.005 |
| INR (n=509) | 1.17 (1.08 – 1.32) | 1.1 (1.0 – 1.2) | <0.001 |
| Platelet count (·103/uL) (n=507) | 132.0 (93.0 – 195.0) | 152.0 (107.0 – 207.0) | 0.013 |
| MELD (n=454) | 10 (8 – 13) | 8 (7 – 11) | <0.001 |
| MELD-Na (n=454) | 12 (8 – 16) | 10 (8 – 14) | <0.001 |
| Child-Pugh Class, n (%) (n=420) | |||
| A | 297 (70.7) | 4159 (88.3) | <0.001 |
| B | 104 (24.8) | 530 (11.2) | <0.001 |
| C | 19 (4.5) | 23 (0.5) | <0.001 |
| Ascites 30 days before surgery, n (%) | 78 (15.2) | 620 (13.2) | 0.174 |
| History of previous decompensation, n (%) | 150 (29.3) | 2066 (43.8) | <0.001 |
| Endoscopic signs of portal hypertension, n (%) (n=422) | 247 (58.5) | - | - |
| Hypertension, n (%) | 242 (47.3) | 3904 (85.4) | <0.001 |
| Diabetes, n (%) | 151 (29.5) | 2355 (51.7) | <0.001 |
| Obesity (BMI ≥ 30 kg/m2) , n (%) (n=454) | 142 (31.3) | 3359 (73.8) | <0.001 |
| Chronic kidney disease, n (%) | 77 (15.0) | - | - |
| Peripheral vascular disease, n (%) | 41 (8.0) | - | - |
| Previous acute myocardial infarction, n (%) | 26 (5.1) | 1622 (34.4) | <0.001 |
| Congestive heart failure, n (%) | 29 (5.7) | 1239 (26.3) | <0.001 |
| Active cancer, n (%) | 107 (20.9) | - | - |
| ASA-IV | 124 (24.2) | 2565 (54.4) | <0.001 |
| Surgery category, n (%) | |||
| Abdominal – Laparoscopic | 94 (18.4) | 47 (10.1) | <0.001 |
| Abdominal – Open | 124 (24.2) | 665 (14.1) | <0.001 |
| Abdominal wall | 111 (21.7) | 1308 (27.8) | 0.002 |
| Vascular | 31 (6.1) | 550 (11.7) | <0.001 |
| Major orthopedic | 128 (25.0) | 1298 (27.5) | 0.205 |
| Thoracic / Cardiac | 24 (4.7) | 415 (8.8) | 0.003 |
| Emergent surgery, n (%) | 206 (40.2) | 476 (10.1) | <0.001 |
| ALIVE (N=462) |
DECEASED (N=50) |
p | |
|---|---|---|---|
| Age (years) | 66 (56 – 75) | 71 (63 – 81) | 0.002 |
| Male sex, n (%) | 302 (65.4) | 30 (60.0) | 0.450 |
| Etiology of liver disease, n (%) (n=510) | |||
| Viral | 150 (32.5) | 19 (38.8) | 0.628 |
| Alcohol | 234 (50.8) | 24 (49.0) | |
| MAFLD | 50 (10.8) | 5 (10.2) | |
| Other | 27 (5.9) | 1 (2.0) | |
| Creatinine (mg/dl) | 0.86 (0.68 – 1.11) | 1.11 (0.77 – 1.52) | 0.002 |
| Total bilirubin (mg/dl) (n=454) | 0.78 (0.50 – 1.31) | 1.59 (0.90 – 3.22) | <0.001 |
| Albumin (g/dl) (n=447) | 4.1 (3.4 – 4.4) | 3.1 (2.5 – 3.7) | <0.001 |
| INR (n=509) | 1.16 (1.07 – 1.29) | 1.34 (1.18 – 1.72) | <0.001 |
| Platelet count (·103/uL) (n=507) | 135.0 (96.0 – 204.5) | 101.0 (72.0 – 146.3) | 0.001 |
| MELD (n=454) | 9 (8 – 12) | 14 (11 – 20) | <0.001 |
| MELD-Na (n=454) | 11 (8 – 15) | 18 (14 – 22) | <0.001 |
| CTP Class, n (%) (n=420) | |||
| A | 285 (75.0) | 12 (30.0) | <0.001 |
| B | 84 (22.1) | 20 (50.0) | |
| C | 11 (2.9) | 8 (20.0) | |
| Ascites 30 days before surgery, n (%) | 58 (12.6) | 20 (40.0) | <0.001 |
| History of previous decompensation, n (%) | 123 (26.6) | 27 (54.0) | <0.001 |
| Endoscopic signs of portal hypertension, n (%) (n=422) | 222 (57.4) | 25 (71.4) | 0.033 |
| Hypertension, n (%) | 216 (46.8) | 26 (52.0) | 0.480 |
| Diabetes, n (%) | 135 (29.2) | 16 (32.0) | 0.682 |
| Obesity (BMI ≥ 30 kg/m2) , n (%) (n=454) | 133 (31.9) | 9 (24.3) | 0.341 |
| Chronic kidney disease, n (%) | 66 (14.3) | 11 (22.0) | 0.147 |
| Peripheral vascular disease, n (%) | 36 (7.8) | 5 (10.0) | 0.585 |
| History of acute myocardial infarction, n (%) | 23 (5.0) | 3 (6.0) | 0.755 |
| Congestive heart failure, n (%) | 23 (5.0) | 6 (12.0) | 0.041 |
| Active cancer, n (%) | 96 (20.8) | 11 (22.0) | 0.840 |
| ASA 4, n (%) | 91 (19.7) | 33 (66.0) | <0.001 |
| CirCom, n (%) | |||
| 0 | 200 (43.3) | 20 (40.0) | 0.427 |
| 1+0 or 1+1 | 108 (23.4) | 8 (16.0) | |
| 3+0 or 3+1 | 136 (29.4) | 19 (38.0) | |
| 5+0 or 5+1 | 18 (3.9) | 3 (6.0) | |
| Surgery category, n (%) | |||
| Abdominal – Laparoscopic | 93 (20.1) | 1 (2.0) | 0.001 |
| Abdominal – Open | 101 (21.9) | 23 (46.0) | |
| Abdominal wall | 103 (22.3) | 8 (16.0) | |
| Vascular | 30 (6.5) | 1 (2.0) | |
| Major orthopedic | 113 (24.5) | 15 (30.0) | |
| Thoracic | 22 (4.8) | 2 (4.0) | |
| Emergent surgery, n (%) | 174 (37.7) | 32 (64.0) | 0.001 |
| Hepatic decompensation, n (%) | 115 (24.7) | 34 (68.0) | <0.001 |
| Acute kidney injury during admission, n (%) (n=427) | 89 (23.5) | 35 (71.4) | <0.001 |
| AKI 1A | 24 (6.3) | 1 (2.0) | <0.001 |
| AKI 1B | 35 (9.3) | 8 (16.3) | |
| AKI 2 | 17 (4.5) | 8 (16.3) | |
| AKI 3 | 13 (3.4) | 18 (36.7) | |
| Infection during admission, n (%) | 158 (34.2) | 42 (84.0) | <0.001 |
| Severe infection during admission, n (%) (n=200) | 26 (16.5) | 21 (50.0) | <0.001 |
| Hemorrhage during admission, n (%) | 57 (12.3) | 16 (32.0) | <0.001 |
| Hemorrhage with transfusion of ≥RBC packs, n (%) | 41 (8.9) | 15 (30.0) | <0.001 |
| Variable | HR | 95% CI | p |
|---|---|---|---|
| Age | 1.034 | 1.009 – 1.058 | 0.006 |
| Congestive heart failure | 0.677 | ||
| ASA-IV | 6.829 | 3.801 – 12.267 | <0.001 |
| Bilirubin | 1.072 | 1.008 – 1.140 | 0.028 |
| Albumin | 0.336 | 0.229 – 0.494 | <0.001 |
| INR | 2.275 | 1.079 – 4.797 | 0.031 |
| Platelets | 0.690 | ||
| Surgery Category | |||
| Abdominal-Laparoscopic | Ref. | ||
| Abdominal-Open | 19.437 | 2.629 – 143.700 | 0.004 |
| Abdominal wall | 5.937 | 0.730 – 48.255 | 0.096 |
| Vascular | 3.926 | 0.245 – 63.017 | 0.334 |
| Major Orthopedic | 12.685 | 1.675 – 96.081 | 0.014 |
| Thoracic | 14.511 | 1.270 – 165.758 | 0.031 |
| Emergent surgery | 2.801 | 1.530 – 5.126 | 0.001 |
| Hepatic decompensation | 0.061 | ||
| AKI | 4.592 | 2.418 – 8.721 | <0.001 |
| Infection | 4.936 | 2.162 – 11.270 | <0.001 |
| Hemorrhage | 0.171 |
| C-statistic (95% CI) | Brier Score | |||
|---|---|---|---|---|
| 30-day Postoperative Mortality | 90-day Postoperative Mortality | 30-day Postoperative Mortality | 90-day Postoperative Mortality | |
| VOCAL-Penn | 0.890 (0.805 – 0.974) | 0.876 (0.808 – 0.944) | 0.046 | 0.055 |
| MRS | 0.862 (0.794 – 0.929) | 0.843 (0.779 – 0.906) | 0.058 | 0.081 |
| NSQIP | 0.862 (0.779 – 0.946) | - | 0.044 | - |
| MELD-Na | 0.859 (0.785 – 0.933) | 0.784 (0.700 – 0.868) | 0.058 | 0.082 |
| Child-Pugh | 0.854 (0.767 – 0.940) | 0.814 (0.731 – 0.897) | 0.050 | 0.074 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).