Submitted:
05 August 2025
Posted:
07 August 2025
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Materials and Methods
2.1. Protocol and Registration
2.2. Eligibility Criteria
2.3. Information Sources and Search Strategy
(("hepato-pancreato-biliary" OR HPB OR hepatobiliary OR pancreatic OR pancreatoduodenectomy OR hepatectomy OR "liver resection" OR "pancreatic resection”)
AND
("artificial intelligence" OR "machine learning" OR "deep learning" OR radiomics OR "augmented reality" OR "mixed reality" OR "image-guided" OR navigation OR "3D planning" OR "3D reconstruction" OR robotic OR "decision support" OR "predictive model"))
AND 2018:2023[dp] AND english[lang].
2.4. Study Selection
2.5. Data Extraction
2.6. Risk of Bias Assessment
2.7. Data Synthesis
- (1)
- Preoperative Imaging and Diagnosis
- (2)
- Risk Prediction (outcomes)
- (3)
- Surgical Planning and Simulation
- (4)
- Intraoperative Guidance and Navigation
- (5)
- Surgical Video Analysis/Robotics
3. Results
3.1. Study Selection and Characteristics
3.2. Preoperative AI and 3D Planning (Imaging and Diagnosis)
- Machine learning for tumor detection and characterization: In liver imaging, AI algorithms (often CNNs) have shown high accuracy in identifying liver tumors and classifying lesion types. For example, one study combined radiomics features with a CNN to differentiate hepatocellular carcinoma (HCC) from liver metastases on ultrasound images, achieving AUC ~0.85–0.90 [4]. In another, a deep learning model (ResNet-50) trained on endoscopic ultrasound (EUS) images distinguished pancreatic ductal adenocarcinoma (PDAC) from chronic pancreatitis with an AUC of 0.95 [18] . These accuracies are on par with, or exceeding, expert radiologist performance in these tasks. A recent systematic review of AI in liver imaging noted that most algorithms focus on lesion classification (particularly on CT scans) and report high internal accuracies, but a common limitation is lack of external validation [24] – suggesting potential optimism bias in those results.
- Beyond simply detecting lesions, AI has been used to predict tumor biology or staging from preoperative scans. For instance, radiomic models analyzing preoperative CT have shown ability to predict early HCC recurrence after resection better than conventional clinical staging, by identifying subtle textural features associated with tumor aggressiveness [26]. In pancreatic cancer, one model automatically quantified vascular involvement on CT to classify tumors as resectable vs. locally advanced unresectable, with high agreement to expert assessments [27]. Tools like this could aid surgical decision-making by more objectively staging tumors preoperatively (e.g., determining which patients should go straight to surgery vs. need neoadjuvant therapy).
- Some digital tools also bridge into intraoperative imaging enhancement. For example, an experimental system used an AI algorithm to register real-time intraoperative ultrasound with preoperative CTimages [28]. This kind of image fusion could improve the surgeon’s ability to locate tumors during laparoscopic ultrasound by correlating it with pre-op imaging. In summary, AI in preoperative imaging has shown high diagnostic performance in identifying and characterizing HPB tumors. The challenge ahead lies in translating these algorithms into clinical workflows and ensuring they maintain accuracy in the real-world setting. As noted in the literature, prospective validation is needed: e.g., Bektas et al. (2024) concluded that while ultrasound-based AI models showed AUCs up to 0.98 in differentiating tissue types, prospective studies are required to confirm consistent performance externally [4] .
- In parallel, advanced 3D imaging and visualization tools are augmenting preoperative planning. Automated 3D reconstruction: Several studies highlighted the use of AI to perform 3D reconstructions of liver and pancreatic anatomy from CT/MRI scans. This includes segmenting the liver into anatomical units and delineating tumors, vessels, and ducts [29,30]. Historically, creating patient-specific 3D models was time-consuming (often requiring hours of manual work by radiologists). AI-based image segmentation significantly accelerates this. For example, a deep learning algorithm in one study reduced liver 3D model processing time by ~94% compared to manual methods. Rapid model generation makes it feasible to use 3D visualization for every complex case. Surgeons can then virtually plan their resections – determining optimal resection planes, estimating future liver remnant volume, and even rehearsing the surgery on a computer [31,32]. One recent randomized study even incorporated 3D-printed models: Li et al. (2025) reported that using AI-assisted 3D printed liver models for surgical planning led to significantly less intraoperative blood loss compared to standard planning without such models. This suggests that enhanced planning can translate to improved intraoperative outcomes [33].
- Augmented and mixed reality for planning: In addition to screen-based 3D models, some teams have explored using augmented reality (AR) or mixed reality to aid preoperative planning. For instance, holographic visualization of patient anatomy via AR headsets has been tested as a planning tool. In a pilot study for pancreatic tumor resection using mixed reality, surgeons could visualize major arteries and veins holographically in 3D prior to surgery, which reportedly improved their confidence in dissection around those structures (though quantitative outcomes were not yet measured)[34,35].
3.3. Predictive Analytics (AI for Risk and Outcome Prediction)
- Postoperative complication risk models: A prototypical example is predicting postoperative pancreatic fistula (POPF), one of the most common and feared complications after pancreatic resection. Traditional risk scores (like the Fistula Risk Score, FRS) use a few surgeon-assessed variables and have moderate accuracy (AUC often ~0.6) [36]. Several included studies developed ML models that substantially improved prediction of clinically relevant POPF. Müller et al. (2025) applied an ensemble of ML algorithms to ~300 pancreaticoduodenectomies; their model incorporated dozens of clinical and radiologic features and achieved an AUC around 0.80 for POPF on validation, significantly outperforming the conventional FRS (~0.56 AUC) [20]. This highlights AI’s value in personalized risk stratification by analyzing complex, high-dimensional perioperative data that surgeons cannot easily synthesize alone. Similarly, other studies used ML to predict complications like liver insufficiency after hepatectomy or severe bile leak after bile duct injury repair, often reporting improved accuracy over logistic regression models [37,38]. Notably, most AI-based risk models to date have been developed retrospectively; prospective testing is still scarce. A consistent finding, however, is that combining human expertise with AI can be synergistic – e.g., an AI model might quickly flag high-risk patients, which the surgical team can then further evaluate and proactively manage (such as closer postoperative monitoring or preemptive interventions) [39,40].
- Outcome prediction and decision support: Beyond immediate complications, AI has been used to predict oncologic outcomes like cancer recurrence or long-term survival. Models integrating tumor genomic data, radiologic features, and patient comorbidities have shown promise in forecasting which patients are likely to have early recurrence after resection, which could influence adjuvant therapy decisions. For example, one radiomics study could predict early recurrence of HCC from preoperative imaging and lab data, raising the prospect of tailoring follow-up intensity for high-risk patients [41]. Another AI tool predicted which patients might not benefit from surgery at all due to very aggressive tumor biology, potentially guiding multidisciplinary discussions on alternative treatments [42]. These predictive analytics tools carry ethical implications: using an AI to recommend against surgery or to alter standard treatment must be approached cautiously and transparently. Nonetheless, they offer an avenue for more data-driven clinical decisions in HPB oncology.
3.4. Intraoperative AR and Navigation
- AR for open and minimally invasive surgery: Several pilot studies in our review implemented AR during liver or pancreatic resections. The common workflow is: a 3D model of the patient’s anatomy (from preoperative imaging) is created and then registered to the patient on the operating table. Registration often uses surface landmarks or fiducial markers so that the virtual model aligns correctly with the real organ. For example, in an AR-guided liver surgery study, a CT-based 3D model of the liver (with tumor and vessels) was projected onto the live laparoscopic camera view [44]. For instance, a snapshot of such an AR overlay is being shown to the surgeon for a planned segment 5 liver resection, with the tumor (green) and planned transection plane (red) delineated. By seeing this overlay, the surgeon gets a form of “X-ray vision” – the ability to visualize hidden structures beneath the liver surface. This can guide where to cut and help avoid critical vessels that are not visible externally [22,45]
- Technical feasibility and accuracy: The feasibility of AR has been demonstrated in small case series. Giannone et al. (2021) reported using an AR overlay in 3 cases of robotic liver resection. The AR model was displayed in the surgeon’s console view, showing tumor and vasculature projections during the robotic hepatectomies. Surgeons found it helped localize lesions and plan transections. However, a noted limitation was the need for improved registration accuracy – misalignment of the virtual overlay by even a few millimeters could erode trust in the system. Organ deformation is a major issue: in soft tissues like the liver, once surgery begins and the organ is mobilized or resected partially, it changes shape, making static preoperative overlays increasingly inaccurate [22]. Future solutions may involve real-time organ tracking or deformable models (potentially using AI to adjust the overlays continuously based on intraoperative imaging or sensors) [46,47]. Indeed, Giannone et al. specifically noted issues with organ deformation and lack of widespread support for the technology at present [22].
- Navigation and workflow: Despite these challenges, AR clearly adds value as a navigation aid. For example, AR has been used to guide the placement of trocars (ports) in minimally invasive HPB surgery by projecting an optimal port map onto the patient’s abdomen [22,48]. It has also been applied to help locate small tumors during parenchymal transection by projecting their approximate depth/location [48]. Surgeons generally still rely on tactile feedback or intraoperative ultrasound for confirmation, but AR provides an extra layer of information. In a recent mixed-reality study for pancreatic tumor resection, surgeons could see major blood vessels holographically “through” the pancreatic tissue, which improved their confidence in dissecting around those structures (qualitatively reported) [49].
3.5. Robotics and AI Augmentation (Computer Vision in Surgery)
- Automatic landmark and safety identification: A prominent example is objective recognition of the Critical View of Safety (CVS) during laparoscopic cholecystectomy. CVS is a method to ensure the cystic duct and artery are clearly identified before cutting, to prevent common bile duct injuries. Achieving CVS is typically a subjective assessment by the surgeon. One included study by Kawamura et al. (2023) developed an AI system to automatically detect when CVS had been attained. They trained a deep CNN on ~23,000 laparoscopic cholecystectomy video frames, labeled for presence or absence of key CVS criteria. The best model achieved ~83% accuracy in determining if CVS was achieved, operating at ~6 frames per second (nearly real-time). Such a system could potentially alert a surgeon if they have not yet adequately exposed critical structures [19]. In effect, the AI serves as a “safety coach” in the OR. Considering bile duct injuries are among the most dreaded complications in HPB surgery, this application has high significance. A recent review echoed that AI can reliably identify safe vs. unsafe zones during gallbladder dissection, reinforcing its potential to improve surgical safety [54].
- Real-time hazard detection: Another cutting-edge application is automatic detection of intraoperative bleeding and other hazards. In complex HPB surgeries, bleeding from small vessels can sometimes go unnoticed for critical seconds if the surgeon’s focus is elsewhere. One innovative study (Crisan et al., 2023) designed a hazard detection system using the YOLOv5 deep learning model to identify bleeding in endoscopic video and immediately display alerts via an AR headset. The system distinguished true bleeding from look-alike events (such as spilled irrigating fluid) with high accuracy, highlighting the bleed with a bounding box on the surgeon’s display in real time. Essentially, this is an AI-driven early warning system – a digital “co-pilot” that never blinks, constantly scanning the operative field for hazards. In testing across recorded procedures, the system successfully alerted surgeons to bleeding events that were at times outside the central field of view or at the periphery. Such technology could reduce response time to hemorrhage, potentially improving patient safety in major liver or pancreatic resections where even a brief delay in controlling bleeding can have serious consequences [23].
- Robotic surgery integration: In robotic surgery, integration of AI is also advancing. The da Vinci surgical system already allows some digital interfacing – for example, the TileProTM feature can display auxiliary imaging (like preoperative scans or ultrasound) side-by-side with the operative view [56]. Researchers are going further by embedding AI into robotic workflows. One aspect is surgical skill analysis – computer vision can analyze the motion of instruments (captured via the robot’s kinematic data or video) to grade the surgeon’s skill or identify suboptimal technique. While our review focused on clinical outcome tools, it’s worth noting that some surgery studies have used AI to assess technique quality for training purposes [57].
3.6. Postoperative Video Analytics
4. Discussion
4.1. Key Findings and Current Evidence
4.2. Evidence Quality and Bias
4.3. Safety and Ethical Considerations
4.4. Clinical Guidance for Surgeons
4.5. Strengths and Limitations of This Review
5. Future Directions
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Agrawal, H.; Tanwar, H.; Gupta, N. Revolutionizing hepatobiliary surgery: impact of three-dimensional imaging and virtual surgical planning on precision, complications, and patient outcomes. Artif Intell Gastroenterol. 2025, 6, 106746. [Google Scholar] [CrossRef]
- Zureikat, A.H.; Postlewait, L.M.; Liu, Y.; Gillespie, T.; Weber, S.M.; Abbott, D.E.; et al. A multi-institutional comparison of perioperative outcomes of robotic and open pancreaticoduodenectomy. Ann Surg. 2016, 264, 640–9. [Google Scholar] [CrossRef]
- Zheng, R.J.; Li, D.L.; Lin, H.M.; Wang, J.F.; Luo, Y.M.; Tang, Y.; et al. Bibliometrics of artificial intelligence applications in hepatobiliary surgery from 2014 to 2024. World J Gastrointest Surg. 2025, 17, 104728. [Google Scholar] [CrossRef] [PubMed]
- Bektaş, M.; Chia, C.M.; Burchell, G.L.; Daams, F.; Bonjer, H.J.; van der Peet, D.L. Artificial intelligence-aided ultrasound imaging in hepatopancreatobiliary surgery: where are we now? Surg Endosc. 2024, 38, 4869–4879. [Google Scholar] [CrossRef] [PubMed]
- Chadebecq, F.; Vasconcelos, F.; Mazomenos, E.; Stoyanov, D. Computer vision in the surgical operating room. Visc Med. 2020, 36, 456–462. [Google Scholar] [CrossRef] [PubMed]
- Lan, T.; Liu, S.; Dai, Y.; Jin, Y. Real-time image fusion and Apple Vision Pro in laparoscopic microwave ablation of hepatic hemangiomas. npj Precis Onc. 2025, 9, 79. [Google Scholar] [CrossRef]
- Lyu, Y.; Ma, Z.; Wu, J.; Zhang, X.; Li, W.; Chen, G.; et al. Deep learning-based prediction of post-pancreaticoduodenectomy pancreatic fistula: development and validation of preoperative and perioperative models. Sci Rep. 2024, 14, 51777. [Google Scholar] [CrossRef]
- Verma, A.; Balian, J.; Hadaya, J.; Premji, A.; Shimizu, T.; Donahue, T.; Benharash, P. Machine Learning-based Prediction of Postoperative Pancreatic Fistula Following Pancreaticoduodenectomy. Ann Surg. 2024 Aug 1;280, 325–331. [CrossRef]
- Grover, S.; Gupta, S. Automated diagnosis and classification of liver cancers using deep learning techniques: a systematic review. Discover Appl Sci. 2024, 6, 508. [Google Scholar] [CrossRef]
- Rawlani, P.; Ghosh, N.K.; Kumar, A. Role of artificial intelligence in the characterization of indeterminate pancreatic head mass and its usefulness in preoperative diagnosis. Artif Intell Gastroenterol. 2023, 4, 48–63. [Google Scholar] [CrossRef]
- Cremades Pérez, M.; Espin Álvarez, F.; Pardo Aranda, F.; Navinés López, J.; Vidal Piñeiro, L.; Zarate Pinedo, A.; Piquera Hinojo, A.M.; Sentí Farrarons, S.; Cugat Andorra, E. Augmented reality in hepatobiliary-pancreatic surgery: a technology at your fingertips. Cirugía Española. 2023, 101, 312–318. [Google Scholar] [CrossRef]
- Roman J, Sengul I, Němec M, Sengul D, Penhaker M, Strakoš P, et al. Augmented and mixed reality in liver surgery: a comprehensive narrative review of novel clinical implications on cohort studies. Rev Assoc Med Bras (1992). 2025, 71, e20250315. [Google Scholar] [CrossRef]
- Ntourakis, D.; Memeo, R.; Soler, L.; et al. Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience. World J Surg. 2016, 40, 419–426. [Google Scholar] [CrossRef]
- Hua, S.; Gao, J.; Wang, Z.; Yeerkenbieke, P.; Li, J.; Wang, J.; et al. Automatic bleeding detection in laparoscopic surgery based on a faster region-based convolutional neural network. Ann Transl Med. 2022 May;10, 546. [CrossRef]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021, 372:n71. [CrossRef]
- Wolff, R.F.; Moons, K.G.M.; Riley, R.D.; Whiting, P.F.; Westwood, M.; Collins, G.S.; et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies. Ann Intern Med. 2019, 170, 51–8. [Google Scholar] [CrossRef]
- Whiting, P.F.; Rutjes, A.W.S.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011, 155, 529–36. [Google Scholar] [CrossRef]
- Tong, T.; Gu, J.; Xu, D.; Song, L.; Zhao, Q.; et al. Deep learning radiomics based on contrast-enhanced ultrasound images for assisted diagnosis of pancreatic ductal adenocarcinoma and chronic pancreatitis. BMC Med. 2022, 20, 74. [Google Scholar] [CrossRef] [PubMed]
- Kawamura, M.; Endo, Y.; Fujinaga, A.; Orimoto, H.; Amano, S.; et al. Development of an artificial intelligence system for real-time intraoperative assessment of the Critical View of Safety in laparoscopic cholecystectomy. Surg. Endosc. 2023, 37(11), 8755–8763. [Google Scholar] [CrossRef]
- Müller, P.C.; Erdem, S.; Müller, B.P.; Künzli, B.; Gutschow, C.A.; Hackert, T.; Diener, M.K. Artificial intelligence and image guidance in minimally invasive pancreatic surgery: current status and future challenges. Artif. Intell. Surg. 2025, 5, 170–181. [Google Scholar] [CrossRef]
- Wang, X.; Yang, J.; Zhou, B.; Tang, L.; Liang, Y. Integrating mixed reality, augmented reality, and artificial intelligence in complex liver surgeries: Enhancing precision, safety, and outcomes. iLiver 2025, 4(2), 100167. [Google Scholar] [CrossRef] [PubMed]
- Giannone, F.; Felli, E.; Cherkaoui, Z.; Mascagni, P.; Pessaux, P. Augmented Reality and Image-Guided Robotic Liver Surgery. Cancers 2021, 13(24), 6268. [Google Scholar] [CrossRef]
- Crisan, N.; Gherman, B.; Radu, C.; Tucan, P.; Iakab, S.; et al. Artificial Intelligence-Based Hazard Detection in Robotic-Assisted Single-Incision Oncologic Surgery. Cancers 2023, 15(13), 3387. [Google Scholar] [CrossRef]
- Pomohaci, M.D.; Grasu, M.C.; Băicoianu-Nițescu, A.; Enache, R.M.; Lupescu, I.G. Systematic Review: AI Applications in Liver Imaging with a Focus on Segmentation and Detection. Life 2025, 15(2), 258. [Google Scholar] [CrossRef]
- Cheng, H.; Xu, H.; Peng, B.; Huang, X.; Hu, Y.; et al. Illuminating the future of precision cancer surgery with fluorescence imaging and artificial intelligence convergence. npj Precis. Oncol. 2024, 8, Article 40. [Google Scholar] [CrossRef]
- Xi, Y.; Li, J.; Chen, Y.; Zhang, Y.; Xu, W.; Qiu, J.; et al. Radiomics analysis of preoperative CT for prediction of early recurrence in hepatocellular carcinoma after resection. Cancer Imaging. 2021, 21, 6. [Google Scholar] [CrossRef]
- Bereska, J.I.; Janssen, B.V.; Nio, C.Y.; Kop, M.P.M.; Kazemier, G.; et al. Artificial intelligence for assessment of vascular involvement and tumor resectability on CT in patients with pancreatic cancer. Eur Radiol Exp. 2024, 8, 18. [Google Scholar] [CrossRef]
- Wang, D.; Azadvar, S.; Heiselman, J.; Jiang, X.; Miga, M.I.; Wang, L. LIBR+: Improving intraoperative liver registration by learning the residual of biomechanics-based deformable registration. arXiv preprint arXiv:2403.06901 [Preprint]. 2024 Mar 11. arXiv:2403.06901 [Preprint]. 2024 Mar 11. [CrossRef]
- Sethia, K., Strakos, P., Jaros, M. et al. Advances in liver, liver lesion, hepatic vasculature, and biliary segmentation: a comprehensive review of traditional and deep learning approaches. Artif Intell Rev 58, 299 (2025). [CrossRef]
- Moglia, A.; Cavicchioli, M.; Mainardi, L.; et al. Deep learning for pancreas segmentation on computed tomography: a systematic review. Artif Intell Rev. 2025, 58, 220. [Google Scholar] [CrossRef]
- Takamoto, T.; Ban, D.; Nara, S.; Mizui, T.; Nagashima, D.; Esaki, M.; Shimada, K. Automated three-dimensional liver reconstruction with artificial intelligence for virtual hepatectomy. J Gastrointest Surg. 2022 Oct;26, 2119–2127. [CrossRef]
- Kazami, Y.; Kaneko, J.; Keshwani, D.; Kitamura, Y.; Takahashi, R.; Mihara, Y.; et al. Two-step artificial intelligence algorithm for liver segmentation automates anatomic virtual hepatectomy. J Hepatobiliary Pancreat Sci. 2023 Nov;30, 1205–1217. [CrossRef]
- Li, L.; Cheng, S.; Li, J.; Yang, J.; Wang, H.; Dong, B.; et al. Randomized comparison of AI-enhanced 3D printing and traditional simulations in hepatobiliary surgery. npj Digit Med. 2025, 8, 293. [Google Scholar] [CrossRef] [PubMed]
- Javaheri, H.; Ghamarnejad, O.; Bade, R.; Lukowicz, P.; Karolus, J.; Stavrou, G.A. Beyond the visible: preliminary evaluation of the first wearable augmented reality assistance system for pancreatic surgery. Int J Comput Assist Radiol Surg. 2024, 19, 931–939. [Google Scholar] [CrossRef]
- Stott, M.; Kausar, A. Can 3D visualisation and navigation techniques improve pancreatic surgery? A systematic review. Artif Intell Surg. 2023, 3, 207–216. [Google Scholar] [CrossRef]
- Ryu, Y.; Shin, S.H.; Park, D.J.; Kim, N.; Heo, J.S.; Choi, D.W.; Han, I.W. Validation of original and alternative fistula risk scores in postoperative pancreatic fistula. J Hepatobiliary Pancreat Sci. 2019 Jul 1;26, 354–359. [CrossRef]
- Wang, J.; Mai, R.Y.; Liu, Y.W.; Lu, H.J.; Li, L.; Liu, H.; et al. Machine learning prediction model for post-hepatectomy liver failure in hepatocellular carcinoma: a multicenter study. Front Oncol. 2022, 12, 986867. [Google Scholar] [CrossRef] [PubMed]
- Altaf, A.; Munir, M.M.; Khan, M.M.M.; Rashid, Z.; Khalil, M.; Guglielmi, A.; et al. Machine learning based prediction model for bile leak following hepatectomy for liver cancer. HPB (Oxford). 2025, 27, 489–501. [Google Scholar] [CrossRef]
- Vaccaro, M.; Almaatouq, A.; Malone, T. When combinations of humans and AI are useful: a systematic review and meta-analysis. Nat Hum Behav. 2024, 8, 2293–2303. [Google Scholar] [CrossRef]
- Brennan, M.; Puri, S.; Ozrazgat-Baslanti, T.; Bhat, R.; Feng, Z.; Momcilovic, P.; et al. Comparing Clinical Judgment with MySurgeryRisk Algorithm for Preoperative Risk Assessment: A Pilot Study. Crit Care. 2018, 22, 330. [Google Scholar] [CrossRef]
- Wang, K.D.; Guan, M.J.; Bao, Z.Y.; Shi, Z.J.; Tong, H.H.; Xiao, Z.Q.; et al. Radiomics analysis based on dynamic contrast-enhanced MRI for predicting early recurrence after hepatectomy in hepatocellular carcinoma patients. Sci Rep. 2025, 15, 22240. [Google Scholar] [CrossRef]
- Morales-Galicia, A.E.; Rincón-Sánchez, M.N.; Ramírez-Mejía, M.M.; Méndez-Sánchez, N. Outcome prediction for cholangiocarcinoma prognosis: embracing the machine learning era. World J Gastroenterol. 2025, 31, 106808. [Google Scholar] [CrossRef]
- Kenig, N.; Monton Echeverria, J.; Muntaner Vives, A. Artificial intelligence in surgery: a systematic review of use and validation. J Clin Med. 2024 Nov 24;13, 7108. [CrossRef] [PubMed]
- Oh, M.Y.; Yoon, K.C.; Hyeon, S.; Jang, T.; et al. Navigating the future of 3D laparoscopic liver surgeries: visualization of internal anatomy on laparoscopic images with augmented reality. Surg Laparosc Endosc Percutan Tech. 2024, 34, —. [Google Scholar] [CrossRef] [PubMed]
- Ramalhinho, J.; Yoo, S.; Dowrick, T.; Koo, B.; Somasundaram, M.; et al. The value of augmented reality in surgery—a usability study on laparoscopic liver surgery. Med Image Anal. 2023, 86, 102943. [Google Scholar] [CrossRef] [PubMed]
- Han, Z.; Dou, Q. (2024). A review on organ deformation modeling approaches for reliable surgical navigation using augmented reality. Computer Assisted Surgery, 29(1). [CrossRef]
- Han, Z.; Zhou, J.; Pei, J.; Qin, J.; Fan, Y.; Dou, Q. Toward reliable AR-guided surgical navigation: interactive deformation modeling with data-driven biomechanics and prompts. IEEE Trans Med Imaging. 2025. [CrossRef]
- Ribeiro, M.; Espinel, Y.; Rabbani, N.; Pereira, B.; Bartoli, A.; Buc, E. Augmented reality guided laparoscopic liver resection: a phantom study with intraparenchymal tumors. J Surg Res. 2024, 296, 612–620. [Google Scholar] [CrossRef] [PubMed]
- Stanuch, M.; Janc, K.; Skalski, A.; Proniewska, K.; Grzelak, P.; Korczynski, P.; et al. 3D mixed-reality visualization of medical imaging data as a supporting tool for minimally invasive surgery in gastrointestinal tumors: pilot experience with CarnaLife Holo and HoloLens 2. Ann Surg Oncol. 2021, 28(Suppl 3):S634–S641. [CrossRef]
- Wu, X.W.; Wang, D.H.; Xiang, N.; Pan, M.X.; Jia, F.C.; Yang, J.; et al. Augmented reality-assisted navigation system contributes to better intraoperative and short-time outcomes of laparoscopic pancreaticoduodenectomy: a retrospective cohort study. Int J Surg. 2023 Sep;109(Pt A):2598–607. [CrossRef]
- Cheng, K.; You, J.; Wu, S.; Chen, Z.; Zhou, Z.; Guan, J.; et al. Artificial intelligence-based automated laparoscopic cholecystectomy surgical phase recognition and analysis. Surg Endosc. 2022, 36, 3160–3168. [Google Scholar] [CrossRef]
- Tokuyasu, T.; Iwashita, Y.; Matsunobu, Y.; Kamiyama, T.; Ishikake, M.; Sakaguchi, S.; et al. Development of an artificial intelligence system using deep learning to indicate anatomical landmarks during laparoscopic cholecystectomy. Surg Endosc. 2021, 35, 1651–1658. [Google Scholar] [CrossRef]
- You, J.; Cai, H.; Wang, Y.; Bian, A.; Cheng, K.; Meng, L.; Wang, X.; Gao, P.; Chen, S.; Cai, Y.; Peng, B. Artificial intelligence automated surgical phases recognition in intraoperative videos of laparoscopic pancreatoduodenectomy. Surg Endosc. 2024 Sep;38, 4894–4905. [CrossRef]
- Laplante, S.; Namazi, B.; Kiani, P.; Hashimoto, D.A.; Alseidi, A.; Pasten, M.; et al. Validation of an artificial intelligence platform for the guidance of safe laparoscopic cholecystectomy. Surg Endosc. 2023 Mar;37, 2260–2268. [CrossRef]
- Kehagias, D.; Lampropoulos, C.; Bellou, A.; Kehagias, I. Detection of anatomic landmarks during laparoscopic cholecystectomy with the use of artificial intelligence—a systematic review of the literature. Updates Surg. 2025, 77, 1–17. [Google Scholar] [CrossRef]
- Woo, Y.; Choi, G.H.; Min, B.S.; Hyung, W.J.; et al. Novel application of simultaneous multi-image display during complex robotic abdominal procedures using the da Vinci TilePro™ system. BMC Surg. 2014, 14, 13. [Google Scholar] [CrossRef]
- Hashemi, N.; Mose, M.; Østergaard, L.R.; Bjerrum, F.; Hashemi, M.; Svendsen, M.B.S.; et al. Video-based robotic surgical action recognition and skills assessment on porcine models using deep learning. Surg Endosc. 2025 Mar;39, 1709–1719. [CrossRef]
- Saeidi, H.; Opfermann, J.D.; Kam, M.; Leonard, S.; Hsieh, M.H.; Kang, J.U.; Krieger, A. Autonomous robotic laparoscopic surgery for intestinal anastomosis. Sci Robot. 2022 Mar;7, eabj2908. [CrossRef]
- Gruijthuijsen, C.; Garcia-Peraza-Herrera, L.C.; Borghesan, G.; Reynaerts, D.; Deprest, J.; Ourselin, S.; Vander Poorten, E. Robotic endoscope control via autonomous instrument tracking. Front Robot AI. 2022, 9, 832208. [Google Scholar] [CrossRef]
- Golany, T.; Aides, A.; Freedman, D.; Rabani, N.; Liu, Y.; Rivlin, E.; et al. Artificial intelligence for phase recognition in complex laparoscopic cholecystectomy. Surg Endosc. 2022 Aug;36, 9215–9223. [CrossRef]
- Yang, H.Y.; Hong, S.S.; Yoon, J.; Park, B.; Yoon, Y.; Han, D.H.; et al. Deep learning-based surgical phase recognition in laparoscopic cholecystectomy. Ann Hepatobiliary Pancreat Surg. 2024, 28, 112–120. [Google Scholar] [CrossRef]
- Mascagni, P.; Alapatt, D.; Garcia, A.; et al. Surgical data science for safe cholecystectomy: protocol for segmentation of hepatocystic anatomy and assessment of the critical view of safety. arXiv preprint. 2021.
- Pei, J.; Zhou, Z.; Guo, D.; et al. Synergistic bleeding region and point detection in surgical videos. arXiv preprint. 2025 Mar 28;abs/2503.22174.
- Kamtam, D.N.; Shrager, J.B.; Malla, S.D.; et al. Deep learning approaches to surgical video segmentation and object detection: a scoping review. arXiv preprint. 2025 Feb 23;abs/2502.16459.
- Kanani, F.; Zoabi, N.; et al. Clinical outcomes, learning effectiveness, and patient-safety implications of AI-assisted HPB surgery for trainees: a systematic review and meta-analysis. Artif Intell Surg. 2025; in press.
- Romero, F.P.; Diler, A.; Bisson-Grégoire, G.; Turcotte, S.; Lapointe, R.; Vandenbroucke-Menu, F.; et al. End-to-end discriminative deep network for liver lesion classification in CT imaging. arXiv preprint. 2019 Jan 28;abs/1901.09483.
- Huo, Y.; Cai, J.; Cheng, C.T.; Raju, A.; Yan, K.; Landman, B.A.; et al. Harvesting, detecting, and characterizing liver lesions using deep dynamic texture learning on CT data. arXiv preprint. 2020 Jun 28;abs/2006.15691.
- Kaul V, Sehgal CM, Mohan BP, et al. Diagnostic value of artificial intelligence–assisted endoscopic ultrasound for pancreatic cancer: A systematic review and meta-analysis. Endosc Ultrasound. 2023, 12, 258–266. [Google Scholar] [CrossRef]
- Wang D, Shang J, Liu F, et al. Machine learning–based prediction of postoperative pancreatic fistula after laparoscopic pancreaticoduodenectomy. BMC Surg. 2025, 25, 191. [Google Scholar] [CrossRef]
- Wang, P.; Wang, S.; Luo, P. Evaluation of the effectiveness of preoperative 3D reconstruction combined with intraoperative augmented reality fluorescence guidance system in laparoscopic liver surgery: a retrospective cohort study. BMC Surg. 2025, 25, 288. [Google Scholar] [CrossRef]
- Wu, S.; Tang, M.; Liu, J.; Qin, D.; Wang, Y.; et al. Impact of an AI-based laparoscopic cholecystectomy coaching program on surgical performance: a multicenter randomized controlled trial. Int J Surg. 2024, 110, 7816–7823. [Google Scholar] [CrossRef] [PubMed]
- Li, Z.; Li, F.; Fu, Q.; Wang, X.; Liu, H.; Zhao, Y.; et al. Large language models and medical education: a paradigm shift in educator roles. Smart Learn Environ. 2024, 11, 26. [Google Scholar] [CrossRef]
- US Food and Drug Administration. Artificial Intelligence and Machine Learning Software as a Medical Device (SaMD) Action Plan — Total Product Lifecycle (TPLC) approach, GMLP, and PCCP frameworks. Jan 2025.
- US Food and Drug Administration. Artificial Intelligence-Enabled Device Software Functions: Lifecycle Management and Marketing Submission Recommendations. Draft Guidance released Jan 6, 2025.
- Lekadir, K.; Frangi, A.F.; Porras, A.R.; Glocker, B.; Cintas, C.; Langlotz, C.P.; et al. FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare. BMJ. 2025, 388:e081554. [CrossRef]
- Arjomandi Rad, A.; Vardanyan, R.; Athanasiou, T.; Maessen, J.; Sardari Nia, P. The ethical considerations of integrating artificial intelligence into surgery: a review. Interdiscip CardioVasc Thorac Surg. 2025, 40, ivae192. [Google Scholar] [CrossRef] [PubMed]
- Ye, Z.; Zhou, R.; Deng, Z.; Wang, D.; Zhu, Y.; Jin, X.; et al. A comprehensive video dataset for surgical laparoscopic action analysis. Sci Data. 2025, 12, 862. [Google Scholar] [CrossRef] [PubMed]
- Peng, Z.; Wei, J.; Xiao, Z.; et al. SurgBench: a unified large-scale benchmark for surgical video analysis. arXiv preprint. 2025.
- Chen, G.; Sha, Y.; Wang, Z.; Wang, K.; Chen, L. The Role of Large Language Models (LLMs) in Hepato-Pancreato-Biliary Surgery: Opportunities and Challenges. Cureus. 2025 Jun 14;17, e85979. [CrossRef]
- Banerjee, S.; Wang, D.S.; Kim, H.J.; Sirlin, C.B.; Chan, M.G.; Korn, R.L.; et al. A computed tomography radiogenomic biomarker predicts microvascular invasion and clinical outcomes in hepatocellular carcinoma. Hepatology. 2015, 62, 792–800. [Google Scholar] [CrossRef] [PubMed]
- Hashimoto, D.A.; Ward, T.M.; Meireles, O.R. The Role of Artificial Intelligence in Surgery: A Review of Current and Future Applications. JAMA Surg. 2022, 157, 368–76. [Google Scholar] [CrossRef] [PubMed]


| Study (Author, Year) | AI Method or Tool | Target Organ / Disease Focus | Clinical Application | Performance Metrics | Study Type |
|---|---|---|---|---|---|
| Bektas et al., 2024 [4] | Radiomics + CNN on ultrasound imaging | Liver (HCC tumors) | Imaging diagnosis (tumor classification; recurrence prediction) | AUC ~0.81–0.85 for early HCC recurrence (outperformed clinical risk factors); high accuracy distinguishing HCC vs. metastases | Retrospective cohort study (imaging analysis) |
| Tong et al., 2022 [18] | Deep CNN (ResNet-50) on EUS images | Pancreas (PDAC vs. chronic pancreatitis) | Imaging diagnosis (tumor differentiation) | AUC ≈0.95 for PDAC detection (vs pancreatitis); demonstrated high diagnostic accuracy as decision support in borderline cases | Retrospective diagnostic study (multi-center image dataset) |
| Kawamura et al., 2023 [19] | CNN-based video analysis for CVS identification | Biliary (CVS during cholecystectomy) | Intraoperative safety guidance (anatomic landmark confirmation) | Real-time CVS recognition with ~83% overall accuracy; could alert surgeons to incomplete CVS, aiming to prevent bile duct injury | Retrospective observational study (analysis of recorded LC videos) |
| Müller et al., 2025 [20] | Ensemble ML algorithms on clinical data | Pancreas (postoperative fistula risk) | Outcome risk prediction (complication risk stratification) | AUC ~0.80 for clinically relevant POPF (vs <0.60 with Fistula Risk Score); ML model significantly improved risk prediction | Retrospective cohort study (model development & validation) |
| Wang et al., 2025 [21] | Mixed Reality (Hololens) with 3D liver model overlay | Liver (tumor cases) | Surgical planning (preoperative simulation & education) | Qualitative improvements in anatomical understanding and surgical strategy planning (holographic tumor visualization); no quantitative metrics reported | Prospective case series (pilot implementation of MR planning) |
| Giannone et al., 2021 [22] | Augmented Reality overlay in robotic surgery | Liver (robotic hepatectomy for tumors) | Intraoperative guidance (real-time image guidance) | Feasible AR overlay of tumor and vasculature during surgery; improved lesion localization and transection planning (qualitative), though registration accuracy was a noted limitation | Prospective pilot study (feasibility in 3 cases) |
| Crisan et al., 2023 [23] | YOLOv5 deep learning vision + AR display | Intraoperative bleeding (multiple HPB procedures) | Intraoperative hazard detection (real-time bleed alert) | Detected surgical bleeding in real time with high accuracy (distinguished blood vs. irrigation fluid); demonstrated concept of automated hazard alerts via AR headset | Experimental feasibility study (lab validation on recorded surgery videos) |
| Pomohaci et al., 2025 [24] | N/A (Systematic review of AI in imaging) | Liver imaging (various pathologies) | Imaging diagnosis (lesion detection & classification) – review | N/A (Reviewed 329 studies: most focused on lesion classification; CT was the most common modality; highlighted lack of external validation in many studies) | Systematic review (2018–2024 literature) |
| Cheng et al., 2024 [25] | Concept: AI-enhanced fluorescence imaging | HPB cancers (tumor margins) | Intraoperative guidance (augmented fluorescence surgery) | N/A (Conceptual proposal: AI can enhance fluorescence image quality and differentiate tumor vs normal tissue signals, potentially improving margin detection and resection precision) | Perspective article (conceptual review of emerging techniques) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).