Explainable Artificial Intelligence (XAI) for Diagnosing and Treating Tumors of the Female Reproductive Systems: Challenges and Advances

1. Introduction

In recent years, with the rapid development of artificial intelligence (AI) algorithms, computing capacities, data models, interpretable AI, and related methods have been nourishing tremendous products in the domain of medical imaging, especially in the field of malignant tumor diagnosis and treatment. Cervical cancer, endometrial cancer, and ovarian cancer represent three major types of gynecological malignant tumors, where the global incidence rate is increasing year by year and displays the prevalent incidence of diseases with a younger trend in mainland China [1].

In the medical domain, the contemporary study of gynecological tumors represents a very specific branch, which comprises a variety of topics such as disease prevention and control, early-stage screening and detection, the distribution of diseases, genetic testing, human data analysis, diagnosis, and treatment, to name a few. Those aspects have close intersections with explainable AI, which are gradually established on the foundations of big data, cloud computing, and deep learning-related approaches, indicating potential advantages on significant contributions to cancer screening and medical treatments.

As a communication article oriented toward state-of-the-art approaches, this paper mainly presents challenges and advances in explainable AI and current progress with big data, deep learning, radiation diagnosis, and treatments, providing referrable evidence and innovative ideas for the latest research on AI in the field of gynecological oncology.

The keynote objectives of this paper are summarized as below:

i) In accordance with the concepts of explainable AI and clinical imaging, the crucial methods for diagnosing and treating gynecological tumors are concisely addressed with category and summary of kernel work in the last decade (before the spread of COVID-19);

ii) As suggested by the guest editor for PRIMSA methodology on a systematic review, challenges and advances in gynecological oncology are discussed in reference to cross-subject research topics such as medical image analysis, deep learning, and AI schemes, etc.

iii) Representative explainable AI systems, mainstream applications, prospects on future progress on pre-warning, diagnosing and treating, and post-operative predicting those tumors on female reproductive systems are briefly analyzed in the last two sections.

iv) Quantitative parameters such as average accuracy, ROC-AUC value, and time cost are also tabulated for comparison on the state-of-the-art schemes in the last five years.

The remainder of this paper is structured as follows. Section 2 presents the crucial methodology on basic concepts, related workflow of explainable AI, and explainable AI-related schemes for gynecology. Section 3 shows recent advances and challenging issues on treating gynecological tumors in the latest five years. Section 4 provides discussions on the technical advances of explainable AI on early screening and precise diagnosis of gynecological tumors, while Section 5 displays conclusions and future directions.

2. Approaches and Methods

2.1. Fundamental Concepts and Workflow of Explainable AI for Clinical Use

As early as 2019, Gartner stated in the prediction of the ten largest trends in data and analysis, explainable AI is of paramount necessary since explainability enables systems in the styles of working closer to nature [2]; meanwhile, since AI models are more and more universally augmenting and substituting human beings for decision-making, in enterprise administration or medical diagnosis, justification must be made for reasonability on these models. For simplicity, the fundamental concepts of explainable AI between tasks and users are depicted in the workflow of Figure 1.

Despite that, most advanced AI models are complicated black boxes that are lacking in evidence for whether they may propose a specific suggestion or decision, explainable AI models in the clinical domain, as characterized by high flexibility, repetitively usable and fast developing, bring about refreshed capabilities for clinical diagnosis, especially in specific medical branches such as gynecological oncology. Typically, an explainable AI-assisted clinical workflow consists of three modules [3]: current practice, decision port, and “areas of impact” guided by AI. A workflow to enhance the standard of care for cancer patients is depicted in Figure 2, where the block diagrams of current practice, decision port, and AI “areas of impact” are colored white, dark blue, and orange, respectively. Explainable AI offers auxiliary support to enhance this workflow and decision-making on diagnosing, treating, and predicting potential tumors in the female reproductive system. Subsequently, the measured outcomes also generate feedback from patients and AI-based optimization for systematic improvement.

In gynecological malignant tumors, the links between explainable AI and big data mainly comprise early disease warning, medical imaging diagnosis and treatment, health management, genetic testing, and drug development [4].

Take disease warning as the first example [4]: it aims to discover correlations among multiple test results from patients, the present conditions of their disease, and medical outcomes from big data analysis, and then identify high-risk female patients with truly pre-cancerous potentials for invasive cancer and pre-invasive illness, referring them for medical referral, mandatory health monitoring, or providing them with personalized interventions and treatments in advance.

While AI shows much stronger capacities for data analysis and computation, it lacks emotions, self-awareness, and the ability to reflect on situations of one’s own [4]. As a result, the input information is just processed and analyzed with respect to manually designed computer programs. In a word, AI is still immature in quite a few aspects, where the recent advances can be investigated by referring to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology [5], which will be shown in subsequent sections. Hence, appropriately explainable AI models and disease warnings demand crucial attention in preventing and treating gynecological malignant tumors.

2.2. Preliminary Review of Explainable AI on Diagnosis and Treatment for Gynecological Oncology

In the past decade, some of the most representative approaches for explainable AI on the clinical use for gynecological tumors, are summarized below:

An advanced neural network (NN) and AI technique-based clinical Decision Support Scoring System (DSSS) was developed by Kyrgiou et al. [6], which exploits the capacities of all biomarker information on accurate prediction for which women display clinically significant lesions with true carcinogenic potential (CIN2 or worse), offering quantitative probabilities for different histological diagnosis.

Similarly, a neural network-based AI scheme was adopted by Pergialiotis et al. [7], predicting endometrial cancer with an accuracy of 85.4% in 178 female patients with endometrial thickness of 5 mm and post-menopausal vaginal bleeding.

The advantages of explainable AI on gynecological diagnosis are also oriented to skipping manual analysis while only requiring reviewed results from medical specialists [4]. For diagnostic imaging, reliable AI techniques can reduce observer bias, alleviate the workload of doctors, and thereafter enable them to concentrate more on difficult cases, helping accurately identify rare diseases along with the quality of standardized reports [3]. Therefore, it may significantly improve the efficiency of disease screening, overcome those errors due to the more vital subjectivity of manual diagnosis, and thereafter enhance the accuracy of clinical diagnosis [4].

In 2017, Bora et al. [8] proposed a training and recognition framework for cervical atypical hyperplasia, which involves computer vision (CV) techniques for performing structured restructuring and analysis of cervical dysplasia, extracting key features of the lesion site, showing AI-based analysis of disease development, then proposing suitable plans for auxiliary diagnosis and treatments. Meanwhile, the classification and prediction of colposcopic images also benefit from the technical outputs of AI, which may effectively capture fine texture features and achieve higher diagnostic accuracy comparable to those achieved by medical experts [9,10].

While taking care of complicated gynecological tumors, AI usually offers guidance on clinical diagnosis and treatment in pre-operative imaging diagnosis: first, it predicts the presence of microvascular, lymph node metastasis, and nerve invasion lesions, then assists in designing personalized treatments; later, it helps to distinguish the benign and malignant conditions of the uterus and its attachments owing to the advantages from big data models [11]. For pathological diagnosis, the differentiation of benign and malignant gynecological tumors, disease classification, and prognosis judgment are also dependent on automated histopathological image analysis [12]. For instance, AI-aided screening for cervical cancers may demand technical output from automated detection on liquid-based cervical cell imaging [13]. Besides, AI-based classifications between normal and CIN I-III features of cervical epithelial cells can be achieved by extracting kernel nuclear features or artificial biomarkers for nuclear images [14].

AI-related clinical treatments for gynecological tumors are also broadly classified as surgery, chemotherapy and radiotherapy, etc. [6]. Currently, the most typical minimally invasive surgical method for gynecological tumors is undoubtedly robot-assisted surgery, represented by the Da Vinci robot, which consists of a surgical console, a mobile robotic arm, and a three-dimensional (3D) imaging system. The main advantages of the Da Vinci Robot system are its high magnification, high-definition stereoscopic field of view of 3D imaging, and higher surgical accuracy. Utilizing an intuitive motion control and a turning instrumental arm, the smart surgical system may perform more sensitive operations while filtering out tremors, hence increasing both stability and safety. In contrast to traditional laparoscopic surgeries, due to less trauma, less bleeding, and fewer complications, which are capable of effectively alleviating post-operative pain, this AI-assisted system works for ovarian cancer patients who have pretty strong demands to preserve fertility in the early stage [15]. Besides, by creating images of virtual surgical sites, explainable AI-related deep medical image analysis and video processing, may not only qualify for pre-operative planning, intra-operative navigation, accurate ablation of tumors and dissection of lymph nodes, etc. [4], but also control mechanical arms remotely through the Internet to achieve telemedicine [16].

In response to the potential drug resistance of gynecological malignant carcinoma cells in chemotherapy, AI has great potential for predicting the most effective anticancer drugs with their responses and continuously releasing the drugs to a concentration level above certain thresholds [17]. For in-vivo targeted treatment of gynecological malignant tumors, AI mainly combines drugs through the functionalization of nano-robots, which points out cancer cells fast and accurately for later specific combination when enhancing the effectiveness of treatment; hence, the dosage of drug and potential side effects are decreased [18]. Besides, while overcoming most drawbacks of poor penetration on intra-peritoneal infusion chemotherapy and its potential limitation on the surface of tumors, where AI-based computer-aided models incorporate their spatial heterogeneity, i.e., the distribution of capillary vessels and hydrophilicity, which may simulate spatial dynamics of available anti-cancer drugs, and enhance their capacities when penetrating towards the center area of tumor for treatment [19].

In addition to those advances in surgical and chemotherapic treatments in the past few years, research progress in the field of gynecological malignant tumor radiotherapy also relies on the cooperative use of diagnostic imaging, big data, and explainable AI, which mainly focuses on some general workflows such as automatic delineation, dose and efficacy prediction, and adverse reactions to radiotherapy [20]. Typically, deep learning-based approaches for the correlations of patient individual characteristics and dosimetry characteristics may automatically predict appropriate doses and develop radiotherapy plans [4], while the concept of “Internet+” when combining AI techniques on three-level prevention of gynecologic tumor provides alternative solution to problems on traditional managements [21]. Besides, AI improves clinical practice of radiation oncology to develop precise, efficient, and optimized automated boundaries for three-dimensional (3D) space, which can be transplanted into the field of gynecological oncology [22]. Besides, Saw et al. developed Eclipse treatment planning software for the Varian Medical System to achieve intelligent design and dose optimization toward radiotherapy plans [23].

However, applicable techniques for explainable AI, i.e., machine learning and deep neural networks for analyzing and treating gynecological tumors, are still in the research stage, which demands a certain number of experts on training image segmentation to meet advanced expectations of professional radiologists [4,20]. In the target area delineation of radiotherapy, typical AI advantages are efficiency, accuracy, good consistency, and strong standardization. For other organs at risk, AI shows delineation accuracy and good effects on segmentation. In addition, there is still a shortage of in-depth studies on designing radiotherapy plans, the fusion of imaging equipment, radiation toxicity assessment, and prediction of control rate on tumors.

Take AutoPlan (Pinnacle platform, developed by Philip Inc. in the US) for a second example [22]. As another relatively mature system for radiotherapy treatment on tumors, AutoPlan performs automatic planning in contrast to the emphasis on manual planning in the volume rotation of Eclipse. There are not only significant improvements in the conformability and uniformity of the target area in automatic planning, but also an apparent reduction in organs at risk. It is imaginable that instead of merely relying on a few parameters, implementing deep learning (DL) models may replace prior indicators in clinical testing and achieve higher accuracy in personalized prediction. Meanwhile, while explainable AI-assisted delineations of the target region and their schematic planning currently still present limited applications in the diagnosis and treatment of gynecological malignant tumors, it only takes 25-40 minutes to accomplish those tasks equivalent to traditional human labor of several hours, and after that improving the efficiency of both treatment planning and quality control, increasing benefits from those involved patients as well as reducing risks.

Table 1 displays the most representative state-of-the-art schemes of our study on explainable AI, where the relevant information is primarily shown in accordance with the references, category and concise summary of kernel content in chronological orders.

In sum, a brief review was performed on the keynote AI-based schemes in medical advances for diagnosing and treating gynecological tumors. The follow-up investigation on related challenging issues and recent advances (since 2020) are presented in Section 3.

3. Recent Advances and Challenging Issues

3.1. Application of PRISMA 2020 on Systematic Review of the Proposed Study

In this section, recent challenges and advances in establishing recent diagnosis and treatment models for treating gynecological tumors are summarized, which may combine big data and AI for assisting clinicians in standardized operations, providing precise diagnosis and viable treatment, and contributing to personalized, safe, effective design for medical therapy and efficacy evaluation [24].

With respect to the PRIMSA methodology [5], a systematic investigation on crucial challenging issues and recent progress (from the Year 2020 to the present) for explainable AI schemes and gynecological oncology are performed, in which the checklist, structured summary, and flowcharts to document the process of work are presented in Figure 3.

As depicted in Figure 3, the selection of current studies included for this systematic review was followed from this set of scenarios: A google scholar mirror search (accessed on 15 August 2024) was performed, where the outcome came with identification of 529 journal articles relevant to this review. The search terms included: ([“explainable artificial intelligence (AI)” AND “precision medicine” AND “deep learning” AND “interpretable machine learning” OR “gynecological tumor” OR “cervical cancer” OR “endometrial cancer” OR “ovarian cancer”]). A set of inclusion criteria were that the article be peer-reviewed journal with fully text available, written in English, comprising of the search terms in the main content, which were updated by inserting the above-mentioned terms on determining exclusions. The search was restricted to research articles published with the range of years 2020 to present, while with no limitations by date. We did not refer to reference management software such as Endnote, Mendeley or Zotero, while applying semi-manual classification on these articles instead. The PRISMA 2020 flowchart was carefully followed to illustrate the determination on the final set of articles. The resulting 27 articles jointly associates explainable AI to precision medicine and three major types of female reproductive organ tumors in gynecology, which are selected and presented in Table 2, which are permuted according to titles and year of publication.

3.2. Main Set of the Current Schemes on Applying Explainable AI for Gynecological Oncology

The selected 27 studies stand for a typical set of potential solutions and advancements towards challenging issues in explainable AI for diagnosing and treating gynecological tumors published in the latest five years, where the brief description towards the main set of their approaches as tabulated in Table 2, are presented as follows:

Tanabe et al. [25] established a pre-trained CNN model AlexNet on recognizing early-stage epithelial ovarian cancer (EOC) by adopting principal component analysis (PCA)-based 2D barcodes, where the diagnostic accuracy reached 95.1% of Receiver Operating Characteristics and Area Under Curve (ROC-AUC), reducing both financial stress and mental tension of patients when contributing to improving their survival rates. Later, a deep-learning-related mini-review on empowering the capacities of diagnosing diseases was proposed by Zhang et al. [26], which promoted clinical decisions from representative studies among 19 different countries.

A computer-aided diagnosis (CADx) framework was proposed by Chen et al. [27], performing self-supervised learning for in-vivo 3D OCT volumes from the cervix on screening cervical cancers and for cervical OCT image classification. This kernel strategy focused on contrastive learning for texture features from pre-trained convolutional neural network (CNN) models.

In Spring 2022, Lawton and Pavlik investigated eight major factors closely related to diagnosing ovarian cancer from 1809 to 2022 and beyond [28], providing detailed views and insights from the perspective of modern gynecological oncologists, where the outlook on surgical plans involving telemedicine and other referrals, disease warning, prevention and prediction, stands for joint expectations from explainable AI and precise medicine.

AI-assisted colposcopy for cervical diagnostic pathology unit in a tertiary hospital was studied by Zimmer-Stelmach et al. [29], evaluating the potential capabilities of this AI algorithm for correct identification of histopathology results of abnormal CIN2+, and then comparing clinical assessment results before and after applying this approach for the viability of prospective applications.

Zhang, Zhou, and Luo [30] studied the scheme of applying extracellular vesicles to common gynecologic tumors and discussed their roles in treating tumors. However, while there were a great number of potentialities on both diagnostic and therapeutic capacities for gynecologic oncology, it is still at the exploratory stage when cooperating this means with explainable AI.

Given the test results of gynecologic cancer patients, Maruthi et al. [31] presented a brief experimental study on identifying the clinical utility rate of their tests and analyzing the survival benefits for those receiving targeted therapy. While the high clinical utility of the tests used by gynecologic oncologists appeared to be a significant survival benefit, limited technical input combined with AI stands for their weakness. Besides, combining AI and genes represents a progressive tendency for future immunotherapy, which is capable of integrating information from multiple parameters, revealing characteristics of tumors, and providing implications for treatment decisions [4].

Terlizzi et al. [32] reported tests of applying 3D pulsed dose rate brachytherapy for curing children with vaginal tumors, where their proposed strategy on multimodal organ conservation was expected to achieve better oncological results for some typical cases of pediatric vaginal cancers.

When applying image segmentation and classification algorithms to handle cervical screening images, deep-learning-based solutions were reviewed by Youneszade et al. [33], which suggests adopting viable AI techniques and supporting female patients with early detection, diagnosis and treatment of cervical cancer.

Liu et al. [34] studied pre-treatment on histopathology images of high-grade ovarian cancers, when predicting sensitivity or resistance of this cancer to subsequent platinum-based chemotherapy. A deep-learning-based Al framework was presented on improving the prediction of responses to therapy of high-grade serous ovarian cancers, as well as any further adaptation to other types of gynecological cancers and imaging modalities.

With respect to potential challenges in emergency medicine, Okada, Ning, and Ong [35] displayed keynote definitions, importance, and the role of explainable AI, aiming to make those concepts in emergency contexts more clearly understandable by clinicians.

Ghnemat et al. [36] presented medical image classification using explainable AI and accomplished 90.6% testing and validation accuracy on a relatively small image dataset, demonstrating improved accuracy and reduced time cost may practically fit the medical diagnosis, and thereby suggesting the interpretability and transparency of explainable AI on promoting medical diagnosis, and candidates on transplanting feasible schemes for gynecological oncology.

Allahqoli et al. [37] performed an updated review of all the relevant studies on the promising applications of 18F-FDG PET/MRI and 18F-FDG PET/CT in five categories of gynecological malignancies, where the results indicate potential capacities and existing challenges of non-invasive imaging tools of those FDG PET/MRI and FDG PET/CT for enhancing the management of gynecological cancers.

Sekaran et al. [38] derived a creative game theoretic scheme, i.e., the Shapley Additive exPlanations (SHAP) on analyzing the results of vaginal microbiome in cervical cancer by classifying relative species, then showing confirmation with this AI model in the presence of pathogenic microbiomes in vaginal samples of cervical cancer, and their mutuality with microbial imbalance.

Considering patients with uterine cervical cancer undergoing radiation therapy and the related late bladder toxicity, Cheon et al. [39] derived a lightweight prediction model and compared the performance of logistic regression with deep-learning models when predicting late bladder toxicity in patients with cervical cancer, where the outcome of patients got improved and featured as minimized treatment-related complications with secured reliability.

Abuzinadah et al. [40] put up a stacked explainable AI model to accelerate screening and provide more accurate results on predicting, detecting, and treating ovarian cancer, which achieved an accuracy of 96.87% among 49 features on enhancing detection results, elaborating viable applications of explainable AI techniques for better understandings.

Most recently, when establishing a comprehensive overview of long-axial field-of-view (LAFOV) PET/CT imaging for those patients with gynecological malignant tumors, Triumbari et al. [41] explored some potential applications and benefits for all phases of management, i.e., the initial staging to surgery and radiotherapy planning, evaluation of treatment response, restaging, as well as later patient-tailored care.

Another latest review was proposed by Margul, Yu and AlHilli [42], which studied the tumor immune microenvironment (TIME) in all three major types of gynecological tumors and vaginal/vulvar cancers. Data sources of clinical trials were analyzed, proving their understanding of TIME to treat gynecologic malignancies.

Pang, Xiu and Ma [43] summarized the progress of explainable AI when diagnosing, treating, and predicting mediastinal malignancies with a cross-area survey of machine learning and artificial intelligence, where the potential shortcomings exist in the shortage of clear definitions on specific type of tumors and lacking visible experimental results. Similar problematic issues were also inherent when specifically interpreting and coping with the machine learning models from explainable AI as proposed by Robert et al. [44].

Most notably, reviewing applicable AI-based radiomics by Wang et al. [45] toward similar assessment of ovarian cancers is more specific, claiming its potential to enhance the capacities of diagnosis and prognostic prediction in patients to facilitate the innovative concept of precision medicine.

Seo, Refai and Hile [46] applied a modern data-driven learning technique for testing spatiotemporal plantar pressure data collected from 16 female patients with active breast, ovarian or uterine cancers by walking through the high-resolution sensor-impregnated walkway, then reported an average accuracy of over 86% in tests. It is concluded that for automatic identification of peripheral neuropathy and other chemotherapy side effects, which have a great impact on mobility, indicating the presence of persistent deviation from pre-chemotherapy step consistencies of survivors. Meanwhile, Jopek et al. [47] also developed a multi-class deep-learning-based scheme, which was integrated as similar as the explainable AI approach (XAI) - SHAP, where the outcome was originated from a set of sixty genes to show its promising capacity on cancer detection, and could support the decision-making process of clinicians for complicated case of tumors.

Integrations of AI and applications into a variety of medical specialties for clinical practice were reviewed by Karalis [48], which justified the enhanced accuracy of AI-aided diagnosis and personalized treatment plans in addition to special reference on legal and ethical concerns. A short subsection discussed obstacles and progress of integrating AI in obstetrics and gynecology while neglecting recent advances in gynecological oncology, which renders a shortcoming in this set of work arousing further discussions.

In early 2024, Brandão et al. [49] established an investigation on the current status of AI schemes and developments in gynecology, where several challenging problems on clinical practice are also discussed with respect to a variety of high-frequently used deep learning models towards specific type of cancers in female reproductive systems. While prospecting opening questions, unmet demands and potential promises for implementing explainable AI to enhance their corresponding clinical utility, both technical and ethical issues were taken into account for development, implementation and accountability [49].

However, there are quite a few challenging issues for explainable AI. There are rather scarce image datasets in cervical malignant tumors and a shortage of external validation [50]. Longer periods and higher expenses are common for auxiliary diagnostic systems such as colposcopy, while the necessity of developing dynamic systems for explainable AI imaging and the relative unfamiliarity in a certain domain remain potential technical barriers for conducting research. Secondly, despite some early-stage screening algorithms undergoing extensive training, most are small-scale sample investigations and short of external validation. Moreover, the enhancement of interpretability for those deep learning models, acquisition and application of explainable AI systems, efficiency and robustness of available algorithms for clinical treatments on gynecological malignancies, indicate universally refreshed topics on AI-based technical development.

Take the field of radiotherapy as an example [20]: recent studies of AI are mainly oriented on head and neck cancers as well as prostate cancers, while such progress was mostly restricted to gynecology. In addition, in chemotherapy and immunotherapy, the compatibilities of explainable AI with equipment, reagents, images, and dependencies on a large number of high-quality datasets and deep-learning-based methods still represent prevalently tricky issues. Needless to say, the interpretability of diagnostic results and ethical responsibilities for the doctor-patient relationships and topics on intelligent health management [4]. Most notably, applications of virtual reality (VR) and augmented reality (AR) for psychological therapy and remote medicine come across restrictions of time and space, also benefit the treatment of gynecological cancers so as to ensure the optimal opportunities of medical care, and thereby release the unbalanced distribution of medical resources, which are under fast progress towards modified state-of-the-art architectures, i.e., variations of ResNet and higher-level system integration, offering advanced support for gynecological oncology [51].

4. Discussion

4.1. Selected Evaluations on Explainable AI-Guided Precise Medicine for Gynecological Tumors

In retrospect to those technical advances of explainable AI, a variety of considerable achievements were fulfilled on early screening and precise diagnosis of gynecological tumors, especially in the field of AI-aided diagnostic imaging and pathological analysis. However, it is still very difficult to select the most appropriate AI techniques for accuracy, reliability, and efficacy. Besides, regarding the applications of new staging, which jointly adopt pathological classifications and molecular classifications, a booming demand for human labor may appear for pathologists, where explainable AI provides solutions for sharing some of their workload due to the presence of big data models, advanced neural networks, weakly supervised learning schemes as well as deep-learning based algorithms.

In accordance with the state-of-the-art schemes of explainable AI which associate with early-stage diagnosis, medical treatment and prognostic information on gynecology, there is still some potential gap between the current study and technical approaches. For instance, the evaluation metrics on explainable AI-guided precise medicine, are short of comprehensive investigation. As a result, it is necessary to establish a systematic summary on the keynote quantitative parameters which are high-frequently used in related studies. While digging into the selected categories of kernel work and current study as tabulated in Table 1 and Table 2, a sequence of representative schemes matching with explainable AI schemes, data sources, analytical methods and performance metrics, are summarized in Table 3.

The tabulated results selected 21 studies of explainable AI (XAI) directly oriented for gynecological malignancy in the past decade. As illustrated in Table 3, the dominant XAI scheme works with deep CNN and other DL and ML models for classification, while the data sources were mostly originated from clinical case study, sample patients and typical image datasets. Except for a few systematic reviews with visualized results, k-fold cross validation represents the most high-frequently tool for analytical use. For experimental results, basic information retrieval (IR) metrics such as sensitivity, specificity, F₁-score and overall / average accuracy of classifiers, are often applied for performance analysis, while ROC-AUC, SHAP values, 5-year survival rates, ML related indices and cost of medical care with XAI, also stand for keynote metrics in some of the studies upon our investigation.

4.2. Brief Summary on Contributions and Limitations of Our Study

Up till now, a concise study on the connective correspondence of explainable AI and clinical advances in gynecological oncology is presented, where the major contributions of our work are summarized as follows:

i) Firstly, we picked up some keynote AI-based approaches on the very specific topics of gynecological oncology, including theoretical advances in the past decade, early-stage screening, and diagnostic and surgical treatments with respect to several practical fields, with some emphasis on a couple of present mature systems for radiotherapy treatments.

ii) Secondly, we established a narrow but complete investigation on applicable areas of explainable AI in several crucial branches of diagnosing and treating gynecological malignant tumors, i.e., disease warning, pathological analysis, virtual reality, minimally invasive surgical planning and health management, etc. Enhanced detection accuracy, time efficiency, and quality evaluation of those technical advances have been refreshed and are up to date.

iii) Last but not the feast, coping with the concept of integrating AI and biomedical science towards future healthcare, the potential weakness of prior studies in a small portion of the listed research products are specified along with potential challenging issues in the field of study on gynecological oncology and practical devices for clinical use.

Despite such kind of innovative ideas and critical thinking in those aforementioned manifolds, our study still has several limitations, which are concisely described below:

To begin with, explainable AI techniques are progressing in the primary stage, where the specific values of clinical applications and marketing potentials are beyond discussion. Restrictions such as lacking self-awareness, emotional response and perspective reflecting on individual situations, remain open to problems which are prospecting for solution [4]. Besides, many current explainable AI schemes involve complicated high-performance computer-aided techniques, which might not be friendly to most common clinicians. In other words, explainable AI is effective only if it truly saves time and improves efficiency for most people, and this concept is also universally applicable to any clinical branch related to gynecological oncology. Meanwhile, due to the scarcity of either first-hand clinical data or practical implementation of algorithms, we still do not have a uniform platform to train, test, and validate those technical advances, i.e., deep learning-based schemes for the latest study on gynecological tumors, hence, our set of work demands prospective orientations and progressive exploration in machine learning and deep learning-based framework for medical image analysis [52,53], self-distillation framework of multiple-instance learning for image classification [54], deep transfer learning with explainable AI paradigm when diagnosing Alzheimer’s disease [55], and other reliable applications of explainable AI for gynecological oncology towards the promising goal of precision medicine in digital health [20,56].

The accepted fifty-eight papers in this article were originated from research scholars among thirty nations: Australia, Bangladesh, Canada, China, Egypt, France, Germany, Greece, India, Iran, Italy, Japan, Jordan, Korea, Malaysia, Mexico, Morocco, Netherlands, Nigeria, Pakistan, Poland, Portugal, Saudi Arabia, Singapore, Spain, Sweden, Switzerland, Qatar, UK, and USA.

5. Conclusions and Future Directions

In sum, the latest progress of XAI in the field of gynecological oncology is mainly distributed on cytological screening of cervical lesions, disease warning and early-stage diagnosis of uterine and ovarian tumors, as well as prognostic prediction of gynecological malignancies which may become potential killers to women’s health. While introducing refreshed statistical explanations and by means of diagnostic imaging and pathological analysis, subsidiary treatment plans are provided for clinicians. More specifically, virtual reality, minimally invasive technology, and intelligent robots may provide new concepts and challenges for difficulties of pre- and intra-operative strategies and speed up post-operative healing for gynecological tumors. In a few practical fields such as chemotherapy, radiotherapy, and immunotherapy, etc., deeper involvements of XAI technology integrate multi-parameter information, accelerate the revelation of crucial features on tumors, supplement clinical decision-making, and optimize treatment plans, which stand for a much more popular trend for the future progress of gynecological oncology. Quantitative parameters on selected research studies involve basic information retrieval metrics, i.e., sensitivity, specificity, overall / average accuracy, ROC-AUC and budget on expenses of comprehensive medical treatment, are summarized in comparison.

We sketch plans for future study on explainable AI with gynecological cancers in the following manifolds: for the purpose of multi-center and larger-scale investigations, public image group data platform demands installation for expanding image datasets and covering various radiotherapy centers, which is within our scope for dataset construction. Meanwhile, explainable AI-based techniques not only call for clinical translation, but also require accuracy enhancement in radiotherapy applications, where those perspectives are originated from data sources, quality control, technical support and reliable algorithms themselves [57]. The subsequent progress of deep learning, big data and precise medicine coping with explainable AI, nourish the technical advances of gynecological oncology.

In addition to Chat-GPT and beyond techniques [58] on AI for healthcare, we also intend to seek for in-depth cooperations with clinical departments in provincial hospitals and research institutions for the information sharing of related issues and facing up with those challenging topics of gynecological oncology in the new era of “Healthy China 2030”. Finally, thanks to the progressive discovery of applicable values in these explainable AI-based approaches, prospective exploration, and deeper integration with their viability, interpretability, accuracy, and reliability, our society may benefit from refreshed ideas and improved solutions for the diagnosis and treatment of gynecological tumors.