Submitted:
20 November 2025
Posted:
24 November 2025
You are already at the latest version
Abstract
Background: Precise delineation of the rectum is crucial in treatment planning for cancers in the pelvic region, such as prostate and cervical cancers. Manual segmentation is also still time-consuming and suffers from inter-observer variability. Since there are meaningful differences in rectal anatomy between males and females, incorporating sex-specific anatomical patterns can be used to enhance the performance of segmentations. Furthermore, recent deep learning advancements have provided promising solutions for automatically classifying patient sex from CT scans and leveraging this information for enhancing the accuracy of rectal segmentation. However, their clinical utility requires comprehensive validation against real-world standards. Methods: In this study, a two-stage deep learning pipeline was developed using CT scans from 186 patients with either prostate or cervical cancer. First, a CNN model automatically classified the patient’s biological sex from CT images in order to capture anatomical variations dependent on sex. Second, a sex-aware U-Net model performed automated rectal segmentation, allowing the network to adjust its feature representation based on the anatomical differences identified in stage one. The internal validation had an 80/20 train-test split, and 15% of the training portion was held out for validation to ensure balanced distribution regarding sex and diagnosis. Model performance was evaluated using spatial similarity metrics, including the Dice Similarity Coefficient (DSC), Hausdorff Distance, and Average Surface Distance. Additionally, a radiation oncologist conducted a retrospective clinical evaluation using a 3-point Likert scale. Statistical significance was examined using Wilcoxon signed-rank tests, Welch’s t-tests, and Mann-Whitney U test. Results: The sex-classification model attained an accuracy of 94.6% (AUC = 0.98, 95% CI: 0.96–0.99). Incorporation of predicted sex into the segmentation pipeline improved anatomical consistency of U-Net outputs. Mean DSC values were 0.91 (95% CI: 0.89–0.92) for prostate cases and 0.89 (95% CI: 0.87–0.91) for cervical cases, with no significant difference between groups (P=0.12). Surface distance metrics calculated on resampled isotropic voxels showed mean HD values of 3.4±0.8 mm and ASD of 1.2±0.3 mm, consistent with clinically acceptable accuracy. On clinical evaluation, 89.2% of contours were rated as excellent, while 9.1% required only minor adjustments. Automated segmentation reduced the average contouring time from 12.7±2.3 minutes manually to 4.3±0.9 minutes. Conclusion: The proposed sex-aware deep learning framework offers accurate, robust segmentation of the rectum in pelvic CT imaging by explicitly modeling sex-specific differences in anatomical characteristics. This physiologically informed approach enhances segmentation performance and supports reliable integration of AI-based delineation into radiotherapy workflows to improve both contouring efficiency and clinical consistency.
Keywords:
1. Introduction
2. Research Background
3. Materials and Methods
3.1. Patient Cohort and Data Acquisition
3.2. Data Preprocessing and Ground Truth Mask Definition
3.3. Model design and Training
3.4. Performance Evaluation Metrics and Statistical Analysis
3.4.1. The Dice Similarity Coefficient (DSC)
3.4.2. Average Symmetric Surface Distance (ASD)
3.4.3. The Hausdorff Distance (HD)
3.4.4. Clinical Validation
- Poor: Unacceptable for clinical use.
- Fair: Acceptable with minor changes.
- Excellent: Clinically acceptable without modification.
3.4.5. Sex Prediction Task
3.5. Ethical Considerations and AI Use Declaration
4. Results
4.1. Model Performance in Biological Sex Prediction
4.2. Automated Rectum Segmentation Performance
4.3. Comparative Analysis with Expert Manual Segmentation
4.4. Retrospective Clinical Validation Results
4.5. Processing Time and Computational Efficiency
5. Discussion
6. Conclusion
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Conflicts of interest
References
- Baskar R, Lee KA, Yeo R, Yeoh K-W. Cancer and radiation therapy: current advances and future directions. International journal of medical sciences. 2012;9(3):193.
- Huang EH, Pollack A, Levy L, Starkschall G, Dong L, Rosen I, et al. Late rectal toxicity: dose-volume effects of conformal radiotherapy for prostate cancer. International Journal of Radiation Oncology* Biology* Physics. 2002;54(5):1314-21.
- Michalski JM, Gay H, Jackson A, Tucker SL, Deasy JO. Radiation dose–volume effects in radiation-induced rectal injury. International Journal of Radiation Oncology* Biology* Physics. 2010;76(3):S123-S9.
- Vinod SK, Jameson MG, Min M, Holloway LC. Uncertainties in volume delineation in radiation oncology: a systematic review and recommendations for future studies. Radiotherapy and Oncology. 2016;121(2):169-79.
- Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, et al. A survey on deep learning in medical image analysis. Medical image analysis. 2017;42:60-88.
- Ronneberger O, Fischer P, Brox T, editors. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention; 2015: Springer.
- Balagopal A, Kazemifar S, Nguyen D, Lin M-H, Hannan R, Owrangi A, et al. Fully automated organ segmentation in male pelvic CT images. Physics in Medicine & Biology. 2018;63(24):245015.
- Lempart M, Nilsson MP, Scherman J, Gustafsson CJ, Nilsson M, Alkner S, et al. Pelvic U-Net: multi-label semantic segmentation of pelvic organs at risk for radiation therapy anal cancer patients using a deeply supervised shuffle attention convolutional neural network. Radiation oncology. 2022;17(1):114.
- Ghaedi E, Asadi A, Hosseini SA, Arabi H. Enhanced Pelvic CT Segmentation via Deep Learning: A Study on Loss Function Effects. Journal of Imaging Informatics in Medicine. 2025:1-14.
- Jeong S, Cheon W, Kim S, Park W, Han Y. Deep-learning-based segmentation using individual patient data on prostate cancer radiation therapy. Plos one. 2024;19(7):e0308181.
- Kalantar R, Lin G, Winfield JM, Messiou C, Lalondrelle S, Blackledge MD, et al. Automatic segmentation of pelvic cancers using deep learning: State-of-the-art approaches and challenges. Diagnostics. 2021;11(11):1964.
- Zou X, Zhou X, Li Y, Huang Q, Ni Y, Zhang R, et al. Gender-specific data-driven adiposity subtypes using deep-learning-based abdominal CT segmentation. Obesity. 2023;31(6):1600-9.
- Čevora K, Glocker B, Bai W, editors. Quantifying the Impact of Population Shift Across Age and Sex for Abdominal Organ Segmentation. MICCAI Workshop on Fairness of AI in Medical Imaging; 2024: Springer.
- Oktay O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, et al. Attention u-net: Learning where to look for the pancreas. arXiv:180403999. 2018.
- Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O, editors. 3D U-Net: learning dense volumetric segmentation from sparse annotation. International conference on medical image computing and computer-assisted intervention; 2016: Springer.
- Cardenas CE, Yang J, Anderson BM, Court LE, Brock KB, editors. Advances in auto-segmentation. Seminars in radiation oncology; 2019: Elsevier.
- Lustberg T, van Soest J, Gooding M, Peressutti D, Aljabar P, van der Stoep J, et al. Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer. Radiotherapy and Oncology. 2018;126(2):312-7.
- Xie P, Zhang L, Jindal B, Alaa A, Weinreb R, Wilson D, et al. Generative AI Enables Medical Image Segmentation in Ultra Low-Data Regimes. 2024.
- Belue MJ, Harmon SA, Patel K, Daryanani A, Yilmaz EC, Pinto PA, et al. Development of a 3D CNN-based AI model for automated segmentation of the prostatic urethra. Academic radiology. 2022;29(9):1404-12.
- Czipczer V, Kolozsvári B, Deák-Karancsi B, Capala ME, Pearson RA, Borzási E, et al. Comprehensive deep learning-based framework for automatic organs-at-risk segmentation in head-and-neck and pelvis for MR-guided radiation therapy planning. Frontiers in Physics. 2023;11:1236792.
- Liu X, Isa NAM, Chen C, Lv F. Colorectal Polyp Segmentation Based on Deep Learning Methods: A Systematic Review. Journal of Imaging. 2025;11(9):293.
- Liu Z, Liu X, Guan H, Zhen H, Sun Y, Chen Q, et al. Development and validation of a deep learning algorithm for auto-delineation of clinical target volume and organs at risk in cervical cancer radiotherapy. Radiotherapy and Oncology. 2020;153:172-9.
- Taha AA, Hanbury A. Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC medical imaging. 2015;15(1):29.
- Heimann T, Van Ginneken B, Styner MA, Arzhaeva Y, Aurich V, Bauer C, et al. Comparison and evaluation of methods for liver segmentation from CT datasets. IEEE transactions on medical imaging. 2009;28(8):1251-65.
- Huttenlocher DP, Klanderman GA, Rucklidge WJ. Comparing images using the Hausdorff distance. IEEE Transactions on pattern analysis and machine intelligence. 2002;15(9):850-63.
- Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE transactions on medical imaging. 2016;35(5):1285-98.
- Kohavi R, editor A study of cross-validation and bootstrap for accuracy estimation and model selection. Ijcai; 1995: Montreal, Canada.
- Landis JR, Koch GG. The measurement of observer agreement for categorical data. biometrics. 1977:159-74.
- Gichoya JW, Banerjee I, Bhimireddy AR, Burns JL, Celi LA, Chen L-C, et al. AI recognition of patient race in medical imaging: a modelling study. The Lancet Digital Health. 2022;4(6):e406-e14.
- DeSilvio T, Antunes JT, Bera K, Chirra P, Le H, Liska D, et al. Region-specific deep learning models for accurate segmentation of rectal structures on post-chemoradiation T2w MRI: a multi-institutional, multi-reader study. Frontiers in Medicine. 2023;10:1149056.
- Thompson RF, Valdes G, Fuller CD, Carpenter CM, Morin O, Aneja S, et al. Artificial intelligence in radiation oncology: a specialty-wide disruptive transformation? Radiotherapy and Oncology. 2018;129(3):421-6.






| References | Model Architecture | Data | Evaluation Metric | Key Results |
|---|---|---|---|---|
| [6] | U-Net (Base Architecture) | Biomedical Images (limited data) | - | Introduced the foundational U-Net architecture, becoming a baseline for many subsequent models. |
| [7] | 3D U-Net | Male Pelvic CT Images | DSC | DSC: 0.94 (mean) for various organs |
| [8] | Pelvic U-Net (Deeply supervised shuffle attention CNN) | Pelvic CT of Anal Cancer Patients and OARs | DSC & Time Savings | DSC: 0.87 - 0.97 Time: ~40 min (manual) → ~12 min (with correction) → ~4 min (fully automatic) |
| [9] | SegResNet (VAE) | Pelvic CT for OARs | DSC | DSC: 0.86 (achieved with optimized loss function) |
| [10] | Deep Learning-based (Patient-specific nnU-Net) | Prostate CT for Radiation Therapy | DSC | 0.83 ± 0.04 |
| [11] | Review (Various State-of-the-Art Models) | Pelvic Cancers (CT/MRI) | - | Review Article: Discusses current state-of-the-art approaches and challenges in the field. |
| [22] | Deep Learning-based Segmentation Model | Cervical CT for Radiation Therapy | DSC | between 0.82 and 0.87 |
| [12] | Deep Learning-based Segmentation Model | Abdominal CT for Adiposity | - | Identified gender-specific adiposity subtypes from the segmentation data. |
| [19] | CNN-based architecture | prostate and rectal segmentation on CT images | DSC | DSC of over 0.69 |
| [21] | tested 44 segmentation models | - | DSC | DSC: between 0.82 and 0.87 transformer-based models scoring higher than 0.88 |
| Characteristic | Prostate Cancer (n=97) | Cervical Cancer (n=89) |
|---|---|---|
| Age (years) | 68.0 ± 6.0 | 52.0 ± 6.5 |
| Male, n (%) | 97 (100) | - |
| Female, n (%) | - | 89 (100) |
| BMI (kg/m2) | 26.8 ± 2.5 | 25.4 ± 2.5 |
| CT Slice Thickness (mm) | 3.0 | 3.0 |
| Rectal Volume (cm3) | 98.4 ± 14.3 | 86.3 ± 13.2 |
| Metric | Value (%) | 95% Confidence Interval |
|---|---|---|
| Overall Accuracy | 94.6 | 90.2-97.1 |
| Sensitivity (Male) | 93.5 | 87.9-96.6 |
| Specificity (Female) | 95.7 | 90.8-98.1 |
| Positive Predictive Value | 95.3 | 90.4-97.8 |
| Negative Predictive Value | 94.0 | 89.3-96.8 |
| F1-Score | 94.4 | 90.6-96.7 |
| Metric | Prostate Cancer (n=97) | Cervical Cancer (n=89) | p-value |
|---|---|---|---|
| Dice Similarity Coefficient (DSC) | 0.91 (0.88-0.93) | 0.89 (0.86-0.92) | 0.12 |
| Hausdorff Distance (HD, mm) | 3.2 (2.5-4.1) | 3.5 (2.8-4.3) | 0.08 |
| Average Surface Distance (ASD, mm) | 1.1 (0.8-1.4) | 1.2 (0.9-1.5) | 0.15 |
| Precision | 0.92 (0.89-0.94) | 0.90 (0.87-0.93) | 0.09 |
| Recall | 0.91 (0.88-0.93) | 0.89 (0.86-0.92) | 0.11 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).