Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

LegoNet: Alternating Model Blocks for Medical Image Segmentation

Version 1 : Received: 15 June 2023 / Approved: 16 June 2023 / Online: 19 June 2023 (13:00:58 CEST)

How to cite: Sobirov, I.; Xie, C.; Siddique, M.; Patel, P.; Chan, K.; Halborg, T.; Kotanidis, C.; Fatima, Z.; West, H.; Channon, K.; Neubauer, S.; Antoniades, C.; Yaqub, M. LegoNet: Alternating Model Blocks for Medical Image Segmentation. Preprints 2023, 2023061360. https://doi.org/10.20944/preprints202306.1360.v1 Sobirov, I.; Xie, C.; Siddique, M.; Patel, P.; Chan, K.; Halborg, T.; Kotanidis, C.; Fatima, Z.; West, H.; Channon, K.; Neubauer, S.; Antoniades, C.; Yaqub, M. LegoNet: Alternating Model Blocks for Medical Image Segmentation. Preprints 2023, 2023061360. https://doi.org/10.20944/preprints202306.1360.v1

Abstract

Since the emergence of convolutional neural networks (CNNs), and later vision transformers (ViTs), the standard paradigm for model development has been using a set of identical block types with varying parameters/hyper-parameters. To leverage the benefits of different architectural designs (e.g., CNNs and ViTs), we propose alternating structurally different types of blocks to generate a new architecture, mimicking how Lego blocks can be assembled. Using two CNN-based and one SwinViT-based blocks, we investigate three variations to the so-called LegoNet that apply the new block alternation concept for the segmentation task in medical imaging. We also study a new clinical problem that has not been investigated before – the right internal mammary artery (RIMA) and perivascular space segmentation from computed tomography angiography (CTA). It was proven to demonstrate a prognostic value to primary cardiovascular outcomes. We compare the model performance against popular CNN and ViT architectures using two large datasets (achieving 0.749 dice similarity coefficient (DSC) on the larger dataset). We also evaluate the model’s performance on three external testing cohorts, where an expert clinician corrected model-segmented results (DSC>0.90 for the three cohorts). To assess our proposed model for suitability in clinical use, we perform intra- and inter-observer variability analysis. Finally, we investigate a joint self-supervised learning approach to determine its impact on model performance.

Keywords

Internal Mammary Artery Segmentation; Alternating Blocks; Medical Imaging Segmentation; Self-supervised Pretraining; LegoNet

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.