Sanchez-Cesteros, O.; Rincon, M.; Bachiller, M.; Valladares-Rodriguez, S. A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures. Sensors2023, 23, 7582.
Sanchez-Cesteros, O.; Rincon, M.; Bachiller, M.; Valladares-Rodriguez, S. A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures. Sensors 2023, 23, 7582.
Sanchez-Cesteros, O.; Rincon, M.; Bachiller, M.; Valladares-Rodriguez, S. A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures. Sensors2023, 23, 7582.
Sanchez-Cesteros, O.; Rincon, M.; Bachiller, M.; Valladares-Rodriguez, S. A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures. Sensors 2023, 23, 7582.
Abstract
Some recent studies show that filters in convolutional neural networks (CNNs) have low color selectivity in datasets of natural scenes such as Imagenet. CNNs, bio-inspired in the visual cortex, are characterized by their hierarchical learning structure, which appears to gradually transform the representation space. Inspired by the direct connection between the LGN and V4, which allows V4 to handle low-level information closer to the trichromatic input in addition to processed information that comes from V2/V3, we propose the addition of a long skip connection (LSC) between the first and last blocks of the feature extraction stage to allow deeper parts of the network to receive information from shallower layers. This type of connection improves classification accuracy by combining simple-visual and complex-abstract features to create more color-selective ones. We have applied this strategy to classic CNN architectures and quantitatively and qualitatively analyzed the improvement in accuracy while focusing on color selectivity. The results show that, in general, skip connections improve accuracy, but LSC improves it even more and enhances the color selectivity of the original CNN architectures. As a side result, we propose a new color representation procedure for organizing and filtering feature maps, making their visualization more manageable.
Keywords
Color selectivity; skip connections; long skip connection; CNN; VGG16; Densenet121; Resnet50; feature map visualization
Subject
Computer Science and Mathematics, Computer Vision and Graphics
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
