Abstract:The objects of fine-grained image categories(e.g., bird species) are various subclass under different categories. Because the differences between subclass are very subtle and most of them are concentrated in multiple local areas, the task of fine-grained image recognition is very challenging. At the same time, some fine-grained networks tend to focus on a certain region when judging the target category, resulting in the lack of other auxiliary regional features. To this end, Inception V3 is used as the backbone network, and an enhanced and complementary fine-grained image classification network is designed. While adopting the method of reinforcement learning to obtain more detailed fine grain image features, the complementary network can obtain the complementary discriminant area of the target through the method of attention erasure to increase the network's perception of the overall target. Finally, experiments are conducted on CUB-200-2011, FGVC Aircraft and Stanford dogs three open datasets. The experimental results show that the proposed model has better performance.

Body image disturbance (BID) involves negative attitudes towards shape and weight and is associated with lower levels of interoception (awareness of and attention toward internal physiological states). This association is considered a risk factor for developing eating disorders (EDs) and is linked to altered sensorimotor representations of the body (i.e., body schema). BIDs manifest across genders and are currently understudied in men. This study investigated gender-related differences in BID and its relationship to the body schema and interoception. Data were collected from 86 men and women. BID was assessed using questionnaires measuring self-objectification, state, and trait body dissatisfaction. Interoceptive sensibility was measured via the MAIA-2. The body schema was indexed via an embodied mental rotation task. Results showed that women reported higher BID than men across all scales. Gender differences in sub-components of interoceptive sensibility were found. Overall, both gender and interoceptive sensibility predicted BID. However, interoceptive sensibility exhibited its own unique association with BID beyond the influence of gender. BID, IS and gender were not significant predictors of performance in the body schema task. Therefore, while gender predicts differences in BID and interoceptive sensibility, there was no evidence of gender-related differences in body schema.

Precision agriculture is a farm management technology that involves sensing and then responding to the observed variability in the field. Remote sensing is one of the tools of precision agriculture. The emergence of small unmanned aerial vehicles (sUAV) have paved the way to accessible remote sensing tools for farmers. This paper describes the comparison of two popular off-the-shelf sUAVs: 3DR Iris and DJI Phantom 2. Both units are equipped with a camera gimbal attached with a GoPro camera. The comparison of the two sUAV involves a hovering test and a rectilinear motion test. In the hovering test, the sUAV was allowed to hover over a known object and images were taken every second for two minutes. The position of the object in the images was measured and this was used to assess the stability of the sUAV while hovering. In the rectilinear test, the sUAV was allowed to follow a straight path and images of a lined track were acquired. The lines on the images were then measured on how accurate the sUAV followed the path. Results showed that both sUAV performed well in both the hovering test and the rectilinear motion test. This demonstrates that both sUAVs can be used for agricultural monitoring.

In the past few decades, the transmission of data over an unsecure channel resulted in an increased rate of hacking. Therefore, the requirement to make multimedia data more secure is increasing day by day. Numerous algorithms are developed to improve efficiency and robustness. In this article, a novel and secure image encryption algorithm is presented. It is based on a modified chaotic logistic map (CLM) that provides the advantage of having less computational time to encrypt an input image. The encryption algorithm is based on Shannon’s idea of using substitution-permutation and one-time-pad network to achieve ideal secrecy. The CLM is used for substitution and permutation to improve randomness and increase dependency on the encryption key. Various statistical tests are conducted, such as Key Space Analysis, Complexity Analysis, Sensitivity Analysis, Strict Avalanche Criteria (SAC), Histogram Analysis, Entropy Analysis, Mean of Absolute Deviation (MAD) Analysis, Correlation Analysis, Contrast Analysis, and Homogeneity to give a comparative analysis of the proposed algorithm and verify its security. As a result of various statistical tests, it is evident that the proposed algorithm is more efficient and robust as compared to previous ones.

The study of velocimetry is important for characterizing and comprehending the effects of fluid flow, and the Particle Image Velocimetry (PIV) technique is one of the primary approaches for understanding the velocity vector field in a test section. Commercial PIV systems are expensive, with one of the main cost factors being high-speed camera equipment capable of capturing images at high frames per second (fps), rendering them impractical for many applications. This study proposes an evaluation of utilizing smartphones as image acquisition systems for PIV technique application. An experimental setup inspired by the known angular displacement of synthetic particles is proposed. A stepper motor rotates a plate containing an image of synthetic particles on its surface. The motion of the plate is captured by the smartphone camera, and the images are processed using PIVlab-MatLab® software. The use of two smartphones is assessed, with acquisition rates of either 240 fps or 960 fps and varying angular velocities. The results were satisfactory for velocities up to 0.7 m/s at an acquisition rate of 240 fps and up to 1.8 m/s at 960 fps, validating the use of smartphones as a cost-effective alternative for the PIV technique.

In this study, we explore the potential of using a straightforward neural network inspired by the retina model to efficiently restore low-light images. The retina model imitates the neurophysiological principles and dynamics of various optical neurons. Our proposed neural network model reduces the computational overhead compared to traditional signal-processing models while achieving results similar to complex deep learning models from a subjective perceptual perspective. By directly simulating retinal neuron functionalities with neural networks, we not only avoid manual parameter optimization but also lay the groundwork for constructing artificial versions of specific neurobiological organizations.

This study was designed to assess the reliability of geographic information using satellite image information in ungauged basins. For this, this study constructed geographic information using actual gauged data and satellite information data and conducted runoff analysis through S-RAT, a rainfall–runoff model, and performed the comparison and analysis of geographic information and runoff data. For actual gauged data, the gauged geographic information of the Water Resources Management Information System (WAMIS) was collected, and for satellite information, the image information of moderate-resolution imaging spectroradiometer (MODIS) observation sensor loaded on Terra Satellite was collected. As analysis areas, three basins where mountains occupy more than 80% and another three basins where urban areas occupy more than 7% in the Han River basin were selected. According to the analysis result, the gauged information and satellite image information showed great difference in runoff, maximum 50% in peak flood and maximum 17% in total flood, in the rivers with many urban areas, while the runoff difference in the rivers with many mountains showed maximum 13% in peak flood and 4% in total flood. What showed the greatest difference in image information was land use, and it turned out that the MODIS satellite recognized the urban rivers as cities for more than maximum 60% compared to WAMIS-gauged data. Meanwhile, in the forest area, the MODIS satellite image showed error of less than 5% of the WAMIS-gauged data, which indicates that it has higher applicability in Mountain Rivers.

This paper presents novel feature descriptors and classification algorithms for automated scoring of HER2 in Whole Slide Images (WSI) of breast cancer histology slides. Since a large amount of processing is involved in analyzing WSI images, the primary design goal has been to keep the computational complexity to the minimum possible level and to use simple, yet robust feature descriptors that can provide accurate classification of the slides. We propose two types of feature descriptors that encode important information about staining patterns and the percentage of staining present in ImmunoHistoChemistry (IHC) stained slides. The first descriptor is called a characteristic curve which is a smooth non-increasing curve that represents the variation of percentage of staining with saturation levels. The second new descriptor introduced in this paper is an LBP feature curve which is also a non-increasing smooth curve that represents the local texture of the staining patterns. Both descriptors show excellent interclass variance and intraclass correlation, and are suitable for the design of automatic HER2 classification algorithms. This paper gives the detailed theoretical aspects of the feature descriptors and also provides experimental results and comparative analysis.

In recent years, data providers are generating and streaming a large number of images. More particularly, processing images that contain faces have received great attention due to its numerous applications, such as entertainment and social media apps. The enormous amount of images shared on these applications presents serious challenges and requires massive computing resources to ensure efficient data processing. However, images are subject to a wide range of distortions in real application scenarios during the processing, transmission, sharing, or combination of many factors. So, there is a need to guarantee acceptable delivery content, even though some distorted images do not have access to their original version. In this paper, we present a framework developed to estimate the images' quality while processing a large number of images in real-time. Our quality evaluation is measured using an integration of a deep network with random forests. In addition, a face alignment metric is used to assess the facial features. Experimental results have been conducted on two artificially distorted benchmark datasets, LIVE and TID2013. We show that our proposed approach outperforms the state-of-art methods, having a Pearson Correlation Coefficient (PCC) and Spearman Rank Order Correlation Correlation Coefficient (SROCC) with subjective human scores of almost 0.942 and 0.931 while minimizing the processing time from 4.8ms to 1.8ms.

This paper explores the application of wavelet analysis, a multiscale approach for enhancing visual clarity, in the context of image denoising, which reduces the impact of noisy pixels, caused by various factors such as electronic sensor limitations, low-light conditions, or transmission errors in digital imaging systems. This paper introduces some common noise types like Gaussian noise and processes of image denoising, eliciting the strength of wavelet analysis. As a powerful image denoising technology, wavelet analysis needs five steps to process the image, and the key step is thresholding. There are many kinds of wavelet, and each wavelet has different advantages and functions, which makes it suitable for different applications. Hence, wavelet analysis also makes a contribution in various fields beyond signal processing and data analysis, such as Biomedical Imaging and Geophysics and Seismology, where preserving image quality is essential for accurate analysis and interpretation. In short, this research highlights the promise of wavelet analysis, emphasizing the use of high- quality image data.

River monitoring has the potential to grow substantially with present-day available affordable and locally sourced hardware. Yet river monitoring networks are still under pressure due to lack of resources, difficulties with maintenance, and rapidly changing conditions which in part may be due to climate change. We advocate that to turn around this trend, monitoring stations must rely on local people, work with locally available devices, work without contact with water and operate through openly available knowledge. River observations with camera videos have this potential. IP cameras, drones or smartphones are widely available as observation platforms. The scientific methods are well established in literature. Yet current attempts to establish scalable open-source software solutions that can be operated anywhere are lacking. In fact, currently available software is either research-oriented, more aimed at incidental observations, is restricted to single-use licenses, entirely proprietary, or restricted to operations through a third-party Software as a Service. To overcome this obstacle, we present OpenRiverCam, a free and open-source software ecosystem for river observations that can fulfill a wide variety of use cases and business cases through a well-documented and simple to use Application Programming Interface, service workflows, cloud scalability and interoperability, and options to extend to several applications within the hydrological, hydrodynamic, environmental and geospatial domains. We demonstrate its current technical abilities through three different case studies that all originate from a user perspective. We discuss the future developments to meet further requirements, which include documentation, widely available training materials and embedding in curricula, and further hardware and software developments.

Although neural network architectures are critical for their performance, how the structural characteristics of a neural network affect its performance has still not been fully explored. We here map architectures of neural network to directed acyclic graphs, and find that incoherence, a structural characteristic to measure the order of directed acyclic graphs, is a good indicator for the performance of corresponding neural networks. Therefore we propose a deep isotropic neural network architecture by folding a chain of same blocks then connecting the blocks with skip connections at different distances. Our models, named FoldNet, have two distinguishing features compared with traditional residual neural netowrks. First, the distances between block pairs connected by skip connections increase from always equal to one to specially selected different values, which lead to more incoherent graphs and let the neural network explore larger receptive fields and thus enhance its multi-scale representation ability. Second, the number of direct paths increases from one to multiple, which leads to a larger proportion of shorter paths and thus improve the direct propagation of information throughout the entire network. Image classification results on CIFAR-10 and Tiny ImageNet benchmarks suggested that our new network architecture performs better than traditional residual neural networks.

Recent neuroscience research results show that the nerve information in the brain is not only encoded by the spatial information. Spiking neural network based on pulse frequency coding plays a very important role in dealing with the problem of brain signal, especially complicated space-time information. In this paper, an unsupervised learning algorithm for bilayer feedforward spiking neural networks based on spike-timing dependent plasticity (STDP) competitiveness is proposed and applied to SAR image classification on MSTAR for the first time. The SNN learns autonomously from the input value without any labeled signal and the overall classification accuracy of SAR targets reached 80.8%. The experimental results show that the algorithm adopts the synaptic neurons and network structure with stronger biological rationality, and has the ability to classify targets on SAR image. Meanwhile, the feature map extraction ability of neurons is visualized by the generative property of SNN, which is a beneficial attempt to apply the brain-like neural network into SAR image interpretation.

Haze always shrouds satellite images, obscuring valuable geographic information for military surveillance, natural calamity surveillance and mineral resource exploration. Satellite image dehazing (SID) provides the possibility for better applications of satellite images. Most of the existing dehazing methods are tailored for natural images and are not very effective for satellite images with non-homogeneous haze since the semantic structure information and inconsistent attenuation are not fully considered. To tackle this problem, this study proposes a hierarchical semantic-guided contextual structure-aware network (SCSNet) for satellite image dehazing. Specifically, a hybrid CNN-transformer architecture integrated with a hierarchical semantic guidance (HSG) module is presented to learn semantic structure information by synergetically complementing local representation from non-local features. Furthermore, a cross-layer fusion (CLF) module is specially designed to replace the traditional skip connection during the feature decoding stage, so as to reinforce the attention to the spatial regions and feature channels with more serious attenuation. The results on the SateHaze1k, RS-Haze, and RSID datasets demonstrate that the proposed SCSNet can achieve effective dehazing and outperforms existing state-of-the-art methods.

Spinal deformity refers to a range of disorders that are defined by anomalous curvature of the spine and may be classified as scoliosis, lordosis, or kyphosis. Among these, scoliosis stands out as the most common type of spinal deformity in human beings, and it can be distinguished by abnormal lateral spine curvature accompanied by axial rotation. Accurate identification of spinal deformity is crucial for a person's diagnosis, and numerous assessment methods have been developed by researchers. Therefore, the present study aims to systematically review recent works on spinal deformity as-assessment for scoliosis diagnosis, utilizing image processing techniques. To gather relevant studies, a search strategy was conducted on three electronic databases (Scopus, ScienceDirect, and PubMed) between 2012 and 2022, using specific keywords and focusing on scoliosis cases. A total of 17 papers fully satisfied the established criteria and were extensively evaluated. Despite variations in methodological designs across the studies, all reviewed articles obtained quality ratings higher than satisfactory. Various diagnostic approaches have been employed, including artificial intelligence mechanisms, image processing, and scoliosis diagnosis systems. These approaches have the potential to save time and, more significantly, can reduce the incidence of human error. While all assessment methods have potential in scoliosis diagnosis, they possess several limitations that can be ameliorated in forthcoming studies. Therefore, the findings of this study may serve as guidelines for the development of a more accurate spinal deformity assessment method that can aid medical personnel in the real diagnosis of scoliosis.

Crop disease classification has always been a critical and persistent problem in the field of agricultural and forestry sciences, where often we do not have access to a sufficient number of samples to know the distribution of real-world samples. How to make full use of the existing data is the starting point of our thinking. To address this problem, this paper proposes a supervised image augmentation method Negative Contrast, which uses the contrast images of existing disease samples after removing disease areas as negative samples for image augmentation when samples are relatively scarce. Numerous experiments have shown that several classical models using this augmentation method have improved in disease classification of four crops, rice, wheat, corn, and soybean, with a maximum accuracy improvement of 30.8%. In addition, the comparative analysis of attentional heat map shows that the model using Negative Contrast is more accurate and intense on the area of interest of diseases, and thus reflects better generalization ability in real-world disease classification. Our dataset and codes can be found in https://www.kaggle.com/datasets/w970704112/corn-wheat-rice-soybean and https://github.com/hiter0/contrastaug .

Hydraulic conductivity is the key and one of the most uncertain parameters in groundwater modeling. The grid based numerical simulation require spatial distribution of sampled hydraulic conductivity at un-sampled locations in the study area. This spatial interpolation has been routinely performed using variogram based models (two-point geostatistics methods). These traditional techniques fail to capture the complex geological structures, provides smoothing effects and ignore the higher order moments of subsurface heterogeneities. In this work, a multiple-point geostatistics (MPS) method is applied to interpolate hydraulic conductivity data which will be further used in WASH123D numerical groundwater simulation model for regional smart groundwater management. To do this, MPS need ‘training images (TIs) as a key input. TI is a conceptual model of subsurface geological heterogeneity which was developed by using concept of ages, topographic slope as an index criteria and knowledge of geologist. After considerations of full physics of study area, an example shows the advantages of using multiple-point geostatistics compared with the traditional two-point geostatistics methods (such as Kriging) for the interpolation of hydraulic conductivity data in a complex geological formation.

This study has investigated the effect of nutrition labeling on consumer guilt, in situations where consumers ingest products that have an unhealthy image. The first investigation has examined the effects of types of nutrition labeling (adding healthy ingredients/reducing unhealthy ingredients). The second investigation has examined the influence of two goal-activation types(utilitarian and hedonic) and nutrition labeling on consumer guilt. The findings reveal that the utilitarian-goal-activation group felt less guilty about consuming a product with a reduced unhealthy ingredient than they did about consuming a product with an added healthy ingredient. In addition, there were interactions between the two variables, since consumer goal activation had more effect on consumer guilt about products with reduced unhealthy ingredients than on products with added healthy ingredients. Based on these results, the academic and practical implications of the present study are discussed. and proposes several directions for future research.

This research paper presents a deep learning approach to early detection of skin cancer using image augmentation techniques. The authors propose a two-stage image augmentation technique that involves the use of geometric augmentation and generative adversarial network (GAN) to classify skin lesions as either benign or malignant. This research utilized the public HAM10000 dataset to test the proposed model. Several pre-trained models of CNN were employed, namely Xception, Inceptionv3, Resnet152v2, EfficientnetB7, InceptionresnetV2, and VGG19. Our approach achieved accuracy, precision, recall, and F1-score of 96.90%, 97.07%, 96.87%, 96.97%, respectively, which is higher than the performance achieved by other state-of-the-art methods. The paper also discusses the use of SHapley Additive exPlanations (SHAP), an interpretable technique for skin cancer diagnosis, which can help clinicians understand the reasoning behind the diagnosis and improve trust in the system. Overall, the proposed method presents a promising approach to automated skin cancer detection that could improve patient outcomes and reduce healthcare costs.

Employing low tensor rank decompositions in image inpainting has attracted increasing attention. This paper exploits a novel tensor-augmentation schemes to transform an image (a low-order tensor) to a higher-order tensor without changing the total number of pixels. The developed augmentation schemes enhance the low-rankness of an image under three tensor decompositions: matrix SVD, tensor train (TT) decomposition, and tensor singular value decomposition (t-SVD). By exploiting the schemes, we solve the image inpainting problem with three low-rank con-strained models which use the matrix rank, TT rank, and tubal rank as constrained priors re-spectively. The tensor tubal rank and tensor train multi-rank are developed from t-SVD and TT decomposition respectively. We exploit efficient ADMM algorithms for solving the three models. Experimental results demonstrate that our methods are effective for image inpainting and supe-rior to numerous close methods.

An evaluation of image contrast in a controlled foggy environment has been made by comparison between intensity imaging and different modes of polarimetric imaging. A small-scale fog chamber has been designed and constructed to create the necessary controlled foggy environment. A linear polarimetric camera of division of focal plane and a linearly polarized light source has been used for performing the experiments with polarized light. In order to evaluate the image contrast of the different imaging modes, the Michelson’s contrast of samples of different materials relative to their background has been calculated. The higher the image contrast, the easier is to detect and segment the targets of interest that are surrounded by fog. It has been proved quantitatively that in the studied situations polarimetric images present an improvement in contrast when compared to conventional intensity images.

A fast calculation method for the full parallax high-resolution hologram is proposed based on the elemental light field image (EI) rendering. A 3D object located near the holographic plane is firstly rendered as multiple EIs with a pinhole array. Each EI is interpolated and multiplied by a divergent sphere wave and interfered with a reference wave to form a hogel. Parallel acceleration is used to calculate the high-resolution hologram because calculation of each hogel is independent. A high-resolution hologram with the resolution of 20,0000×20,0000 pixels is calculated only within 8 minutes. Full parallax high-resolution 3D displays are realized by optical reconstructions.

This paper shows the results of applying high-resolution Unmanned Aircraft System (UAS) photogrammetric surveying on a large landslide. A real case study, where permanently installing GCPs could be complex, where natural shaped and formed land pose severe limitations in deploying ground targets with optimal geometric configuration. We analysed performances in terms of survey accuracy obtained by performing photogrammetric surveys through the Zenmuse P1 DJI optical camera and Phantom 4 Pro 2. In combination with DJI Matrice 300 UAS, the P1 camera allows direct georeferencing through GNSS observations in RTK mode. Photogrammetric surveys, performed through different georeferencing methods, have been compared. Several targets have been permanently installed on the ground over the maximum vegetation height to guarantee long-lasting reference over the years in the area, which is characterised by a diffuse short vegetation coverage. Multitemporal UAS surveys have been then compared using Digital Image Correlation (DIC) algorithms, and deformation maps have been produced. Afterwards, DIC results were compared with observations made by the GNSS ground-based permanent receivers resulting in a standard deviation of 0,077 m. Through results analysis, good accordance between ground-based GNSS observations and DIC analysis on the photogrammetric surveys have been identified for the same time span. To conclude, this type of landslide presents a moderate deformation speed; in such a case, effective deformations monitoring could be achieved using pseudo-direct georeferencing, which permitted a 0.24 m accuracy on the whole tested area.

Mineral identification is an important part of geological analysis. Traditional identification methods rely on either the experiences of the appraisers or the various measuring instruments and the methods are either easily influenced by the experiences or need too much work. To solve the above problems, there have been studies using image recognition and intelligent algorithms to identify minerals. But the current studies can not identify many minerals, and the accuracy is low. To increase the number of identified mineral categories and the accuracy, we proposed the method that uses both the mineral images and the Mohs hardness in the deep neural networks to identify the minerals. The experimental results showed that the method can reach 94.0% Top-1 accuracy and 99.9% Top-5 accuracy for 28 common minerals. The model that combines image and Mohs hardness together can identify more minerals and increase the accuracy using less training data.

Due to an increase in the number of image achieves, Content-Based Image Retrieval (CBIR) has gained attention for research community of computer vision. The image visual contents are represented in a feature space in the form of numerical values that is considered as a feature vector of image. Images belonging to different classes may contain the common visuals and shapes that can result in the closeness of computed feature space of two different images belonging to separate classes. Due to this reason, feature extraction and image representation is selected with appropriate features as it directly affects the performance of image retrieval system. The commonly used visual features are image spatial layout, color, texture and shape. Image feature space is combined to achieve the discriminating ability that is not possible to achieve when the features are used separately. Due to this reason, in this paper, we aim to explore the low-level feature combination that are based on color and shape features. We selected color moments and color histogram to represent color while shape is represented by using invariant moments. We selected this combination, as these features are reported intuitive, compact and robust for image representation. We evaluated the performance of our proposed research by using the Corel, Coil and Ground Truth (GT) image datasets. We evaluated the proposed low-level feature fusion by calculating the precision, recall and time required for feature extraction. The precision, recall and feature extraction values obtained from the proposed low-level feature fusion outperforms the existing research of CBIR.

Contrary to optical images, Synthetic Aperture Radar (SAR) images are in different electromagnetic spectrum where the human visual system is not accustomed to. Thus, with more and more SAR applications, the demand for enhanced high-quality SAR images has increased considerably. However, high-quality SAR images entail high costs due to the limitations of current SAR devices and their image processing resources. To improve the quality of SAR images and to reduce the costs of their generation, we propose a Dialectical Generative Adversarial Network (Dialectical GAN) to generate high-quality SAR images. This method is based on the analysis of hierarchical SAR information and the “dialectical” structure of GAN frameworks. As a demonstration, a typical example will be shown where a low-resolution SAR image (e.g., a Sentinel-1 image) with large ground coverage is translated into a high-resolution SAR image (e.g., a TerraSAR-X image). Three traditional algorithms are compared, and a new algorithm is proposed based on a network framework by combining conditional WGAN-GP (Wasserstein Generative Adversarial Network - Gradient Penalty) loss functions and Spatial Gram matrices under the rule of dialectics. Experimental results show that the SAR image translation works very well when we compare the results of our proposed method with the selected traditional methods.

Dislocation is one of the major challenges in unmanned aerial vehicle (UAV) image stitching. In this paper, we propose a new dynamic programming for seamlessly stitching UAV images using optical flow. Our solution consists of two steps: Firstly, an image-matching algorithm is used to correct the images so that they are in the same coordinate system. Secondly, a new dynamic programming algorithm is develop based on the concept of a stereo dual-channel energy accumulation using optical flow. A new energy aggregation and traversal strategy is adopted in our solution, which can find a more optimal seam line for adjacent image stitching. Our algorithm overcomes the theoretical limitation of the classical Duplaquet algorithm. Experiments show that the algorithm can effectively solve the dislocation problem in UAV image stitching. Beyond that, our solution is also direction-independent, which has more adaptability and robustness for UAV images.

Colombia is noteworthy as a biodiversity hotspot, featuring an extraordinary number of en-demic orchids, birds, and butterflies. This exploratory study examines the perceptions of desti-nation image considering the cognitive and affective image in predicting behavioral intentions of ecotourists through symmetric data analysis. Using Partial Least Squares (PLS), the author(s) analyzed 64 survey responses collected of rural areas, including a new 15 statement scale spe-cialized on birdwatching. The findings support the reliability of the model, symmetric analysis presents the higher influence of emotions and affections in increasing intentions of recommen-dation, considering birdwatching as based on personal relationships. Additionally, the cognitive image for the birders despite representing destination attributes or sets of destination resources of a mental picture does not have the same impact on behavioral intentions. Therefore, manag-ers should develop positioning strategies based on the generation of emotions, because bird-watching tourists seek to have more emotional experiences.

Document classification is one of the most critical steps in the document analysis pipeline. There are two types of approaches for document classification, known as image-based and multimodal approaches. The image-based document classification approaches are solely based on the inherent visual cues of the document images. In contrast, the multimodal approach co-learns the visual and textual features, and it has proved to be more effective. Nonetheless, these approaches require a huge amount of data. This paper presents a novel approach for document classification that works with a small amount of data and outperforms other approaches. The proposed approach incorporates a hierarchical attention network(HAN) for the textual stream and the EfficientNet-B0 for the image stream. The hierarchical attention network in the textual stream uses the dynamic word embedding through fine-tuned BERT. HAN incorporates both the word level and sentence level features. While the earlier approaches rely on training on a large corpus (RVL-CDIP), we show that our approach works with a small amount of data (Tobacco-3482). To this end, we trained the neural network at Tobacco-3428 from scratch. Thereby, we outperform state-of-the-art by obtaining an accuracy of 90.3%. This results in a relative error reduction rate of 7.9%.

Diseases of cereals caused by pathogenic fungi can significantly reduce crop yields. Many cultures are exposed to them. The disease is difficult to control on a large scale, thus one of the relevant approaches is the crop field monitoring, which helps to identify the disease at an early stage and take measures to prevent its spread. One of the effective control methods is disease identification based on the analysis of digital images with the possibility of obtaining them in field conditions using mobile devices. In this work, we propose a method for the recognition of five fungal diseases of wheat shoots (leaf rust, stem rust, yellow rust, powdery mildew, and septoria), both separately and in combination, with the possibility of identifying the stage of plant development. A set of 2414 images of wheat fungi diseases (WFD2020) was generated, for which expert labeling was performed by the type of disease. WFD2020 data are available freely at http://wfd.sysbio.ru/. In the process of creating this set, a method was applied to reduce the degeneracy of the training data based on the image hashing algorithm. The disease recognition algorithm is based on the convolutional neural network with the EfficientNet architecture. The best accuracy (0.942) was shown by a network with a training strategy based on augmentation and transfer of image styles. The recognition method was implemented by the authors as a bot on the Telegram platform, which allows assessing plants by lesions in the field conditions.

With the rapid development of satellite remote sensing technology, the volume of image datasets in many application areas is growing exponentially and the demand for Land-Cover and Land-Use change remote sensing data is growing rapidly. It is thus becoming hard to efficiently and intelligently retrieve the change information that users need from massive image databases. In this paper, content-based image retrieval is successfully applied to change detection and a content-based remote sensing image change information retrieval model is introduced. First, the construction of a new model framework for change information retrieval in a remote sensing database is described. Then, as the target content cannot be expressed by one kind of feature alone, a multiple-feature integrated retrieval model is proposed. Thirdly, an experimental prototype system that was set up to demonstrate the validity and practicability of the model is described. The proposed model is a new method of acquiring change detection information from remote sensing imagery and so can reduce the need for image pre-processing, deal with problems related toseasonal changes as well as other problems encountered in the field of change detection. Meanwhile, the new model has important implications for improving remote sensing image management and autonomous information retrieval.

For Synthetic Aperture Radar (SAR) image registration, successive processes following feature extraction are required by both the traditional feature-based method and the deep learning method. Among these processes, the feature matching process—whose time and space complexity are related to the number of feature points extracted from sensed and reference images, as well as the dimension of feature descriptors—proves to be particularly time-consuming. Additionally, the successive processes introduce data sharing and memory occupancy issues, requiring an elaborate design to prevent memory leaks. To address these challenges, this paper introduces the OptionEM-based reinforcement learning framework to achieve end-to-end SAR image registration. This framework outputs registered images directly without requiring feature matching and calculation of the transformation matrix, leading to significant processing time savings. The Transformer architecture is employed to learn image features, while a correlation network is introduced to learn the correlation and transformation matrix between image pairs. Reinforcement learning, as a decision process, can dynamically correct errors, making it more efficient and robust compared to supervised learning mechanisms like deep learning. We present a hierarchical reinforcement learning framework combined with episodic memory to mitigate the inherent problem of invalid exploration in generalized reinforcement learning algorithms. This approach effectively combines coarse and fine registration, further enhancing training efficiency. Experiments conducted on three sets of SAR images, acquired by TerraSAR-X and Sentinel-1A, demonstrate that the proposed method’s average runtime is sub-second, achieving subpixel registration accuracy.

The agricultural sector is undergoing a revolution that requires sustainable solutions to the challenges that arise from traditional farming methods. To address these challenges, technical and sustainable support is needed to develop projects that improve crop performance. This study focuses on the onion crop and the challenges presented throughout its phenological cycle. Aerial monitoring using unmanned aerial vehicles (UAV) and digital image processing were used to identify patterns in the onion crop, including humid areas, weed growth, vegetation deficits, and decreased harvest performance. An algorithm was developed to identify the patterns that most affected crop growth, as the average local production reported was 40.166 ton/ha, but only 25.00 ton/ha was reached due to blight caused by constant humidity and limited sunlight. This resulted in the death of leaves and poor development of bulbs, with 50% of the production being of medium size. It is estimated that approximately 20% of the production was lost due to blight and unfavorable weather conditions.

The use of convolutional neural networks (CNNs) in image classification has become the standard method of approaching computer vision problems. Here we apply pre-trained networks to classify images of non-breaking, plunging and spilling breaking waves. The CNNs are used as basic feature extractors and a classifier is then trained on top of these networks. The dynamic nature of breaking waves is exploited by using image sequences to gain extra information and improve the classification results. We also see improved classification performance in using pre-computed image features such as the optical flow between image pairs. The inclusion of the dynamic information improves the classification between breaking wave classes. We also provide corrections to the methodology from the article from which the data originates to achieve a more accurate assessment of performance.

In the present, the growth of digitization and worldwide communications make OCR systems of exotic languages a very important task. In this paper, we attempt to develop an OCR system for one of these exotic languages with a unique script, Amharic. Motivated by the recent success of the Attention mechanism in Neural Machine Translation (NMT), we extend the attention mechanism for Amharic text-image recognition. The proposed model consists of CNNs and attention embedded recurrent encoder-decoder networks that are integrated following the configuration of the seq2seq framework. The attention network parameters are trained in an end-to-end fashion and the context vector is injected, with the previously predicted output, at each time steps of decoding. Unlike the existing OCR model that minimizes the CTC objective function, the new model minimizes the categorical cross-entropy loss. The performance of the proposed attention-based model is evaluated against the test dataset from the ADOCR database which consists of both printed and synthetically generated Amharic text-line images and achieved promising results with a CER of 1.54% and 1.17% respectively.

In Indonesia, types of meat are still identified manually due to increasing prices for beef and buf-falo ahead of Idul Fitri. Traders mix beef with pork to thwart the beef scam. Haar wavelet and GLCM, GLCM with angles of 0°, 45°, 90°, and 135°, as well as matrices using contrast, correlation, energy, homogeneity, and entropy, are used in feature extraction. The following are the results of meat image classification testing using k-NN, Haar wavelet, and GLCM: The k-NN algorithm shows superiority in identifying fresh (99%), frozen (99%), and rotten (96%) meat texture images with the most fantastic accuracy results in every situation. Meanwhile, GLCM routinely provides good results, especially regarding the texture image of fresh meat (183.21) and rotten meat (115.79). However, despite delivering less throughput than k-NN and GLCM, Haar wavelets are still helpful, especially when dealing with fresh meat texture images (89,96).

Corrugated board, widely used in the packing industry, is a recyclable and durable material. Its strength and cushioning, influenced by geometry, environmental conditions like humidity and temperature, and paper quality, make it versatile. Double-walled (or five-ply) corrugated board, comprising two flutes and three liners, enhances these properties. This study introduces a novel approach to analyze 5-layered corrugated board, extending a previously published algorithm for single-walled boards. Our method focuses on measuring layer and overall board thickness, flute height, and center lines of each layer. Integrating image processing and genetic algorithms, the research successfully developed an algorithm for precise geometric feature identification of double-walled boards. Images were recorded using a special device with a sophisticated camera and image sensor for detailed corrugated board cross-sections. Demonstrating high accuracy, the method faced limitations only with very deformed or damaged samples. This research contributes significantly to quality control in the packaging industry and paves the way for further automated material analysis using advanced machine learning and image sensors. It emphasizes the importance of sample quality and suggests areas for algorithm refinement to enhance robustness and accuracy.

This proposed research explores a novel approach to image classification by deploying a complex-valued neural network (CVNN) on a field-programmable gate array (FPGA), specifically for classifying 2D images transformed into polar form. The aim of this research is to address the limitations of existing neural network models in terms of energy and resource efficiency, by exploring the potential of FPGA-based hardware acceleration in conjunction with advanced neural network architectures like CVNNs. The methodological innovation of this research lies in the Cartesian to polar transformation of 2D images, effectively reducing the input data volume required for neural network processing. Subsequent efforts focused on constructing a CVNN model optimized for FPGA implementation, emphasizing the enhancement of computational efficiency and overall performance. The experimental findings provide empirical evidence supporting the efficacy of the image classification system developed in this study. One of the developed models, CVNN_128, achieves an accuracy of 88.3% with an inference time of just 1.6ms and a power consumption of 4.66mW for the classification of the MNIST test dataset consists of 10,000 frames. While there is a slight concession in accuracy compared to recent FPGA implementations that achieve 94.43%, our model significantly excels in classification speed and power efficiency—surpassing existing models by more than a factor of 100. In conclusion, the paper demonstrates the substantial advantages of FPGA-implementation of CVNNs for image classification tasks, particularly in scenarios where speed, resource, and power consumption are critical. The study’s reproducible results and corresponding code are available on GitHub at the following link: https://github.com/mahmad2005/CVNNonFPGA

Infrared and visible image fusion technologies are used to characterize the same scene by diverse modalities. However, most existing deep learning-based fusion methods are designed as symmetric networks, which ignore the differences between modal images and lead to the source image information loss during feature extraction. In this paper, we propose a new fusion framework for the different characteristics of infrared and visible images. Specifically, we design a dual-stream asymmetric network with two different feature extraction networks to extract infrared and visible feature maps respectively. The transformer architecture is introduced in the infrared feature extraction branch, which can force the network to focus on the local features of infrared images while still obtaining their contextual information. And the visible feature extraction branch uses residual dense blocks to fully extract the rich background and texture detail information of visible images. In this way, it can provide better infrared targets and visible details for the fused image. Experimental results on multiple datasets indicate that DSA-Net outperforms state-of-the-art methods in both qualitative and quantitative evaluations. In addition, we also apply the fusion results to the target detection task, which indirectly demonstrates the fusion performances of our method.

A 'little brother' of pain, itch is an unpleasant sensation that creates a specific urge to scratch. To date, various machine-learning based image classifiers (MBICs) have been proposed for quantitative analysis of itch-induced scratch behaviour of laboratory animals in an automated, non-invasive, inexpensive and real-time manner. In spite of MBICs' advantages, the overall performances (accuracy, sensitivity and specificity) of current MBIC approaches remains inconsistent, with their values varying from ~50% to ~99%, for which the reasons underlying have yet to be investigated further, both computationally and experimentally. To look into the variation of the performance of MBICs in automated detection of itch-induced scratch, this article focuses on the experimental data recording step, and reports here for the first time that MBICs' overall performance is inextricably linked to the sharpness of experimentally recorded video of laboratory animal scratch behaviour. This article furthermore demonstrates for the first time that a linearly correlated relationship exists between video sharpness and overall performance (accuracy and specificity, but not sensitivity) of MBICs, and highlight the primary role of experimental data recording in rapid, accurate and consistent quantitative assessment of laboratory animal itch.

The concept of destination image is closely related to the brand image of the destination. A good image is a step in branding the destination. The image of the destination can be a primary, sec-ondary or global one, the latter incorporating the first two. The sustainability of a positive image of the destination is based on both a positive secondary image and a positive global image. The purpose of this research is to analyze separately the two types of images for a given tourist des-tination that has registered in recent years a remarkable increase in the number of visitors. The research is based on a questionnaire-based survey of a sample of 607 people. The collected data were processed with SPSS and the results show significant differences between the two types of images (secondary image and global image), a dangerous situation in the medium and long term for destination management. The nuances in the perception of the image of the destination on the two types of respondents (who experienced respectively who did not experience the destination) can be explained by the aggressive strategy of promoting the tourist destination, but inefficient strategy for younger age groups. The study allows the formulation of conclusions and measures to correct the situation.

The critical changes in physical appearance during adolescence can considerably influence the self-appraisal of body image. The purpose of this study is to analyze body self-image gender differences in Mediterranean adolescents, and his relationships to the anthropometric characteristics of this population in different phases of the adolescence. Participants were 809 Mediterranean teenagers (396 females) aged 11 to 17. A relative low prevalence of dissatisfaction with body image was observed among healthy urban Mediterranean adolescents (boys 17.3%; girls 22.7%). Girls showed statistically significantly higher mean BSQ scores than boys (M = 61.7, SD = 26.6 versus M = 56.3, SD = 27.1; p < 0.001). Girls in the late adolescence were more often classified as being dissatisfied (31%) in comparison to those in the early adolescent group (19.1%; p < 0.05). There was a good correlation of BSQ scores with all the anthropometric variables in males but not in females.

"Finding fresh water in the ocean of data." is a challenge that all deep learning domains struggle with, especially in the area of hyperspectral image analysis. As hyperspectral remote sensing technology advances by leaps and bounds, there are increasing amounts of hyperspectral images(HSIs) can be available. Whereas in fact, these unlabeled HSIs are powerless to be used as material to driven a supervised learning task due to the extremely expensive labeling costs and some unknown regions. Although learning-based methods have achieved remarkable performance due to their superior ability to represent features, at the cost, these methods are complex, inflexible and tough to carry out transfer learning. In this paper, we propose the "Instructional Mask AutoEncoder"(IMAE), which is a simple and powerful self-supervised learner for HSI classification that uses a transformer-based mask autoencoder to extract the general features of HSIs through a self-reconstructing agent task. Moreover, we utilize the metric learning to perform an instructor which can direct the model focus on the human interested region of the input so that we can alleviate the defects of transformer-based model such as local attention distraction, lack of inductive bias and tremendous training data requirement. In downstream forward propagation, instead of global average pooling, we employ a learnable aggregation to put the tokens into fullplay. The obtained results illustrate that our method effectively accelerates the convergence rate and promotes the performance in downstream task.

This paper discusses the computer-aided (CAD) classification between Hepatocellular Carcinoma (HCC), i.e., the most common type of liver cancer, and Liver Abscess, based on ultrasound image texture features and Support Vector Machine (SVM) classifier. Among 79 cases of liver diseases, with 44 cases of HCC and 35 cases of liver abscess, this research extracts 96 features of Gray-Level Co-occurrence Matrix (GLCM) and Gray-Level Run-Length Matrix (GLRLM) from the region of interests (ROIs) in ultrasound images. Three feature selection models, i) Sequential Forward Selection, ii) Sequential Backward Selection, and iii) F-score, are adopted to determine the identification of these liver diseases. Finally, the developed system can classify HCC and liver abscess by SVM with the accuracy of 88.875%. The proposed methods can provide diagnostic assistance while distinguishing two kinds of liver diseases by using a CAD system.

A number of studies have been conducted to improve the accessibility of images using touchscreen devices for screen reader users. In this study, we conducted a systematic review of 33 papers to get a holistic understanding of existing approaches and to suggest a research road map given identified gaps. As a result, we identified types of images, visual information, input device and feedback modalities that were studied for improving image accessibility using touchscreen devices. Findings also revealed that little has studied how to automate the generation of image-related information, and that screen reader users play important roles during the evaluation but the design process. Then we introduce two of our recent studies on the accessibility of artwork and comics, AccessArt and AccessComics respectively. Based on the identified key challenges, we suggest a research agenda for improving image accessibility for screen reader users.

Verifying the accuracy of a 3D-printed object involves using an image processing system. This system compares images of the CAD model of the object to be printed with its 3D-printed counterparts to identify any discrepancies. It is important to note that the integrity of the accuracy measurement is heavily dependent on the image processing settings chosen. This study focuses on this issue by developing a customized image processing system. The system generates binary images of a given CAD model and its 3D-printed counterparts and then compares them pixel-by-pixel to determine the accuracy. Users can experiment with various image processing settings, such as grayscale to binary image conversion threshold, noise reduction parameters, masking parameters, and pixel-fineness adjustment parameters, to see how they affect accuracy. The study concludes that the grayscale to binary image conversion threshold has the most significant impact on accuracy and that the optimal threshold varies depending on the color of the 3D-printed object. The system can also effectively eliminate noise (filament marks) during image processing, ensuring accurate measurements. Additionally, the system can measure the accuracy of highly complex porous structures where the pores size, depth, and distribution are random. The insights gained from this study can be used to develop intelligent systems for the metrology of additive manufacturing.

Underwater image processing faces significant challenges due to the absorption and scattering of light as it travels through water. A self-supervised learning network based on the self-attention mechanism is proposed for underwater visual applications in this paper. The goal is to improve the effectiveness and stability of feature extraction from underwater images. By incorporating self-attention mechanism, the sensitivity of the original network architecture to degraded features of blurred underwater images is enhanced. The network proposed in this paper is trained using transfer learning and evaluated on various underwater image datasets. With distributive, quantitative, and qualitative advantages compared with other methods, experimental results have demonstrated that the algorithm presented shows a slighter decline in feature extraction ability for blurred images as the turbidity of water increases.

In recent decades, the Variational AutoEncoder (VAE) model has shown good potential and capabilities in image generation and dimensionality reduction. The combination of VAE and various machine learning frameworks has also worked effectively in different daily life applications, however its possibility and effectiveness in modern game design has seldom been explored nor assessed. The use of its feature extractor for data clustering was minimally discussed in literature neither. This paper first attempts to explore different mathematical properties of the VAE model, in particular, the theoretical framework of the encoding and decoding processes, the possible achievable lower bound and loss functions of different applications; then applies the established VAE model into generating new game levels within two well-known game settings; as well as validating the effectiveness of its data clustering mechanism with the aid of the Modified National Institute of Standards and Technology (MNIST) database. Respective statistical metrics and assessments were also utilized for evaluating the performance of the proposed VAE model in aforementioned case studies. Based on the statistical and spatial results, several potential drawbacks and future enhancement of the established model were outlined, with the aim of maximizing the strengths and advantages of VAE for future game design tasks and relevant industrial missions.

This study aims to clarify the influence of photographic environments under different light sources on image-based SPAD value prediction. Radish leaf patches of 1.5 cm diameter were photographed under halogen or LED light. The input variables for the SPAD value prediction using random forests were RGB values, HSL values, and HSV values. Additionally, the light color temperature (LCT) and illuminance (ILL) were used as the input variables. Model performance was assessed using Pearson’s correlation coefficient (COR), Nash-Sutcliffe efficiency (NSE), and root mean squared error (RMSE). SPAD value prediction resulted in high accuracy in a stable light environment; CORRGB+ILL+LCT and CORHSL+ILL+LCT were 0.929 and 0.922, respectively. Image-based SPAD value prediction was effective under halogen light with a similar color temperature at dusk; CORRGB+ILL and CORHSL+ILL were 0.895 and 0.876, respectively. The HSL value under LED could be used to predict the SPAD value with high accuracy; COR, NSE, and RMSE were 0.972, 0.944, and 2.07, respectively. The partial dependence plots of the H value indicate a change from blue to green with increasing SPAD values. Further studies are required to examine this method under outdoor conditions in spatiotemporally dynamic light environments.

Spectral image analysis has the potential to replace traditional approaches for assessing plant responses to different types of stress including herbicide, through non-destructive and high-throughput screening (HTS). Therefore, this study was conducted to develop a rapid bioassay method using a multi-well plate and spectral image analysis for diagnosis of herbicide activity and mode of action. Crabgrass (Digitaria ciliaris) as a model weed was cultivated in multi-well plates and subsequently treated with 6 herbicides with different modes of action when they reached the 1-leaf stage, using only a quarter of the recommended dose. To detect plant response to herbicides, plant spectral images were acquired after herbicide treatment using RGB, infrared (IR) thermal, and chlorophyll fluorescence (CF) sensors and analyzed for diagnosing herbicide efficacy and mode of action. Principal Component Analysis (PCA) using all spectral data successfully distinguished herbicides and clustered depending on their modes of action. The performed experiments have shown that the multi-well plate assay combined with spectral image analysis can be successfully applied for herbicide bioassay. In addition, the use of spectral image sensors, especially in CF image, would facilitate HTS by enabling rapid observation of herbicide response, as early as 3 hours after herbicide treatment.

Our image recognition system mainly judges whether the left upper limb in the image is the left upper limb or the right upper limb through our deep learning model in the image. The doctor then could give the correct surgical position. From the experimental results, it could be found that the precision rate and recall rate of the intelligent image recognition system proposed in this paper for preventing the upper limb dislocation surgery could reach 98% and 93%, respectively. It proved that our intelligent image recognition system could indeed assist orthopedic surgeons to prevent the occurrence of left and right dislocation in upper limb surgery. At the same time, this paper also completes the IRB application approval through the prototype experimental results and will conduct the second phase of human trials in the future. It showed that the research results of this paper will be of great benefit and research value to upper limb orthopedic surgery.

In remote sensing applications, one of the key points is the acquisition, real-time pre-processing and storage of information. Due to the large amount of information present in the form of images or videos, compression of this data is necessary. Compressed sensing (CS) is an efficient technique to meet this challenge. It consists in acquiring a signal, assuming that it can have a sparse representation, using a minimal number of non-adaptive linear measurements. After this CS process, a reconstruction of the original signal must be performed at the receiver. Reconstruction techniques are often unable to preserve the texture of the image and tend to smooth out its details. To overcome this problem, we propose in this work, a CS reconstruction method that combines the total variation regularization and the non-local self-similarity constraint. The optimization of this method is performed by the augmented Lagrangian which avoids the difficult problem of non-linearity and non-differentiability of the regularization terms. The proposed algorithm, called denoising compressed sensing by regularizations terms (DCSR), will not only perform image reconstruction but also denoising. To evaluate the performance of the proposed algorithm, we compare its performance with state-of-the-art methods, such as Nesterov's algorithm, group-based sparse representation and wavelet-based methods, in terms of denoising, and preservation of edges, texture and image details, as well as from the point of view of computational complexity. Our approach allows to gain up to 25% in terms of denoising efficiency, and visual quality using two metrics: PSNR and SSIM.

The determination of crack propagation velocities can provide valuable information for a better understanding of damage processes of concrete. The spatio-temporal analysis of crack patterns developing at a speed of several hundred meters per second is a rather challenging task. In the paper, a photogrammetric procedure for the determination of crack propagation velocities in concrete specimens using high-speed camera image sequences is presented. A cascaded image sequence processing which starts with the computation of displacement vector fields for a dense pattern of points on the specimen’s surface between consecutive time steps of the image sequence chain has been developed. These surface points are triangulated into a mesh, and as representations of cracks, discontinuities in the displacement vector fields are found by a deformation analysis applied to all triangles of the mesh. Connected components of the deformed triangles are computed using region-growing techniques. Then, the crack tips are determined using principal component analysis. The tips are tracked in the image sequence and the velocities between the time stamps of the images are derived. A major advantage of this method as compared to established techniques is in the fact of its allowing for spatio-temporally resolved, full-field measurements rather than point-wise measurements and that information on crack width can be obtained simultaneously. To validate the experimentation, the authors processed image sequences of tests on four compact-tension specimens performed on a split-Hopkinson tension bar. The images were taken by a high-speed camera at a frame rate of 160,000 images per second. By applying to these datasets the image sequence processing procedure as developed, crack propagation velocities of about 800 m/s were determined with a precision in the order of 50 m/s.

This study examines how the design of museum archaeological boxes and the overall museum image affect behavioral intention. This research used partial least squares-structural equation modeling, indicating a relationship between aesthetics, symbolism, affective museum image, perceived value, and behavioral intention. This study found that symbolism predicted behavioral intention. Moreover, aesthetics, symbolism, and affective museum image affected perceived value, in turn triggering behavioral intention. This indicates theoretical and practical implications for museum products.

We propose an algorithm for generating a panoramic image of a pipe’s inner surface based on inverse perspective mapping (IPM). For efficient crack detection, we used only perspective images of the pipe interior that can be obtained with a single lens camera instead of those taken with a 360-degree camera or a 3D depth camera. Frontal images taken while passing through the pipe were converted to images of the inner surface of the pipe using IPM. We derived a generalized IPM formula that considers the slope of the image plane to correct image distortion caused by the tilt of the plane; this IPM formula was derived based on the vanishing point of the perspective image, which was detected using optical flow techniques. Finally, the multiple transformed images with overlapping areas were combined via image stitching to create a panoramic image of the inner pipe surface. To validate our proposed algorithm, we restored images of pipe inner surface using a 3D pipe model and used these images for crack detection.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

In recent years, researchers have paid increasing attention on hyperspectral image (HSI) classification using deep learning methods. To improve the accuracy and reduce the training samples, we propose a double-branch dual-attention mechanism network (DBDA) for HSI classification in this paper. Two branches are designed in DBDA to capture plenty of spectral and spatial features contained in HSI. Furthermore, a channel attention block and a spatial attention block are applied to these two branches respectively, which enables DBDA to refine and optimize the extracted feature maps. A series of experiments on four hyperspectral datasets show that the proposed framework has superior performance to the state-of-the-art algorithm, especially when the training samples are signally lacking.

In table tennis competitions the rule violation judgment with the greatest controversy is the height of the ball serve. This is because inaccuracy in the ball height judgment, which results in erroneous judgment, is unavoidable. Thus, we designed an automatic image judgment auxiliary system for table tennis ball height during service in this study. We used a high-speed camera to record the ball toss in the table tennis service. The designed algorithm architecture can automatically search for the ball and the position of the hand action under low light source conditions. The algorithm is mainly divided into hue-saturation-value color space processing and morphology processing using Hough transform to search for the circular ball. Experiment result shows that color segmentation can successfully and accurately determine the ball position under low light conditions. The morphology method can find the position of the hand and help determine the moment when the ball leaves the hand during the service ball toss. Finally, the actual size of the target is used to estimate the actual distance unit represented by the image pixel.

Malaria is one of the life-threatening disease caused by the Anopheles mosquitoes affecting the human red blood cells. It is the global health concern which is quite common in tropical as well as sub-tropical parts of the World. Therefore, it is an important to have an effective computer aided system in place for early detection and treatment. State of the art machine learning techniques are used to detect the infected malaria cells from the pool of images. As the visual heterogeneity of the malaria dataset is highly complex and dynamic, therefore higher number of images are needed to train the machine learning models effectively. However, hospitals as well as medical institutions do not share the medical image data for collaboration due to general data protection regulation (GDPR) and data protection act (DPA). To overcome this collaborative challenge, our research is inspired to use the real-time medical image data while using the framework of federated learning (FL) framework that will ensure the data privacy while mutual collaboration of hospitals and medical institutes. We have used the state of the art machine learning models that include the Resnet50 and densenet in a federated learning framework. We have experimented both models in different settings and our preliminary results showed that the densenet model performed better in accuracy (75%) in contrast to resnet50 (72%) while considering 8 clients, while the trend is observed common in 4 clients with the similar accuracy of 94% and 6 client showed that the densenet model performed quite well with the accuracy of 92% while resnet50 achieving only 72%.

Fringe projection profilometry(FPP) has been extensively applied in various fields for its superior fast speed, high accuracy and high data density. However, measuring some objects with high reflective surfaces or high dynamic range surfaces remains challenging for FPP. Some multiple exposure image fusion methods have been proposed and successfully improved the measurement performance for these kinds of objects. Normally, these methods have a relatively fixed sequence of exposure settings determined by artificial experience or trial and error experiments, which may decrease the efficiency of the entire measurement process and may have less robustness to various environmental lighting conditions and object reflective properties. In this paper, a novel self-adaptive multiple exposure image fusion method is proposed with two main aspects of improvement on adaptively optimizing the initial exposure and the exposure sequence. By introducing the theory of information entropy, combined with the analysis of the characterization of fringe image entropy, an adaptive initial exposure searching method is first proposed. Then, an exposure sequence generation method based on dichotomy is further described. On the base of these two improvements, a novel self-adaptive multiple exposure image fusion method for FPP as well as its detailed procedures are given. Experimental results validate the performance of the proposed self-adaptivity multiple exposure image fusion method by measuring the objects with different surface reflectivity and in different ambient lighting conditions.

Background: Assessing body image and personalized rehabilitation in lower limb amputation is essential to measure impact on an individual’s quality of life and psychosocial wellbeing. The aim of this study was to develop a Spanish version of the Amputee Body Image Scale (ABIS-E) for Spanish-speaking lower limb amputee. Methods: A cross-sectional study was conducted including amputee patients in local in Madrid, Spain. Clinical outcomes about body image (Amputee Body Image Scale, ABIS), health-related quality of life (EuroQol-5D-5L), depression and anxiety (Hospital Anxiety and Depression Scale, HADS), pain (Brief Pain Inventory-Short Form, BPI-SF) and functional capacity (Prosthesis Evaluation Questionnaire, PEQ) were collected. Results: Seventy-three participants were assessed. Excellent test-retest reliability (ICC=0.847) and good internal consistency (Cronbach's alpha=0.753) were obtained. Three factors were extracted in the factor analyses. Convergent validity with Pearson's and Spearman's correlation coefficients were calculated for the depression and anxiety questionnaires (HADS) (values between .57 and .67), functional capacity (PEQ) (values between -.35 and .71) and quality of life (EQ-5D-5L) (values between -.37 and .61). Conclusions: The ABIS-E is a reliable and valid tool for measuring body image in the Spanish population with a lower limb amputation, potentially useful in primary care to identify psychosocial problems.

(1) Background: Colon polyps are common protrusions in the colon’s lumen with potential risks of developing colorectal cancer. Early detection and intervention of these polyps are vital for reducing colorectal cancer incidence and mortality rates. This research aims to evaluate and compare the performance of three machine-learning image classification models’ performance in detecting and classifying colon polyps. (2) Methods: The performance of three machine learning image classification models, Google Teachable Machine (GTM), Roboflow3 (RF3), and You Only Look Once version 8 (YOLOV8), in the detection and classification of colon polyps were evaluated. The study used a dataset of colonoscopy images of normal colon, polyps, and resected polyps. The study assessed the models’ ability to correctly classify the images into their respective classes using precision, recall, and F1 score generated from confusion matrix analysis and performance graphs. (3) Results: All three models successfully distinguished between normal colon, polyps, and resected polyps in colonoscopy images. GTM achieved the highest accuracies: 0.99, with consistent precision, recall, and F1 scores of 1.00 for the `normal’ class, 0.97 - 1.00 for `polyps,’ and 0.97 - 1.00 for `resected polyps.’ While GTM exclusively classified images into these three categories, both YOLOV8 and RF3 extended their capabilities to detect normal colonic tissue, polyps, and resected polyps, with YOLOV8 and RF3 achieving overall accuracies of 0.84 and 0.87, respectively. (4) Conclusions: Machine learning, particularly models like GTM, shows promising results in ensuring comprehensive detection of polyps during colonoscopies.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

This article develops algorithms for the characterization and the visualization of micro-scale features by using a small number of sample points, and with a goal to mitigate for the measurement shortcomings which are often destructive or time consuming. We implement the algorithms to rapidly examine the microscopic features of a Microelectromechanical System (MEMS) surface. Such images are highly dense; therefore, traditional image processing techniques might be computationally expensive. The contribution of this research include first, we develop local and global algorithm based on modified Thin Plate Spline (TPS) model to reconstruct high resolution images of the micro-surface’s topography, and its derivatives by using low resolution images. Second, we obtain a bending energy algorithm from our modified TPS model, and use it to filter out image defects. Finally, we develop a computationally efficient Windowing technique, which combines TPS and Linear Sequential Estimation (LSE), to enhance the visualization of images. The Windowing technique allows rapid image reconstruction based on the reduction of inverse problem.

Research on image-inpainting tasks has mainly focused on enhancing performance by augmenting various stages and modules. However, this trend does not consider the increase in the number of model parameters and operational memory, which increases the burden on computational resources. To solve this problem, we propose a Parametric Efficient Image InPainting Network (PEIPNet) for efficient and effective image-inpainting. Unlike other state-of-the-art methods, the proposed model has a one-stage inpainting framework in which depthwise and pointwise convolutions are adopted to reduce the number of parameters and computational costs. To generate semantically appealing results, we selected three unique components: spatially-adaptive denormalization (SPADE), dense dilated convolution module (DDCM), and efficient self-attention (ESA). The SPADE was adopted to conditionally normalize activations according to the mask to distinguish between damaged and undamaged regions. The DDCM was employed at every scale to overcome the gradient-vanishing obstacle and gradually fill-in pixels by capturing global information along the feature maps. The ESA was utilized to obtain clues from unmasked areas by extracting long-range information. In terms of efficiency, our model has the lowest operational memory compared with other state-of-the-art methods. Both qualitative and quantitative experiments demonstrate the generalized inpainting of our method on three public datasets: Paris StreetView, CelebA, and Places2.

Many university female students are concerned about their bodies. Body image perception has become a public health issue globally. This study aimed to explore factors contributing to body image dissatisfaction among female students at the University of Venda. The study was qualitative in nature and employed exploratory research design. A sample of 10 female students enrolled at the University of Venda were identified using convenience sampling method. A pre-tested, semi-structured interview guide was used to collect data and thematic content analysis technique was used to analyse the collected data. The findings of the study showed that body comparison, societal beauty standards, social media, and body shaming by family and friends were the main factors contributing to student’s body image dissatisfaction. The findings further revealed that lack of self-confidence, stress, avoidance, anxiety and depressive symptoms were the challenges faced by students with body image dissatisfaction. Acceptance. Self-care, and healthy diet were identified as coping strategies to help deal with the challenges of student’s body image dissatisfaction. Conclusively, students should be encouraged to seek professional help timeously, to help navigate their body image concerns to avoid decline in their daily functioning.

Deep neural networks have been extensively researched in the field of document image classification to improve classification performance and have shown excellent results. However, there is little research in this area that addresses the question of how well these models would perform in a real-world environment, where the data the models are confronted with often exhibits various types of noise or distortion. In this work, we present two separate benchmark datasets, namely RVL-CDIP-D and Tobacco3482-D, to evaluate the robustness of existing state-of-the-art document image classifiers to different types of data distortions that are commonly encountered in the real world. The proposed benchmarks are generated by inserting 21 different types of data distortions with varying severity levels into the well-known document datasets RVL-CDIP and Tobacco3482, respectively, which are then used to quantitatively evaluate the impact of the different distortion types on the performance of latest document image classifiers. In doing so, we show that while the higher accuracy models also exhibit relatively higher robustness, they still severely underperform on some specific distortions, with their classification accuracies dropping from ~90% to as low as ~40% in some cases. We also show that some of these high accuracy models perform even worse than the baseline AlexNet model in the presence of distortions, with the relative decline in their accuracy sometimes reaching as high as 300-450% that of AlexNet. The proposed robustness benchmarks are made available to the community and may aid future research in this area.

Blind image quality assessment (BIQA) aims to evaluate image quality in a way that closely matches human perception. To achieve this goal, the strengths of deep learning and the characteristics of human visual system (HVS) can be combined. In this paper, inspired by the ventral pathway and dorsal pathway of HVS, a dual-pathway convolutional neural network is proposed for BIQA task. The proposed method consists of two pathways: “what” pathway, which mimics the ventral pathway of HVS to extract the content features of distorted images, and the “where” pathway, which mimics the dorsal pathway of HVS to extract the global shape features of distorted images. Then, the features from the two pathways are fused and mapped to an image quality score. Additionally, the gradient images weighted by the contrast sensitivity are used as the input to the “where” pathway, allowing it to extract global shape features that are more sensitive to human perception. Moreover, a dual-pathway multi-scale feature fusion module is designed to fuse the multi-scale features of the two pathways, enabling the model to capture both global features and local details, thus improving the overall performance of the model. The experiments conducted on six databases show that the proposed method achieves the state-of-the-art performance.

Star image registration is the most important step in the application of astronomical image differencing, stacking and mosaicking, which requires high robustness, accuracy and real--time of the algorithm, but there is no high--performance registration algorithm in this field. In this paper, we propose a star image registration algorithm that relies only on radial module features (RMF) and rotation angle features (RAF), which has excellent robustness, high accuracy, and good real--time performance. The test results on a large amount of simulated and real data show that the comprehensive performance of the proposed algorithm is significantly better than the four classical baseline algorithms in the presence of rotation, insufficient overlapping area, false stars, position deviation, magnitude deviation and complex sky background, which is a more ideal star image registration algorithm.

Deep learning has been introduced to single-image super-resolution (SISR) in the last decade. These techniques have taken over the benchmarks of SISR tasks. Nevertheless, most architectural designs necessitate substantial computational resources, leading to a prolonged inference time on embedded systems or rendering them infeasible for deployment. This paper presents a comprehensive survey of plausible solutions and optimization methods to address this problem. Then, we propose a pipeline that aggregates the latter in order to enhance the inference time without significantly compromising the perceptual quality. We investigate the effectiveness of the proposed method on a lightweight GAN-based perceptual-oriented model as a case study. The experimental results show that our proposed method leads to significant improvement in the inference time on both Desktop and Jetson Xavier NX, especially for higher resolution input sizes on the latter, thereby making it deployable in practice.

Fog, haze, or smoke are usual atmospheric phenomena that dramatically compromise the overall visibility of any scene, critically affecting features such as illumination, contrast, and contour detection of objects. The decrease in visibility compromises the performance of computer vision algorithms such as pattern recognition and segmentation, some of them very relevant for decision-making for the security or autonomous vehicle industries. Several dehazing methods have been proposed, however, to the best of our knowledge, all proposed metrics compare the defogged image to its ground truth for evaluation of the defogging algorithms, or need to estimate parameters through physical models. This fact hinders progress in the field as obtaining proper ground truth images is costly and time-consuming, and physical parameters greatly depend on the scene conditions. This paper aims to tackle this issue by proposing a contour-based metric for image defogging evaluation that does not need a ground truth image. The proposed metric only requires the original hazy RGB image and the RGB image after the defogging procedure. A comparison of the proposed metric with metrics currently used in the NTIRE 2018 defogging challenge is performed to prove its effectiveness in a general situation, showing comparable results to conventional metrics.

To address three important issues related to extraction of water features from Landsat imagery, i.e., selection of water indexes and classification algorithms for image classification, collection of ground truth data for accuracy assessment, this study applied four sets (ultra-blue, blue, green, and red light based) of water indexes (NWDI, MNDWI, MNDWI2, AWEI_ns, and AWEI_s) combined with three types of image classification methods (zero-water index threshold, Otsu, and kNN) to 24 selected lakes across the globe to extract water features from Landsat-8 OLI imagery. 1440 (4x5x3x24) image classification results were compared with the extracted water features from high resolution Google Earth images with the same (or ±1 day) acquisition dates through computing the Kappa coefficients. Results show the kNN method is better than the Otsu method, and the Otsu method is better than the zero-water index threshold method. If the computational cost is not an issue, the kNN method combined with the ultra-blue light based AWEI_ns is the best method for extracting water features from Landsat imagery because it produced the highest Kappa coefficients. If the computational cost is taken into account, the Otsu method is a good choice. AWEI_ns and AWEI_s are better than NDWI, MNDWI and MNDWI2. AWEI_ns works better than AWEI_s under the Otsu method, and the average rank of the image classification accuracy from high to low is the ultra-blue, blue, green, and red light-based AWEI_ns.

Drone and aerial remote sensing images are widely used, but their imaging environment is complex and prone to image blurring. Existing CNN deblurring algorithms usually use multi-scale fusion to extract features in order to make full use of aerial remote sensing blurred image information, but images with different degrees of blurring use the same weights, leading to increasing errors in the feature fusion process layer by layer. Based on the physical properties of image blurring, this paper proposes an adaptive multi-scale fusion blind deblurred generative adversarial network (AMD-GAN), which innovatively applies the degree of image blurring to guide the adjustment of the weights of multi-scale fusion, effectively suppressing the errors in the multi-scale fusion process and enhancing the interpretability of the feature layer. The research work in this paper reveals the necessity and effectiveness of a priori information on image blurring levels in image deblurring tasks. By studying and exploring the image blurring levels, the network model focuses more on the basic physical features of image blurring. Meanwhile, this paper proposes an image blurring degree description model, which can effectively represent the blurring degree of aerial remote sensing images. The comparison experiments show that the algorithm in this paper can effectively recover images with different degrees of blur, obtain high-quality images with clear texture details, outperform the comparison algorithm in both qualitative and quantitative evaluation, and can effectively improve the object detection performance of aerial remote sensing blurred images. Moreover, the average PSNR of this paper's algorithm tested on the publicly available dataset RealBlur-R reached 41.02dB, surpassing the latest SOTA algorithm.

Our image recognition system mainly judges whether the left upper limb in the image is the left upper limb or the right upper limb through our deep learning model in the image. The doctor then could give the correct surgical position. From the experimental results, it could be found that the precision rate and recall rate of the intelligent image recognition system proposed in this paper for preventing the upper limb dislocation surgery could reach 98% and 93%, respectively. It proved that our artificial intelligent image recognition system, AIIRS, could indeed assist orthopedic surgeons to prevent the occurrence of left and right dislocation in upper limb surgery. At the same time, this paper also completes the IRB application approval through the prototype experimental results and will conduct the second phase of human trials in the future. It showed that the research results of this paper will be of great benefit and research value to upper limb orthopedic surgery.

Deep convolutional neural network (CNN) has shown their great advantages in the single image deraining task. However, most existing CNN-based single image deraining methods still suffer from residual rain streaks and details lost. In this paper, we propose a deep neural network including the Multi-scale feature extraction module and the channel attention module, which are embed in the feature extraction sub-network and the rain removal sub-network respectively. In the feature extraction sub-network, the Multi-scale feature extraction module is constructed by a Multi-layer Laplacian pyramid, and is then integrated multi-scale feature maps by a feature fusion module. In the rain removal sub-network, the channel attention module, which assigns different weights to the different channels, is introduced for preserving image details. Experimental results on visually and quantitatively comparison demonstrate that the proposed method performs favorably against other state-of-the-art approaches

A tabletop system can facilitate multi-user collaboration in a variety of settings including small meetings, group work, and education and training exercises. The ability of identifying the users touching the table and their positions can promote collaborative work among participants, so methods have been studied that involve the attaching of sensors to the table or chairs or to the users themselves. An effective method of recognizing user actions without placing a burden on the user would be some type of visual process, so the development of a method that processes multi-touch gestures by visual means is desired. This paper describes the development of a multi-touch tabletop system using infrared image recognition for user position identification and presents the results of touch-gesture recognition experiments and a system usability evaluation. Using an FTIR touch panel and infrared light, this system picks up the shadow area of the user’s hand by infrared camera in relation to user touch operations and estimates user position by image recognition. The multi-touch gestures prepared for this system include an operation to change the direction of an object to face the user and a copy operation in which two users generate duplicates of an object. The average recognition rate of the change-direction gesture and copy gesture were found to be 96% and 85%, respectively. In addition, the system usability evaluation revealed that prior learning was easy and that system operations could be easily performed.

Pediatric interventional cardiology procedures are essential in diagnosing and treating congenital heart disease in children; however, they raise concerns about potential radiation exposure. Managing radiation doses and assessing image quality in angiographs becomes imperative for safe and effective interventions. This systematic review aims to comprehensively analyze the current understanding of physical image quality metrics relevant for characterizing X-ray systems used in fluoroscopy-guided pediatric cardiac interventional procedures, considering the main factors reported in the literature that influence this outcome. A search in Scopus and Web of Science, using relevant keywords and inclusion/exclusion criteria, yielded fourteen relevant articles published between 2000 and 2022. The physical image quality metrics reported were noise, signal-to-noise ratio, contrast, contrast-to-noise ratio, and high contrast spatial resolution. Various factors influencing image quality were investigated, such as polymethyl methacrylate thickness (often used to simulate water equivalent tissue thickness), operation mode, anti-scatter grid presence and tube voltage. Objective evaluations using these metrics ensure impartial assessments for main factors affecting image quality, improving in the characterization fluoroscopic X-ray systems, and aiding informed decisions to safeguard pediatric patients during procedures.

This research used an experimental study design in which 60 subjects were randomly assigned to either an experimental (image e-book guidance) group or a control (text guidance) group after meeting the admission conditions and agreeing to participate in the study. It was proven that providing image e-book guidance before surgery significantly changed the behavior of patients and promoted relief of urinary catheter discomfort through self-efficacy to reduce urinary catheter pain after surgery. It was found that providing image e-book guidance can shorten the time for health education and provide patients with repeated medical education and familiarity with health guidance, which can help to address the important clinical service demand issue and the shortage of nursing staff.

The utilization of tempered blast furnace (BF) slag through the direct fiber forming process to create high-value thermal insulation materials offers a dual benefit: it efficiently harnesses the latent heat within unused slag and substantially enhances the value of blast-furnace slag utilization. However, gauging the melting properties of iron slag under high temperatures is a challenge. In this study, we explore the melting behavior of SiO2 within a high-temperature molten pool. We employ dynamic visual data (video stream) captured via a non-contact charge coupled device (CCD) video recording system to extract SiO2 contours through image processing. The change in image centroid characteristics is used to establish a convolution function relationship, and MATLAB's traversal search algorithm determines SiO2's centroid position. Given that SiO2 is proportionate to crucible pixels, the area of SiO2 is calculated through pixel statistics within these contours. Subsequently, we propose a new indirect method to process image information, yielding SiO2 volume and mass at different time points. An exponential fitting yields the melting rate function of SiO2. Finally, we compare this indirect method with shape from shading (SFS), quantitative characterization, and dimensional analysis techniques. We also discuss the strengths and limitations of each method. Our findings reveal that the indirect solution method presented here boasts straightforward calculation steps and imposes minimal image format requirements. This research provides theoretical and technical support for blast-furnace slag's direct fiber forming process.

The IoT Internet of Things being a promising technology of the future. It is expected to connect billions of devices. The increased communication number is expected to generate data mountain and the data security can be a threat. The devices in the architecture are fundamentally smaller in size and low powered. In general, classical encryption algorithms are computationally expensive and this due to their complexity and needs numerous rounds for encrypting, basically wasting the constrained energy of the gadgets. Less complex algorithm, though, may compromise the desired integrity. In this paper we apply a lightweight encryption algorithm named as Secure IoT (SIT) to a quantized speech image for Secure IoT. It is a 64-bit block cipher and requires 64-bit key to encrypt the data. This quantized speech image is constructed by first quantizing a speech signal and then splitting the quantized signal into frames. Then each of these frames is transposed for obtaining the different columns of this quantized speech image. Simulations result shows the algorithm provides substantial security in just five encryption rounds.

Few-shot fine-grained image classification (FSFGIC) methods refer to machine learning methods which aim to classify images (e.g., bird species, flowers, and airplanes) belonging to subordinate object categories of the same entry-level category with only a few samples. It is worth to note that feature representation learning is used not only to represent training samples, but also to construct classifiers for performing various FSFGIC tasks. In this paper, starting from the definition of FSFGIC, a taxonomy of feature representation learning for FSFGIC is proposed. According to this taxonomy, we discuss key issues on FSFGIC (including data augmentation, local or/and global deep feature representation learning, class representation learning, and task specific feature representation learning). The existing popular datasets and evaluation standards are introduced. Furthermore, a novel classification performance evaluation mechanism is designed with a 0.95 confidence interval for judging whether the classification accuracy obtained by a certain specified method is good or bad. Moreover, current challenges and future trends of feature representation learning on FSFGIC are elaborated.

Understanding the effect of staking sequences and identifying the damage occurring within a structure using a structural health monitoring system are the keys to an efficient design of composite-based parts. In this research, a combination of digital image correlation (DIC) and acoustic emission (AE) is used to locate and classify the type of damage depending on the stacking sequence of the laminate during flexural loading. A comparison of the strain field results for unidirectional, cross-ply, and quasi-isotropic laminates was made in a first attempt to discuss their global behavior and to correlate the different damage patterns with the possible failure mechanisms. The damage was then addressed using a comprehensive interpretation of the acoustic emission signatures using the K-means classification of the acoustic events. The development of each damage mechanism was correlated to the applied load and expressed as a function of the loading rate to highlight the effect of the stacking sequence. Finally, the results of DIC and AE were combined to improve the reliability of the damage investigation without limiting the failure mechanism to matrix cracking, interfacial failure, and fiber breakage, as expected by the unsupervised event clustering.

Digital Image Correlation (DIC) is an optical technique used to measure surface displacements and strains in materials and structures. This technique has demonstrated significant utility in structural examination and monitoring. This manuscript offers a comprehensive review of contemporary research and applications that have leveraged the DIC technique in laboratory-based structural tests. The reviewed works encompass a broad spectrum of structural components, such as concrete beams, columns, pillars, masonry walls, infills, composite materials, structural joints, steel beams, slabs, and other structural elements. These investigations have underscored the efficacy of DIC as a metrological instrument for precise quantification of surface deformation and strain in these structural components. Moreover, the constraints of the DIC technique have been highlighted, especially in scenarios involving extensive or complex test configurations. Notwithstanding these constraints, the DIC methodology has validated its effectiveness as a strain measurement instrument, offering numerous benefits such as non-invasive operation, full-field measurement capability, high precision, real-time surveillance, and compatibility with integration into other measurement instruments and methodologies.

This paper proposes an approach for image data extraction and driving behavior analysis using geographic information and driving data. Information derived from geographic and global positioning systems was used for image data extraction. In addition, we used an onboard diagnostic II and a controller area network bus logger to record driving data for driving behavior analysis. Driving behavior was analyzed using sparse automatic encoders and data exploration to detect abnormal and aggressive behavior. A regression analysis was used to derive the relationship between aggressive driving behavior and road facilities. Several traffic improvements were proposed for specific intersections and roads. The results indicate that lane ratios without lane markings and with straight lane markings are important features that affect aggressive driving behaviors.

Owing to the advantages of cost-effectiveness, compactness, and the avoidance of complicated camera synchronization, single-camera three-dimensional (3D) digital image correlation (DIC) techniques have gained increasing attention for deformation measurement of materials and structures. In the traditional single-camera 3D-DIC system, the left and right view images can be recorded by a single camera using a diffraction grating, a bi-prism or a set of planar mirrors. To further improve the measurement accuracy of single-camera 3D-DIC, this paper introduces a single-camera four-view imaging technique by installing a pyramidal prism in front of the camera. The 3D reconstruction of the measured points before and after deformation is realized with eight governing equations induced by four views, and the strong geometric constraints of four views can help to improve the measurement accuracy. A static experiment, a rigid body translation experiment and a four-point bending experiment show that the proposed single-camera 3D-DIC method can achieve higher measurement accuracy than the dual-view single-camera 3D-DIC techniques and has advantages in reducing both random error and systematic error.

Aircraft heat exchangers play a crucial role in maintaining thermal balance and ensuring that essential components operate efficiently and safely. In this context, it is highly relevant to gain knowledge about the deterioration and the predominant damage mechanisms of these components. In this study, two different non-destructive methods are employed to analyze the damage initiation of a heat exchanger part during fatigue test. On the one hand, Acoustic Emission technique is employed using membrane-free microphones capable of capturing a broad bandwidth. The acoustic events were classified by a machine learning algorithm to determine their source and damage mechanisms. On the other side, Digital Image Correlation (DIC) allowed the measurement of the strain evolution along the test and more precisely, redistributions were considered as damage indicators. As a result, it was identified that AE served as early damage indicator as the cumulative number of events was in good agreement with the severity of the damage. With respect to classification two clear clusters ascribed to different type of events were identified. In the case of DIC, strain redistributions gave clear indications of damage or deterioration but at a later stage compared to AE

Vegetation status assessment is crucial for agricultural monitoring and management. Vegetation indices derived from high resolution image time series can be used to derive key phenological parameters for annual crops. In this work, we propose a procedure for the estimation of these parameters and their associated uncertainties. The approach uses Bayesian inference through Markov Chain Monte Carlo in order to obtain the full joint posterior distribution of the phenological parameters given the satellite observations. The proposed algorithm is quantitatively validated on synthetic data. Its use on real data is presented together with an application to real-time within season estimation allowing for phenology forecasting.

With the explosion of the generation, transmission and sharing of image data over the Internet and other unsecured networks, the need and significance for the development of novel image encryption algorithms is unprecedented. In this research work, we propose a novel framework for image encryption that is based on two hyperchaotic maps, utilized in conjunction with the single neuron model (SNM). The framework entails three successive stages, where in every stage, a substitution box (S-box) is applied, then XORing with an encryption key is carried out. The S-boxes and the encryption keys are generated from the numerical solutions of the hyperchaotic maps and the SNM. The performance of the proposed framework is gauged through a number of metrics, reflecting superior performance and complete asymmetry between the plain images and their encrypted versions. However, the main advantages of this work are: (1) The attained width of the key space; and (2) The achieved efficiency in software implementation. The superior key space of 2^{2551} is the result of employing the two hyperchaotic maps, while the improved efficiency, resulting in an average encryption rate of 8.54 Mbps, is the result of the utilization of the single neuron model, as well as the employment of optimized parallel processing techniques. In addition, the proposed encryption framework is shown to output encrypted images that pass the NIST SP 800 suite.

This study presents the algorithm ACTION, defined as Automatic Center detection of Tropical cyclone (TC) using Image processing based on the Operational radar Network. Based on the high visibility of weather radar imagery, the TC’s motion vector is calculated from the continuous image change using optical flow, producing its rotation center as the TC’s center. The algorithm’s performance was verified for typhoons (TCs in the Northwestern Pacific) affecting the Korean Peninsula from 2018–2021 and showed a high detection rate of 80.8% within an error distance of 40 km compared to the best track of the Korea Meteorological Administration (KMA). The detection rate was 100% for typhoons with temporally consistent morphological characteristics. ACTION automatically generates TC center information upon the TC’s initial entry inside the observation radius even in the absence of uniform radar data. ACTION easily calculates using Open Source Computer Vision, performs in real time, and can be directly applied to rapidly generated weather radar images; hence, it is currently being utilized by the KMA. The high-temporal-resolution TC center information calculated through ACTION is expected to improve the efficiency of TC forecasting.

Grading of rice grains has gain attentions due its requirement of quality assessment during import or export. Rice grain quality depends on milling operation, where rice hull is removed with a huller system followed by whitening operation. In such process, adjustment of rollers, control, and operation is important in terms of quality of milled rice. Especially, the basmati rice needed more quality assurance as it is not parboiled rice and exported globally with a high product value. In this present work, the basic problem of quality assessment in rice industry is addressed with digital image processing based technique. Machine vision and digital image processing provide an alternative with the automated, nondestructive, cost-effective, and fast approach as compared with traditional method which is done manually by human inspectors. A model of quality grade testing and identification is built based on morphological features using digital image processing and knowledge based adaptive neuro-fuzzy inference system (ANFIS). The qualities of rice kernels are determined with the help of shape descriptors and geometric features using the sample images of milled rice. The adopted technique has been tested on a sufficient number of training images of basmati rice grain. The proposed method gives a promising result in an evaluation of rice quality with 100% classification accuracy for broken and whole grain. The milling efficiency is also assessed using the ratio between head rice and broken rice percentage and it is 77.27% for the test sample. The overall results of the adopted methodology are promising in terms of classification accuracy and efficiency.

It has remained a hard nut for years to segment sonar images, most of which are noisy images with inevitable blur after noise reduction. For the purpose of solutions to this problem, a fast segmentation algorithm is proposed on the basis of the gray value characteristics of sonar images. This algorithm is endowed with the advantage in no need of segmentation thresholds to be calculated. To realize this goal, it follows the undermentioned steps: first, calculate the gray matrix of the fuzzy image background. After adjusting the gray value, segment the region into the background region, buffer region and target regions. After filtering, reset the pixels with gray value lower than 255 to binarize images and eliminate most artifacts. Finally, remove the remaining noise from images by means of morphological image processing. The simulation results of several sonar images show that the algorithm can segment the fuzzy sonar image quickly and effectively, with no problem of incomplete image target shape. Thus, the stable and feasible method is testified.

Fine-grained image classification remains an ongoing challenge in the computer vision field, which is particularly intended to identify objects within sub-categories. It is a difficult task since there is a minimal and substantial intra-class variance. The current methods address the issue by first locating selective regions with Region Proposal Networks (RPN), object localization, or part localization, followed by implementing a CNN Network or SVM classifier to those selective regions. This approach, however, makes the process simple by implementing a single-stage end-to-end feature encoding with a localization method, which leads to improved feature representations of individual tokens/regions by integrating the transformer encoder blocks into the Yolov5 backbone structure. These Transformer Encoder Blocks, with their self-attention mechanism, effectively captured the global dependencies and enabled the model to learn relationships between distant regions. This improved the model ability to understand context and captured long-range spatial relationships in the image. We also replaced the Yolov5 detection heads with three transformer heads at the output for object recognition using the discriminative and informative features maps from transformer encoder blocks. We established the potential of the single stage detector for the fine-grained image recognition task, by achieving state of the art 93.4% accuracy, as well as outperforming the existing Yolov5 model. The effectiveness of our approach is assessed using the Stanford car dataset, which includes 16,185 images of 196 different classes of vehicles with significantly identical visual appearances.

This paper proposes an encryption scheme for high pixel density images. Based on the application of the quantum random walk algorithm, the Long short-term memory (LSTM) can effectively solve the problem of low efficiency of the quantum random walk algorithm in generating large-scale pseudorandom matrices, and further improve the statistical properties of the pseudorandom matrices required for encryption. The LSTM is then divided into columns and fed into the LSTM in order for training. Due to the randomness of the input matrix, the LSTM cannot be trained effectively, so the output matrix is predicted to be highly random. The LSTM prediction matrix of the same size as the key matrix is generated based on the pixel density of the image to be encrypted, which can effectively complete the encryption of the image. In the statistical performance test, the proposed encryption scheme achieves an average information entropy of 7.9992, an average number of pixels changed rate (NPCR) of 99.6231%, an average uniform average change intensity (UACI) of 33.6029% and an average correlation of 0.0032. Finally, various noise simulation tests are also conducted to verify its robustness in real-world applications where common noise and attack interference are encountered.

For Visually impaired People (VIPs), the ability to convert text to sound can mean a new level of independence or the simple joy of a good book. With significant advances in Optical Character Recognition (OCR) in recent years, a number of reading aids are appearing on the market. These reading aids convert images captured by a camera to text which can then be read aloud. However, all of these reading aids suffer from a key issue – the user must be able to visually target the text and capture an image of sufficient quality for the OCR algorithm to function – no small task for VIPs. In this work, a Sound-Emitting Document Image Quality Assessment metric (SEDIQA) is proposed which allows the user to hear the quality of the text image and automatically captures the best image for OCR accuracy. This work also includes testing of OCR performance against image degradations, to identify the most significant contributors to accuracy reduction. The proposed No-Reference Image Quality Assessor (NR-IQA) is validated alongside established NR-IQAs and this work includes insights into the performance of these NR-IQAs on document images.

Underwater image often exhibit detail blurring and color distortion due to light scattering, impurities, and other influences, obscuring essential textures and details. This presents a challenge for existing super-resolution techniques in identifying and extracting effective features, making high-quality reconstruction difficult. This research aims to innovate underwater image super-resolution technology to tackle this challenge. Initially, an underwater image degradation model was created by integrating random subsampling, Gaussian blur, mixed noise, and suspended particle simulation to generate a highly realistic synthetic dataset, thereby training the network to adapt to various degradation factors. Subsequently, to enhance the network's capability to extract key features, improvements were made based on the symmetrically structured Blind Super-Resolution Generative Adversarial Network (BSRGAN) model architecture. An attention mechanism based on energy functions was introduced within the generator to assess the importance of each pixel, and a weighted fusion strategy of adversarial loss, reconstruction loss, and perceptual loss was utilized to improve the quality of image reconstruction. Experimental results demonstrate that the proposed method achieved significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Underwater Image Quality Measure (UIQM) by 0.85 dB and 0.19, respectively, significantly enhancing the visual perception quality and indicating its feasibility in super-resolution applications.

To accurately and non-destructively monitor the growth of spring wheat in the Hetao Irrigation Area, UAV remote sensing was employed during various fertility stages. Digital image indices from diverse fertilization treatments were calculated and compared with physiological indices to identify the most sensitive digital image indices corresponding to these indices. The study underscored the critical importance of the flowering stage in the growth of spring wheat, thus highlighting the necessity of focusing on this stage. This finding reiterated that the flowering stage was pivotal for spring wheat development in the Hetao Irrigation Area. Several digital image indices, such as GLA, R, G, INT, g, GRVI, MGRVI, RGBVI, EXG, and GRRI, exhibited a high frequency of significant correlations with physiological indices during the four primary reproductive stages of wheat. Consequently, these sensitive digital image indices during the flowering stage can more effectively characterize the physiological indices of spring wheat.

One of the most important challenges in the Machine and Deep Learning areas today is to build good models using small datasets, because sometimes it is not possible to have large ones. Several techniques have been proposed in the literature to address this challenge. This paper aims at studying the different available Deep Learning techniques and performing a thorough experimentation to analyze which technique or combination thereof improves the performance and effectiveness of the models. A complete comparison with classical Machine Learning techniques was carried out, to contrast the results obtained using both techniques when working with small datasets. Thirteen algorithms were implemented and trained using three different small datasets (MNIST, Fashion MNIST, and CIFAR-10). Each experiment was evaluated using a well-established set of metrics (Accuracy, Precision, Recall, F1, and the Matthews correlation coefficient). The experimentation allowed concluding that it is possible to find a technique or combination of them to mitigate a lack of data, but this depends on the nature of the dataset, the amount of data, and the metrics used to evaluate them.

Background: Computed tomography examinations have produced high radiation doses to patients, especially the CT brain. This study aimed to optimize the radiation dose and image quality in adult CT brain protocol. Materials and Methods: Images were acquired by Catphan 700 phantom. Radiation doses were recorded as CTDIvol and dose length product (DLP). CT brain protocols were optimized by varying parameters such as kVp, mAs, signal-to-noise ratio (SNR) level, and Clearview iterative reconstruction (IR). Image quality were also evaluataion by The AutoQA Plus software. Results: CT Number accuracy and linearity had a robust positive correlation with the linear attenuation coefficient (µ) and showed more inaccurate CT numbers when using 80 kVp. MTF showed a higher value in 100 and 120 kVp protocols, while high contrast spatial resolution showed a higher value in 80 and 100 kVp protocols. Low contrast detectability and CNR tended to increase when using high mAs, SNR and Clearview IR protocol. Noise decreased when using a high radiation dose and a high percentage of Clearview IR. CTDIvol and DLP were increased with increasing kVp, mAs, and SNR levels, while the increasing percentage of Clearview did not affect the radiation dose. Conclusion: Optimized protocols, including radiation dose and image quality, should be evaluated to preserve diagnostic capability. The recommended parameter settings include kVp set between 100-120 kVp, mAs ranging from 200-300 mAs, SNR level within the range of 0.7-1.0, and an iterative reconstruction value of 30% Clearview to 60% or higher.

.Purpose: This paper presents a comparative analysis of state-of-the-art DIR algorithms in the context of head and neck squamous cell carcinoma (HNSCC) radiation therapy. Materials and Methods: We used a dataset of head and neck cancer patients within the Cancer Image Archive, which includes 31 patients with 3D CT image data from pre-treatment, mid-treatment, and post-treatment stages of radiotherapy. We applied DIR algorithms to two datasets, one for pre-treatment to mid-treatment registration and another for mid-treatment to post-treatment registration, by aligning one CT image to another CT image. To quantitatively analyze the patient data, we focused on the spinal cord, optic nerve, brain stem, cochlea, and PTV as the OAR datasets. To verify the DIR algorithm, we used two non-learning-based methods, SyN and NiftyReg, as well as three deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph. We trained a deep learning model by adjusting the ratio of the training dataset, validation dataset, and test dataset to 7:1:2. Results: The average DSCs of SyN and NiftyReg, the non-learning-based methods, were 0.74±0.06 and 0.70±0.12, respectively. The deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph, had average DSCs of 0.72±0.08, 0.68±0.11, and 0.69±0.13, respectively. The deep learning DIR algorithm produced transformed outputs of OAR/PTV in a shorter time than other models, including commercial and conventional mathematical algorithms (At Inference(sec/images), Voxelmorph: 0.36, Cyclemorph: 0.3, Transmorph: 5.1, SyN: 140, NiftyReg: 40.2). Conclusions: In conclusion, our study provides a comprehensive comparison of commercial DIR algorithms with traditional and deep learning-based DIR methods. Our results demonstrate that commercial DIR algorithms outperform traditional DIR methods in terms of accuracy and efficiency. However, we also show that deep learning-based DIR methods have the potential to achieve similar performance to commercial algorithms with proper training and optimization. Our findings suggest that both commercial and deep learning-based DIR methods have their respective advantages and limitations, and the choice of method should depend on the specific requirements of the clinical application. Overall, our study contributes to ongoing efforts to improve the accuracy and efficiency of DIR methods for better patient outcomes.

Image compression is a top priority today due to the need for faster encoding and decoding. To achieve this, the present study has proposed the use of Canonical Huffman Coding (CHC) as an entropy coder, which has a lower decoding time complexity than binary Huffman codes. For image compression, combining of the Discrete Wavelet Transform (DWT) and CHC with Principal Component Analysis (PCA) has been recommended. The lossy method has been introduced by using PCA, followed by DWT and CHC to enhance compression efficiency. By using DWT and CHC instead of PCA alone, the reconstructed image has been found to have a better peak signal-to-noise ratio (PSNR) value. This study has developed a hybrid compression model combining the advantages of DWT, CHC and PCA. With the increasing use of image data, better image compression techniques are necessary for efficient use of storage space. The proposed technique has achieved up to 60% compression while maintaining high visual quality. This method has also outperformed the currently available techniques in terms of both PSNR (in dB) and bit-per-pixel (bpp) scores. This approach has been tested on various color images, including Peppers 512×512 and Couple 256×256, showing improvement by 17 dB and 22 dB, respectively, while reducing bpp by 0.56 and 0.10, respectively. For grayscale images, i.e., Lena 512×512 and Boat 256×256, the proposed method has shown an improvement by 5 dB and 8 dB, respectively, with a decrease of 0.02 bpp in both cases.