X-ray tomography is an effective non-destructive testing method for industrial quality control. Limited angle tomography can be used to reduce the amount of data that needs to be acquired and thus speed up the process. In some industrial applications, however, objects are flat and layered, and laminography is preferred. It can deliver 2D images of the structure of a layered object at a particular depth from very limited data. An image at a particular depth is obtained by summing those parts of the data that contribute to that slice. This produces a sharp image of that slice while superimposing a blurred version of structures present at other depths. In this paper, we investigate an optimal experimental design (OED) problem for laminography that aims to determine the optimal source positions. Not only can this be used to mitigate imaging artifacts, it can also speed up the acquisition process in case where moving the source and detector is time consuming (e.g., in robotic arm imaging systems). We investigate the imaging artifacts in detail through a modified Fourier Slice Theorem. We address the experimental design problem within the Bayesian risk framework using empirical Bayes risk minimization. Finally, we present numerical experiments on simulated data.

Hyperspectral (HS) imaging plays a pivotal role in various fields, including medical diagnostics, where precise human vein detection is crucial. Hyperspectral image data are very large and can cause computational complexities. Dimensionality reduction techniques are often employed to streamline HS image data processing. This paper investigates the effectiveness of three dimensionality reduction techniques, namely: Principal Component Analysis (PCA), Folded PCA (FPCA), and Ward’s Linkage Strategy using Mutual Information (WaLuMI) for vein detection using HS images. A HS image dataset, encompassing left and right-hand images captured from 100 subjects with varying skin tones was created and annotated using anatomical data to represent vein and non-vein areas within the images. To generate experimental results, the HS image dataset was divided into train and test datasets. Optimum performing parameters for each of the dimensionality reduction techniques in conjunction with The Support Vector Machine binary classification were determined using the Training dataset. The performance of the three dimensionality reduction based vein detection methods was then assessed and compared using the test image dataset. Results show that the FPCA-based method outperforms the other two methods in terms of accuracy. For visualization purposes, the classification prediction image for each technique is post-processed using morphological operators, and results show the significant potential of HS imaging in vein detection.

There is growing recognition of the adverse effects of body image dissatisfaction (BID) and eating disorder (ED) symptoms on adolescent health. The aim of this study was to estimate the prevalence of ED symptoms, BID, and their relationship in adolescents from public schools in Southern Brazil. A total of 782 schoolchildren (male: n=420, female: n=362); age: 15 ± 0,4 years) answered a self-administrated questionnaire to identify sociodemographic data. Children´s Figure Rating Scale was adopted to identify body image and Eating Attitudes Test (EAT-26) was applied to investigate ED symptoms. Inferential statistics and hierarchical model-controlled logistic regression were used for association between variables. Most of the schoolchildren reported being satisfied with their bodies. However, we observed a higher prevalence of dissatisfaction among girls for being overweight and thinness among boys. Female students and students from schools located in the central area of the city showed higher chances of developing ED symptoms, and the absence of symptoms of ED appeared to act as a protective factor against BID in schoolchildren. Results of this study show the need to reflect on these factors that influence the development of ED and non-acceptance of their own body in a population concerned with their physical appearance.

Autonomous image recognition has numerous potential applications in the field of planetary science and geology. For instance, having the ability to classify images of rocks would allow geologists to have immediate feedback without having to bring back samples to the laboratory. Also, planetary rovers could classify rocks in remote places and even in other planets without needing human intervention. Shu et al. classified 9 different types of rock images using a Support Vector Machine (SVM) with the image features extracted autonomously. Through this method, the authors achieved a test accuracy of 96.71%. In this research, Convolutional Neural Networks(CNN) have been used to classify the same set of rock images. Results show that a 3-layer network obtains an average accuracy of 99.60% across 10 trials on the test set. A version of Self-taught Learning was also implemented to prove the generalizability of the features extracted by the CNN. Finally, one model has been chosen to be deployed on a mobile device to demonstrate practicality and portability. The deployed model achieves a perfect classification accuracy on the test set, while taking only 0.068 seconds to make a prediction, equivalent to about 14 frames per second.

In this paper, a technique of image watermarking using multiple images as watermarks is presented. The technique is based on transform domain functions including discrete wavelet transform (DWT), discrete cosine transform (DCT) and singular value decomposition (SVD) with an image as the host signal i.e. the watermarks will be used as proofs of the authenticity of the host image. The technique is executed by performing multilevel DWT followed by applying DCT and SVD to both the host and watermark. Multiple watermarks are used for the insurance of better security level. The scheme is immune to common image processing operations & some attacks and exhibits PSNR of 108.3781dB, normalized cross correlation (NCC) over 0.99 and normalized correlation (NC) over 0.99.

Much has been learned about the interaction between myosin and actin through biochemistry, in vitro motility assays and cryo-electron microscopy of F-actin decorated with myosin heads. Comparatively less is known about actin-myosin interactions within the filament lattice of muscle, where myosin heads function as independent force generators and thus most measurements report an average signal from multiple biochemical and mechanical states. All of the 3-D imaging by electron microscopy that has revealed the interplay of the regular array of actin subunits and myosin heads within the filament lattice has been accomplished using the flight muscle of the large waterbug Lethocerus sp. Lethocerus flight muscle possesses a particularly favorable filament arrangement that enables all the myosin cross-bridges contacting the actin filament to be visualized in a thin section. This review covers the history of this effort and the progress toward visualizing the complex set of conformational changes that myosin heads make when binding to actin in several static states as well as fast frozen actively contracting muscle. The efforts have revealed a consistent pattern of changes to the myosin head structures determined by X-ray crystallography needed to explain the structure of the different acto-myosin interactions observed in situ.

An effective on-board cloud detection method in small satellites would greatly improve the downlink data transmission efficiency and reduce the memory cost. In this paper, an ensemble method combining a lightweight U-Net with wavelet image compression is proposed and evaluated. The red, green, blue and infrared waveband images from Landsat-8 dataset are trained and tested to estimate the performance of proposed method. The LeGall-5/3 wavelet transform is applied on the dataset to accelerate the neural network and improve the feasibility of on-board implement. The experiment results illustrate that the overall accuracy of the proposed model achieves 97.45% by utilizing only four bands. Tests on low coefficients of compressed dataset have shown that the overall accuracy of the proposed method is still higher than 95%, while its inference speed is accelerated to 0.055 second per million pixels and maximum memory cost reduces to 2Mb. By taking advantage of mature image compression system in small satellites, the proposed method provides a good possibility of on-board cloud detection based on deep learning.

Segmentation of brain tumor images is a major research topic in medical imaging to have a refined detection and understanding of abnormal masses in the brain. This paper proposes a new segmentation method, consisting of three main steps, to detect brain lesions using magnetic resonance imaging (MRI). In the first step, the parts of the image delineating the skull bone are removed to exclude insignificant data. In the second step, which is the main contribution of this study, the particle swarm optimization (PSO) technique is applied to detect the block that contains the brain lesions. The fitness function, used to determine the best block among all candidate blocks, is based on a two-way fixed-effects analysis of variance (ANOVA). In the last step of the algorithm, the K-means segmentation method is used in the lesion block to classify it as tumor or not. A thorough evaluation of the proposed algorithm is performed using the MRI database provided by the Kouba imaging center in Algiers, Algeria. Estimates of the selected fitness function are first compared to those based on the sum-of-absolute-differences (SAD) dissimilarity criterion and demonstrate the efficiency and robustness of the ANOVA. The performance of the optimized brain tumor segmentation algorithm is then compared to the results of several state-of-the-art techniques, including fuzzy C-means, K-means, Otsu thresholding, local thresholding, and watershed segmentation. The results obtained using Dice coefficient, Jaccard distance, correlation coefficient, and root mean square error (RMSE) measurements demonstrate the superiority of the proposed optimized segmentation algorithm over equivalent techniques.

With the explosion of the generation, transmission and sharing of image data over the Internet and other unsecured networks, the need and significance for the development of novel image encryption algorithms is unprecedented. In this research work, we propose a novel framework for image encryption that is based on two hyperchaotic maps, utilized in conjunction with the single neuron model (SNM). The framework entails three successive stages, where in every stage, a substitution box (S-box) is applied, then XORing with an encryption key is carried out. The S-boxes and the encryption keys are generated from the numerical solutions of the hyperchaotic maps and the SNM. The performance of the proposed framework is gauged through a number of metrics, reflecting superior performance and complete asymmetry between the plain images and their encrypted versions. However, the main advantages of this work are: (1) The attained width of the key space; and (2) The achieved efficiency in software implementation. The superior key space of 2^{2551} is the result of employing the two hyperchaotic maps, while the improved efficiency, resulting in an average encryption rate of 8.54 Mbps, is the result of the utilization of the single neuron model, as well as the employment of optimized parallel processing techniques. In addition, the proposed encryption framework is shown to output encrypted images that pass the NIST SP 800 suite.

The paper describes the new method for image compression based on coordinated group signal transformation. The algorithm is a type of difference coding. Coordinated processing significantly simplifies the difference signal conversion scheme using a single group codec for all signals. The described method considers color channels as correlated signals of a multi-channel communication system. The specifics of the processed data required modification of the coordinated group processing algorithm. First, we changed how to calculate the difference signals to prevent data loss. Secondly, the group codec was supplemented with a neural network to improve the quality of reconstructed images. We considered the following types of neural networks: fully connected, recurrent, convolution, and convolution in the Fourier space. Based on the simulation results, it is best to use fully connected neural networks if the goal is to minimize processing delay time. These networks have a response time of 13 ms. On the other hand, if the priority is to improve quality in cases where delays are not critical, then convolution neural networks in the Fourier space should be used. These networks have a response time of 140 ms and are of significant interest.

Advancements in deep learning and availability of medical imaging data have led to use of CNN based architectures in disease diagnostic assisted systems. In spite of the abundant use of reverse transcription-polymerase chain reaction (RT-PCR) based tests in COVID-19 diagnosis, CT images offer an applicable supplement with its high sensitivity rates. Here, we study classification of COVID-19 pneumonia (CP) and non-COVID-19 pneumonia (NCP) in chest CT scans using efficient deep learning methods to be readily implemented by any hospital. We report our deep network framework design that encompasses Convolutional Neural Networks (CNNs) and bidirectional Long Short Term Memory (biLSTM) architectures. Our study achieved high specificity (CP: 98.3%, NCP: 96.2% Healthy: 89.3%) and high sensitivity (CP: 84.0%, NCP: 93.9% Healthy: 94.9%) in classifying COVID-19 pneumonia, non-COVID-19 pneumonia and healthy patients. Next, we provide visual explanations for the CNN predictions with gradient-weighted class activation mapping (Grad-CAM). The results provided a model explainability by showing that Ground Glass Opacities (GGO), indicators of COVID-19 pneumonia disease, were captured by our CNN network. Finally, we have implemented our approach in three hospitals proving its compatibility and efficiency.

Advanced image processing will be crucial for emerging technologies such as autonomous driving, where the requirement to quickly recognize and classify objects under rapidly changing, poor visibility environments in real time will be needed. Photonic technologies will be key for next-generation signal and information processing, due to their wide bandwidths of 10’s of Terahertz and versatility. Here, we demonstrate broadband real time analog image and video processing with an ultrahigh bandwidth photonic processor that is highly versatile and reconfigurable. It is capable of massively parallel processing over 10,000 video signals simultaneously in real time, performing key functions needed for object recognition, such as edge enhancement and detection. Our system, based on a soliton crystal Kerr optical micro-comb with a 49GHz spacing with >90 wavelengths in the C-band, is highly versatile, performing different functions without changing the physical hardware. These results highlight the potential for photonic processing based on Kerr microcombs for chip-scale fully programmable high-speed real time video processing for next generation technologies.

This paper presents novel feature descriptors and classification algorithms for automated scoring of HER2 in Whole Slide Images (WSI) of breast cancer histology slides. Since a large amount of processing is involved in analyzing WSI images, the primary design goal has been to keep the computational complexity to the minimum possible level and to use simple, yet robust feature descriptors that can provide accurate classification of the slides. We propose two types of feature descriptors that encode important information about staining patterns and the percentage of staining present in ImmunoHistoChemistry (IHC) stained slides. The first descriptor is called a characteristic curve which is a smooth non-increasing curve that represents the variation of percentage of staining with saturation levels. The second new descriptor introduced in this paper is an LBP feature curve which is also a non-increasing smooth curve that represents the local texture of the staining patterns. Both descriptors show excellent interclass variance and intraclass correlation, and are suitable for the design of automatic HER2 classification algorithms. This paper gives the detailed theoretical aspects of the feature descriptors and also provides experimental results and comparative analysis.

In research applications across several areas, noise removal is indispensable for accuracy of final results. Noise is caused due to physical principals, such as background electronic noise, quantum effect, and wave rebound effect to name a few. Noise removal can help improve results in medical, astronomy, defense, and numerous other fields. Addressing this limitation would result in potentially low cost, automatic, and reliable systems. In this paper, a generalized new approach i.e. Multi-Frame Noise Removal (MFNR) is proposed for noise removal. Given any type of data, the probability density function (PDF) of the noise can be determined. Herein, we extracted the noise PDF parameters using KDE (Kernel Density Estimation). Because the data is corrupted by “deterministic” noise, hence can be cleaned. This could be used as a general purpose noise removal tool. The data point with same position in multiple frames helps us determine the noise PDF characteristics and hence making it possible to remove noise. The conventional wisdom which states that noise removal and detail preservation are contrary to each other is not true for MFNR. Experimental results validate our proposed method which showed practically complete noise reduction based on number of frames used, as compared to existing benchmark methods.

Mindful Eating (ME) is an increasingly popular dietary practice that may mediate the sympto-matology of Eating Disorders (EDs). Orthorexia Nervosa (ON) is a recently proposed eating dis-order characterized by excessive concern for healthy eating and calorie control. The purpose of this study is to investigate the relationship between ME and Psychological Distress (PD) with EDs and ON. In a cross-sectional study involving 407 adults, this research explored the interplay between ME, PD, and EDs, notably ON. Utilizing validated scales for ME (MES-16), EDs (EDE-QS), ON (ORTO-R), and PD, subcategorized in depression, anxiety, and stress (DASS-21), alongside inquiries into Instagram usage, significant correlations emerged. ME demonstrated a robust negative asso-ciation with both EDE-QS (r=-0.501, p<0.001) and ORTO-R (r=-0.519, p<0.001), while EDE-Q and ORTO-R showed significant correlations with depression, anxiety, and stress (p<0.001). Variations in ORTO-R mean scores were notably distinct across different ME categories (p<0.001), emphasizing the relationship between ME and ON. Additionally, participants with extensive daily Instagram use displayed significantly higher ON scores compared to minimal users (p<0.05). These findings sug-gest a negative link between ME with EDs and ON, highlighting ME's potential role in reducing ON tendencies. Furthermore, Instagram use seems associated with PD and elevated ON levels.

The color and NIR spectrum are key to build an oil estimation model, thus it requires individual olives clustering before the Sohlext oil extraction method can be applied. The objective was to analyze an OC estimation model of individual olives, based on cluster of similar color and NIR spectrum in different combination of the first and/or the second season. This study was performed with Chilean Arbequina olives in 2016 and 2017. The descriptor of the cluster consisted of the 3 color channels of c1, c2, c3 color model plus 11 reflectance points between 1710 and 1735 nm of each olive, normalized with the Z-score index. Clusters of similar color and NIR spectrum were formed with the k-means++ algorithm, leaving a sufficient amount of olives to be able to perform the Sohlext analysis of OC, as reference value. The estimation models were based on the Support Vector Machine. The test was carried out with the Leave One-Out Cross Validation in different training-testing combinations. The best model predicted the OC with 6% and 13%deviation respect to the real value in one season by itself and when one season tested with another season, respectively. The use of clustering in estimation model is discussed.

Victor Vasarely’s (1906-1997) important legacy to the study of human perception is brought to the forefront and discussed. A large part of his impressive work conveys the appearance of striking three-dimensional shapes and structures in a large-scale pictorial plane. Current perception science explains such effects by invoking brain mechanisms for the processing of monocular (2D) depth cues. Here in this study, we illustrate and explain the local effects of 2D color and contrast cues on the perceptual organization in terms of figure-ground assignments, i.e. which local surfaces are likely to be seen as “nearer” or “bigger” in the image plane. Paired configurations are embedded in a larger, structurally ambivalent pictorial context inspired by some of Vasarely’s creations. The figure-ground effects these configurations produce reveal a significant correlation between perceptual solutions for “nearer” and “bigger” when no other monocular depth cues are given in the image. In consistency with previous findings on similar, albeit simpler visual displays, a specific color may compete with luminance contrast in resolving the planar ambiguity of a complex pattern context. Vasarely intuitively understood, and successfully exploited, this kind of subtle context effect in his art, well before empirical investigations had set out to study and explain their genesis in terms of information processing by the visual brain.

Global food security for the increasing world population not only requires increased sustainable production of food but a significant reduction in pre- and post-harvest waste. The timing of when a fruit is harvested is critical for reducing waste along the supply chain and increasing fruit quality for consumers. The early in field assessment of fruit ripeness and prediction of the harvest date and yield by non-destructive technologies have the potential to revolutionize farming practices and enable the consumer to eat the tastiest and freshest fruit possible. A variety of non-destructive techniques have been applied to estimate the ripeness or maturity but not all of them are applicable for in situ (field or glasshouse) assessment. This review focuses on the non-destructive methods which are promising, or have already been, applied to the pre-harvest in field measurement including colorimetry, visible imaging, spectroscopy and spectroscopic imaging. Machine learning and regression models used in assessing ripeness are also discussed.

Shape of supracondylar fracture of the humeral of pediatric patients is analysed with Procrustes method. XR–images of fractures are considered both in anterio-posterior (AP) view (66 images) and in a lateral (L) view (24 images). Applying Procrustes method for both views mean images are constructed and compared. Variability of shapes is quantified with a shape principal component analysis. Non-parametric tests (permutational and bootstrap) do not indicate statistical difference between Procrustes mean shapes in anterio-posterior and lateral projections. It is shown, however, that AP and L shapes of humeral fractures differ in their variability quantified by shape principal components.

Research on early stages of corrosion of steel bars, together with the formation and development of cracks induced in the surrounding concrete and caused by chloride penetration, is relevant in improving the durability of reinforced concrete structures. This paper uses integration of the analytical models examined in the published literature, combined with experimental research in corrosion induced at the concrete/steel interface, in estimating the time-to-crack initiation of reinforced concrete subjected to corrosion. This work studies the influence of the porous network and electric current density on the cracking process at early ages. The experimental campaign was performed by using an accelerated corrosion test on a conventional concrete (CC) and a concrete with silica fume (SFC) by submitting them to a current density of 50μA/cm² and 100μA/cm². Examination performed by scanning electron microscopy (SEM) and energy-dispersive X-ray spectroscopy (EDS) provided both qualitative and quantitative information on the penetration of the rust layer in the surrounding concrete porous network. Strain gauges were used to measure corrosion-induced deformations between steel and concrete matrices, as well as the formation of corrosion-induced cracks. A good correlation between the rate of penetration of the rust products in the surrounding pores and the delay of the cracking pressure in concrete was observed from the experimental results. This phenomenon is incorporated into the analytical model by using a reduction factor, which mainly depends on the pore size of the concrete. The crack width obtained exhibited a significant dependency on electric current density at the beginning of the test, depending mainly on the pore size of the concrete later.

Endoscopic medical images can suffer from uneven illumination, low contrast, and lack of texture information due to the use of point directional light sources and the presence of narrow tissue structures, posing diagnostic difficulties for physicians. In this paper, a deep learning-based su-pervised illumination enhancement network is designed for low-light endoscopic images, aiming to improve both global illumination and local details. Initially, a global illumination enhancement module is formulated utilizing a higher-order curve function to improve global illumination. Sec-ondly, a local feature extraction module incorporating dual attention is designed to capture local detailed features. Considering the significance of color fidelity in biomedical scenarios, the designed loss function prioritizes introducing color loss to alleviate image color distortion. Compared with seven state-of-the-art enhancement algorithms on Endo4IE endoscopic datasets, experimental re-sults show that the proposed method can better enhance low-light endoscopic images and avoid image color distortion. It provides an efficient method to enhance images captured by endoscopes which can effectively assist clinical diagnosis and treatment.

Near Earth Asteroids represent potential threats to human life because their trajectories may bring them in the proximity of the Earth. Monitoring these objects could help predict future impact events, but such efforts are hindered by the large numbers of objects that pass through the Earth’s vicinity. Additionally, there is also the problem of distinguishing asteroids from other objects in the night sky, which implies sifting through large sets of telescope image data. Within this context, we believe that employing machine learning techniques could greatly improve the detection process by sorting out the most likely asteroid candidates to be reviewed by human experts. At the moment, the use of machine learning techniques is still limited in the field of astronomy and the main goal of the present paper is to study the effectiveness of deep CNNs for the classification of astronomical objects, asteroids in this particular case, by comparing some of the well-known deep convolutional neural networks, including InceptionV3, Xception, InceptionResNetV2 and ResNet152V2. We have applied transfer learning and fine-tuning on these pre-existing deep convolutional networks and from the results that we have obtained one can see the potential of using deep convolutional neural networks in the process of asteroid classification. The InceptionV3 model has the best results in the asteroid class, meaning that by using it, we loose the least number of valid asteroids.

Spectrometers have a wide range of applications ranging from optical to non-optical spectroscopy. The need for compact, portable, and user-friendly spectrometers has been the pivot of attention from small laboratories to the industrial scale. Here, the Czerny Turner configuration-based optical spectrometer simulation design is carried out using ZEMAX OpticStudio. A compact and low-cost optical spectrometer in the visible range has been developed by using diffraction grating as a dispersive element and USB-type WebCAM CCD (Charge-coupled device) as a detector instead of an expensive commercial diffraction grating and detector. Using National Instruments LabVIEW, data acquisition, processing, and displaying techniques are made possible. We have employed different virtual images in LabVIEW programs to collect the pixel-to-pixel information and wavelength-intensity information from the image captured using the WebCAM CCD. Finally, we have shown that the OpticStudio-based spectrometer and experimental measurements of the developed spectrometer are in good agreement.

For Visually impaired People (VIPs), the ability to convert text to sound can mean a new level of independence or the simple joy of a good book. With significant advances in Optical Character Recognition (OCR) in recent years, a number of reading aids are appearing on the market. These reading aids convert images captured by a camera to text which can then be read aloud. However, all of these reading aids suffer from a key issue – the user must be able to visually target the text and capture an image of sufficient quality for the OCR algorithm to function – no small task for VIPs. In this work, a Sound-Emitting Document Image Quality Assessment metric (SEDIQA) is proposed which allows the user to hear the quality of the text image and automatically captures the best image for OCR accuracy. This work also includes testing of OCR performance against image degradations, to identify the most significant contributors to accuracy reduction. The proposed No-Reference Image Quality Assessor (NR-IQA) is validated alongside established NR-IQAs and this work includes insights into the performance of these NR-IQAs on document images.

Electron Beam Melting (EBM) is an increasingly used Additive Manufacturing (AM) technique employed by many industrial sectors, including the medical device and aerospace industries. In EBM process monitoring, data analysis for processed layer quality evaluation is currently focused on the extraction of information from the raw data collected in-EBM process, i.e. thermal/ optical / electronic images, and the comparison between the collected data and the Computed Tomography (CT)/ microscopy images generated post-EBM process. This article postulates that a stack of bitmaps could be generated from the 3D model at a range of Z heights during file preparation of the EBM process, and serve as a reference image set. In-EBM process comparison between that and the workpiece images collected during the EBM process could then be used for quality assessment purposes. In addition, despite the extensive literature on 3D model slicing and contour generation for AM process preparation, no methods regarding image generation from cross sections of the 3D models have been disseminated in details. This article aims to address this by presenting a piece of 3D model-image generation software. The software is capable of generating binary 3D model reference images with user-defined Region-of-Interest (ROI) of the processing area, and Z heights of the model. It is envisaged that this 3D model-reference image generation ability opens up new opportunities in quality assessment for the in-process monitoring of the EBM process.

CNN-based off-the-shelf features have shown themselves as a good baseline for trademark retrieval. However, in recent years, the computer vision area was transitioning from CNNs to a new architecture – Vision Transformer. In this paper, we investigate the performance of off-the-shelf features extracted with vision transformers and explore the effects of pre, post-processing, and pre-training on big datasets. We propose a method of joint usage of global and local features, which leverages the best aspects of both approaches. Experimental results on METU Trademark Dataset show that off-the-shelf features extracted with ViT-based models outperform off-the-shelf features from CNN-based models. The proposed method achieves the mAP value of 31.23, surpassing previous state-of-the-art results. We assume that the proposed approach for the trademark similarity evaluation will allow one to improve the protection of such data with the help of artificial intelligence methods. Moreover, this approach will allow one to identify cases of unfair use of such data and form an evidence base for litigation.

A lensless camera is an ultra-thin computational-imaging system. Existing lensless cameras are based on the axial arrangement of an image sensor and a coding mask, and therefore, the back side of the image sensor cannot be captured. In this paper, we propose a lensless camera with a novel design that can capture the front and back sides simultaneously. The proposed camera is composed of multiple coded image sensors, which are complementary-metal-oxide-semiconductor~(CMOS) image sensors in which air holes are randomly made at some pixels by drilling processing. When the sensors are placed facing each other, the object-side sensor works as a coding mask and the other works as a sparsified image sensor. The captured image is a sparse coded image, which can be decoded computationally by using compressive-sensing-based image reconstruction. We verified the feasibility of the proposed lensless camera by simulations and experiments. The proposed thin lensless camera realizes super field-of-view imaging without lenses or coding masks, and therefore can be used for rich information sensing in confined spaces. This work also suggests a new direction in the design of CMOS image sensors in the era of computational imaging.

This paper presents a robust method based on graph topology to find the topologically correct and consistent subset of inter-robot relative pose measurements for multi-robot map fusion. However, the absence of good prior gives a severe challenge to distinguish the inliers and outliers, and wrong loop closures can seriously corrupt the fused global map. Existing works mainly rely on the consistency of spatial dimension to select inter-robot measurements, which does not always hold. In this paper, we propose a fast inter-robot loop closure selection method that integrates the consistency and topology relationship of measurements, which both conform to the continuity characteristics of similar scenes and spatiotemporal consistency. The traditional high-dimensional consistency matrix is decomposed into the sub-matrix blocks corresponding to the overlapping trajectory area. Building on this logic, a clustering method involving topology correctness of inter-robot loop closures is introduced to split the entire measurement set into multiple clusters. We define the weight function to find the maximum cardinality subset with topologically correct and consistent, then convert the weight function to a maximum clique problem in the graph and solve it. We evaluate the performance of our method in a simulation and in a real-world experiment. Compared to state-of-the-art methods, the results show that our method can achieve competitive performance in accuracy while reducing computation time by 75%.

Skin image analysis using artificial intelligence (AI) has recently attracted significant research interest, particularly for analyzing skin images captured by mobile devices. Acne is one of the most common skin conditions with profound effects in severe cases. In this study, we developed an AI system called AcneDet for automatic acne object detection and acne severity grading using facial images captured by smartphones. AcneDet includes two models for conducting two tasks: (1) a Faster R-CNN-based deep learning model for the detection of acne lesion objects of four types including blackheads/whiteheads, papules/pustules, nodules/cysts, and acne scars; and (2) a LightGBM machine learning model for grading acne severity using the Investigator’s Global Assessment (IGA) scale. The output of the Faster R-CNN model, i.e., the counts of each acne type, were used as input for the LightGBM model for acne severity grading. A dataset consisting of 1,572 labeled facial images captured by both iOS and Android smartphones was used for training. The results show that the Faster R-CNN model achieves a mAP of 0.54 for acne object detection. The mean accuracy of acne severity grading by the LightGBM model is 0.85. With this study, we hope to contribute to the development of artificial intelligent systems that are able to help acne patients understand more about their conditions and support doctors in acne diagnosis.

Although neural network architectures are critical for their performance, how the structural characteristics of a neural network affect its performance has still not been fully explored. We here map architectures of neural network to directed acyclic graphs, and find that incoherence, a structural characteristic to measure the order of directed acyclic graphs, is a good indicator for the performance of corresponding neural networks. Therefore we propose a deep isotropic neural network architecture by folding a chain of same blocks then connecting the blocks with skip connections at different distances. Our models, named FoldNet, have two distinguishing features compared with traditional residual neural netowrks. First, the distances between block pairs connected by skip connections increase from always equal to one to specially selected different values, which lead to more incoherent graphs and let the neural network explore larger receptive fields and thus enhance its multi-scale representation ability. Second, the number of direct paths increases from one to multiple, which leads to a larger proportion of shorter paths and thus improve the direct propagation of information throughout the entire network. Image classification results on CIFAR-10 and Tiny ImageNet benchmarks suggested that our new network architecture performs better than traditional residual neural networks.

Background: Zebrafish (Danio rerio) is a model organism emerged for the study of human cancer. Compared with the murine model, the zebrafish model has several properties ideal for personalized therapies. The transparency of the zebrafish embryos and the development of the pigment-deficient “casper” zebrafish line give the capacity to directly observe cancer formation and progression in the living animal. Automatic quantification of cellular proliferation in vivo is critical to the development of personalized medicine. Methods: A new methodology was defined to automatically quantify the cancer cellular evolution. ZFTool was developed to establish a base threshold that eliminates the embryo auto-fluorescence and automatically measures the area and intensity of GFP (green-fluorescent protein) marked cells and define a proliferation index. Results: Proliferation index automatically computed on different targets demonstrates the efficiency of ZFTool to provide a good automatic quantification of cancer cell evolution and dissemination. Conclusion: Our results demonstrate that ZFTool is a reliable tool for the automatic quantification of the proliferation index, being a measure of cancer mass evolution in zebrafish eliminating the influence of its autofluorescence.

Li-ion cell designs, component integrity and manufacturing processes all have critical influence on the safety of Li-ion batteries. Any internal defective features that induce a short circuit, can trigger a thermal runaway: a cascade of reactions, leading to a device fire. As consumer device manufacturers push aggressively for increased battery energy, instances of field failure are increasingly reported. Notably Samsung made a press release in 2017 following a total product recall of their Galaxy Note 7 mobile phone, confirming speculation that the events were attributable to the battery and its mode of manufacture. Recent incidences of battery swelling on the new iPhone 8 have been reported in the media, and the techniques and lessons reported herein may have future relevance. Here we look deeper into the key components of one of these cells and confirm evidence of cracking of electrode material in tightly folded areas, combined with a delamination of surface coating on the separator, which itself is an unusually thin monolayer. We report microstructural information about the electrodes, battery welding attributes and thermal mapping of the battery whilst operational. The findings point to the most likely combination of events and highlights the impact of design features, whilst providing structural considerations most likely to have led to the reported incidences relating to this phone.

This study examines how the design of museum archaeological boxes and the overall museum image affect behavioral intention. This research used partial least squares-structural equation modeling, indicating a relationship between aesthetics, symbolism, affective museum image, perceived value, and behavioral intention. This study found that symbolism predicted behavioral intention. Moreover, aesthetics, symbolism, and affective museum image affected perceived value, in turn triggering behavioral intention. This indicates theoretical and practical implications for museum products.

We propose an algorithm for generating a panoramic image of a pipe’s inner surface based on inverse perspective mapping (IPM). For efficient crack detection, we used only perspective images of the pipe interior that can be obtained with a single lens camera instead of those taken with a 360-degree camera or a 3D depth camera. Frontal images taken while passing through the pipe were converted to images of the inner surface of the pipe using IPM. We derived a generalized IPM formula that considers the slope of the image plane to correct image distortion caused by the tilt of the plane; this IPM formula was derived based on the vanishing point of the perspective image, which was detected using optical flow techniques. Finally, the multiple transformed images with overlapping areas were combined via image stitching to create a panoramic image of the inner pipe surface. To validate our proposed algorithm, we restored images of pipe inner surface using a 3D pipe model and used these images for crack detection.

In-depth insights into the profound impacts of climate change and human activities on water resources are garnered through the dynamic changes in surface water, a crucial aspect of effective water resource management and the preservation of aquatic ecosystems. This paper introduces an innovative approach employing the random forest algorithm for the systematic extraction and monitoring of surface water at large regional or national scales. This method integrates spectral bands, spectral indices, and digital elevation model data, offering a novel perspective on this critical task. A data filling model is proposed to mitigate the impact of missing data due to cloud cover. Leveraging the capabilities of the Google Earth Engine (GEE), detailed information on surface water dynamics during the rainy and dry seasons in the Yangtze River Basin (YRB) from 1991 to 2021 is extracted using Landsat time series imagery. The analysis encompasses spatial-temporal variation characteristics and trends, with a specific focus on the intricate interplay between the areal extent of surface water and hydro-meteorological factors in each sub-basin of the YRB. Importantly, this includes considerations of potential groundwater contributions to surface water. Key findings from our research include: (1) Achieving a remarkable overall accuracy of 0.96 ± 0.03 in obtaining reliable surface water datasets with the support of GEE. (2) Identifying significant trends, such as a noteworthy increase in rainy season surface water bodies (+248.0 km2·yr−1) and a concerning decrease in surface ice/snow cover during both rainy and dry seasons, with change rates of −39.7 km2·yr−1 and −651.3 km2·yr−1, respectively. (3) Uncovering the driving mechanisms behind these changes, revealing positive correlations between the areal extent of rainy season surface water bodies and precipitation, as well as negative correlations between surface ice/snow cover area and average surface skin temperature. It is crucial to note that these driving factors exhibit variation among secondary river systems, underscoring the complexity of surface water dynamics. Furthermore, comparative analyses with existing surface water products are conducted, contributing to a deeper understanding of the advantages and uncertainties inherent in our proposed extraction method. The proposed method for large-scale surface water extraction not only enhances the monitoring of spatio-temporal surface water dynamics in the YRB but also provides valuable insights for the sustainable utilization and protection of water resources, considering the potential role of groundwater in supplementing surface water.

Particle acceleration, and the thermalisation of energetic particles, are fundamental processes across the universe. Whilst the Sun is an excellent object to study this phenomenon, since it is the most energetic particle accelerator in the Solar System, this phenomenon arises in many other astrophysical objects, such as active galactic nuclei, black holes, neutron stars, gamma ray bursts, solar and stellar coronae, accretion disks and planetary magnetospheres. Observations in the Extreme Ultraviolet (EUV) are essential for these studies but can only be made from space. Current spectrographs operating in the EUV use an entrance slit and cover the required field of view using a scanning mechanism. This results in a relatively slow image cadence on the order of minutes to capture inherently rapid and transient processes, and/or in the spectrograph slit `missing the action'. The application of image slicers for EUV integral field spectrographs is therefore revolutionary. The development of this technology will enable observations of EUV spectra from an entire 2D field of view in seconds, over two orders of magnitude faster than what is currently possible. The Spectral Imaging of the Solar Atmosphere (SISA) instrument is the first integral field spectrograph proposed for observations at 180A combining the image slicer technology and curved diffraction gratings in a highly efficient and compact layout, while providing important spectroscopic diagnostics for characterization of solar coronal and flare plasmas. SISA's characteristics, main challenges and the on-going activities to enable the image slicer technology for EUV applications are presented in this paper.

In order to realize rapid and nondestructive monitoring of wheat biomass in field, field experiments based on different densities, nitrogen fertilizer and variety treatments were studied. RGB images of wheat in the main growth stage were obtained by UAV, and wheat color and texture feature indices were obtained by image processing, and wheat biomass was obtained by field sampling in the same period. Then the relationship between different color and texture feature indices and wheat biomass was analyzed to select the color and texture feature index suitable for wheat biomass estimation. The results showed that there was a high correlation between image color index and wheat biomass in different stages, and most of them reached a very significant correlation level. However, the correlation between image texture feature index and wheat biomass was poor, only a few indexes reached significant or extremely significant correlation level. Based on the above results, the color indices with the highest correlation to wheat biomass or the combining indices of color and texture feature in different growth stage were used to construct estimation model of wheat biomass. The models were validated using independently measured biomass data, and the correlation between simulated and measured values reached the significant level, RMSE were smaller. This indicated that the estimated results by the models were reliable and accurate. It also showed that the estimation models of wheat biomass combined with color and texture feature indices of UAV image were better than the single color index models. The results would provide a new method for real-time monitoring of wheat field growth and biomass estimation.

Thermal infrared imagery provides temperature information on target objects, and has been widely applied in non-destructive testing. However, thermal infrared imagery is not always able to display detailed textures of inspected objects, which hampers the understanding of geometric entities consisting of temperature information. Although some commercial software has been developed for 3D thermal model displays, the software requires the use of expensive specific thermal infrared sensors. This study proposes a cost-effective method for 3D thermal model reconstruction based on image-based modeling. Two smart phones and a low-cost thermal infrared camera are employed to acquire visible images and thermal images, respectively, that are fused for 3D thermal model reconstruction. The experiment results demonstrate that the proposed method is able to effectively reconstruct a 3D thermal model which extremely approximates its corresponding entity. The total computation time for the 3D thermal model reconstruction is intensive while generating dense points required for the creation of a geometric entity. Future work will improve the efficiency of the proposed method in order to expand its potential applications to in-time monitoring.

Over the years, artificial intelligence (AI) is spreading its roots in different areas by utilizing the concept of making the computers learn and handle complex tasks that previously require substantial laborious tasks by human beings. With better accuracy and speed, AI is helping lawyers to streamline work processing. New legal AI software tools like Catalyst, Ross intelligence, and Matlab along with natural language processing provide effective quarrel resolution, better legal clearness, and superior admittance to justice and fresh challenges to conventional law firms providing legal services using leveraged cohort correlate model. This paper discusses current applications of legal AI and suggests deep learning and machine learning techniques that can be applied in future to simplify the cumbersome legal tasks.

Precipitation processes are technologies commonly used in hydrometallurgical plants to recover metals or to treat wastewaters. Moreover, solid-liquid separation technologies, such as thickening or filtering, are relevant unit operations, included in the precipitation technologies. These methods are strongly dependent on the characteristics of the solid precipitates formed during the specific precipitation reaction. One of these characteristics is the particle size distribution (PSD) of the solid precipitates which are fed into a solid-liquid separation process. Therefore, PSD determination is a typical practice for the characterization of the slurries generated in a precipitation plant. Furthermore, the precipitates generated in these processes have a colloidal or aggregation behavior, depending on the operational conditions. Nevertheless, the conventional methods used to estimate PSD (e.g., laser diffraction and/or ciclosizer) have not been designed to measure particles that tend to aggregate or disaggregate, since they include external forces (e.g., centrifugal, agitation, pumping and sonication). These forces affect the true size of the aggregates formed in a unit operation, thereby losing representativity in terms of aggregates particle size. This study presents an alternative method of measuring the size distribution of particles with aggregation behavior, particularly, by using non-invasive microscopy and image processing and analysis. The samples used have been obtained from an experimental precipitation process by applying sulfidization to treat the cyanide-copper complexes contained in a cyanidation solution. This method has been validated with statistical tools and compared with a conventional analysis based on laser diffraction. Our results show significant differences between the methods analyzed, demonstrating that image processing and analysis by microscopy is an excellent and non-invasive alternative to obtaining size distribution of aggregates in precipitation processes.

In recent years, significant advancements in the field of machine learning have influenced the domain of image restoration. While these technological advancements present prospects for improving the quality of images, they also present difficulties, particularly the proliferation of manipulated or counterfeit multimedia information on the internet. The objective of this paper is to provide a comprehensive review of existing inpainting algorithms and forgery detections, with a specific emphasis on techniques that are designed for the purpose of removing objects from digital images. In this study, we will examine various techniques encompassing conventional texture synthesis methods, as well as those based on neural networks. Furthermore, we will explore the artifacts associated with the identification of modified photos and present the artifacts frequently introduced by the inpainting procedure and assess the state-of-the-art technology for detecting such modifications. Lastly, we shall look at the available datasets and how the methods compare with each other. Having covered all of the above, the final outcome of this study is to provide a comprehensive perspective on the abilities and constraints to detect images for which an inpainting object removal method was applied.

The study focuses on the crucial aspect of lossless compression for FAST pulsar search data. The deep generative model PixelCNN, stacking multiple masked convolutional layers, achieves neural network autoregressive modeling, making it one of the most excellent image density estimators. However, the local nature of convolutional networks causes PixelCNN to concentrate only on nearby information, neglecting important information at greater distances. Although deepening the network can broaden the receptive field, excessive depth can compromise model stability, leading to issues like gradient degradation. To address these challenges, the study combines causal attention modules with residual connections, proposing the Causal Residual Attention Module to enhance the PixelCNN model. This innovation not only resolves convergence problems arising from network deepening but also widens the receptive field. It effectively utilizes global features, particularly capturing vertically correlated features prominently present in subgraphs of candidates. This significantly enhances its capability to model pulsar data.In the experiments, the model is trained and validated using the HTRU1 dataset. The study compares the average negative log-likelihood score with baseline models like GMM, STM, and PixelCNN. The results demonstrate the superior performance of the our model over other models. Finally, the study introduces the practical compression encoding process by combining the proposed model with arithmetic coding.

In this study, we explore the potential of using a straightforward neural network inspired by the retina model to efficiently restore low-light images. The retina model imitates the neurophysiological principles and dynamics of various optical neurons. Our proposed neural network model reduces the computational overhead compared to traditional signal-processing models while achieving results similar to complex deep learning models from a subjective perceptual perspective. By directly simulating retinal neuron functionalities with neural networks, we not only avoid manual parameter optimization but also lay the groundwork for constructing artificial versions of specific neurobiological organizations.

Video editing is a high-required job, for it requires skilled artists or workers equipped with plentiful physical strength and multidisciplinary knowledge, such as cinematography, aesthetics. Thus gradually, more and more researches focus on proposing semi-automatical and even fully automatical solutions to reduce workloads. Since those conventional methods are usually designed to follow some simple guidelines, they lack flexibility and capability to learn complex ones. Fortunately, the advances of computer vision and machine learning make up the shortages of traditional approaches and make AI editing feasible. There is no survey to conclude those emerging researches yet. This paper summaries the development history of automatic video editing, and especially the applications of AI in partial and full workflows. We emphasizes video editing and discuss related works from multiple aspects: modality, type of input videos, methology, optimization, dataset, and evaluation metric. Besides, we also summarize the progresses in image editing domain, i.e., style transferring, retargeting, and colorization, and seek for the possibility to transfer those techniques to video domain. Finally, we give a brief conclusion about this survey and explore some open problems.

Microscopes based on dielectric mesoscale particles, using the effect of a photonic jet or terajet in the terahertz range, are a promising tool for overcoming the diffraction limit. However, the image they generate has limited contrast, which limits the application of this method. In this letter, we demonstrate that it is possible to increase the contrast of an image based on dielectric mesoscale particles that provide the formation of photonic hooks. In this case, the illumination of the object is carried out by an oblique incidence of subwavelength terajet, which significantly (more than 2 times) increases the contrast of the image.

The genetic development of commercial broiler led to body misconfiguration and consequent walking disabilities, mainly at the slaughter age. The present study aimed to identify broiler locomotion ability using image analysis automatically. A total of 40 broiler 40 d-old were placed to walk on a specially built runway, and their locomotion was recorded. An image segmentation algorithm was developed, and the coordinates of the bird's center of mass were extracted from the segmented images for each frame analyzed, and the Unrest Index (UI) was applied. We calculated the center of mass's movement of the broiler walking's lateral images, therefore, capturing the bird's displacement speed in the onward direction. Results indicated that broiler speed on the runway tends to decrease with the increase of the gait score. The locomotion did not differ between males or females. The proposed algorithm was efficient if predicting the broiler gait score based on their displacement speed.

Online social networking techniques and large-scale multimedia retrieval are developing rapidly, which not only has brought great convenience to our daily life, but generated, collected, and stored large-scale multimedia data as well. This trend has put forward higher requirements and greater challenges on massive multimedia retrieval. In this paper, we investigate the problem of image similarity measurement, which is one of the key problems of multimedia retrieval. Firstly, the definition of similarity measurement of images and the related notions are proposed. Then, an efficient similarity measurement framework is proposed. Besides, we present a novel basic method of similarity measurement named SMIN. To improve the performance of similarity measurement, we carefully design a novel indexing structure called SMI Temp Index (SMII for short). Moreover, we establish an index of potential similar visual words off-line to solve to problem that the index cannot be reused. Experimental evaluations on two real image datasets demonstrate that the proposed approach outperforms state-of-the-arts.

Visible light photography diagnostic images are coloured ex vivo medical images popularly used in Dermatology and Endoscopy for diagnosis and monitoring. The need to protect the integrity of these images as well as associated patient data calls for techniques such as image steganography and watermarking. This research explores and compares the effect of watermarking on the YIQ and YCbCr colour transforms used in processing digital coloured images and video in recent times. Using a new spread spectrum watermarking algorithm, it was found that YIQ has better distortion performance than YCbCr in the order of 3dB while YCbCr had lower BER for accurate watermark retrieval and tamper detection in the order of 1.3 x 10-3.

This study was designed to assess the reliability of geographic information using satellite image information in ungauged basins. For this, this study constructed geographic information using actual gauged data and satellite information data and conducted runoff analysis through S-RAT, a rainfall–runoff model, and performed the comparison and analysis of geographic information and runoff data. For actual gauged data, the gauged geographic information of the Water Resources Management Information System (WAMIS) was collected, and for satellite information, the image information of moderate-resolution imaging spectroradiometer (MODIS) observation sensor loaded on Terra Satellite was collected. As analysis areas, three basins where mountains occupy more than 80% and another three basins where urban areas occupy more than 7% in the Han River basin were selected. According to the analysis result, the gauged information and satellite image information showed great difference in runoff, maximum 50% in peak flood and maximum 17% in total flood, in the rivers with many urban areas, while the runoff difference in the rivers with many mountains showed maximum 13% in peak flood and 4% in total flood. What showed the greatest difference in image information was land use, and it turned out that the MODIS satellite recognized the urban rivers as cities for more than maximum 60% compared to WAMIS-gauged data. Meanwhile, in the forest area, the MODIS satellite image showed error of less than 5% of the WAMIS-gauged data, which indicates that it has higher applicability in Mountain Rivers.

Aiming at the problems that are poor generalization performance, low retrieval accuracy and large time consumption of existing content-based image retrieval system, the hierarchical image retrieval method based on multi feature fusion is proposed in this paper. The retrieval accuracy rates on Corel5K, UKbeach and Holidays are 68.23(Top 1), 3.73(N-S) and 88.20(mAp), respectively. The experimental results show that the method proposed in this paper can effectively improve the deficiency of single feature retrieval and save time significantly in the premise of a small amount of loss of accuracy.

The structure of self-reinforced composites (SRCs) based on ultra-high molecular weight 21 polyethylene (UHMWPE) was studied by means of Wide-Angle X-Ray Scattering (WAXS), X-Ray 22 tomography, Raman spectroscopy, Scanning Electron Microscopy (SEM) and in situ tensile testing 23 in combination with advanced processing tools like Avizo, ImageJ, and Ncorr to determine the cor-24 relation between the processing conditions, on the one hand, and the molecular structure and 25 mechanical properties, on the other. SRCs were fabricated by hot compaction of UHMWPE fibers at 26 different pressure and temperature combinations without addition of polymer matrix or softener. 27 It was found by WAXS that higher compaction temperatures led to more extensive melting of 28 fibers with the corresponding reduction of the Herman’s factor reflecting the degree of molecular 29 orientation, while the increase of hot compaction pressure suppressed the melting of fibers within 30 SRCs at a given temperature. X-Ray tomography proved the absence of porosity while polarized 31 light Raman spectroscopy measurements for both longitudinal and perpendicular fiber orienta-32 tions showed qualitatively the anisotropy of SRC samples. SEM revealed that the matrix was 33 formed by interlayers of molten polymer entrapped between fibers in SRCs. Moreover, in situ 34 tensile tests demonstrated the increase of Young’s modulus and tensile strength with increasing 35 temperature.

Machine Learning has completely transformed health care system, which transmits medical data through IOT sensors. So it is very important to encrypt them to protect patient data. encrypting medical images from a performance perspective consumes time; hence the use of an auto encoder is essential. An auto encoder is used in this work to compress the image as a vector prior to the encryption process. The digital image passes across description function and a decoder to get back the image in the proposed work; various experiments are carried out on hyper parameters to achieve the highest outcome of the classification. The findings demonstrate that the combination of Mean Square Logarithmic Error as the loss function, ADA grad as an optimizer, two layers for the encoder, and another reverse for the decoder, RELU as the activation function generates the best auto encoder results. The combination of Mean square error (lose function), RMS prop (optimizer), three layers for the encoder and another reverse for the decoder, and RELU (activation function) has the best classification result. All the experiments with different hyper parameter has run almost very close to each other even when changing the number of layers. The running time is between 9 and 16 second for each epoch.

To improve the adaptability of aerial reflective opto-mechanical structures to low-temperature environments, an optimized thermal control design is proposed. Firstly, the relationship be-tween conventional heating methods and axial/radial temperature differences of mirrors with different shapes is analyzed. Based on heat transfer analyses, it is pointed out that optimized thermal control design is necessary to ensure the temperature uniformity of the fused silica mirror and take into account the temperature level when working in low temperature environ-ments. A thermal control scheme based on temperature negative feedback variable power zone heating is proposed for the characteristics of aerial electro-optics systems. Using the thermal control scheme at low temperatures ensures that the average temperature of the mirror fluctu-ates slowly and slightly around 20℃. At the same time, the temperature differences within a mirror and between the primary mirror and the secondary mirror can be controlled within 5℃. Thereby, satisfactory image quality is obtained.

The study of velocimetry is important for characterizing and comprehending the effects of fluid flow, and the Particle Image Velocimetry (PIV) technique is one of the primary approaches for understanding the velocity vector field in a test section. Commercial PIV systems are expensive, with one of the main cost factors being high-speed camera equipment capable of capturing images at high frames per second (fps), rendering them impractical for many applications. This study proposes an evaluation of utilizing smartphones as image acquisition systems for PIV technique application. An experimental setup inspired by the known angular displacement of synthetic particles is proposed. A stepper motor rotates a plate containing an image of synthetic particles on its surface. The motion of the plate is captured by the smartphone camera, and the images are processed using PIVlab-MatLab® software. The use of two smartphones is assessed, with acquisition rates of either 240 fps or 960 fps and varying angular velocities. The results were satisfactory for velocities up to 0.7 m/s at an acquisition rate of 240 fps and up to 1.8 m/s at 960 fps, validating the use of smartphones as a cost-effective alternative for the PIV technique.

This paper investigates existing mathematical morphology based techniques applied for performing malaria parasites detection and identification in both Giemsa and Leishman stained blood smears images. Malaria is an epidemic health disease and a rapid, accurate diagnosis is necessary for proper intervention. Generally, pathologists visually examine blood stained slides for malaria diagnosis; this kind of visual inspection is subjective, errorprone and time consuming. In order to cope with such issues, computer-aided methods have been increasingly evolved for abnormal erythrocyte and/or parasites detection, segmentation and semi/fully automated classification. The aim of this paper is to present a review of recent mathematical morphology based methods for malaria parasite detection.

This paper shows the results of applying high-resolution Unmanned Aircraft System (UAS) photogrammetric surveying on a large landslide. A real case study, where permanently installing GCPs could be complex, where natural shaped and formed land pose severe limitations in deploying ground targets with optimal geometric configuration. We analysed performances in terms of survey accuracy obtained by performing photogrammetric surveys through the Zenmuse P1 DJI optical camera and Phantom 4 Pro 2. In combination with DJI Matrice 300 UAS, the P1 camera allows direct georeferencing through GNSS observations in RTK mode. Photogrammetric surveys, performed through different georeferencing methods, have been compared. Several targets have been permanently installed on the ground over the maximum vegetation height to guarantee long-lasting reference over the years in the area, which is characterised by a diffuse short vegetation coverage. Multitemporal UAS surveys have been then compared using Digital Image Correlation (DIC) algorithms, and deformation maps have been produced. Afterwards, DIC results were compared with observations made by the GNSS ground-based permanent receivers resulting in a standard deviation of 0,077 m. Through results analysis, good accordance between ground-based GNSS observations and DIC analysis on the photogrammetric surveys have been identified for the same time span. To conclude, this type of landslide presents a moderate deformation speed; in such a case, effective deformations monitoring could be achieved using pseudo-direct georeferencing, which permitted a 0.24 m accuracy on the whole tested area.

Due to an increase in the number of image achieves, Content-Based Image Retrieval (CBIR) has gained attention for research community of computer vision. The image visual contents are represented in a feature space in the form of numerical values that is considered as a feature vector of image. Images belonging to different classes may contain the common visuals and shapes that can result in the closeness of computed feature space of two different images belonging to separate classes. Due to this reason, feature extraction and image representation is selected with appropriate features as it directly affects the performance of image retrieval system. The commonly used visual features are image spatial layout, color, texture and shape. Image feature space is combined to achieve the discriminating ability that is not possible to achieve when the features are used separately. Due to this reason, in this paper, we aim to explore the low-level feature combination that are based on color and shape features. We selected color moments and color histogram to represent color while shape is represented by using invariant moments. We selected this combination, as these features are reported intuitive, compact and robust for image representation. We evaluated the performance of our proposed research by using the Corel, Coil and Ground Truth (GT) image datasets. We evaluated the proposed low-level feature fusion by calculating the precision, recall and time required for feature extraction. The precision, recall and feature extraction values obtained from the proposed low-level feature fusion outperforms the existing research of CBIR.

Global Earth Observation (EO) is becoming increasingly important in understanding and addressing critical aspects of life on our planet about environmental issues, natural disasters, sustainable development and others. EO plays a key role in making informed decisions on applying or reforming land use, responding to disasters, shaping climate adaptation policies etc. EO is also becoming a useful tool for helping professionals make the most profitable decisions, e.g., in real estate or the investment sector. Finding similarities in landscapes may provide useful information regarding applying contiguous policies, taking alike decisions or learning from best practices on events and happenings that have already occurred in similar landscapes in the past. However, current applications of similar landscape retrieval are limited by moderate performance and the need for time-consuming and costly annotations. We propose splitting the similar landscape retrieval task into a set of smaller tasks that aim at identifying individual concepts inherent to satellite images. Our approach relies on several models trained with Unsupervised Representation Learning (URL) on Google Earth images to identify these concepts. We show the efficacy of matching individual concepts for tackling the task of retrieving similar landscape(s) to a user-selected satellite image with a proof-of-concept application of the proposed approach on the geographical territory of the Republic of Cyprus. Our results demonstrate the efficacy of breaking up the landscape similarity task into individual concepts closely related to remote sensing instead of trying to capture all concepts and image semantics with a single model like a single RGB semantics model.

In this study, we aimed to develop a deep learning model for identifying bacterial keratitis (BK) and fungal keratitis (FK) by using slit-lamp images. We retrospectively collected slit-lamp images of patients with culture-proven microbial keratitis between January 1, 2010, and December 31, 2019, from two medical centers in Taiwan. We constructed a deep learning algorithm, consisting of a segmentation model for cropping cornea images and a classification model that applies convolutional neural networks to differentiate between FK and BK. The model performance was evaluated and presented as the area under the curve (AUC) of the receiver operating characteristic curves. A gradient-weighted class activation mapping technique was used to plot the heatmap of the model. By using 1330 images from 580 patients, the deep learning algorithm achieved an average diagnostic accuracy of 80.00%. The diagnostic accuracy for BK ranged from 79.59% to 95.91% and that for FK ranged from 26.31% to 63.15%. DenseNet169 showed the best model performance, with an AUC of 0.78 for both BK and FK. The heat maps revealed that the model was able to identify the corneal infiltrations. The model showed better diagnostic accuracy than the previously reported diagnostic performance of both general ophthalmologists and corneal specialists.

Single-level Principal Components Analysis (PCA) and multi-level PCA (mPCA) methods are applied here to a set of (2D frontal) facial images from a group of 80 Finnish subjects (34 male; 46 female) with two different facial expressions (smiling and neutral) per subject. Inspection of eigenvalues gives insight into the importance of different factors affecting shapes, including: biological sex, facial expression (neutral versus smiling), and all other variations. Biological sex and facial expression are shown to be reflected in those components at appropriate levels of the mPCA model. Dynamic 3D shape data for all phases of a smile made up a second dataset sampled from 60 adult British subjects (31 male; 29 female). Modes of variation reflected the act of smiling at the correct level of the mPCA model. Seven phases of the dynamic smiles are identified: rest pre-smile, onset 1 (acceleration), onset 2 (deceleration), apex, offset 1 (acceleration), offset 2 (deceleration), and rest post-smile. A clear cycle is observed in standardized scores at an appropriate level for mPCA and in single-level PCA. mPCA can be used to study static shapes and images, as well as dynamic changes in shape. It gave us much insight into the question “what’s in a smile?”

In recent decades, the Variational AutoEncoder (VAE) model has shown good potential and capabilities in image generation and dimensionality reduction. The combination of VAE and various machine learning frameworks has also worked effectively in different daily life applications, however its possibility and effectiveness in modern game design has seldom been explored nor assessed. The use of its feature extractor for data clustering was minimally discussed in literature neither. This paper first attempts to explore different mathematical properties of the VAE model, in particular, the theoretical framework of the encoding and decoding processes, the possible achievable lower bound and loss functions of different applications; then applies the established VAE model into generating new game levels within two well-known game settings; as well as validating the effectiveness of its data clustering mechanism with the aid of the Modified National Institute of Standards and Technology (MNIST) database. Respective statistical metrics and assessments were also utilized for evaluating the performance of the proposed VAE model in aforementioned case studies. Based on the statistical and spatial results, several potential drawbacks and future enhancement of the established model were outlined, with the aim of maximizing the strengths and advantages of VAE for future game design tasks and relevant industrial missions.

This paper presents a novel dynamic camera parameter control method for position and posture estimation of highly miniaturized AR markers (micro AR markers) using a low cost general camera. The proposed method performs iterative calculation of the marker’s position and posture to converge them to specified accuracy with dynamically updating the camera’s zoom, focus and other parameter values based on the detected marker’s depth distances. For a 10 mm square micro AR marker, the proposed system demonstrated recognition accuracy of better than ±1.0% for depth distance and 2.5∘ for posture angle with a maximum recognition range of 1.0 m. In addition, the iterative calculation time was at most 0.7 seconds in an initial detection of the marker. These experimental results suggest that the proposed method and system can be applied to a robotic precise handling of small objects with low cost.

.Purpose: This paper presents a comparative analysis of state-of-the-art DIR algorithms in the context of head and neck squamous cell carcinoma (HNSCC) radiation therapy. Materials and Methods: We used a dataset of head and neck cancer patients within the Cancer Image Archive, which includes 31 patients with 3D CT image data from pre-treatment, mid-treatment, and post-treatment stages of radiotherapy. We applied DIR algorithms to two datasets, one for pre-treatment to mid-treatment registration and another for mid-treatment to post-treatment registration, by aligning one CT image to another CT image. To quantitatively analyze the patient data, we focused on the spinal cord, optic nerve, brain stem, cochlea, and PTV as the OAR datasets. To verify the DIR algorithm, we used two non-learning-based methods, SyN and NiftyReg, as well as three deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph. We trained a deep learning model by adjusting the ratio of the training dataset, validation dataset, and test dataset to 7:1:2. Results: The average DSCs of SyN and NiftyReg, the non-learning-based methods, were 0.74±0.06 and 0.70±0.12, respectively. The deep learning-based methods, Voxelmorph, Cyclemorph, and Transmorph, had average DSCs of 0.72±0.08, 0.68±0.11, and 0.69±0.13, respectively. The deep learning DIR algorithm produced transformed outputs of OAR/PTV in a shorter time than other models, including commercial and conventional mathematical algorithms (At Inference(sec/images), Voxelmorph: 0.36, Cyclemorph: 0.3, Transmorph: 5.1, SyN: 140, NiftyReg: 40.2). Conclusions: In conclusion, our study provides a comprehensive comparison of commercial DIR algorithms with traditional and deep learning-based DIR methods. Our results demonstrate that commercial DIR algorithms outperform traditional DIR methods in terms of accuracy and efficiency. However, we also show that deep learning-based DIR methods have the potential to achieve similar performance to commercial algorithms with proper training and optimization. Our findings suggest that both commercial and deep learning-based DIR methods have their respective advantages and limitations, and the choice of method should depend on the specific requirements of the clinical application. Overall, our study contributes to ongoing efforts to improve the accuracy and efficiency of DIR methods for better patient outcomes.

This paper presents a novel approach for semantic segmentation of building roof in dense urban environment with Deep Convolution Neural Network (DCNN) using imagery acquired by a Chinese Very High Resolution (VHR) satellite mission, i.e. GaoFen-2 (GF-2). To provide an operational end-to-end work flow for accurate build roof mapping with feature extraction as well as image segmentation, a fully convolutional DCNN with both convolutional and deconvolutional layers is designed to perform the VHR image analysis for labeling pixels. Since the diverse urban patterns and building styles in large areas, sample image data sets of building roof and non-building roof are collected over different metropolitan regions in China. We selected typical cities with dense urban environment in each metropolitan region as study areas for collecting training and test samples. High performance cluster with GPU-mounted workstations is employed to perform the model training and optimization. With the building roof samples collected over different cities, the predictive model with multiple NN layers is developed for building roof labeling. The validation of the building roof map shows that the overall accuracy(OA) and the mean Intersection Over Union( mIOU) of DCNN based segmentation are 94.67%, 0.85 respectively, while CRF-refined segmentation achieved OA of 94.69% and mIOU of 0.83. The results suggest that the proposed approach is a promising solution for building roof mapping with VHR images over large areas across different urban and building patterns. With the operational acquisition of GF2 VHR imagery, it is expected to develop an automated pipeline for operational built-up area monitoring and timely update of building roof map over large areas.

Loess is a special soil with high water sensitivity, which covers a large area in northwest China. Cracks are prone to generate in loess under the arid and semi-arid climate, which will provide the preferential channel for water and reduce the mechanical properties of soils. It is of great significance to understand the evolution characteristics and mechanisms of the cracks in loess areas. At present, the researches on cracks in soils are mainly concentrated in the characteristics of different cracking patterns. However, the spacing cracks are mostly discussed in materials like rock and concrete, rather than soils. The cracking characteristics and mechanisms of spacing cracks in loess is still inadequate. In this research, the drying tests of loess are carried out with different sizes of specimens. The parameters of spacing cracks and local strain distributions of the loess samples are obtained via PCAS and DIC methods during desiccation, respectively. The cracking modes, space cracking laws like insertion and saturation of spacing cracks are revealed. Finally, the size effect on the characteristics of spacing cracks is verified with a discrete element software MatDEM.

Corona virus disease (COVID-19) has infected over more than 10 million people around the globe and killed at least 500K worldwide by the end of June 2020. As this disease continues to evolve and scientists and researchers around the world now trying to find out the way to combat this disease in most effective way. Chest X-rays are widely available modality for immediate care in diagnosing COVID-19. Precise detection and diagnosis of COVID-19 from these chest X-rays would be practical for the current situation. This paper proposes one shot cluster based approach for the accurate detection of COVID-19 chest x-rays. The main objective of one shot learning (OSL) is to mimic the way humans learn in order to make classification or prediction on a wide range of similar but novel problems. The core constraint of this type of task is that the algorithm should decide on the class of a test instance after seeing just one test example. For this purpose we have experimented with widely known Generalized Regression and Probabilistic Neural Networks. Experiments conducted with publicly available chest x-ray images demonstrate that the method can detect COVID-19 accurately with high precision. The obtained results have outperformed many of the convolutional neural network based existing methods proposed in the literature.

Objective tools to track medication adherence are lacking. A tool to monitor pill intake that can be implemented in mHealth apps without the need for additional devices was developed. We propose a pill intake detection tool that uses digital image processing to analyze images of a blister to detect the presence of pills. The tool uses the circular Hough transform as a feature extraction technique and is therefore primarily useful for the detection of pills with a round shape. This pill detection tool is composed of two steps. First, the registration of a full blister and storing of reference values in a local database. Second, the detection and classification of taken and remaining pills in similar blisters, to determine the actual number of untaken pills. In the registration of round pills in full blisters, 100% of pills in gray blisters or blisters with a transparent cover were successfully detected. In counting of untaken pills in partially opened blisters, 95.2% of remaining and 95.1% of taken pills were detected in gray blisters, while 88.2% of remaining and 80.8% of taken pills were detected in blisters with a transparent cover. The proposed tool provides promising results for the detection of round pills. However, the classification of taken and remaining pills need to be further improved, in particular for the detection of pills with non-oval shapes.

In the realm of artificial intelligence (AI), generative systems, most notably Midjourney, have tremendous power to generate creative images of buildings and sites of Islamic architectural heritage through text-to-image generation based on the internet. The AI-generated representations have significant potential for architects, specialists, and common users. However, the system has considerable limitations when generating images for some buildings and sites where the representations appear too far from their original represented structures. This research article attempts to answer the question: What are the limitations of using the AI system of Midjourney in producing images similar to the original buildings and sites of the Islamic architectural heritage? The research employs prompt engineering techniques based on historical sources as inputs to examine the accuracy of the output of the AI-generated images of selected examples of structures of the Islamic tradition. It compares the output with the original look by employing direct observation and critical analysis of human intelligence (HI). It categorizes these limitations into four groups: (1) limits of the prompt, (2) limits of fame, (3) limits of regionality and historical styles, and (4) limits of architectural elements and details. It concludes that while Midjourney has great capability to represent high-end AI-generated images inspired by the Islamic tradition, it currently falls short of presenting the actual appearance of some of their original structures.

Cellular Nonlinear Networks (CNN) are a concept introduced in 1988 by Leon Chua and Lin Yang as a bio-inspired architecture, capable of massively parallel computation. Later on, CNN have been enhanced by incorporating designs that incorporate memristors to profit from their processing and memory capabilities. In addition, Stochastic Computing (SC) can be used to optimize the quantity of required processing elements; thus it provides a lightweight approximate computing framework, quite accurate and effective, though. In this work, we propose utilization of SC in designing and implementing a memristor-based CNN. As a proof of the proposed concept, an example of application is presented. This application combines Matlab and a FPGA in order to create the CNN. The implemented CNN has then been used to perform three different real-time applications on a 512x512 gray-scale and a 768x512 color image: storage of the image, edge detection, and image sharpening. It has to be pointed out that the same CNN has been used for the three different tasks, with the sole change of some programmable parameters. Results show an excellent capability with significant accompanying advantages, like the low number of needed elements further allowing for a low cost FPGA-based system implementation, something confirming the system’s ability for real time operation.

Image processing is a field of which its popularity increases and continues and, that grows dynamically with new technologies. Nowadays, image processing finds itself in use in almost every field. One of these uses is undoubtedly in the field of medicine, where diagnosis and treatment planning are made from images and, which is constantly changing with newly developed techniques. Of course, the most important factor in using this so widely in the medical field is the acquisition of images on every medical field. With the help of these images, the complaints can be seen more easily and the doctor can follow a path in the treatment of the disease. In our study, we used the Region Growing segmentation method to detect the intestinal mass. This study compares the area determined by the specialist with the area obtained with the segmentation process and, it is seen that the created software system can be used as an auxiliary system to specialist doctors.

In this paper, we introduce a specialized, fully automated experimental arrangement designed for assessing the effectiveness of augmented and virtual reality technologies in healthcare setting and explore its design principles focusing on depth sensor characterization. The main goal of this project is to establish a robust benchtop platform for the quantitative evaluation of extended reality technologies in a controlled environment, emphasizing the practical assessment of augmented reality head-mounted devices. We outline a design concept and considerations for an experimental configuration aimed at creating a realistic testing environment. This apparatus comprises an observation platform mounted on a three-degree-of-freedom motorized system and a test phantom stage. Focusing on real-case scenarios, we utilized a range of sensors, including readily available range-sensing cameras and commercial augmented reality headsets, such as the Intel RealSense L515 LiDAR camera, mounted on the motion control system. The setup enabled automated data collection and facilitates controlled assessments and validation of various facets of augmented reality technologies, including object, hand, and head tracking, as well as static and dynamic image registration. This paper describes the system architecture, the process of automated data collection, and presents several evaluation studies conducted with this setup, providing insights into the quality and temporal noise associated with static or moving objects or observers in augmented reality applications.

"Deep fake" technologies are often associated with face-swapping algorithms based on images or videos. Although much research is focused on developing these techniques, there is still room for improvement, especially in human and visual assessment. In this study, we present an innovative approach to the problem of face replacement based on one model while preserving background features. Our model uses the Adaptive Attentional Denormalization method from FaceShifter while integrating identity features from the ArcFace and BiSeNet models to support the attribute extraction process. We used Fast GAN as a generative model to optimize and accelerate the training process on smaller data sets. Our research proves the effectiveness of the proposed approach by combining innovative methods and architectures in one coherent solution.

Traditional image steganography conceals secret messages into unprocessed natural images by modifying the pixel value, causing the obtained stego different from the original image in terms of statistical distribution, thereby could be detected by a well-trained classifier for steganalysis. To ensure the steganography is imperceptible and in line with the trend of art images produced by Artificial Intelligence Generated Content (AIGC) becoming popular in social networks, this paper proposes to embed hidden information throughout the process of the generation of an art-style image by designing an image style transformation neural network with steganography function. The proposed scheme takes a content image, an art-style image, and messages to be embedded as inputs, processing them with an encoder-decoder model, and finally generates a styled image containing the secret messages at the same time. An adversarial training technique is applied to enhance the imperceptibility of the generated art-styled stego image with from plain style-transferred images. The lack of the original cover image makes it difficult for the opponent learning a steganalyzer to identify the stego. The recommended approach can successfully withstand existing steganalysis techniques and attain the embedding capacity of 3 bits per pixel for a color image, according to experimental results.

Recently, Artificial Intelligence (AI)-based algorithms have revolutionized the medical image segmentation processes. Thus, the precise segmentation of organs and their lesions may contribute to an efficient diagnostics process and a more effective selection of targeted therapies as well as increasing the effectiveness of the training process. Thus, AI may contribute to the automatization of the image scan segmentation process and increase the quality of the resulting 3D objects, which may lead to the generation of more realistic virtual objects. In this paper, we focus on the AI-based solutions applied in the medical image scan segmentation, and intelligent visual-content generation, i.e. computer-generated three-dimensional (3D) images in the context of Extended Reality (XR). We consider different types of neural networks used with a special emphasis on the learning rules applied, taking into account algorithm accuracy and performance, as well as open data availability. This paper also attempts to summarize the current development of AI-based segmentation methods in medical imaging and intelligent visual content generation that are applied in XR. Finally, this paper concludes with possible developments and open challenges in AI application in Extended Reality-based solutions. Finally, the future lines of research and development directions of Artificial Intelligence applications both in medical image segmentation and Extended reality-based medical solutions are discussed.

Image encryption based on chaotic maps is an important way to ensure the secure communication of digital multimedia on the Internet. To improve the encryption performance and security of image encryption systems, a new image encryption algorithm is proposed by employing a compound chaotic map and random cyclic shift. Firstly, an improved Hybrid chaotic system is designed by coupling Logistic, ICMIC, Tent, and Chebyshev maps (HLITC). Comparison tests with previous chaotic maps in terms of chaotic trajectory, Lyapunov exponent, and Kolmogorov entropy illustrate the new hybrid chaotic map has better chaotic performance. Then the proposed HLITC chaotic system is used to develop a new chaotic image encryption scheme with the double cyclic shift. The improved HLITC chaotic system is performed to generate key sequences used in the image scrambling and diffusion stage. The spiral transformation controlled by chaotic sequence is used to scramble the pixels of the plaintext image, while the XOR operation based on a chaotic map is used for pixel diffusion. Extensive experiments of statistical analysis, key sensitivity, and keyspace analysis are conducted. Experimental results show the proposed encryption scheme has good robustness against brute force attacks, statistical attacks, and differential attacks, and is more effective than many existing chaotic image encryption algorithms.

This work tackles the problem of image restoration, a crucial task in many fields of applied sciences, focusing on removing degradation caused by blur and noise during the acquisition process. Drawing inspiration from the multi-penalty approach based on the Uniform Penalty principle introduced in [Bortolotti et al. arXiv.math.NA/2309.14163], we develop here a new image restoration model and an iterative algorithm for its effective solution. The model incorporates pixel-wise regularization terms and establishes a rule for parameters selection, aiming to restore images through the solution of a sequence of constrained optimization problems. To achieve this, we present a modified version of the Newton Projection method, adapted to multi-penalty scenarios, and prove its convergence. Numerical experiments demonstrate the efficacy of the method in eliminating noise and blur while preserving the image edges.

Single image deraining (SID) has shown its importance in many advanced computer vision tasks. Though many CNN based image deraining methods have been proposed, how to effectively remove raindrops while maintaining background structure remains a challenge that needs to be overcome. Most of the deraining work focuses on removing rain streaks, but in heavy rain images, the dense accumulation of rainwater or the rain curtain effect significantly interferes with the effective removal of rain streaks, and often introduces some artifacts that make the scene more blurry. In this paper, we propose a new network structure R-PReNet for single image deraining with good background structure maintaining. This framework fully utilizes the cyclic recursive structure of PReNet. Moreover, we introduce residual channel prior (RCP) and feature fusion modules for better deraining performance by focusing on background feature information. Compared with the previous methods, our method has significantly improvement effect on the rainstorm image with the artifacts removing and good visual detail restoring.

This study proposes a method for image matching between infrared(IR)-RGB images using a deep learning network to estimate the deformation field. We propose a deformation field generator (DFG) that estimates the deformation field of the transformation matrix to match each pixel or IR image to the RGB image. DFG is a network that receives IR and RGB images as input; the output size is two channels and has the sample resolution as the input image. By warping the IR image through a grid-sampler that warps the image according to the value of the deformation field, we can obtain a warped IR image that matches the RGB image. Additionally, to check whether the warped IR image matched the RGB image, the masking images detecting the segmentation of objects were photographed in two images. Without directly comparing IR and RGB images, we proposed mask loss that warps the IR mask image through the deformation field and grid sampler and then compares the warped IR mask image with the RGB mask image. Mask loss solves the spatial similarity comparison problem with multi-modality images, such as IR and RGB images, by comparing the mask image with the same modality image as the mask image.

Spinal deformity refers to a range of disorders that are defined by anomalous curvature of the spine and may be classified as scoliosis, lordosis, or kyphosis. Among these, scoliosis stands out as the most common type of spinal deformity in human beings, and it can be distinguished by abnormal lateral spine curvature accompanied by axial rotation. Accurate identification of spinal deformity is crucial for a person's diagnosis, and numerous assessment methods have been developed by researchers. Therefore, the present study aims to systematically review recent works on spinal deformity as-assessment for scoliosis diagnosis, utilizing image processing techniques. To gather relevant studies, a search strategy was conducted on three electronic databases (Scopus, ScienceDirect, and PubMed) between 2012 and 2022, using specific keywords and focusing on scoliosis cases. A total of 17 papers fully satisfied the established criteria and were extensively evaluated. Despite variations in methodological designs across the studies, all reviewed articles obtained quality ratings higher than satisfactory. Various diagnostic approaches have been employed, including artificial intelligence mechanisms, image processing, and scoliosis diagnosis systems. These approaches have the potential to save time and, more significantly, can reduce the incidence of human error. While all assessment methods have potential in scoliosis diagnosis, they possess several limitations that can be ameliorated in forthcoming studies. Therefore, the findings of this study may serve as guidelines for the development of a more accurate spinal deformity assessment method that can aid medical personnel in the real diagnosis of scoliosis.

Plant phenotype plays an important role in crop breeding and planting. Leaf phenotype is an important part of plant phenotype. In order to analyze the leaf phenotype, the target leaf is required to be segmented from the complex background image. In this paper, an automatic soybean leaf segmentation method based on object detection and interactive segmentation models is proposed. Firstly, the Libra R-CNN object detection algorithm is used to detect all soybean leaves in the image. Then, based on the idea that the target soybean leaf is located in the center of the image and the area is large, the detection bounding box of the target leaf is selected. In order not to destroy the segmentation result, the bounding box is optimized to completely enclose the whole leaf. Finally, according to the optimized bounding box, the prior channels of foreground and background are constructed using Gaussian model. The two channels together with the original image are as the input of the interactive object segmentation with inside-outside guidance model to segment the target soybean leaf. A large number of qualitative and quantitative experimental results show that the method has high segmentation accuracy and strong generalization capacity.

To solve the problem that the common long-tailed classification method does not use the semantic features of the original label text of the image, and the difference between the classification accuracy of most classes and minority classes is large, the long-tailed image classification method based on enhanced contrast visual language trains the head class and tail class samples separately, uses text image to pre-train the information, and uses enhanced momentum contrast loss function and RandAugment enhancement to improve the learning of tail class samples. On the ImageNet-LT long-tailed dataset, the enhanced contrastive visual-language based long-tailed image classification method has improved all class accuracy, tail class accuracy, middle class accuracy, and F1 values by 3.4%, 7.6%, 3.5%, and 11.2%, respectively, compared to the BALLAD method. The difference in accuracy between the head class and tail class is reduced by 1.6% compared to the BALLAD method. The results of three comparative experiments indicate that the long-tailed image classification method based on enhanced contrastive visual-language has improved the performance of tail classes and reduced the accuracy difference between majority and minority classes.

Crop disease classification has always been a critical and persistent problem in the field of agricultural and forestry sciences, where often we do not have access to a sufficient number of samples to know the distribution of real-world samples. How to make full use of the existing data is the starting point of our thinking. To address this problem, this paper proposes a supervised image augmentation method Negative Contrast, which uses the contrast images of existing disease samples after removing disease areas as negative samples for image augmentation when samples are relatively scarce. Numerous experiments have shown that several classical models using this augmentation method have improved in disease classification of four crops, rice, wheat, corn, and soybean, with a maximum accuracy improvement of 30.8%. In addition, the comparative analysis of attentional heat map shows that the model using Negative Contrast is more accurate and intense on the area of interest of diseases, and thus reflects better generalization ability in real-world disease classification. Our dataset and codes can be found in https://www.kaggle.com/datasets/w970704112/corn-wheat-rice-soybean and https://github.com/hiter0/contrastaug .

UAV has become powerful devices for both practitioners and researchers. In recent years, there has been a substantial growth in the usage of UAV for a wide range of applications in research and engineering. UAV are mostly utilized for image capturing techniques due to their time savings, low cost, minimum field work, and high precision. The purpose of this study is to generate an accurate and reliable 3D modelling process using UAVs photogrammetric technology; hence this study allows the techniques to evaluate the practicability of modelling and mapping inaccessible tunnels using images recorded by UAVs and photogrammetry. As a result, the approach was always employed to depict the true state of the place. This research incorporates three experiments. The first experiment is to build a 3D model using only one-directional light source and evaluate the accuracy of 3D photogrammetric model and conducted at the concrete tunnel. The second one is to build a 3D model of underground sewer tunnel using different light sources one-directional and omni-directional. The last experiment was to build 3D model using an UAV system which is developed based on first and second experiment’s result, evaluate an accuracy of 3D photogrammetric model and conducted at the tunnel named in the research as a “pedestrian tunnel. There is certain limitation in this study such as Adding a payload to a drone changed its weight distribution, which affected its stability. If the payload was not properly balanced, it caused the drone to fly unevenly, making it more difficult to control.

This research used an experimental study design in which 60 subjects were randomly assigned to either an experimental (image e-book guidance) group or a control (text guidance) group after meeting the admission conditions and agreeing to participate in the study. It was proven that providing image e-book guidance before surgery significantly changed the behavior of patients and promoted relief of urinary catheter discomfort through self-efficacy to reduce urinary catheter pain after surgery. It was found that providing image e-book guidance can shorten the time for health education and provide patients with repeated medical education and familiarity with health guidance, which can help to address the important clinical service demand issue and the shortage of nursing staff.

Alzheimer’s disease has become a major concern in the healthcare domain as it is growing rapidly. Many researches have been conducted to detect it from MRI images through various deep-learning approaches. However, the problem of the availability of medical data and the privacy of the patients still exists. To mitigate this issue in Alzheimer’s disease detection, we have implemented the federated approach which is found to be more efficient, robust, and consistent compared to the conventional approach. For this, we needed deep excavation on various orientations of MRI images and transfer learning architectures. Then, we utilized the publicly available two datasets (OASIS, and ADNI), and designed various cases to evaluate the performance of the federated approach. In almost all of them, the federated approach achieved better accuracy and sensitivity. In distinguishing between two classes equally, the capability of the models was better in the found model when trained with federated approach compared to the conventional approach. In this approach. MobileNet, which is a low-cost transfer learning architecture, achieved the highest 95.24%, 81.94%, and 83.97% accuracy in OASIS, ADNI, and merged (ADNI+OASIS) test set, which was way higher than the achieved performance in Conventional approach. Moreover, in this approach, only the weights of the model were shared which keeps the original MRI images in their respective hospital or institutions, mitigating the privacy concern in the healthcare domain.

Recent advances in deep learning technology have led to increased interest in text-to-image technology, which enables computers to create images from text by simulating the human process of forming mental images. The GAN-based text-to-image technology involves the extraction of features from input text, which are combined with noise and then used as input to a GAN that generates images that are similar to the original images through competition between the generator and discriminator. Although generating images from English text is a mature area of research, text-to-image technology based on multilingualism, such as Korean, is still in its early stages of development. Webtoon is a digital comic format that allows comics to be viewed online. The creation process for webtoons is divided into story planning, content/sketching, coloring, and background drawing. Since each stage of webtoon production requires human intervention, it is both time-consuming and expensive. As a result, deep learning technologies such as automatic coloring and automatic line drawing are being used to reduce human involvement. However, there is a shortage of technology that can assist authors with story creation in webtoon production. Therefore, this study proposes a multilingual text-to-image model capable of generating webtoon images when presented with multilingual input text. The proposed model employs Multilingual BERT to extract feature vectors for multiple languages, and trains a DCGAN in conjunction with the images. The experimental results demonstrate that the model can generate images that are similar to the original images when presented with multilingual input text after training.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Recent advances in microscopy imaging and image analysis motivate more and more institutes world-wide to establish dedicated core-facilities for bio-image analysis. To maximize the benefits research groups at these institutes gain from their core-facilities, they should be established to fit well into their respective environment. In this article, we introduce common collaborator requests and corresponding potential services core-facilities can offer. We also discuss potential conflicts of interests between the targeted missions and implementations of services to guide decision makers and core-facility founders to circumvent common pitfalls.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

The major goal of this paper is to use image enhancement techniques for enhancing and extracting data in FANET applications to improve the efficiency of surveillance. The proposed conceptual system design can improve the likelihood of FANET operations in oil pipeline surveillance, and sports and media coverage with the ultimate goal of providing efficient services to those who are interested. The system architecture model is based on current scientific principles and developing technologies. A FANET, which is capable of gathering image data from video-enabled drones, and an image processing system that permits data collection and analysis are the two primary components of the system. Based on the image processing technique, a proof of concept for efficient data extraction and enhancement in FANET situations and possible services is illustrated

Problem. Image biomarker analysis, also known as radiomics, is a tool for tissue characterization and treatment prognosis that relies on routinely acquired clinical images and delineations. Due to the uncertainty in image acquisition, processing, and segmentation (delineation) protocols, radiomics often lacks reproducibility. Radiomics harmonization techniques have been proposed as a solution to reduce these sources of uncertainty and/or their influence on the prognostic model performance. A relevant question is how to estimate the protocol-induced uncertainty of a specific image biomarker, what the effect is on the model performance, and how to optimize the model given the uncertainty. In this manuscript, we show how protocol uncertainty can drastically reduce prognostic model performance. We introduce an effect-size measure η that assesses the protocol-induced uncertainty versus the measurable effect. Methods. Two non-small cell lung cancer (NSCLC) cohorts, composed of 421 and 240 patients respectively, were used for training and testing. Per patient, a Monte Carlo algorithm was used to generate three hundred synthetic contours with a surface dice tolerance measure less than 1.18 mm with respect to the original GTV. These contours were subsequently used to derive 104 radiomic features, which were ranked on their relative sensitivity to contour perturbation, expressed in the parameter η. The top four (low η) and the bottom four (high η) features were selected for two models based on Cox proportional hazards model. To investigate the influence of segmentation uncertainty on the prognostic model, we trained and tested the setup in 5000 augmented realizations (using a Monte Carlo sampling method); the log-rank test was used to assess the stratification performance and stability to segmentation uncertainty. Results. Although both low and high η setup showed significant testing set log-rank p-values (p=0.01) in the original GTV delineations (without segmentation uncertainty introduced), in the model with high uncertainty to effect ratio only around 30% of the augmented realizations resulted in model performance with p < 0.05 in the test set. In contrast, the low η setup performed with log-rank p < 0.05 in 90% of the augmented realizations. Moreover, the high η setup classification was uncertain for 50% of the subjects in the testing set (for 80% agreement rate), whereas the low η setup was uncertain only in 10% of the cases. The code and part of the data are available at https://github.com/Maastro-CDS-Imaging-Group/sure. Discussion. Estimating image biomarker model performance based only on the original GTV segmentation without considering segmentation uncertainty may be deceiving. The model might result in a significant stratification performance, but can be unstable for delineation variations, which are inherent to manual segmentation. Simulating segmentation uncertainty using the method described allows for more stable image biomarker estimation, selection, and model development. The segmentation uncertainty estimation method described here is universal and can be extended to estimate other protocol uncertainties (such as image acquisition and pre-processing).

The notion of enhancement of the image is to ameliorate the perceptibility of information contained in an image. In the present research, a novel technique for the enhancement of image quality is propounded using fuzzy logic technique with a cuckoo optimization algorithm. Generally, the image is transformed from RGB domain to HSV domain keeping the color information intact within the image. The image has been categorized into three regions: underexposed, overexposed and mixed region on the basis of two threshold values. For the fuzzification of under and overexposed area the degree of membership is defined by the Gaussian membership, while the mixed area is fuzzified by parametric sigmoid function. The key parameters like visual factors and fuzzy contrast provide the quantitative analysis of an image. An objective function is framed which involves entropy and visual factor has been optimized by a new evolutionary cuckoo optimization algorithm. The results procured after simulation by the cuckoo optimization algorithm are compared with Bacterial foraging algorithm and ant colony optimization based image enhancement and this approach is found to be improved.

Identifying the total number of fruits on trees has long been of interest in agricultural crop estimation work. Yield prediction of fruits in practical environment is one of the hard and significant tasks to obtain better results in crop management system to achieve more productivity with regard to moderate cost. Utilized color vision in machine vision system to identify citrus fruits, and estimated yield information of the citrus grove in-real time. Fruit recognition algorithms based on color features to estimate the number of fruit. In the current research work, some low complexity and efficient image analysis approach was proposed to count yield fruits image in the natural scene. Semi automatic segmentation and yield calculation of fruit based on shape analysis is presented. Color and shape analysis was utilized to segment the images of different fruits like apple, pomegranate obtained under different lighting conditions. First the input sectional tree image was converted from RGB colour space into the colour space transform (i.e., YUV, YIQ, or YCbCr). The resultant image was then applied to the algorithm for fruit segmentation. After it is applied Morphological Operations which is enhanced image then execute Blob counting method which identify the object and count the number of it. Accuracy of this algorithm used in this thesis is 82.21% for images that have been scanned.

With the development of hyperspectral technology, to establish an effective spectral data compressive reconstruction method that can improving data storage, transmission and maintaining spectral information is critical for quantitative remote sensing research and application in vegetation. By introducing the idea of compressive sensing in compressed reconstruction, the spectral adaptive grouping distributed compressive sensing algorithm is proposed, which enables a distributed compressed sensing reconstruction of plant hyperspectral data. The experimental results showed that comparing with orthogonal matching pursuit(OMP) and gradient projection reconstruction(GPSR), the proposed algorithm can significantly improve the visual effect of image reconstruction in the spatial domain. The PSNR in low sampling rate(sampling rate is lower than 0.2) increases by 13.72dB than OMP and 1.66dB than GPSR. In the spectral domain, the average normalized root mean square error、the mean absolute percentage error and the mean absolute error of the proposed algorithm is35.38%，31.83% and 33.33% lower than GPSR respectively.. Therefore, the proposed algorithm can achieve relatively high reconstructed efficiency.

Early-season crop-type data are required for a variety of agricultural monitoring and decision-making applications. The early season in this study referred to the prophase and middle of a growth season. Early-season detection of crop types remains challenging because of limited discriminative features, especially for landscapes that are characterized by complex cropping patterns. In fact, different remote-sensing satellites can increase the frequency of data acquisition, which can provide more information in the early season. Moreover, optical and radar sensors have different degrees of sensitivity to crop parameters. Therefore, the integration and application of two types of multitemporal data are of great significance to improve the accuracy and timeliness of crop type detection.In deep learning (DL), convolutional neural network (CNN) and recurrent neural network (RNN) models have great potential for temporal feature extraction. Compared with RNNs, CNNs usually have fewer parameters and are more conducive to determining early-season detection dates of different crop types, which requires a lot of training because of the need to model on different dates. Nevertheless, revisit dates and temporal intervals of different satellites are usually different, resulting in different data acquisition time series; these data cannot be directly used as input for the same convolutional layer. To address this challenge, a Dual-1DCNN was bulit based on the CNN model in this study. Moreover, an incremental training method was used to attain the network on each data acquisition date and obtained the best detection date for each crop type in the early season. A case study for Hengshui City in China was conducted using time series of Sentinel-1A (S1A) and Sentinel-2 (S2). To verify this method, classical methods support vector machine (SVM) and random forest (RF) were implemented. The results demonstrated the following: (1) the Dual-1DCNN extracted discriminative features from S1A and S2 time series at the early season by producing the highest overall accuracy (OA: 87.23%); (2) for summer maize, cotton, and common yam rhizome, the Dual-1DCNN achieved F1 values of 92.39%, 87.71%, and 84.38%, respectively, at the early season (moreover, the early seasons were almost 40, 70, and 80 days before the end of the growth seasons, respectively). These findings suggested that the Dual-1DCNN is promising for the accurate and timely detection of crop types.

The lack of defect image data is one of the main factors affecting the accuracy of supervised deep learning-based defect detection models. In response to the insufficient training data of defect images with complex backgrounds such as rust and surface oil leakage in substation equipment, leading to poor performance of the detection model, this paper proposed a novel adversarial deep learning model for substation defect generation: ADD-GAN. In comparison to existing generative adversarial networks, this model generates defect images based on effectively segmented local areas of substation equipment images, avoiding image distortion caused by global style changes. Additionally, the model utilizes a joint discriminator for overall image and defect image to address the issue of low attention to local defect areas, thereby improving the loss of image features. This enhances the overall quality of generated images as well as locally generated defect images, ultimately improving image realism. Experimental results demonstrate that the YOLOV7 object detection model trained on the dataset generated using the ADD-GAN method achieves an mAP of 81.5% on the test dataset, representing an improvement of 9.6% over the original dataset, 5.7% over traditional augmentation methods, and 7% over typical adversarial deep learning methods. This confirms that the ADD-GAN method can generate a high-fidelity dataset of substation equipment defects.

The quality of yarn is essential in the control of the fabrics processes. There is some commercial equipment that measures the quality of yarn based on sensors, of different types, used for collecting data about some yarn characteristic parameters. The existing equipment, for the above-mentioned purpose, is characterized by its high size and cost, and for allowing the analysis of only few yarn quality parameters. Thus, this paper presents the development and results obtained with the design of a mechatronic prototype integrating a computer vision system that allows, among other parameters, the analysis and classification, in real time, of the hairs of the yarn using artificial intelligence techniques. The system also determines other characteristics inherent to the yarn quality analysis, such as: linear mass, diameter, volume, twist orientation, twist step, average mass deviation, coefficient of variation, hairiness coefficient, average hairiness deviation and standard hairiness deviation, as well as performs spectral analysis. A comparison of the obtained results with the designed system and a commercial equipment was performed validating the undertaken methodology.

This proposed research explores a novel approach to image classification by deploying a complex-valued neural network (CVNN) on a field-programmable gate array (FPGA), specifically for classifying 2D images transformed into polar form. The aim of this research is to address the limitations of existing neural network models in terms of energy and resource efficiency, by exploring the potential of FPGA-based hardware acceleration in conjunction with advanced neural network architectures like CVNNs. The methodological innovation of this research lies in the Cartesian to polar transformation of 2D images, effectively reducing the input data volume required for neural network processing. Subsequent efforts focused on constructing a CVNN model optimized for FPGA implementation, emphasizing the enhancement of computational efficiency and overall performance. The experimental findings provide empirical evidence supporting the efficacy of the image classification system developed in this study. One of the developed models, CVNN_128, achieves an accuracy of 88.3% with an inference time of just 1.6ms and a power consumption of 4.66mW for the classification of the MNIST test dataset consists of 10,000 frames. While there is a slight concession in accuracy compared to recent FPGA implementations that achieve 94.43%, our model significantly excels in classification speed and power efficiency—surpassing existing models by more than a factor of 100. In conclusion, the paper demonstrates the substantial advantages of FPGA-implementation of CVNNs for image classification tasks, particularly in scenarios where speed, resource, and power consumption are critical. The study’s reproducible results and corresponding code are available on GitHub at the following link: https://github.com/mahmad2005/CVNNonFPGA

Several coastal barriers experienced significant erosion and change in shape throughout the Mediterranean coasts over the past decades, and the issue has become of increasing concern for scientists and policymakers. With reference to a case study and by meteorological and geomorphological investigations, this note aims to infer recent shoreline dynamics and define coastal phenomena shaping the beach-dune barrier of Cesine Lagoon (South Italy), to finally point out the weather-driven processes. A challenge for this research was to obtain significant results from publicly available sources and simple and inexpensive methods. The retreat of the dune toe, the accretion of washover fans, and the formation of gravel beaches have been related to the analyzed wind-wave conditions. Net longshore transport was found in accordance with the direction of the more intense winds. The role of extreme events in the shaping of coastal landforms is yet to be established even if they greatly increase the vulnerability to flooding of the study area. The results achieved so far are starting points for further data collection and analysis in the perspective of assessing the impact of climate changes on the lagoon barrier.

With the increasing availability of large digitized fine art collections, automated analysis and classification of paintings is becoming an interesting area of research. However, due to domain specificity, implicit subjectivity, and pervasive nuances that vaguely separate art movements, analyzing art using machine learning techniques poses significant challenges. Residual networks, or variants thereof, are one the most popular tools for image classification tasks, which can extract relevant features for well-defined classes. In this case study, we focus on the classification of a selected painting 'Portrait of the Painter Charles Bruni' by Johann Kupetzky and the analysis of the performance of the proposed classifier. We show that the features extracted during residual network training can be useful for image retrieval within search systems in online art collections.