This paper aims at trying to answer the question of whether a low cost drone equipped with a regular camera can serve as a simple device to estimate the size of objects. Ad-ditionally, it assesses if the accuracy of measurement is good enough for using a drone for measurements, relying solely on GPS position and camera. A review of the literature pertaining to ground object measurements was conducted. The availability of such in-struments was evaluated in terms of purchase and rental costs, the number of instru-ments on the market, and the time to obtain them. The most common measurement methods were considered and their unit costs were reviewed. The cost of professional surveying and measuring equipment was compared to the possibility of using low-cost, non-commercial drones to measure objects and surfaces. The quality of the images ob-tained was compared with high-resolution satellite systems. Is an ordinary drone with a standard camera suitable for length measurement without professional measuring equipment? Should the results be considered only in the category of size estimation?

Accurate geometric modeling of blood vessels lumen given their 3D images is a basis for vessel quantification in support of cardiovascular diseases diagnosis, treatment and monitoring. Unlike other approaches, which assume circular or elliptical vessel cross-section, the proposed method employs parametric B-splines combined with the image formation system equations to accurately localize the highly curved lumen boundaries. No image segmentation is involved which might reduce the localization accuracy in effect of spatial discretization. It is shown that the model parameters can be reliably identified by a feedforward neural network which, driven by the cross-section images, predicts the parameter values many times faster than a reference least-squares (LS) model fitting algorithm. Two example applications: modeling the lower extremities artery-vein complexes visualized in steady-state contrast-enhanced magnetic resonance images (MRI) and the coronary arteries pictured in computed tomography angiograms (CTA), are presented and discussed to demonstrate the method potential. Besides application to medical diagnosis, blood-flow simulation and vessel-phantom design, it can serve as a tool for automated annotation of image datasets required to train machine-learning algorithms.

Sacroiliac (SI) joint dysfunction can lead to debilitating pain but can be treated with minimally invasive sacroiliac joint fusion (SIJF). This treatment is commonly performed using 2D fluoroscopic guidance. This makes placing the implants without damaging surrounding neural structures challenging. Virtual surgical planning (VSP) using simulated fluoroscopic images may improve perioperative guidance. This article describes a workflow with VSP in SIJF using simulated fluoroscopic images and evaluates achieved implant placement accuracy. Routinely collected survey data on the added value of VSP were also evaluated. Ten interventions were performed on 10 patients by the same surgeon, comprising 30 implants; the median age was 39 years, and all patients were female. The overall mean implant placement accuracy was 4.9 ± 1.26 mm and 4.0 ± 1.44°. There were no malpositioning complications. The VSP helped the surgeon understand the anatomy and determine the optimal position and length of the implants. The average Likert scale score of the survey was 4.7, suggesting a positive role of VSP for SIJF. Planned positions of the implants could be reproduced in surgery with clinically acceptable accuracy and VSP was a valuable asset for the surgeon.

Chenodeoxycholic acid (CA) is a naturally occurring bile acid that is produced in the liver from cholesterol. Three CA complexes using Zn(II), Mg(II), and Ca(II) ions were synthesized to examine the chelation tendencies of CA towards these metal ions. The complexation reaction of CA with the metal ions under investigation was conducted with a 1:1 molar ratio (CA to metal) at 60-70°C in natural media (pH 7-8), which consisted of a binary solvent of MeOH and H2O (1:1). The resulting CA complexes were characterized using analytical data (metal, H, C, and Cl, analysis) and spectral data (UV-visible, FT-IR, and 1H NMR) to elucidate the complexes’ structures. The results suggested that CA in anion form utilized oxygen atoms of the carboxylate group (-COO−) to capture Zn(II), Mg(II), and Ca(II) ions. This produced complexes with the general compositions of [Zn(CA)(H2O)Cl], [Mg(CA)(H2O)Cl]H2O, and [Ca(CA)(H2O)Cl]2H2O, respectively. The Kirby-Bauer disc diffusion assay was then used to explore the bioactivity of the CA complexes toward three fungal species, three Gram-positive bacteria, and two Gram-negative bacteria. The Ca(II) and Mg(II) complexes exhibited marked inhibitory effects on the cell growth of the fungal species Aspergillus niger with potency equal to 127% and 116% of the activity of the positive control, respectively. The Zn(II) and Ca(II) complexes strongly inhibited the growth of Penicillium sp., while the Zn(II) and Mg(II) complexes showed strong growth inhibition towards the Gram-negative species Pseudomonas aeruginosa.

Recently, deep learning-based image quality enhancement models have been proposed to improve the perceptual quality of distorted synthesized views impaired by compression and Depth Image Based Rendering (DIBR) process in multiview video systems. However, due to the lack of multi-view video plus depth data, the training data for quality enhancement models is small, which limits the performance and progress of these models. Augmenting the training data to enhance the Synthesized View Quality Enhancement (SVQE) models is a feasible solution. In this paper, we suggest a deep learning-based SVQE model using more synthetic Synthesized View Images (SVIs). To simulate the irregular geometric displacement of DIBR distortion, a random irregular polygon-based SVI synthesis method is proposed based on existing massive RGB/RGBD data, and a synthetic synthesized view database is constructed, which includes synthetic SVIs and DIBR distortion masks. Moreover, to further guide the SVQE models to focus more precisely on DIBR distortion, the DIBR distortion mask prediction network which could predict the position and variance of DIBR distortion is embedded into the SVQE models. The experimental results demonstrate that by pretraining on the synthetic SVI database, the performance of the existing SVQE models could be greatly promoted. In addition, by introducing the DIBR distortion mask prediction network, the SVI quality could be further enhanced.

Objectives: Evaluate hand-held echocardiography (HHE) performed and interpreted by trained Advanced Practice Providers (APPs) on hospitalized CHF patients for image quality and interpretation, by comparing against expert echocardiographer and SE findings. Background: Congestive heart failure (CHF) is associated with increased hospital admissions and mortality. While standard echocardiogram (SE) is the gold standard for cardiac assessment, it is not readily available. Hospitalized CHF patients require rapid assessment for expedited treatment. Methods: Over 6 months, five trained APPs performed HHE on hospitalized CHF patients and interpreted: a) Left ventricular (LV) size, b) LV ejection fraction (LVEF), and c) right atrial pressure (RAP). The study echocardiographer reviewed and blindly interpreted HHE images and compared with APPs and SE findings. Kappa-statistics determined the degree of agreement between APPs and study echocardiographer interpretation of HHE images and SE. Results: 80 CHF patients [age 73±14 years, 58% males; LVEF (by SE) 45±19%; 36.3% body mass indexes ≥30 kg/m2] were enrolled. HHE interpretation by APPs had good agreement for LVEF (kappa 0.79) with study echocardiographer and SE (kappa 0.74), and good agreement for RAP (kappa 0.67) with study echocardiographer. Correlation between absolute LVEF interpretation by study echocardiographer on HHE and SE was r=0.88 (p<0.0001). Conclusions: Trained APPs obtained diagnostic-quality HHE images and interpreted LV function and RAP in CHF patients, with good agreement with the study echocardiographer. LVEF by HHE correlated with LVEF by SE. Our study suggests trained APPs can use HHE to evaluate LVEF and RAP in CHF patients leading to expedited and optimized treatment.

Convolutional neural networks (CNN) have attracted much attention as a commonly used method for hyperspectral image (HSI) classification in recent years, however, CNNs can only be applied to Euclidean data and have limitations in dealing with relationships due to the limitations of local feature extraction. However, each pixel of a hyperspectral image contains a set of spectral bands that are correlated and interact with each other, and the methods used to process Euclidean data cannot effectively obtain these correlations. In contrast, the graph convolutional network (GCN) can be used in non-Euclidean data, but usually leads to oversmoothing and ignoring local detail features due to the need for superpixel segmentation processing to reduce computational effort. To overcome the above problems, we constructed a network a fusion network based on GCN and CNN, which contains two branches: a graph convolutional network based on superpixel segmentation and a convolutional network with added attention mechanism. The graph convolu-tional branch can extract the structural features and capture the relationships between the nodes, and the convolutional branch can extract the detailed features in the local fine region. Owing to the fact that the features extracted from the two branches are different, the classification performance can be improved by fusing the complementary features extracted from the two branches. To vali-date the proposed algorithm, experiments were conducted on three widely used datasets, namely Indian Pines, Pavia University, and Salinas, and the overall accuracy of 98.78% was obtained in the Indian Pines dataset, and the overall accuracy of 98.99% and 98.69% was obtained in the other two datasets. The results showed that the proposed fusion network can obtain richer features and achieve high classification accuracy.

Side-scan sonar (SSS) detection is a key method in applications such as underwater environmental security and subsea resource development. The use of acoustic images for seabed target detection has gradually become a mainstream underwater detection method. However, many existing detection approaches primarily concentrate on tracking the evolution path of optical image object detection tasks, resulting in complex structures and limited versatility. To tackle this issue, we introduce a pioneering Dual-Domain Multi-Frequency Network (D2MFNet) meticulously crafted to harness the distinct characteristics of SSS image detection. In D2MFNet, aiming at the underwater detection requirements of small scenes, we introduce a novel method for optimize and improve the detection sensitivity of different frequency ranges and propose a Multi-Frequency Combined Attention Mechanism (MFCAM). This mechanism amplifies the relevance of dual-domain features across different channels and space. Moreover, recognizing that SSS images can provide richer insights after frequency domain conversion, we introduce a Dual-Domain Feature Pyramid Network (D2FPN). By incorporating frequency domain information representation, D2FPN significantly augments the depth and breadth of feature information in underwater small datasets. Our methods are seamlessly designed for integration into existing networks, offering plug-and-play functionality with substantial performance enhancements. We have conducted extensive experiments to validate the efficacy of our proposed techniques, and the results showcase their state-of-the-art performance. MFCAM improves the mAP by 16.9% in the KLSG dataset and 15.5% in the SCTD dataset. The mAP of D2FPN was improved by 8.4% in the KLSG dataset and by 9.8% in the SCTD dataset. We will make our code and models publicly available at https://dagshub.com/estrellaww00/D2MFNet.

The integration of artificial intelligence (AI) into medical imaging has guided in an era of transformation in healthcare. This literature review explores the latest innovations and applications of AI in the field, highlighting its profound impact on medical diagnosis and patient care. The innovation segment explores into cutting-edge developments in AI, such as deep learning algorithms, convolutional neural networks, and generative adversarial networks, which have significantly improved the accuracy and efficiency of medical image analysis. These innovations have enabled rapid and accurate detection of abnormalities, from identifying tumors during radiological examinations to detecting early signs of eye disease in retinal images. The article also highlights various applications of AI in medical imaging, including radiology, pathology, cardiology, and more. AI-based diagnostic tools not only speed up the interpretation of complex images but also improve early detection of disease, ultimately delivering better outcomes for patients. Additionally, AI-based image processing facilitates personalized treatment plans, thereby optimizing healthcare delivery. This literature review highlights the paradigm shift that AI has brought to medical imaging, highlighting its role in revolutionizing diagnosis and patient care. By combining cutting-edge AI techniques and their practical applications, it is clear that AI will continue shaping the future of healthcare in profound and positive ways.

In this paper, a relatively new hyper convolution spectra for characterization liquid, viscoelastic and solid samples is presented. Special attention is paid to the biophysical characterization of epithelial tissues and early detection of cancer of the skin, cervix, colon, and oral cavity. The method is based on the use of two types of white light, diffuse and polarized, from the same LED light sources. Based on the subtraction of the intensity values of these two lights and using the hyper convolution algorithm, the ratio of paired and unpaired electrons of tissue is obtained. This ratio correlates well with the state of the tissue: normal, irritating, precancerous, and cancerous. First, a proof-of-concept studies were performed, and later clinical studies on samples from one thousand two hundred fifteen people were performed. It showed that hyper Opto-Magnetic Imaging Spectroscopy (OMIS) can detect epithelial tissue cancers with an accuracy of 85-96%. Bearing in mind that the OMIS method also acquires the biophysical characteristics of the deeper skin layers (epidermis, basement membrane, dermis) by analysing convolution spectra of RGB channels of both diffuse and polarized white light, it is possible to apply this method in cosmetics (skin hydration, collagen, and elastin states, etc.). During OMIS applications, we noticed places where improvements could be made to increase method’s accuracy using advanced machine learning methodologies.

A land cover map of two arctic catchments, nearby the Abisko Scientific Research Station, was obtained from a classification of a Sentinel-2 satellite image and a ground survey performed in July 2022. The two contiguous catchments, Miellajokka and Stordalen, are covered by various ecotypes, from boreal forest to alpine tundra and peatland. The random forests algorithm correctly identified 88% of polygon pixels reserved for testing. The developed workflow relied solely on open source software and acquired ground observations. Space organization was directed by the altitude as demonstrated by the intersection of the land cover with the topography. Comparison between this new land cover map and previous ones based on data acquired between 2008 and 2011 shows some trends of vegetation cover evolution in response to climate change in the considered area.

Oriented object detection is a challenging task in scene text detection and remote sensing image analysis, which has attracted extensive attention in recent years with the development of deep learning. Currently, mainstream oriented object detectors are based on preset anchor boxes. This method increases the computational load of the network and cause a large amount of anchor box redundancy. To solve this problem, we propose anchor-free oriented object detection based on the Gaussian centerness(AOGC), a single-stage anchor-free detection method. Our method uses contextual attention FPN(CAFPN) to obtain the contextual information of the target. Then we design a label assignment method for oriented objects. Finally, we develop a Gaussian kernel-based centerness branch, which can effectively determine the significance of different anchors. AOGC achieves mAP of 74.30% on the DOTA-1.0 datasets and 89.80% on the HRSC2016 datasets, respectively. AOGC exhibits superior performance to other methods in oriented anchor-free object detection methods.

Malaria is one of the life-threatening disease caused by the Anopheles mosquitoes affecting the human red blood cells. It is the global health concern which is quite common in tropical as well as sub-tropical parts of the World. Therefore, it is an important to have an effective computer aided system in place for early detection and treatment. State of the art machine learning techniques are used to detect the infected malaria cells from the pool of images. As the visual heterogeneity of the malaria dataset is highly complex and dynamic, therefore higher number of images are needed to train the machine learning models effectively. However, hospitals as well as medical institutions do not share the medical image data for collaboration due to general data protection regulation (GDPR) and data protection act (DPA). To overcome this collaborative challenge, our research is inspired to use the real-time medical image data while using the framework of federated learning (FL) framework that will ensure the data privacy while mutual collaboration of hospitals and medical institutes. We have used the state of the art machine learning models that include the Resnet50 and densenet in a federated learning framework. We have experimented both models in different settings and our preliminary results showed that the densenet model performed better in accuracy (75%) in contrast to resnet50 (72%) while considering 8 clients, while the trend is observed common in 4 clients with the similar accuracy of 94% and 6 client showed that the densenet model performed quite well with the accuracy of 92% while resnet50 achieving only 72%.

Unmanned aerial vehicles (UAV) thermal imagery offers several advantages in environmental monitoring, as it can provide a low-cost, high-resolution, and flexible solution to measure the temperature of the surface of the land. Limitations related to the maximum load of the drone lead to use of lightweight uncooled thermal cameras whose internal components are not stabilized to a constant temperature. Such cameras suffer from several unwanted effects that contribute to the increase in temperature measurement error from ±0.5 °C in laboratory conditions, to ±5 °C in unstable flight conditions. This article describes a post processing procedure, that reduces the above unwanted effects. It consists of following steps: i) devignetting using single image vignette correction algorithm, ii) georeferencing of images using EXIF data, scale-invariant feature transform (SIFT) stitching, and gradient descent optimisation, and iii) temperature calibration by minimisation of bias between overlapping thermal images using gradient descent optimisation. The solution was tested in several case studies of river areas, where natural water bodies were used as a reference temperature benchmark. In all tests, the precision of the measurements was increased. The root of the mean of the Square of Errors RMSE on average was reduced by 39.0% and Mean of the absolute value of Errors MAE by 40.5%. The proposed algorithm can be called self-calibrating, as in contrast to other known solutions is fully automatic, uses only field data and does not require any calibration equipment or additional operator effort. A Python implementation of the solution is available on GitHub.

Unmanned Aerial Vehicles (UAVs) image object detection has great application value in military and civilian fields. However, the objects in the captured images from UAVs have problems of large scale variation, complex backgrounds, and a large proportion of small objects. To resolve these problems, a multi-scale object detector based on coordinate and global information aggregation is proposed, named CGMDet. Firstly, a Coordinate and Global Information Aggregation Module (CGAM) is designed by aggregating local, coordinate, and global information, which can obtain features with richer context information. Secondly, a Multi-Feature Fusion Pyramid Network (MF-FPN) is proposed, which can better fuse features of different scales and obtain features containing more context information through repeated use of feature maps, to better detect multi-scale targets. Moreover, more location information of low-level feature maps is integrated to improve the detection results of small targets. Furthermore, we modified the bounding box regression loss of the model to make the model more accurately regress the bounding box and faster convergence. Finally, the proposed CGMDet was tested on VisDrone and UAVDT datasets and mAP0.5 of 50.9% and 48% was obtained, respectively. At the same time, our detector achieved the best results compared to other detectors.

Street view images can help us better understand the city environment and potential characteristics. With the development of computer vision and deep learning, the technology of semantic segmentation algorithms has become more mature. However, DeeplabV3+, which is commonly used in semantic segmentation, has shortcomings such as a large number of parameters, high requirements for computing resources, and easy loss of detailed information. Therefore, this paper proposes LM-DeeplabV3+, which aims to greatly reduce parameters and computations of the model while ensuring the segmentation accuracy. Firstly, the lightweight network MobileNetV2 is selected as the backbone network, and the ECA attention mechanism is introduced after MobileNetV2 extracts shallow features to improve the ability of feature representation; secondly, the ASPP module is improved, and on its basis, the EPSA attention mechanism is introduced to achieve cross-dimensional channel attention and important feature interaction; thirdly, a loss function named CL loss is designed to balance the training offset of multiple categories and better indicate the segmentation quality. This paper conducted experimental verification on the Cityspaces dataset, and the results showed that the mIoU reached 74.9%, which was an improvement of 3.56% compared to DeeplabV3+; the mPA reached 83.01%, which was an improvement of 2.53% compared to DeeplabV3+.

The aim of this study is to analyse problems related to thermal mapping obtained from thermal data acquired from Unmanned Aerial Systems (UAS) equipped with thermal cameras. We focused on an accurate analysis of uncertainties introduced by the PIX4D Mapper software used to obtain the surface temperature maps of thermal images acquired by the UAS. To achieve this aim, we used artificial thermal reference during the surveys, as well as natural hot targets, i.e. thermal anomalies in the Pisciarelli hydrothermal system in Campi Flegrei caldera (CFc). Artificial thermal targets, expressly created and designed for this goal, are a prototype here called “developed thermal target” (DTT) made by the drone Laboratory at Istituto Nazionale di Geofisica e Vulcanologia - Osservatorio Vesuviano (INGV-OV). We show the results obtained by three surveys during which thermal targets were positioned on land at different flight heights of the UAS. Different heights were also necessary to test spatial resolution of the DTT with the used thermal camera as well as possible temperature differences between the raw images acquired by UAS with the thermal mapping obtained from the PIX4D Mapper software. In this work we have estimated the uncertainty that may be introduced by the mosaic procedure and furthermore we find an attenuation of the measured temperatures introduced by the different distances between the thermal anomaly and sensor. These results appear to be of great importance for the subsequent calibration phase of the thermal maps especially in cases where these methodologies are applied for monitoring purposes of volcanic/geothermal areas.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

(1) Background: The aim of the research was to present and emphasize the importance of magnetic resonance imaging (MRI) in diagnosing Achilles tendon (AT) ruptures by presenting case reports. (2) Materials and Methods: The sample of respondents included 7 patients (4 males and 3 females, 2 athletes and 5 non-athletes), aged 25 to 58 years, with AT injuries, who were examined and treated at the Institute for Treatment and Rehabilitation "Niška Banja", Niš, Serbia. Ankle examinations with MRI were conducted using the Esaote O-scan 0.3 T machine. The examinations were performed without the application of a paramagnetic contrast agent and without the use of anesthesia. Results: The MRI method's sensitivity and overall diagnostic accuracy were excellent, with 100% true positives. In our study, the method accurately detected the presence, location, and severity of AT injuries in all cases. MRI is an important and reliable method for detecting AT injuries, classifying them, monitoring the course of recovery, and assessing the effects of therapy. Conclusions: An unrecognized or delayed diagnosis of an AT injury can lead to chronic changes. Timely diagnosis (clinical examination, ultrasonography, magnetic resonance imaging) and appropriate treatment (conservative or operative) enable patients to return to normal activities, including sports. Unfortunately, the use of MRI is limited by restricted access and the cost of the examination.

Multi-source image registration often suffered from great radiation and geometric differences. Specifically, gray scale and texture from similar landforms in different source images often show significantly different visual features. And these differences disturb the corresponding point extraction in the following image registration process. Considering that edges between heterogeneous images can provide homogeneous information and more consistent features can be extracted based on image edges, an edge consistency radiation-change insensitive feature transform (EC-RIFT) method is proposed in this paper. Firstly, the noise and texture interference are reduced by preprocessing according to the image characteristics. Secondly, image edges are extracted based on phase congruency, and an orthogonal Log-Gabor filter is performed to replace the global algorithm. Finally, the descriptors are built with logarithmic partition of the feature point neighborhood, which improves the robustness of descriptors. Comparative experiments on datasets containing multi-source remote sensing image pairs show that the proposed EC-RIFT method outperforms other registration methods in terms of precision and effectiveness.

Sea ice extraction and segmentation of remote sensing images is the basis for sea ice monitoring. Machine learning-based image segmentation methods rely on manual sampling and require complex feature extraction. Deep-learning semantic segmentation methods have the advantages of high efficiency, intelligence, and automation. Sea ice segmentation using deep learning methods faces the following problems: in terms of datasets, the high cost of sea ice image label production leads to fewer datasets for sea ice segmentation; in terms of image quality, remote sensing image noise and Severe weather conditions affects image quality, which affects the ac-curacy of sea ice extraction. To address the quantity and quality of the dataset, this study used multiple data augmentation methods for data expansion. To improve the semantic segmentation accuracy, the SC-U2-Net network was constructed using multi-scale inflation convolution and a multi-layer Convolutional Block Attention Module (CBAM) attention mechanism for the U2-Net network. The experiments showed that (1) data augmentation solved the problem of an insuffi-cient number of training samples to a certain extent and improved the accuracy of image seg-mentation. (2) This study designed a multilevel Gaussian noise data augmentation scheme to improve the network's ability to resist noise interference and achieve a more accurate segmenta-tion of images with different degrees of noise pollution. (3) The inclusion of a multi-scale inflation perceptron and multi-layer CBAM attention mechanism improved the ability of U2-Net network feature extraction and enhanced the model accuracy and generalization ability.

The primary goal of picture compression is to reduce the amount of unused image data while still storing or transmitting it in a format that is appropriate. The compression of raw binary data is quite different from the compression of a picture, and these differences may be rather substantial. In light of this, compression is often regarded as an essential technique for the purposes of both data storage an d transmission in order to mitigate the excessive amounts of data that are generated by these images. In order to transmit enormous datasets, particularly for the purposes of telemedicine and teleradiology, one needs a significant amount of storage capacity as well as an expansive network. As a result, compression is an important aspect of medical imaging. In addition to the importance of compression, the quality of the photos themselves is also an essential factor in the success of analysis. In addition to this, the amount of time necessary to compress the photographs before sending them should be reduced.

Immunohistochemistry is a powerful technique, widely used in biomedical research and clinics, that allows to determine the expression levels of some proteins of interest in tissue samples by means of the intensity of color due to the expression of biomarkers using specific antibodies. As such, immunohistochemical images are complex and problematic to be quantified. Recently we proposed a novel method including a first separation stage based on nonnegative matrix factorization (NMF) that achieved good results. However, that method was highly dependent on sparseness and non-negativity parameter choice and on algorithm initialization. Furthermore, the previously proposed method needed a reference image as starting point for the NMF algorithm. In the present work, we propose a new, simpler and robust method for the automated unsupervised scoring of immunohistochemical images based on bright field. Our work is focused on images from tumor tissues marked with blue (nuclei) and brown (protein of interest). The new proposed method represents a simpler approach that, in one side, avoids the use of NMF for the separation stage, and in the other side, circumvents the need for a control image. This new approach determines the subspace spanned by the two colors of interest by means of principal component analysis (PCA) with dimension reduction. This subspace is a two-dimensional space, allowing the finding of color vectors by considering the peaks of density of points. The method also develops a new scoring stage by avoiding, again, reference images, making the procedure more robust and less dependent on the parameters. Experiments for the semi-quantitative scoring of images in five categories exhibit promising and consistent results when compared to manual scoring carried out by experts.

This research focused on the perception of visually impaired individuals regarding tactile image creation using 3D printing. We developed and applied an experiment with 28 participants with visual impairments. They performed tasks based on skills whose foundations are needed and used in their daily lives, such as scanning, tactile discrimination, picture and spatial comprehension. The tactile images used in this study were developed by additive manufacturing and printed over 180 g/m² sulphite paper. The best performances were obtained when (1) the tactile image contour line heights were between 0.2 mm and 0.4 mm; and (2) the texture presented densities between 10% and 50%, when alone, or between 10% and 90%, when combined with another texture. The tested line widths (0.8 mm and 1.2 mm) did not present statistically significant differences in the results. Vision status (low vision or blindness) and moment of vision loss (congenital or late blind) did not influence the results. Schooling affected the activities of identifying objects and locating their copies. In the Conclusion section, there is a detailed recommendation list for the production and application of tactile materials, which range from simplifying forms to encouraging the use of both hands during content assimilation.

The capability of in-house transient wave-multibody computational tool of ITU-WAVE are extended to predict the wave power absorption with Wave Energy Converters (WECs) arrays placed in front of a vertical breakwater. The analyses of hydrodynamic exciting and radiation forces are approximated solving boundary integral equation at each time interval. The reflection of incoming waves due to a vertical wall is predicted with method of images. The constructive or destructive performance of WECs arrays with different array configurations is measured with mean interaction factor. The behaviour of the exciting and radiation hydrodynamic forces of each WEC due to a vertical wall effect shows considerable differences than those of WECs arrays without a vertical wall influence. When the wave power absorption with WECs arrays with and without a vertical wall effect are compared, it is shown with numerical experiences that WECs placed in front of a vertical wall have much greater effects on wave power absorption. This can be attribute to the hydrodynamic interaction, standing waves, and nearly trapped waves in the gap between a vertical wall and WECs arrays. The analytical and other numerical results are used to for the validation of the numerical results of the present ITU-WAVE computational tool for exciting and radiation forces, and mean interaction factor of WECs arrays which show satisfactory agreements.

Deep neural networks (DNNs) have gained prominence in addressing regression problems, offering versatile architectural designs that cater to various applications. In the field of earthquake engineering, seismic response prediction is a critical area of study. Simplified models such as single-degree-of-freedom (SDOF) and multi-degree-of-freedom (MDOF) systems have traditionally provided valuable insights into structural behavior, known for their computational efficiency facilitating faster simulations. However, these models have notable limitations in capturing the nuanced nonlinear behavior of structures and the spatial variability of ground motions. This study focuses on leveraging ambient vibration (AV) measurements of buildings, combined with earthquake (EQ) time-history data, to create a predictive model using a neural network (NN) in image format. The primary objective is to predict a specific building's earthquake response accurately. The training dataset consists of 1,197 MDOF 2D shear models, generating a total of 32,319 training samples. To evaluate the performance of the proposed model, termed MLPER (Machine Learning based Prediction of building structures' Earthquake Response), several metrics are employed. These include mean absolute percentage error (MAPE) and mean deviation angle (MDA) for comparisons in the time domain. Additionally, we assess magnitude-squared coherence values and phase differences (Δφ) for comparisons in the frequency domain. This study underscores the potential of MLPER as a reliable tool for predicting building earthquake response, addressing the limitations of simplified models. By integrating AV measurements and EQ time-history data into a neural network framework, MLPER offers a promising avenue for enhancing our understanding of structural behavior during seismic events, ultimately contributing to improved earthquake resilience in building design and engineering.

Cloud detection in remote sensing images is a crucial preprocessing step that efficiently identifies and extracts cloud-covered areas within the images, ensuring the precision and reliability of subsequent analyses and applications. Given the diversity of clouds and the intricacies of the surface, distinguishing the boundaries between thin clouds and the underlying surface is a major challenge in cloud detection. To address these challenges, an advanced cloud detection method, CloudformerV3, is presented in this paper. The proposed method employs a multi-scale adapter to incorporate dark and bright channel prior information into the model's backbone, enhancing the model's ability to capture prior information and multi-scale details from remote sensing images. Additionally, multi-level large window attention is utilized, enabling high-resolution feature maps and low-resolution feature maps to mutually focus and subsequently merge during the resolution recovery phase. This facilitates the establishment of connections between different levels of feature maps and offers comprehensive contextual information for the model's decoder. Experimental results on the GF1_WHU dataset demonstrate that the method introduced in this paper exhibits superior detection accuracy when compared to state-of-the-art cloud detection models. Furthermore, enhanced detection performance is achieved along cloud edges and with respect to thin clouds, showcasing the efficacy of the proposed method.

With the increasing utilization of intelligent mobile devices for online inspection of electrical equipment in smart grids, the limited computing power and storage capacity of these devices pose challenges for deploying large algorithm models and it’s hard to obtain a substantial number of images of electrical equipment in public. In this paper, we propose a novel distillation method that compresses the knowledge of teacher networks into a compact few-shot classification network, employing a global and local knowledge distillation strategy. Central to our method is exploiting the global and local relationship between the features exacted by the backbone of the teacher network and student network. We compare our method with recent state-of-the-art (SOTA) methods on three public datasets and achieve superior performance. Additionally, we contribute a new dataset, namely EEI-100, which is specifically designed for classification of electrical equipment. We validate our method on this dataset and demonstrate its exceptional prediction accuracy of 94.12% when utilizing only 5-shot images.

The spectrums of one type of object under different conditions have the same features (up, down, protruding, concave) at the same spectral positions, which can be used as primary parameters to evaluate the difference among remotely sensed pixels. Wavelet-feature correlation ratio Markov clustering algorithm (WFCRMCA) for the remotely sensed data is proposed based on an accurate description of abrupt spectral features and an optimized Markov clustering in the wavelet feather space. The peak points can be captured and identified by applying a wavelet transform to spectral data. The correlation ratio between two samples is a statistical calculation of the matched peak point positions on the wavelet feature within an adjustable spectrum domain or a range of wavelet scales. The evenly sampled data can be used to create class centers, depending on the correlation ratio threshold at each Markov step, accelerating the clustering speed by avoiding the computation of Euclidean distance for traditional clustering algorithms, such as K-means and ISODATA. Markov clustering applies several strategies, such as a simulated annealing method and gradually shrinking the clustering size, to control the clustering convergence. At each clustering tempera-ture, it can obtain the best class centers quickly. The experimental results of the Airborne Visible/ Infrared Imaging Spectrometer (AVIRIS) and Thermal Mapping (TM) data have verified its ac-ceptable clustering accuracy and high convergence velocity.

A land cover map of two arctic catchments, nearby the Abisko Scientific Research Station, was obtained from a classification of a Sentinel-2 satellite image and a ground survey performed in July 2022. The two contiguous catchments, Miellajokka and Stordalen, are covered by various ecotypes, from boreal forest to alpine tundra and peatland. Two classification algorithms, support vector machine and random forest, were tested and gave very similar results. The percentage of correctly classified pixels was over 88% in both cases. The developed workflow relies solely on open source software and acquired ground observations. Space organization was directed by the altitude as demonstrated by the intersection of the land cover with the topography. Comparison between this new land cover map and previous ones based on data acquired between 2008 and 2011 shows some trends of vegetation cover evolution in response to climate change in the considered area. This land cover map is key input data for permafrost modeling, and hence for the quantification of climate change impacts in the studied area.

When two black holes form a binary system, each black hole observes an event horizon and a curved distorted space-time region around the other black hole. In this space-time, two such regions are formed, and another black hole forms in the second region from the initial black hole, which may be termed the “image” of the first black hole. The same event occurs for the other black hole also, and an extra image of it is formed. In these conditions, the energy of the system divides between the two black holes and their images. These four new black holes that are formed interact with each other again and produce new horizons and new distorted regions. Each black hole produces an image of all the other black holes and detects the background of six black holes instead of three. Consequently, for four black holes, 24 new black holes arise. The energy of the system will be divided amongst all 24 black holes. This story continues and black holes interact with one another and produce new images. Finally, very light black holes are formed each of which is so weak that it cannot produce strong distortions of space-time. The radiated gravitational waves from these weak black holes could be detected by LIGO as well as the signature of these binary black holes. However, detected waves are only a part of very strong gravitational waves. Each time a part of these waves escapes from the system and reaches the earth, they may be regarded as emitted waves from a new binary black hole. The time between radiated signals decreases, and it may be interpreted that a new supermassive binary black hole is radiating. If radiated signals combine, an explosion of the very strong binary system could be detected.

Using UAV-based multispectral images for quickly and accurately monitoring chlorophyll content is critical for field management and yield estimation. However, the lower model accuracy and the poor robustness of the estimation models are still preventing the widespread application of UAV-based multispectral images. We carried out two field trials at various experimental sites to further enhance the precision and applicability of the model used to estimate the chlorophyll content of potato plants. Firstly, the texture features and vegetation indices derived from multispectral images were screened using the Pearson correlation coefficient method, and Normalized difference red edge (NDRE) performed the best over the two growth periods. Secondly, principal component analysis (PCA) was applied to recombine five bands of multispectral images, and third PCA results (PCA3) was selected to combined with NDRE according to the construction principle of NDRE, and the newly constructed parameter was named improved NDRE (INDRE). Finally, INDRE was used to establish a chlorophyll content estimation model of potato plants, and compared with some traditional parameters. The results demonstrated that the INDRE had the maximum accuracy (R2 = 0.7865, RMSE = 2.1378), and corresponding R2 increased by 0.1481 and RMSE decreased by 1.2994 than NDRE. Additionally, the model was validated using independent data from Experiment 2, and INDRE considerably increased estimation accuracy compared to other factors. In conclusions, the INDRE suggested in this study significantly enhances the accuracy and applicability of the chlorophyll content inversion model and can serve as an additional reference for fertilization management.

Breast cancer is the second most common cancer worldwide, primarily affecting women, while histopathological image analysis is one of the possibilities used to determine tumor malignancy. Regarding image analysis, the application of deep learning has become increasingly prevalent in recent years. However, a significant issue is the unbalanced nature of available datasets, with some classes having more images than others, which may impact the performance of the models due to poorer generalisability. A possible strategy to avoid this problem is downsampling the class with the most images to create a balanced dataset. Nevertheless, this approach is not recommended for small datasets as it can lead to poor model performance. Instead, techniques such as data augmentation are traditionally used to address this issue. These techniques apply simple transformations, such as translation or rotation, to the images to increase variability in the dataset. Recently, Generative Adversarial Networks (GANs) have emerged, which can generate images from a relatively small training set. This work aims to enhance the model’s performance in classifying histopathological images by applying data augmentation using GANs instead of traditional techniques.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

This study explores novel techniques to improve the detection accuracy of skarn iron deposits using advanced image processing methodologies. Leveraging the capabilities of Aster image, Band Ratio (BR) images, and Principal Component Analysis (PCA), alongside the power of 3D Convolutional Neural Networks (3D-CNN), the research aims to enhance the precision and efficiency of ore detection in complex geological environments. The proposed method employs a specific 3D-CNN architecture, accepting input as a 7×7×C image patch, where C represents the combined number of selected Aster image bands, Principal Component (PC) bands, and computed BR images. To evaluate the accuracy of the proposed method, five distinct image bands combinations, including the proposed bands combination, were tested and evaluated based on the overall accuracy (OA), average accuracy (AA), and kappa coefficient. The results demonstrated that while the incorporation of BR images alongside Aster bands initially seemed promising, it introduced significant confusion in certain classifications, leading to unexpected mis-classification rates. Surprisingly, utilizing solely Aster bands as input parameters yielded higher accuracy rates (OA= 93.13%, AA = 91.96%, Kappa = 90.91%) compared to scenarios involving the integration with band ratios (OA = 87.02%, AA = 79.15, and Kappa = 82.60%) or the integration of BR images to PC bands (OA= 87.78%, AA = 82.39%, Kappa = 83.81%). However, the amalgamation of Aster bands with selected PC bands showed slight improvements in accuracy (OA= 94.65%, AA = 92.93%, Kappa = 93.45%), although challenges in accurately classifying certain features persisted. Ultimately, the proposed combination of Aster bands, PC bands, and BR images (proposed bands combination) presented the most visually appealing and statistically accurate results (OA = 96.95%, AA= 94.87%, and Kappa = 95.93%), effectively addressing misclassifications observed in the other combinations. These findings underscore the synergistic contributions of each of the Aster bands, PC bands, and BR images, with Aster bands proving pivotal for optimal skarn classification, PC bands enhancing intrusions classification accuracy, and BR images strengthening wall rock classification accuracy. In conclusion, the proposed combination of input image bands emerges as a robust and comprehensive methodology, demonstrating unparalleled accuracy in the remote sensing detection of skarn iron minerals.

Pulmonary Embolism (PE) is the obstruction of blood arteries in the lungs by a blood clot. The mortality risk for PE is approximately 30%. Detecting pulmonary embolism in the segmental arteries of the lung is more challenging than in the main arteries and is very prone to being missed. A computer-based approach was created in this work to automatically identify pulmonary embolism in the segmental arteries using computed tomography images. The system's infrastructure includes an enhanced Mask R-CNN deep neural network that has been trained with images containing PE. The network accurately identifies the location of the pulmonary embolism on the computed tomography picture and successfully extracts its borders. The investigation was conducted by generating a local dataset. The study's performance was evaluated using pulmonary embolisms identified manually by the expert radiologist. The sensitivity, specificity, accuracy, dice coefficient, and Jaccard index values for 2130 pictures were 96.4%, 93.5%, 96.1%, 0.96, and 0.90, respectively. The improved Mask R-CNN model has demonstrated superior performance when compared to the traditional Mask R-CNN and U-Net models. This high-performance technology is designed to identify pulmonary embolism and will aid professionals in assessing the size of the embolism.

Prostate Cancer remains a prevalent health concern, emphasizing the critical need for early diagnosis and precise treatment strategies to mitigate mortality rates. Accurate prediction of cancer grade is paramount for timely interventions. This paper introduces an approach to prostate cancer grading, framing it as a classification problem. Leveraging ResNet models on multi-scale patch-level digital pathology and the Diagset dataset, the proposed method demonstrates notable success, achieving an accuracy of 0.999 in identifying clinically significant prostate cancer. The study contributes to the evolving landscape of cancer diagnostics, offering a promising avenue for improved grading accuracy and, consequently, more effective treatment planning. By integrating innovative deep-learning techniques with comprehensive datasets, our approach presents a step forward in the pursuit of personalized and targeted cancer care.