Unmanned aerial vehicles (UAV) thermal imagery offers several advantages in environmental monitoring, as it can provide a low-cost, high-resolution, and flexible solution to measure the temperature of the surface of the land. Limitations related to the maximum load of the drone lead to use of lightweight uncooled thermal cameras whose internal components are not stabilized to a constant temperature. Such cameras suffer from several unwanted effects that contribute to the increase in temperature measurement error from ±0.5 °C in laboratory conditions, to ±5 °C in unstable flight conditions. This article describes a post processing procedure, that reduces the above unwanted effects. It consists of following steps: i) devignetting using single image vignette correction algorithm, ii) georeferencing of images using EXIF data, scale-invariant feature transform (SIFT) stitching, and gradient descent optimisation, and iii) temperature calibration by minimisation of bias between overlapping thermal images using gradient descent optimisation. The solution was tested in several case studies of river areas, where natural water bodies were used as a reference temperature benchmark. In all tests, the precision of the measurements was increased. The root of the mean of the Square of Errors RMSE on average was reduced by 39.0% and Mean of the absolute value of Errors MAE by 40.5%. The proposed algorithm can be called self-calibrating, as in contrast to other known solutions is fully automatic, uses only field data and does not require any calibration equipment or additional operator effort. A Python implementation of the solution is available on GitHub.

Detecting rotational objects in remote sensing imagery is a significant challenge. These images typically encompass a broad field of view, featuring diverse and intricate backgrounds, with ground objects of various sizes densely scattered. As a result, identifying objects of interest within these images is a daunting task. While the integration of Convolutional Neural Networks (CNN) and Transformer networks leads to some advancements in rotational object detection, there is still room for improvement, particularly in enhancing the extraction and utilization of information related to smaller objects. To address this, our paper presents a multi-scale feature fusion module and a global feature context aggregation module. Initially, we fuse original, shallow, and deep features to reduce the loss of shallow feature information, thereby improving the detection performance of small objects in complex backgrounds. Subsequently, we compute the correlation of contextual information within feature maps to extract valuable insights. We name the newly proposed model the "Multiscale Feature Context Aggregation Module" (MFCA). We evaluate our proposed methodology on three challenging remote sensing datasets: DIOR-R, HRSC, and MAR20. Comprehensive experimental results show that our approach surpasses baseline models by 2.07\% mAP, 1.02\% mAP, and 1.98\% mAP on the DIOR-R, HRSC2016, and MAR20 datasets, respectively.

Global Earth Observation (EO) is becoming increasingly important in understanding and addressing critical aspects of life on our planet about environmental issues, natural disasters, sustainable development and others. EO plays a key role in making informed decisions on applying or reforming land use, responding to disasters, shaping climate adaptation policies etc. EO is also becoming a useful tool for helping professionals make the most profitable decisions, e.g., in real estate or the investment sector. Finding similarities in landscapes may provide useful information regarding applying contiguous policies, taking alike decisions or learning from best practices on events and happenings that have already occurred in similar landscapes in the past. However, current applications of similar landscape retrieval are limited by moderate performance and the need for time-consuming and costly annotations. We propose splitting the similar landscape retrieval task into a set of smaller tasks that aim at identifying individual concepts inherent to satellite images. Our approach relies on several models trained with Unsupervised Representation Learning (URL) on Google Earth images to identify these concepts. We show the efficacy of matching individual concepts for tackling the task of retrieving similar landscape(s) to a user-selected satellite image with a proof-of-concept application of the proposed approach on the geographical territory of the Republic of Cyprus. Our results demonstrate the efficacy of breaking up the landscape similarity task into individual concepts closely related to remote sensing instead of trying to capture all concepts and image semantics with a single model like a single RGB semantics model.

With the increasing utilization of intelligent mobile devices for online inspection of electrical equipment in smart grids, the limited computing power and storage capacity of these devices pose challenges for deploying large algorithm models and it’s hard to obtain a substantial number of images of electrical equipment in public. In this paper, we propose a novel distillation method that compresses the knowledge of teacher networks into a compact few-shot classification network, employing a global and local knowledge distillation strategy. Central to our method is exploiting the global and local relationship between the features exacted by the backbone of the teacher network and student network. We compare our method with recent state-of-the-art (SOTA) methods on three public datasets and achieve superior performance. Additionally, we contribute a new dataset, namely EEI-100, which is specifically designed for classification of electrical equipment. We validate our method on this dataset and demonstrate its exceptional prediction accuracy of 94.12% when utilizing only 5-shot images.

Multi-source image registration often suffered from great radiation and geometric differences. Specifically, gray scale and texture from similar landforms in different source images often show significantly different visual features. And these differences disturb the corresponding point extraction in the following image registration process. Considering that edges between heterogeneous images can provide homogeneous information and more consistent features can be extracted based on image edges, an edge consistency radiation-change insensitive feature transform (EC-RIFT) method is proposed in this paper. Firstly, the noise and texture interference are reduced by preprocessing according to the image characteristics. Secondly, image edges are extracted based on phase congruency, and an orthogonal Log-Gabor filter is performed to replace the global algorithm. Finally, the descriptors are built with logarithmic partition of the feature point neighborhood, which improves the robustness of descriptors. Comparative experiments on datasets containing multi-source remote sensing image pairs show that the proposed EC-RIFT method outperforms other registration methods in terms of precision and effectiveness.

Remotely sensed data acquired by multispectral sensors can be used to monitor soil moisture (SM) across a larger land area than in situ monitoring alone. Although there have been wide-ranging applications of remote sensing tools in SM estimation on many ecosystems, there is a limited understanding of their accuracy in restored wetlands. The objective of this study was to examine the potential of remotely sensed data from Landsat-9, Sentinel-1A SAR, and Blackswift E2 Uncrewed Aircraft Systems (UAS) in predicting SM in a restored wetland complex in the Gunnison Basin of Colorado. We tested two response variables, gravimetric SM and volumetric SM, to determine which indicator of SM was better predicted with remotely sensed data. We also tested the accuracy of remotely sensed data in predicting SM at different soil depths. Overall, satellite and UAS indices predicted gravimetric SM better than volumetric SM. The Normalized Difference Red Edge (NDRE) index from Blackswift E2 UAS had the best prediction of GSM at the depth of 0 to 5 cm (R2 = 0.86, RMSE = 7.41). Results from the study provide information on the accuracy of remotely sensed data for SM monitoring on restored wetlands.

Oral Squamous Cell Carcinoma is one among the most common cancer and early detection is the main key to avoid deaths. Automated diagnostic tools that process the histopathological images of a patient to detect abnormal oral lesions will be very much useful for the clinicians. A deep learning framework have been designed with an intermediate layer between feature extraction layers and classification layers for classifying the histopathological images into two categories, namely normal and oral squamous cell carcinoma. The intermediate layer is constructed using the proposed Swarm Intelligence technique called Modified Gorilla Troops Optimizer. Various optimization algorithms are implemented in literature for optimal parameter identification, weights updating and feature selection in deep learning models, but this work focuses on usage of optimization algorithm as intermediate layer that transforms the extracted features into the features that are more suitable for classification. Three datasets totally comprising 2784 normal and 3632 oral squamous cell carcinoma subjects are considered in this work. Three popular CNN architectures namely InceptionV2, MobileNetV3, and EfficientNetB3 are investigated as feature extraction layers. Two fully connected Neural Network layers along with batch normalization and dropout are used as classification layers. Among the investigated feature extraction models, MobileNetV3 performs well in all the three datasets with the highest accuracy of 0.89. Usage of the proposed Modified Gorilla Troops Optimizer as an intermediate layer boosts this accuracy to 0.95.

Objectives: Evaluate hand-held echocardiography (HHE) performed and interpreted by trained Advanced Practice Providers (APPs) on hospitalized CHF patients for image quality and interpretation, by comparing against expert echocardiographer and SE findings. Background: Congestive heart failure (CHF) is associated with increased hospital admissions and mortality. While standard echocardiogram (SE) is the gold standard for cardiac assessment, it is not readily available. Hospitalized CHF patients require rapid assessment for expedited treatment. Methods: Over 6 months, five trained APPs performed HHE on hospitalized CHF patients and interpreted: a) Left ventricular (LV) size, b) LV ejection fraction (LVEF), and c) right atrial pressure (RAP). The study echocardiographer reviewed and blindly interpreted HHE images and compared with APPs and SE findings. Kappa-statistics determined the degree of agreement between APPs and study echocardiographer interpretation of HHE images and SE. Results: 80 CHF patients [age 73±14 years, 58% males; LVEF (by SE) 45±19%; 36.3% body mass indexes ≥30 kg/m2] were enrolled. HHE interpretation by APPs had good agreement for LVEF (kappa 0.79) with study echocardiographer and SE (kappa 0.74), and good agreement for RAP (kappa 0.67) with study echocardiographer. Correlation between absolute LVEF interpretation by study echocardiographer on HHE and SE was r=0.88 (p<0.0001). Conclusions: Trained APPs obtained diagnostic-quality HHE images and interpreted LV function and RAP in CHF patients, with good agreement with the study echocardiographer. LVEF by HHE correlated with LVEF by SE. Our study suggests trained APPs can use HHE to evaluate LVEF and RAP in CHF patients leading to expedited and optimized treatment.

This research focused on the perception of visually impaired individuals regarding tactile image creation using 3D printing. We developed and applied an experiment with 28 participants with visual impairments. They performed tasks based on skills whose foundations are needed and used in their daily lives, such as scanning, tactile discrimination, picture and spatial comprehension. The tactile images used in this study were developed by additive manufacturing and printed over 180 g/m² sulphite paper. The best performances were obtained when (1) the tactile image contour line heights were between 0.2 mm and 0.4 mm; and (2) the texture presented densities between 10% and 50%, when alone, or between 10% and 90%, when combined with another texture. The tested line widths (0.8 mm and 1.2 mm) did not present statistically significant differences in the results. Vision status (low vision or blindness) and moment of vision loss (congenital or late blind) did not influence the results. Schooling affected the activities of identifying objects and locating their copies. In the Conclusion section, there is a detailed recommendation list for the production and application of tactile materials, which range from simplifying forms to encouraging the use of both hands during content assimilation.

Oriented object detection is a challenging task in scene text detection and remote sensing image analysis, which has attracted extensive attention in recent years with the development of deep learning. Currently, mainstream oriented object detectors are based on preset anchor boxes. This method increases the computational load of the network and cause a large amount of anchor box redundancy. To solve this problem, we propose anchor-free oriented object detection based on the Gaussian centerness(AOGC), a single-stage anchor-free detection method. Our method uses contextual attention FPN(CAFPN) to obtain the contextual information of the target. Then we design a label assignment method for oriented objects. Finally, we develop a Gaussian kernel-based centerness branch, which can effectively determine the significance of different anchors. AOGC achieves mAP of 74.30% on the DOTA-1.0 datasets and 89.80% on the HRSC2016 datasets, respectively. AOGC exhibits superior performance to other methods in oriented anchor-free object detection methods.

Landward displacement of coastal boulders is a morphodynamic signature of inundation and erosion processes. The study of these movements can provide useful elements for coastal hazards assessment. In this note, using open-access remote sensing resources, the 2017 to 2021 annual mobility of medium, coarse, and very coarse boulders spread over about 100 km of the eastern coast of the Gulf of Taranto (Italy) is detected. A large interannual variability was found. As established by multi-temporal object-based image analysis, one hundred and ten boulders changed position between July 2019 and June 2020, no boulder was displaced between July 2017 and July 2018, and few boulders were displaced between July 2018 and July 2019, and June 2020 and September 2021. A hydrodynamic analysis of the investigated boulder displacement led to the estimation of the energy of nearshore waves that hit the coast. The storm Detlef, that crossed over the Mediterranean Sea during 11-13 November 2019, is presumed to be the main cause of the massive displacement phenomenon.

Accurate detection of forest restoration sites using deep learning is crucial for effective ecosystem management, optimizing reforestation efforts, and ensuring environmental sustainability. While various deep learning-based systems have been developed for this purpose, the influence of different neural network architectures on model performance during the identification of forest restoration sites remains underexplored. This study aimed to address this gap by exploring the optimal methodology for extracting and classifying candidate sites for forest restoration based on Convolutional Neural Networks (CNNs), specialized for image recognition. Four categories—arable land, road and barren, quarry, and forest—were defined as candidate sites for forest restoration. A dataset comprising 17,043 samples was divided into training (11,929) and validation (5,114) sets at a ratio of 7:3 for model learning. Model accuracy was evaluated using pixel accuracy (PA) and mean intersection over union (mean IoU). The Resnet152-U-Net model demonstrated a pixel accuracy of 95.2% and a mean IoU of 61.3%, indicating excellent performance in extracting candidate sites for forest restoration. This approach offers spatial and temporal advantages over conventional field surveys or aerial image-based assessments, potentially serving as valuable data for selecting future forest restoration sites.

Side-scan sonar (SSS) detection is a key method in applications such as underwater environmental security and subsea resource development. The use of acoustic images for seabed target detection has gradually become a mainstream underwater detection method. However, many existing detection approaches primarily concentrate on tracking the evolution path of optical image object detection tasks, resulting in complex structures and limited versatility. To tackle this issue, we introduce a pioneering Dual-Domain Multi-Frequency Network (D2MFNet) meticulously crafted to harness the distinct characteristics of SSS image detection. In D2MFNet, aiming at the underwater detection requirements of small scenes, we introduce a novel method for optimize and improve the detection sensitivity of different frequency ranges and propose a Multi-Frequency Combined Attention Mechanism (MFCAM). This mechanism amplifies the relevance of dual-domain features across different channels and space. Moreover, recognizing that SSS images can provide richer insights after frequency domain conversion, we introduce a Dual-Domain Feature Pyramid Network (D2FPN). By incorporating frequency domain information representation, D2FPN significantly augments the depth and breadth of feature information in underwater small datasets. Our methods are seamlessly designed for integration into existing networks, offering plug-and-play functionality with substantial performance enhancements. We have conducted extensive experiments to validate the efficacy of our proposed techniques, and the results showcase their state-of-the-art performance. MFCAM improves the mAP by 16.9% in the KLSG dataset and 15.5% in the SCTD dataset. The mAP of D2FPN was improved by 8.4% in the KLSG dataset and by 9.8% in the SCTD dataset. We will make our code and models publicly available at https://dagshub.com/estrellaww00/D2MFNet.

The primary goal of picture compression is to reduce the amount of unused image data while still storing or transmitting it in a format that is appropriate. The compression of raw binary data is quite different from the compression of a picture, and these differences may be rather substantial. In light of this, compression is often regarded as an essential technique for the purposes of both data storage an d transmission in order to mitigate the excessive amounts of data that are generated by these images. In order to transmit enormous datasets, particularly for the purposes of telemedicine and teleradiology, one needs a significant amount of storage capacity as well as an expansive network. As a result, compression is an important aspect of medical imaging. In addition to the importance of compression, the quality of the photos themselves is also an essential factor in the success of analysis. In addition to this, the amount of time necessary to compress the photographs before sending them should be reduced.

When two black holes form a binary system, each black hole observes an event horizon and a curved distorted space-time region around the other black hole. In this space-time, two such regions are formed, and another black hole forms in the second region from the initial black hole, which may be termed the “image” of the first black hole. The same event occurs for the other black hole also, and an extra image of it is formed. In these conditions, the energy of the system divides between the two black holes and their images. These four new black holes that are formed interact with each other again and produce new horizons and new distorted regions. Each black hole produces an image of all the other black holes and detects the background of six black holes instead of three. Consequently, for four black holes, 24 new black holes arise. The energy of the system will be divided amongst all 24 black holes. This story continues and black holes interact with one another and produce new images. Finally, very light black holes are formed each of which is so weak that it cannot produce strong distortions of space-time. The radiated gravitational waves from these weak black holes could be detected by LIGO as well as the signature of these binary black holes. However, detected waves are only a part of very strong gravitational waves. Each time a part of these waves escapes from the system and reaches the earth, they may be regarded as emitted waves from a new binary black hole. The time between radiated signals decreases, and it may be interpreted that a new supermassive binary black hole is radiating. If radiated signals combine, an explosion of the very strong binary system could be detected.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

Immunohistochemistry is a powerful technique, widely used in biomedical research and clinics, that allows to determine the expression levels of some proteins of interest in tissue samples by means of the intensity of color due to the expression of biomarkers using specific antibodies. As such, immunohistochemical images are complex and problematic to be quantified. Recently we proposed a novel method including a first separation stage based on nonnegative matrix factorization (NMF) that achieved good results. However, that method was highly dependent on sparseness and non-negativity parameter choice and on algorithm initialization. Furthermore, the previously proposed method needed a reference image as starting point for the NMF algorithm. In the present work, we propose a new, simpler and robust method for the automated unsupervised scoring of immunohistochemical images based on bright field. Our work is focused on images from tumor tissues marked with blue (nuclei) and brown (protein of interest). The new proposed method represents a simpler approach that, in one side, avoids the use of NMF for the separation stage, and in the other side, circumvents the need for a control image. This new approach determines the subspace spanned by the two colors of interest by means of principal component analysis (PCA) with dimension reduction. This subspace is a two-dimensional space, allowing the finding of color vectors by considering the peaks of density of points. The method also develops a new scoring stage by avoiding, again, reference images, making the procedure more robust and less dependent on the parameters. Experiments for the semi-quantitative scoring of images in five categories exhibit promising and consistent results when compared to manual scoring carried out by experts.

X-band marine radar captures signal reflected from the sea surface. Theoretical studies indicate that the initial unfiltered signal contains meaningful information including parameters related to wind waves. Traditional methods for estimating significant wave height (SWH) rely on the physical laws describing signal reflection from rough surfaces. However, recent studies suggest the feasibility of employing artificial neural networks (ANNs) for SWH approximation. Both classical and ANN-based approaches necessitate costly in situ data. In this study, we propose generating synthetic radar images with specified wind wave parameters using Fourier-based approach and Pierson–Moskowitz wave spectrum as a viable alternative. We generate synthetic images and use them for unsupervised learning approach to train a convolutional component of an ANN. After that, we train a regression ANN based on the previous convolutional component to obtain SWH back from synthetic images. Then, we apply preliminary trained weights for the same regression model to train SWH approximation on the dataset of real sea clutter images. In this study, we demonstrate the increase in the accuracy of SWH estimation from radar images with the preliminary training on synthetic data.

Sacroiliac (SI) joint dysfunction can lead to debilitating pain but can be treated with minimally invasive sacroiliac joint fusion (SIJF). This treatment is commonly performed using 2D fluoroscopic guidance. This makes placing the implants without damaging surrounding neural structures challenging. Virtual surgical planning (VSP) using simulated fluoroscopic images may improve perioperative guidance. This article describes a workflow with VSP in SIJF using simulated fluoroscopic images and evaluates achieved implant placement accuracy. Routinely collected survey data on the added value of VSP were also evaluated. Ten interventions were performed on 10 patients by the same surgeon, comprising 30 implants; the median age was 39 years, and all patients were female. The overall mean implant placement accuracy was 4.9 ± 1.26 mm and 4.0 ± 1.44°. There were no malpositioning complications. The VSP helped the surgeon understand the anatomy and determine the optimal position and length of the implants. The average Likert scale score of the survey was 4.7, suggesting a positive role of VSP for SIJF. Planned positions of the implants could be reproduced in surgery with clinically acceptable accuracy and VSP was a valuable asset for the surgeon.

Malaria is one of the life-threatening disease caused by the Anopheles mosquitoes affecting the human red blood cells. It is the global health concern which is quite common in tropical as well as sub-tropical parts of the World. Therefore, it is an important to have an effective computer aided system in place for early detection and treatment. State of the art machine learning techniques are used to detect the infected malaria cells from the pool of images. As the visual heterogeneity of the malaria dataset is highly complex and dynamic, therefore higher number of images are needed to train the machine learning models effectively. However, hospitals as well as medical institutions do not share the medical image data for collaboration due to general data protection regulation (GDPR) and data protection act (DPA). To overcome this collaborative challenge, our research is inspired to use the real-time medical image data while using the framework of federated learning (FL) framework that will ensure the data privacy while mutual collaboration of hospitals and medical institutes. We have used the state of the art machine learning models that include the Resnet50 and densenet in a federated learning framework. We have experimented both models in different settings and our preliminary results showed that the densenet model performed better in accuracy (75%) in contrast to resnet50 (72%) while considering 8 clients, while the trend is observed common in 4 clients with the similar accuracy of 94% and 6 client showed that the densenet model performed quite well with the accuracy of 92% while resnet50 achieving only 72%.

Byers Peninsula is considered one of the largest ice-free areas in Maritime Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes in lives cycles, limnology and microbiology. Soils from maritime Antarctica are generally weakly developed and have chemical, physical and morphological characteristics strongly influenced by the parent material. However, biological activity during the short Antarctic summer promotes intense transference of nutrients and organic matter in areas occupied by different species of birds and marine mammals. To mapping and monitoring those areas with high biological occupation, could be very useful to have models of edaphic properties prepared from satellite images. In this approach, Deep Learning and Linear Regression models of soil properties and spectral indexes as explicative variables were performed. We training models of soil properties closely related to biological activity such as Dissolved Organic Carbon (DOC) and the iron fraction associated with organic matter (Fe). We tested the best approach to model the spatial distribution of DOC, Fe and pH by training models of Linear Regression and Deep Learning over Sentinel2 and WorldView2 images. The most robust models were used to track possible areas with ornithogenic soils as well as areas of the Byers Peninsula that could support the highest biological development.

In this paper, a relatively new hyper convolution spectra for characterization liquid, viscoelastic and solid samples is presented. Special attention is paid to the biophysical characterization of epithelial tissues and early detection of cancer of the skin, cervix, colon, and oral cavity. The method is based on the use of two types of white light, diffuse and polarized, from the same LED light sources. Based on the subtraction of the intensity values of these two lights and using the hyper convolution algorithm, the ratio of paired and unpaired electrons of tissue is obtained. This ratio correlates well with the state of the tissue: normal, irritating, precancerous, and cancerous. First, a proof-of-concept studies were performed, and later clinical studies on samples from one thousand two hundred fifteen people were performed. It showed that hyper Opto-Magnetic Imaging Spectroscopy (OMIS) can detect epithelial tissue cancers with an accuracy of 85-96%. Bearing in mind that the OMIS method also acquires the biophysical characteristics of the deeper skin layers (epidermis, basement membrane, dermis) by analysing convolution spectra of RGB channels of both diffuse and polarized white light, it is possible to apply this method in cosmetics (skin hydration, collagen, and elastin states, etc.). During OMIS applications, we noticed places where improvements could be made to increase method’s accuracy using advanced machine learning methodologies.

Deep neural networks (DNNs) have gained prominence in addressing regression problems, offering versatile architectural designs that cater to various applications. In the field of earthquake engineering, seismic response prediction is a critical area of study. Simplified models such as single-degree-of-freedom (SDOF) and multi-degree-of-freedom (MDOF) systems have traditionally provided valuable insights into structural behavior, known for their computational efficiency facilitating faster simulations. However, these models have notable limitations in capturing the nuanced nonlinear behavior of structures and the spatial variability of ground motions. This study focuses on leveraging ambient vibration (AV) measurements of buildings, combined with earthquake (EQ) time-history data, to create a predictive model using a neural network (NN) in image format. The primary objective is to predict a specific building's earthquake response accurately. The training dataset consists of 1,197 MDOF 2D shear models, generating a total of 32,319 training samples. To evaluate the performance of the proposed model, termed MLPER (Machine Learning based Prediction of building structures' Earthquake Response), several metrics are employed. These include mean absolute percentage error (MAPE) and mean deviation angle (MDA) for comparisons in the time domain. Additionally, we assess magnitude-squared coherence values and phase differences (Δφ) for comparisons in the frequency domain. This study underscores the potential of MLPER as a reliable tool for predicting building earthquake response, addressing the limitations of simplified models. By integrating AV measurements and EQ time-history data into a neural network framework, MLPER offers a promising avenue for enhancing our understanding of structural behavior during seismic events, ultimately contributing to improved earthquake resilience in building design and engineering.

Byers Peninsula (62°34’-62°40’S-60°54’61°13’W), 60 km2 in size, is considered one of the largest ice-free areas in Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes, limnology and microbiology, live cycles, but not albedo. Surface albedo is one of the key physical parameters in the surface energy budget of polar regions. Most of Antarctica is covered by ice sheets; only about 0.44% of the area is permanently ice-free. However, in maritime Antarctica, the ice-free areas, corresponding to small islands, peninsulas, and coastal beaches, account for about 3% of the territory. To incorporate the contribution of these areas into global albedo models, it is necessary to relate the soil properties of the ice-free areas to the surface albedo response. Also, mapping soil properties and albedo have and special interest in these ice-free areas. Image classification using machine learning methods trained with georeferenced soil data could be useful for mapping soil properties and albedo in multispectral optical satellite images. A shallow neural network implemented using the Keras Python module was used to define and train models of soil properties using 15 explanatory variables corresponding to bands and spectral indices of a Sentinel image and a population of 49 soil samples taken from the top 5 centimeters of the soil profile. The soil samples were analyzed in the laboratory and a spectral library in the Vis-Nir range (350-2500 nm) was created. The albedo of the samples was integrated from the ADS spectra. At the same time, a linear regression model of albedo using the soil properties as explanatory variables was performed. The R2 fit of this new model was about 0.82 and the error of estimation was 4.1. The model was extended to the entire Byers Peninsula using the ML soil property models as explanatory variables. The RMSE of the extended models increased up to 8.2. We think that the main cause of this increase (2.6 points) is related to the error propagation, phenomenon due to the use of models as explanatory variables. However, another important part of the error increase could be due, among other reasons, to the use of an image that, although corrected, is not completely free of clouds.

In recent years, ontology plays an important role in facilitating the semantic description of images which consists of describing the image by a set of words to describe the scene which signifies the belonging of the image. This description specified in several archaeological fields such as cultural, religious objects and heritage objects of France. However, the description of archaeological images is not yet exploited because this field is very diverse. In this article, we present a panel of ontology construction methods as well as archaeological ontologies. Also, we show our own OntunAr ontology to describe Tunisian archaeological images. In addition, we integrate OnTunAr into the automatic annotation of Tunisian archaeological images.

Street view images can help us better understand the city environment and potential characteristics. With the development of computer vision and deep learning, the technology of semantic segmentation algorithms has become more mature. However, DeeplabV3+, which is commonly used in semantic segmentation, has shortcomings such as a large number of parameters, high requirements for computing resources, and easy loss of detailed information. Therefore, this paper proposes LM-DeeplabV3+, which aims to greatly reduce parameters and computations of the model while ensuring the segmentation accuracy. Firstly, the lightweight network MobileNetV2 is selected as the backbone network, and the ECA attention mechanism is introduced after MobileNetV2 extracts shallow features to improve the ability of feature representation; secondly, the ASPP module is improved, and on its basis, the EPSA attention mechanism is introduced to achieve cross-dimensional channel attention and important feature interaction; thirdly, a loss function named CL loss is designed to balance the training offset of multiple categories and better indicate the segmentation quality. This paper conducted experimental verification on the Cityspaces dataset, and the results showed that the mIoU reached 74.9%, which was an improvement of 3.56% compared to DeeplabV3+; the mPA reached 83.01%, which was an improvement of 2.53% compared to DeeplabV3+.

A land cover map of two arctic catchments, nearby the Abisko Scientific Research Station, was obtained from a classification of a Sentinel-2 satellite image and a ground survey performed in July 2022. The two contiguous catchments, Miellajokka and Stordalen, are covered by various ecotypes, from boreal forest to alpine tundra and peatland. Two classification algorithms, support vector machine and random forest, were tested and gave very similar results. The percentage of correctly classified pixels was over 88% in both cases. The developed workflow relies solely on open source software and acquired ground observations. Space organization was directed by the altitude as demonstrated by the intersection of the land cover with the topography. Comparison between this new land cover map and previous ones based on data acquired between 2008 and 2011 shows some trends of vegetation cover evolution in response to climate change in the considered area. This land cover map is key input data for permafrost modeling, and hence for the quantification of climate change impacts in the studied area.

(1) Background: The aim of the research was to present and emphasize the importance of magnetic resonance imaging (MRI) in diagnosing Achilles tendon (AT) ruptures by presenting case reports. (2) Materials and Methods: The sample of respondents included 7 patients (4 males and 3 females, 2 athletes and 5 non-athletes), aged 25 to 58 years, with AT injuries, who were examined and treated at the Institute for Treatment and Rehabilitation "Niška Banja", Niš, Serbia. Ankle examinations with MRI were conducted using the Esaote O-scan 0.3 T machine. The examinations were performed without the application of a paramagnetic contrast agent and without the use of anesthesia. Results: The MRI method's sensitivity and overall diagnostic accuracy were excellent, with 100% true positives. In our study, the method accurately detected the presence, location, and severity of AT injuries in all cases. MRI is an important and reliable method for detecting AT injuries, classifying them, monitoring the course of recovery, and assessing the effects of therapy. Conclusions: An unrecognized or delayed diagnosis of an AT injury can lead to chronic changes. Timely diagnosis (clinical examination, ultrasonography, magnetic resonance imaging) and appropriate treatment (conservative or operative) enable patients to return to normal activities, including sports. Unfortunately, the use of MRI is limited by restricted access and the cost of the examination.

The capability of in-house transient wave-multibody computational tool of ITU-WAVE are extended to predict the wave power absorption with Wave Energy Converters (WECs) arrays placed in front of a vertical breakwater. The analyses of hydrodynamic exciting and radiation forces are approximated solving boundary integral equation at each time interval. The reflection of incoming waves due to a vertical wall is predicted with method of images. The constructive or destructive performance of WECs arrays with different array configurations is measured with mean interaction factor. The behaviour of the exciting and radiation hydrodynamic forces of each WEC due to a vertical wall effect shows considerable differences than those of WECs arrays without a vertical wall influence. When the wave power absorption with WECs arrays with and without a vertical wall effect are compared, it is shown with numerical experiences that WECs placed in front of a vertical wall have much greater effects on wave power absorption. This can be attribute to the hydrodynamic interaction, standing waves, and nearly trapped waves in the gap between a vertical wall and WECs arrays. The analytical and other numerical results are used to for the validation of the numerical results of the present ITU-WAVE computational tool for exciting and radiation forces, and mean interaction factor of WECs arrays which show satisfactory agreements.

Cloud detection in remote sensing images is a crucial preprocessing step that efficiently identifies and extracts cloud-covered areas within the images, ensuring the precision and reliability of subsequent analyses and applications. Given the diversity of clouds and the intricacies of the surface, distinguishing the boundaries between thin clouds and the underlying surface is a major challenge in cloud detection. To address these challenges, an advanced cloud detection method, CloudformerV3, is presented in this paper. The proposed method employs a multi-scale adapter to incorporate dark and bright channel prior information into the model's backbone, enhancing the model's ability to capture prior information and multi-scale details from remote sensing images. Additionally, multi-level large window attention is utilized, enabling high-resolution feature maps and low-resolution feature maps to mutually focus and subsequently merge during the resolution recovery phase. This facilitates the establishment of connections between different levels of feature maps and offers comprehensive contextual information for the model's decoder. Experimental results on the GF1_WHU dataset demonstrate that the method introduced in this paper exhibits superior detection accuracy when compared to state-of-the-art cloud detection models. Furthermore, enhanced detection performance is achieved along cloud edges and with respect to thin clouds, showcasing the efficacy of the proposed method.

The spectrums of one type of object under different conditions have the same features (up, down, protruding, concave) at the same spectral positions, which can be used as primary parameters to evaluate the difference among remotely sensed pixels. Wavelet-feature correlation ratio Markov clustering algorithm (WFCRMCA) for the remotely sensed data is proposed based on an accurate description of abrupt spectral features and an optimized Markov clustering in the wavelet feather space. The peak points can be captured and identified by applying a wavelet transform to spectral data. The correlation ratio between two samples is a statistical calculation of the matched peak point positions on the wavelet feature within an adjustable spectrum domain or a range of wavelet scales. The evenly sampled data can be used to create class centers, depending on the correlation ratio threshold at each Markov step, accelerating the clustering speed by avoiding the computation of Euclidean distance for traditional clustering algorithms, such as K-means and ISODATA. Markov clustering applies several strategies, such as a simulated annealing method and gradually shrinking the clustering size, to control the clustering convergence. At each clustering tempera-ture, it can obtain the best class centers quickly. The experimental results of the Airborne Visible/ Infrared Imaging Spectrometer (AVIRIS) and Thermal Mapping (TM) data have verified its ac-ceptable clustering accuracy and high convergence velocity.

Using UAV-based multispectral images for quickly and accurately monitoring chlorophyll content is critical for field management and yield estimation. However, the lower model accuracy and the poor robustness of the estimation models are still preventing the widespread application of UAV-based multispectral images. We carried out two field trials at various experimental sites to further enhance the precision and applicability of the model used to estimate the chlorophyll content of potato plants. Firstly, the texture features and vegetation indices derived from multispectral images were screened using the Pearson correlation coefficient method, and Normalized difference red edge (NDRE) performed the best over the two growth periods. Secondly, principal component analysis (PCA) was applied to recombine five bands of multispectral images, and third PCA results (PCA3) was selected to combined with NDRE according to the construction principle of NDRE, and the newly constructed parameter was named improved NDRE (INDRE). Finally, INDRE was used to establish a chlorophyll content estimation model of potato plants, and compared with some traditional parameters. The results demonstrated that the INDRE had the maximum accuracy (R2 = 0.7865, RMSE = 2.1378), and corresponding R2 increased by 0.1481 and RMSE decreased by 1.2994 than NDRE. Additionally, the model was validated using independent data from Experiment 2, and INDRE considerably increased estimation accuracy compared to other factors. In conclusions, the INDRE suggested in this study significantly enhances the accuracy and applicability of the chlorophyll content inversion model and can serve as an additional reference for fertilization management.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

This study explores novel techniques to improve the detection accuracy of skarn iron deposits using advanced image processing methodologies. Leveraging the capabilities of Aster image, Band Ratio (BR) images, and Principal Component Analysis (PCA), alongside the power of 3D Convolutional Neural Networks (3D-CNN), the research aims to enhance the precision and efficiency of ore detection in complex geological environments. The proposed method employs a specific 3D-CNN architecture, accepting input as a 7×7×C image patch, where C represents the combined number of selected Aster image bands, Principal Component (PC) bands, and computed BR images. To evaluate the accuracy of the proposed method, five distinct image bands combinations, including the proposed bands combination, were tested and evaluated based on the overall accuracy (OA), average accuracy (AA), and kappa coefficient. The results demonstrated that while the incorporation of BR images alongside Aster bands initially seemed promising, it introduced significant confusion in certain classifications, leading to unexpected mis-classification rates. Surprisingly, utilizing solely Aster bands as input parameters yielded higher accuracy rates (OA= 93.13%, AA = 91.96%, Kappa = 90.91%) compared to scenarios involving the integration with band ratios (OA = 87.02%, AA = 79.15, and Kappa = 82.60%) or the integration of BR images to PC bands (OA= 87.78%, AA = 82.39%, Kappa = 83.81%). However, the amalgamation of Aster bands with selected PC bands showed slight improvements in accuracy (OA= 94.65%, AA = 92.93%, Kappa = 93.45%), although challenges in accurately classifying certain features persisted. Ultimately, the proposed combination of Aster bands, PC bands, and BR images (proposed bands combination) presented the most visually appealing and statistically accurate results (OA = 96.95%, AA= 94.87%, and Kappa = 95.93%), effectively addressing misclassifications observed in the other combinations. These findings underscore the synergistic contributions of each of the Aster bands, PC bands, and BR images, with Aster bands proving pivotal for optimal skarn classification, PC bands enhancing intrusions classification accuracy, and BR images strengthening wall rock classification accuracy. In conclusion, the proposed combination of input image bands emerges as a robust and comprehensive methodology, demonstrating unparalleled accuracy in the remote sensing detection of skarn iron minerals.

Pulmonary Embolism (PE) is the obstruction of blood arteries in the lungs by a blood clot. The mortality risk for PE is approximately 30%. Detecting pulmonary embolism in the segmental arteries of the lung is more challenging than in the main arteries and is very prone to being missed. A computer-based approach was created in this work to automatically identify pulmonary embolism in the segmental arteries using computed tomography images. The system's infrastructure includes an enhanced Mask R-CNN deep neural network that has been trained with images containing PE. The network accurately identifies the location of the pulmonary embolism on the computed tomography picture and successfully extracts its borders. The investigation was conducted by generating a local dataset. The study's performance was evaluated using pulmonary embolisms identified manually by the expert radiologist. The sensitivity, specificity, accuracy, dice coefficient, and Jaccard index values for 2130 pictures were 96.4%, 93.5%, 96.1%, 0.96, and 0.90, respectively. The improved Mask R-CNN model has demonstrated superior performance when compared to the traditional Mask R-CNN and U-Net models. This high-performance technology is designed to identify pulmonary embolism and will aid professionals in assessing the size of the embolism.