Byers Peninsula (62°34’-62°40’S-60°54’61°13’W), 60 km2 in size, is considered one of the largest ice-free areas in Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes, limnology and microbiology, live cycles, but not albedo. Surface albedo is one of the key physical parameters in the surface energy budget of polar regions. Most of Antarctica is covered by ice sheets; only about 0.44% of the area is permanently ice-free. However, in maritime Antarctica, the ice-free areas, corresponding to small islands, peninsulas, and coastal beaches, account for about 3% of the territory. To incorporate the contribution of these areas into global albedo models, it is necessary to relate the soil properties of the ice-free areas to the surface albedo response. Also, mapping soil properties and albedo have and special interest in these ice-free areas. Image classification using machine learning methods trained with georeferenced soil data could be useful for mapping soil properties and albedo in multispectral optical satellite images. A shallow neural network implemented using the Keras Python module was used to define and train models of soil properties using 15 explanatory variables corresponding to bands and spectral indices of a Sentinel image and a population of 49 soil samples taken from the top 5 centimeters of the soil profile. The soil samples were analyzed in the laboratory and a spectral library in the Vis-Nir range (350-2500 nm) was created. The albedo of the samples was integrated from the ADS spectra. At the same time, a linear regression model of albedo using the soil properties as explanatory variables was performed. The R2 fit of this new model was about 0.82 and the error of estimation was 4.1. The model was extended to the entire Byers Peninsula using the ML soil property models as explanatory variables. The RMSE of the extended models increased up to 8.2. We think that the main cause of this increase (2.6 points) is related to the error propagation, phenomenon due to the use of models as explanatory variables. However, another important part of the error increase could be due, among other reasons, to the use of an image that, although corrected, is not completely free of clouds.

Hyper spectral imaging (HSI) is a technique that is used to obtain the spectrum for each pixel in the image. It helps in finding objects and identifying materials etc. Such an identification is very difficult using other imaging techniques. It allows the researchers to investigate the documents without any physical contact. Nowadays detection of unequal Ink mismatch based on HSI has shown vast improvement in distinguishing the inks. Detection of unequal Ink mismatch is an unbalanced clustering problem. This paper used K-means Clustering for ink mismatch detection. K-means Clustering find same subgroups in the data based on Euclidean distance. This paper demonstrates performance in unequal Ink mismatch based on HSI.

This paper describes the first results of an Image Recognition Based Location (IRBL) for mobile application focusing on the procedure to generate a Database of range images (RGB-D). In an indoor environment, to estimate the camera position and orientation, a prior spatial knowledge of the surrounding is needed. In order to achieve this objective a complete 3D survey of two different environment (Bangbae metro station of Seoul and E.T.R.I. building in Daejeon – Republic of Korea) was performed using LiDAR (Light Detection And Ranging) instrument and the obtained scans were processed in order to obtain a spatial model of the environments. From this, two databases of reference images were generated using a specific software realized by the Geomatics group of Politecnico di Torino (ScanToRGBDImage). This tool allow to generate synthetically different RGB-D images) centered in the each scan position in the environment. Later, the external parameters (X, Y, Z, ω, φ, κ) and the range information extracted from the DB images retrieved, are used as reference information for pose estimation of a set of acquired mobile pictures in the IRBL procedure. In this paper the survey operations, the approach for generating the RGB-D images and the IRB strategy are reported. Finally the analysis of the results and the validation test are described.

Knowledge on the health of banana trees is critical for farmers to profit from banana cultivation. Fusarium wilt and banana blood diseases (BDB), two significant diseases infecting banana trees, are caused by Fusarium oxysporum and Ralstonia syzygii, respectively. They have successfully caused a decline in crop yield as they destroy the trees, starting sequentially from the pseudostem to the fruits. The entire distribution of BDB and Fusarium on a plantation can be understood using advanced geospatial information obtained from multispectral aerial photographs taken using an unmanned aerial vehicle (UAV), combined with the reliable data field of infected trees. Vegetation and soil indices derived from a multispectral aerial photograph, such as normalized difference vegetation index, modified chlorophyll absorption ratio index, normalized difference water index (NDWI) and soil pH, may have to be relied on to explain the precise location of these two diseases. In this study, a random forest algorithm was used to handle a large dataset consisting of two models: the banana diseases multispectral model and the banana diseases spectral model. The results show that the soil indices, soil pH and NDWI are the most important variables for predicting the spatial distribution of these two diseases. Simultaneously, the plantation area affected by BDB is more extensive than that affected by Fusarium, if the variation of planted banana cultivars is not considered.

The prompt and accurate diagnosis of breast lesions, including the distinction between cancer, non-cancer, and suspicious cancer, plays a crucial role in the prognosis of breast cancer. In this paper, we introduce a novel method based on feature extraction and reduction for detection of breast cancer in mammography images. First, we extract features from multiple pre-trained convolutional neural network (CNN) models, and then concatenate them. The most informative features are selected based on their mutual information with the target variable. Subsequently, the selected features can be classified using a machine learning algorithm. We evaluate our approach using four different machine learning algorithms, and our results demonstrate that the neural network-based classifier yields an accuracy as high as 92% for the RSNA dataset which is a new dataset that provides two views and additional features such as age. We compare our proposed algorithm with state-of-the-art methods and demonstrate its superiority, particularly in terms of accuracy and sensitivity. For the MIAS dataset, we achieve an accuracy as high as 94.5%, and for the DDSM dataset, an accuracy of 96% is attained. These results highlight the effectiveness of our method in accurately diagnosing breast lesions and surpassing existing approaches.

A problem with synthetic aperture radar (SAR) is that, due to the poor penetrating action of electromagnetic waves inside solid bodies, the capability to observe inside distributed targets is precluded. Under these conditions, imaging action is provided only on the surface of distributed targets. The present work describes an imaging method based on the analysis of micro-movements on the Khnum-Khufu Pyramid, which are usually generated by background seismic waves. The results obtained prove to be very promising, as high-resolution full 3D tomographic imaging of the pyramid's interior and subsurface was achieved. Khnum-Khufu becomes transparent like a crystal when observed in the micro-movement domain. Based on this novelty, we have completely reconstructed internal objects, observing and measuring structures that have never been discovered before. The experimental results are estimated by processing series of SAR images from the second-generation Italian COSMO-SkyMed satellite system, demonstrating the effectiveness of the proposed method.

Speckle noise reduction is an important area of research in the field of ultrasound image processing. Several algorithms for speckle noise characterization and analysis have been recently proposed in the area. Synthetic ultrasound images can play a key role in noise evaluation methods as they can be used to generate a variety of speckle noise models under different interpolation and sampling schemes, and can also provide valuable ground truth data for estimating the accuracy of the chosen methods. However, not much work has been done in the area of modelling synthetic ultrasound images, and in simulating speckle noise generation to get images that are as close as possible to real ultrasound images. An important aspect of simulated synthetic ultrasound images is the requirement for extensive quality assessment for ensuring that they have the texture characteristics and gray-tone features of real images. This paper presents texture feature analysis of synthetic ultrasound images using local binary patterns (LBP) and demonstrates the usefulness of a set of LBP features for image quality assessment. Experimental results presented in the paper clearly show how these features could provide an accurate quality metric that correlates very well with subjective evaluations performed by clinical experts.

This paper aims at trying to answer the question of whether a low cost drone equipped with a regular camera can serve as a simple device to estimate the size of objects. Ad-ditionally, it assesses if the accuracy of measurement is good enough for using a drone for measurements, relying solely on GPS position and camera. A review of the literature pertaining to ground object measurements was conducted. The availability of such in-struments was evaluated in terms of purchase and rental costs, the number of instru-ments on the market, and the time to obtain them. The most common measurement methods were considered and their unit costs were reviewed. The cost of professional surveying and measuring equipment was compared to the possibility of using low-cost, non-commercial drones to measure objects and surfaces. The quality of the images ob-tained was compared with high-resolution satellite systems. Is an ordinary drone with a standard camera suitable for length measurement without professional measuring equipment? Should the results be considered only in the category of size estimation?

While thunderstorms can pose severe risks to property and life, forecasting remains challenging, even at short lead times, as these often arise in meta-stable atmospheric conditions. In this paper, we examine the question of how well we could perform short-term (up to 180min) forecasts using exclusively multi-spectral satellite images and past lighting events as data. We employ representation learning based on deep convolutional neural networks in an “end-to-end” fashion. Here, a crucial problem is handling the imbalance of the positive and negative classes appropriately in order to be able to obtain predictive results (which is not addressed by many previous machine-learning-based approaches). The resulting network outperforms previous methods based on physically-based features and optical flow methods (similar to operational prediction models) and generalizes across different years. A closer examination of the classifier performance over time and under masking of input data indicates that the learned model actually draws most information from structures in the visible spectrum, with infrared imaging sustaining some classification performance during the night.

Object detection is one of the most critical tasks in the field of Computer vision. This task comprises identifying and localizing an object in the image. Architectural floor plans represent the layout of buildings and apartments. The floor plans consist of walls, windows, stairs, and other furniture objects. While recognizing floor plan objects is straightforward for humans, automatically processing floor plans and recognizing objects is a challenging problem. In this work, we investigate the performance of the recently introduced Cascade Mask R-CNN network to solve object detection in floor plan images. Furthermore, we experimentally establish that deformable convolution works better than conventional convolutions in the proposed framework. Identifying objects in floor plan images is also challenging due to the variety of floor plans and different objects. We faced a problem in training our network because of the lack of publicly available datasets. Currently, available public datasets do not have enough images to train deep neural networks efficiently. We introduce SFPI, a novel synthetic floor plan dataset consisting of 10000 images to address this issue. Our proposed method conveniently surpasses the previous state-of-the-art results on the SESYD dataset and sets impressive baseline results on the proposed SFPI dataset. The dataset can be downloaded from SFPI Dataset Link. We believe that the novel dataset enables the researcher to enhance the research in this domain further.

The objective of this study was aimed to study the sensory processes of the “human-computer interaction” model when classifying visual images with an incomplete set of signs based on the analysis of early, middle, late and slow components of event-related potentials (ERPs). 26 healthy subjects (men) aged 20-22 years were investigated. ERPs in 19 monopolar sites according to the 10/20 system were recorded. Discriminant and factor analysis were applied. The component N450 is the most specialized indicator of the perception of unrecognizable (oddball) visual images. The amplitude of the ultra-late components N750 and N900 is also higher under conditions of presentation of the oddball image, regardless of the location of the registration points. The results of the study are discussed in the light of the paradigm of the P300 wave application in brain-computer interface systems, as well as with the peculiarities in brain pathology. Promising directions for the development of studies of the “Brain Computer Interface” (BCI) P300 systems are to increase the throughput of information flows. To extend the application of the P300 ERPs to multiple modalities, the underlying physiological mechanisms and responses of the brain for a particular sensory system and mental function must be carefully examined.

Byers Peninsula is considered one of the largest ice-free areas in Maritime Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes in lives cycles, limnology and microbiology. Soils from maritime Antarctica are generally weakly developed and have chemical, physical and morphological characteristics strongly influenced by the parent material. However, biological activity during the short Antarctic summer promotes intense transference of nutrients and organic matter in areas occupied by different species of birds and marine mammals. To mapping and monitoring those areas with high biological occupation, could be very useful to have models of edaphic properties prepared from satellite images. In this approach, Deep Learning and Linear Regression models of soil properties and spectral indexes as explicative variables were performed. We training models of soil properties closely related to biological activity such as Dissolved Organic Carbon (DOC) and the iron fraction associated with organic matter (Fe). We tested the best approach to model the spatial distribution of DOC, Fe and pH by training models of Linear Regression and Deep Learning over Sentinel2 and WorldView2 images. The most robust models were used to track possible areas with ornithogenic soils as well as areas of the Byers Peninsula that could support the highest biological development.

Thermal Non-destructive Testing and Evaluation (NDT&E) is crucial in ensuring the quality and safety of industrial materials, components, and structures. It serves as a key tool for assessing their operational reliability, thus enhancing safety in a wide range of industries. There is a growing demand for dependable, swift, remote, and secure inspection and assessment techniques to detect hidden flaws, especially for sustainable solutions prompts adjustments in design and manufacturing standards. Hidden defects often emerge during the service life of these materials and structures due to various stress factors, potentially resulting in catastrophic failures. This study delves into the optimal and dependable experimental method for conducting fast, remote, and secure inspections and assessments of carbon fiber reinforced polymer materials using Infrared Imaging (IRI) as part of Thermal Non-Destructive Testing and Evaluation (TNDT&E). Additionally, it examines the post-processing approach associated with this technique. This perspective also sheds light on the current state-of-the-art infrared imaging methods employed in TNDT&E, emphasizing their strengths and weaknesses about their ability to detect subsurface defects present within the material Most of the methods discussed in previous research primarily focus on the thermal differences in specific areas of a sample using processed thermal images, even though these images come from analyzing a series of images captured over time. This study highlights the latest research in thermal/infrared non-destructive testing and evaluation, along with the related post-processing techniques. It aims to not only show hidden subsurface defects through thermal differences also provides information about how these defects change over time.

Fire regimes in mountain landscapes of southern Europe have been shifting from their baselines due to rural abandonment and fire exclusion policies. Understanding the effects of fire on biodiversity is paramount to implement adequate management. Herein, we evaluated the relative role of burn severity and heterogeneity on bird abundance in an abandoned mountain range located in the biogeographic transition between the Eurosiberian and Mediterranean region (the Natural Park ‘Baixa Limia–Serra do Xurés’). We surveyed the bird community in 206 census plots distributed across the Natural Park, both inside and outside areas affected by wildfires over the last 11 years (from 2010 to 2020). We used satellite images of Sentinel 2 and Landsat missions to quantify the burn severity and heterogeneity of each fire within each surveyed plot. We also accounted for the past land use (forestry or agropastoral use) by using a land cover information for year 2010 derived from satellite image classification. We recorded 1,735 contacts from 28 bird species. Our models, fitted by using GLMs with Poisson error distribution (pseudo-R²_-average of 0.22 ± 0.13), showed that up to 71% of the modelled species were linearly correlated with at least one attribute of the fire regime. The spatiotemporal variation in burnt area and severity were relevant factors for explaining the local abundance of our target species (39% of the species; Akaike weights > 0.75). We also found a quadratic effect of at least one fire regime attribute on bird abundance for 60% of the modeled species. The past land use, and its legacy after 10 years, was critical to understand the role of fire (Akaike weights > 0.75). Our findings confirm the importance of incorporating remotely sensed indicators of burn severity into the toolkit of decision makers to accurately anticipate the response of birds to fire management.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

Digital Twin Cities (DTCs) play a fundamental role in city planning and management. They allow three-dimensional modeling and simulation of cities. 3D semantic segmentation is the foundation for automatically creating enriched DTCs, as well as their updates. Past studies indicate that prior level fusion approaches demonstrate more promising precisions in 3D semantic segmentation compared to point level fusion, features level fusion, and decision level fusion families. In order to improve point cloud enriched semantic segmentation outcomes, this article proposes a new approach for 3D point cloud semantic segmentation through developing and benchmarking three prior level fusion scenarios. A reference approach based on point clouds and aerial images was proposed to compare it with the different developed scenarios. In each scenario, we inject a specific prior knowledge (geometric features,classified images ,etc) and aerial images as attributes of point clouds into the neural network’s learning pipeline. The objective is to find the one that integrates the most significant prior knowledge and enhances neural network knowledge more profoundly, which we have named the "smart fusion approach". The advanced Deep Learning algorithm "RandLaNet" was adopted to implement the different proposed scenarios and the reference approach, due to its excellent performance demonstrated in the literature. The introduction of some significant features associated with the label classes facilitated the learning process and improved the semantic segmentation results that can be achievable with the same neural network alone. Overall, our contribution provides a promising solution for addressing some challenges, in particular more accurate extraction of semantically rich objects from the urban fabric. An assessment of the semantic segmentation results obtained by the different scenarios is performed based on metrics computation and visual investigations. Finally,the smart fusion approach was derived based on the obtained qualitative and quantitative results.

Urban spatial perception critically influences human behavior and emotional reactions, emphasizing the necessity of aligning urban spaces with human needs for enhanced urban living. However, functionality-based categorization of urban architecture is prone to biases, stemming from disparities between objective mapping and subjective perception. These biases can result in urban planning and designs that fail to cater adequately to the needs and preferences of city residents, negatively impacting their quality of life and the city's overall functionality. In this study, we apply machine learning to elucidate these biases within urban spatial perception research, utilizing a three-step methodology: objective mapping, subjective perception analysis, and perception deviation assessment. Our findings reveal that machine learning can expose hidden patterns within this research field, bearing substantial implications for urban planning and design. Of particular note, the study revealed significant discrepancies in the distribution centroids between commercial buildings and residential or public buildings. This result illuminates the spatial organization characteristics of urban architectural functions, serving as a valuable reference for urban planning and development. Moreover, it uncovers the advantages and disadvantages of different data sources and techniques in interpreting urban spatial perception, paving the way for a more comprehensive understanding of the subject. These findings underscore the importance of integrating both objective mapping and subjective perspectives in urban architectural functionality classification.

Miscanthus holds a great potential in the frame of the bioeconomy and yield prediction can help improving Miscanthus logistic supply chain. Breeding programs in several countries are attempting to produce high-yielding Miscanthus hybrids better adapted to different climates and end-uses. Multispectral images acquired from unmanned aerial vehicles (UAVs) in Italy and in the UK in 2021 and 2022 were used to investigate the feasibility of high-throughput phenotyping (HTP) of novel Miscanthus hybrids for yield prediction and crop traits estimation. An intercalibration procedure was performed using simulated data from the PROSAIL model to link vegetation indices (VIs) derived from two different multispectral sensors. Random forest algorithm estimated with good accuracy yield traits (light interception, plant height, green leaf biomass and standing biomass) using VIs time series and predicted yield using peak descriptor derived from VIs time series with 2.3 Mg DM ha-1 of RMSE. The study demonstrates the potential of UAVs multispectral in HTP applications and in yield prediction for providing important information needed to increase sustainable biomass production.

Alzheimer's disease (AD) is a progressive and evolving neurodegenerative disease with an insidious onset that can lead to memory loss and cognitive impairment. There is no effective treatment for this disease. However, early diagnosis plays an important role in treatment planning to slow down its progression, as treatment has the greatest impact in the early stages of the disease. Neurological images obtained through different imaging techniques provide powerful information and help diagnose the disease. With the wide application of deep learning techniques in disease diagnosis, especially the prominence of Convolutional Neural Networks (CNNs) in computer vision and image processing, more and more studies are proposing the use of this algorithm for the diagnosis of AD. In this paper, we first systematically introduce the impact of AD on people, detailing the biomarkers, early clinical symptoms, and risk factors of this disease. Secondly, it goes on to detail the development of CNNs, their form, and methods to help diagnose AD. It is proposed that CNNs can help diagnose AD by analyzing medical imaging data, particularly structural brain scans such as magnetic resonance imaging (MRI) and functional scans such as positron emission tomography (PET). Finally, it is concluded that CNNs are of great importance for the diagnosis of AD and that they are likely to play an increasingly important role in the early detection of the disease, the understanding of disease mechanisms, and ultimately, in the development of effective AD therapies and interventions. CNNs are playing an increasingly important role in the Their potential impact on healthcare emphasizes the importance of continued research and innovation in neural networks and medical imaging.

Deep neural networks (DNNs) have gained prominence in addressing regression problems, offering versatile architectural designs that cater to various applications. In the field of earthquake engineering, seismic response prediction is a critical area of study. Simplified models such as single-degree-of-freedom (SDOF) and multi-degree-of-freedom (MDOF) systems have traditionally provided valuable insights into structural behavior, known for their computational efficiency facilitating faster simulations. However, these models have notable limitations in capturing the nuanced nonlinear behavior of structures and the spatial variability of ground motions. This study focuses on leveraging ambient vibration (AV) measurements of buildings, combined with earthquake (EQ) time-history data, to create a predictive model using a neural network (NN) in image format. The primary objective is to predict a specific building's earthquake response accurately. The training dataset consists of 1,197 MDOF 2D shear models, generating a total of 32,319 training samples. To evaluate the performance of the proposed model, termed MLPER (Machine Learning based Prediction of building structures' Earthquake Response), several metrics are employed. These include mean absolute percentage error (MAPE) and mean deviation angle (MDA) for comparisons in the time domain. Additionally, we assess magnitude-squared coherence values and phase differences (Δφ) for comparisons in the frequency domain. This study underscores the potential of MLPER as a reliable tool for predicting building earthquake response, addressing the limitations of simplified models. By integrating AV measurements and EQ time-history data into a neural network framework, MLPER offers a promising avenue for enhancing our understanding of structural behavior during seismic events, ultimately contributing to improved earthquake resilience in building design and engineering.

Sacroiliac (SI) joint dysfunction can lead to debilitating pain but can be treated with minimally invasive sacroiliac joint fusion (SIJF). This treatment is commonly performed using 2D fluoroscopic guidance. This makes placing the implants without damaging surrounding neural structures challenging. Virtual surgical planning (VSP) using simulated fluoroscopic images may improve perioperative guidance. This article describes a workflow with VSP in SIJF using simulated fluoroscopic images and evaluates achieved implant placement accuracy. Routinely collected survey data on the added value of VSP were also evaluated. Ten interventions were performed on 10 patients by the same surgeon, comprising 30 implants; the median age was 39 years, and all patients were female. The overall mean implant placement accuracy was 4.9 ± 1.26 mm and 4.0 ± 1.44°. There were no malpositioning complications. The VSP helped the surgeon understand the anatomy and determine the optimal position and length of the implants. The average Likert scale score of the survey was 4.7, suggesting a positive role of VSP for SIJF. Planned positions of the implants could be reproduced in surgery with clinically acceptable accuracy and VSP was a valuable asset for the surgeon.

Panoramic and periapical radiograph tools help dentists diagnose the most common dental diseases. Generally, dentists identify dental caries manually by inspecting X-ray images. However, due to their heavy workload, or poor image quality, dentists may sometimes overlook some unnoticeable dental caries, which may ultimately hinder the patient treatment. The purpose of this study was to develop an algorithm that classifies the teeth X-Ray images into three categories of “Normal”, “Caries”, and “Filled”. Our study used a dataset of 116 patients and 3712 single teeth images for training, validation and testing. Images were pre-processed using a sharpening filter and an intensity color map. We used a pre-trained transfer learning model, the NASNetMobile, which served as the feature extractor and the Convolutional Neural Network (CNN) model served as the classifier. The training dataset had a “Recall” of 0.92, 0.90 and 0.91 for “Normal”, “Caries” and “Filled” respectively and the test dataset had a “Recall” of 0.86, 0.81 and 0.85 for “Normal”, “Caries” and “Filled” respectively. The classification of the teeth X-Rays was successful and can be valuable for dentist as the artificial intelligence algorithm can serve as a decision support tool to aid dentists when they need to diagnose dental treatment.

Signal-to-noise ratio (SNR) is an important index to evaluate radiation performance and image quality of optical imaging systems under low illumination background. Under the nighttime lighting condition, the illumination of remote sensing objects is low and varies greatly, usually ranging from several lux to tens of thousands of lux. Nighttime light remote sensing imaging requires high sensitivity and large dynamic range of detectors. Luojia 1-01 is the first professional nighttime light remote sensing satellite in the world. In this paper, we took the nighttime light remote sensing camera carried on the satellite as research object, proposed an in-orbit SNR test method based on time series images to overcome the problem of low spatial resolution. We first analyzed the process of luminous flux transmission between objects and satellite and established a radiative transfer model. By combining the parameters of large relative aperture optical system and high sensitivity CMOS device, we established SNR model and specially analyzed the effect of exposure time and quantization bits on SNR. Finally we used the proposed in-orbit test method to calculate SNR of lighting images acquired by satellite. And the measured result is in good agreement with the model predicted data. Under the condition of 10lx illumination, the SNR of typical objects can reach 27.02dB, which is much better than the requirement of 20dB for engineering application.

Descriptive geometry has indispensable applications in many engineering activities, some of which are presented in the first chapter of this paper in order to place the development presented here among them. As a result of the continuous variability of the technological environment according to various optimization aspects, the engineering activities must also be continuously adapted to the changes, which an appropriate approach and formulation are required from the practitioners of descriptive geometry, and can even lead to improvement in the field of descriptive geometry. The imaging procedures are always based on the methods and theorems of descriptive geometry. Resolving contradictions in spatial geometry reconstruction research is a constant challenge, to which a possible answer in many cases is the search for the right projection direction. A special method of enumerating the possible infinite viewpoints for the representation of the surface edge curves is presented in another part of the paper. The procedure for determining the correct directions in a mathematically exact way is also presented through examples. The analysis and some of the results of the Monge mapping, which is suitable for the solution of a mechanical engineering task to be solved in a specific technical environment, are also presented.

Due to the special characteristics of the shooting distance and angle of remote sensing satellites, the pixel area ratio of ship targets is small and the feature expression is insufficient, which leads to unsatisfactory ship detection performance and even situations such as missed detection and false detection. In this study, we propose an improved-YOLOv5 algorithm. The improvement strategies mainly include: (1) Add the Convolutional Block Attention Module (CBAM) into the Backbone to enhance the extraction of target-adaptive optimal features; (2) Introduce cross-layer connection channel and lightweight GSConv structure into the Neck to achieve higher-level multi-scale feature fusion and reduce the number of model parameters; (3) The Wise-IoU loss function is used to cal-culate the localization loss in the Output, and assign reasonable gradient gains to cope with dif-ferences in image quality. In addition, during the preprocessing stage of experimental data, a me-dian and bilateral filter method is used for noise reduction to reduce interference from ripples and waves and highlight the information of ship features. The experimental results show that Im-proved-YOLOv5 has a significant improvement in recognition accuracy compared to various mainstream target detection algorithms; Compared to the original YOLOv5s, the mean Average Precision (mAP) has improved by 3.2% and the Frames Per Second (FPN) has accelerated by 8.7%.

At INFN-LNS, and in collaboration with the ATOMKI laboratories, an innovative multi-diagnostic system with advanced analytical methods has been designed and implemented. This is based on several detectors and techniques (Optical Emission Spectroscopy, RF systems, Interfero-polarimetry, X-ray detectors) and here we focus on high resolution spatially-resolved X-ray spectroscopy, performed by means of a X-ray pin-hole camera setup operating in the 0.5−20 keV energy domain. The diagnostic system was installed at a 14 GHz Electron Cyclotron Resonance (ECR) ion source (ATOMKI, Debrecen), enabling high precision X-ray spectrally-resolved imaging of ECR plasmas heated by hundreds of Watts. The achieved spatial and energy resolution were 0.5 mm and 300 eV at 8 keV, respectively. We here present the innovative analysis algorithm that we properly developed for obtaining Single Photon-Counted (SPhC) images providing the local plasma emitted spectrum in a High-Dynamic-Range (HDR) mode, by distinguishing fluorescence lines of the materials of the plasma chamber (Ti, Ta) from plasma (Ar). This method allows a quantitative characterization of warm electrons population in the plasma (and its 2D distribution) which are the most important for ionization, and also to estimate local plasma density and spectral temperatures. The developed post-processing analysis is also able to remove the readout noise, that is often observable at very low exposure times (msec). The setup is now under update including fast shutters and trigger systems in order to allow simultaneously space and time-resolved plasma spectroscopy during transients, stable and turbulent regimes.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

Tables in the document image are one of the most important entities since they contain crucial information. Therefore, accurate table detection can significantly improve information extraction from tables. In this work, we present a novel end-to-end trainable pipeline, HybridTabNet, for table detection in scanned document images. Our two-stage table detector uses the ResNeXt-101 backbone for feature extraction and Hybrid Task Cascade (HTC) to localize the tables in scanned document images. Moreover, we replace conventional convolutions with deformable convolutions in the backbone network. This enables our network to detect tables of arbitrary layouts precisely. We evaluate our approach comprehensively on ICDAR-13, ICDAR-17 POD, ICDAR-19, TableBank, Marmot, and UNLV. Apart from the ICDAR-17 POD dataset, our proposed HybridTabNet outperforms earlier state-of-the-art results without depending on pre and post-processing steps. Furthermore, to investigate how the proposed method generalizes unseen data, we conduct an exhaustive leave-one-out-evaluation. In comparison to prior state-of-the-art results, our method reduces the relative error by 27.57% on ICDAR-2019-TrackA-Modern, 42.64% on TableBank (Latex), 41.33% on TableBank (Word), 55.73% on TableBank (Latex + Word), 10% on Marmot, and 9.67% on UNLV dataset. The achieved results reflect the superior performance of the proposed method.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

Pieron's and Chocholle’s seminal psychophysical work predicts that human response time to information relative to visual contrast and/or sound frequency decreases when contrast intensity or sound frequency increases. The goal of this study is to bring to the fore the ability of individuals to use visual contrast intensity and sound frequency in combination for faster perceptual decisions of relative depth (“nearer”) in planar (2D) object configurations on the basis of physical variations in luminance contrast. Computer controlled images with two abstract patterns of varying contrast intensity, one on the left and one on the right, preceded or not by a pure tone of varying frequency, were shown to healthy young humans in controlled experimental sequences. Their task (two-alternative forced-choice) was to decide as quickly as possible which of two patterns, the left or the right one, in a given image appeared to “stand out as if it were nearer” in terms of apparent (subjective) visual depth. The results show that the combinations of varying relative visual contrast with sounds of varying frequency exploited here produced an additive effect on choice response times in terms of facilitation, where a stronger visual contrast combined with a higher sound frequency produced shorter forced-choice response times. This new effect is predicted by cross-modal audio-visual probability summation.

A quantum hybrid (QH) intelligent approach that blends the adaptive search capability of the quantum-behaved particle swarm optimisation (QPSO) method with the intuitionistic rationality of traditional fuzzy k-nearest neighbours (Fuzzy k-NN) algorithm (known simply as the Q-Fuzzy approach) is proposed for efficient feature selection and classification of cells in cervical smeared (CS) images. From an initial multitude of seventeen (17) features describing the geometry, colour, and texture of the CS images, the QPSO stage of our proposed technique is used to select the best subset features (i.e. global best particles) that represent a pruned down collection of seven (7) features. Using a dataset of almost 1000 images, performance evaluation of our proposed Q-Fuzzy approach assesses the impact of our feature selection on classification accuracy by way of three experimental scenarios that are compared alongside two other approaches: The All-features (i.e. classification without prior feature selection) and another hybrid technique combining the standard PSO algorithm with the Fuzzy k-NN technique (P-Fuzzy approach). In the first and second scenarios, we further divided the assessment criteria in terms of classification accuracy based on the choice of best features and those in terms of the different categories of the cervical cells. In the third scenario, we introduced new QH hybrid techniques, i.e. QPSO combined with other supervised learning methods, and compared the classification accuracy alongside our proposed Q-Fuzzy approach. Furthermore, we employed statistical approaches to establish qualitative agreement with regards to the feature selection in scenarios 1 and 3. The synergy between the QPSO and Fuzzy k-NN in the proposed Q-Fuzzy approach marginally improves classification accuracy as manifest in the reduction in number cell features, which is crucial for effective cervical cancer detection and diagnosis.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

X-band marine radar captures signal reflected from the sea surface. Theoretical studies indicate that the initial unfiltered signal contains meaningful information including parameters related to wind waves. Traditional methods for estimating significant wave height (SWH) rely on the physical laws describing signal reflection from rough surfaces. However, recent studies suggest the feasibility of employing artificial neural networks (ANNs) for SWH approximation. Both classical and ANN-based approaches necessitate costly in situ data. In this study, we propose generating synthetic radar images with specified wind wave parameters using Fourier-based approach and Pierson–Moskowitz wave spectrum as a viable alternative. We generate synthetic images and use them for unsupervised learning approach to train a convolutional component of an ANN. After that, we train a regression ANN based on the previous convolutional component to obtain SWH back from synthetic images. Then, we apply preliminary trained weights for the same regression model to train SWH approximation on the dataset of real sea clutter images. In this study, we demonstrate the increase in the accuracy of SWH estimation from radar images with the preliminary training on synthetic data.

This research delves into the intricate challenges confronting the agricultural sector, with a specialized focus on mitigating infections in tomato crops, particularly powdery mildew induced by the Leveillula Taurica pathogen. Tomatoes, renowned for their nutritional richness, are vital to global food security. However, conventional methodologies for disease detection exhibit both laborious processes and limited accuracy. In response to these challenges, this study advocates for an innovative fusion of hyperspectral imaging and deep learning methodologies to detect crop disease and its severity. The systematic workflow commenced with the curation of a dataset, involving the acquisition of live images through OpenCV, followed by conversion to RGB format and subsequent feature extraction utilizing a pre-trained visual geometry group (VGG-16) model for enhanced analysis. Sequentially, RGB images were transformed into simulated hyperspectral images (SHSI) leveraging a Neural Network generator model, offering a distinctive viewpoint on spectral information. This novel approach transcends conventional constraints by delivering a three-dimensional perspective, seamlessly integrating spatial and spectral dimensions for holistic data acquisition. The SHSI is further transmuted into a 3D visualization cube comprehensive grasp of spatial and spectral aspects encompassing spectral, spatial, and Haralick features. The research concludes with severity detection, categorized as low, moderate, or high, employing a Gaussian Mixture Model (GMM) and K-means for visualization.