Geologists employ high-spatial-resolution (HR) remote sensing (RS) data for many diverse applications as they effectively reflect detailed geological information, enabling high-quality and efficient geological surveys. Applications of HR RS data to geological and related fields have grown recently. By analyzing these applications, we can better understand the results of previous studies and more effectively use the latest data and methods to efficiently extract key geological information. HR optical remote sensing data are widely used in geological hazard assessment, seismic monitoring, mineral exploitation, glacier monitoring, and mineral information extraction due to high accuracy and clear object features. Compared with optical satellite images, synthetic-aperture radar (SAR) images are stereoscopic and exhibit clear relief, strong performance, and good detection of terrain, landforms, and other information. SAR images have been applied to seismic mechanism research, volcanic monitoring, topographic deformation, and fault analysis. Furthermore, a multi-standard maturity analysis of the geological applications of HR images using literature from the Science Citation Index reveals that optical remote sensing data are superior to radar data for mining, geological disaster, lithologic, and volcanic applications, but inferior for earthquake, glacial, and fault applications. Therefore, geological remote sensing research needs to be truly multidisciplinary or interdisciplinary, ensuring more detailed and efficient surveys through cross-linking with other disciplines. Moreover, the recent application of deep learning technology to remote sensing data extraction has improved automatic processing and data analysis capabilities.

LULC changes are major environmental challenges in many parts of the world which are adversely affecting ecosystem services. This study was aimed to analyze LULC changes in the ecological landscape of Ethiopia CRV areas from 1985 to 2015. Satellite images were accessed and pre-processing and classification is done. Major LULC types were detected and change analysis was executed. Nine LULC changes were successfully evaluated. The classification result revealed that in 1985, 44.34% of the land was covered with small scale farming followed by mixed cultivated/acacia (21.89%), open woodland (11.96%), and water bodies (9.77%). Whereas for the same study year open grazing land, forest, degraded savannah and settlements accounted the smallest proportion. Though the area varied among land use classes, the trend of share occupied by the LULC types in the study area remained the same in 1995 and 2015. Increase in small and large scale farming, settlements and mixed cultivation/acacia while a decrease in water bodies, forest, and open woodlands is noted. About 86.11% of the land showed major changes in land use/cover. Lastly, DPSIR framework analysis was done and integrated land use and development planning and policy reform are suggested for sustainable land use planning and management.

This paper describes the first results of an Image Recognition Based Location (IRBL) for mobile application focusing on the procedure to generate a Database of range images (RGB-D). In an indoor environment, to estimate the camera position and orientation, a prior spatial knowledge of the surrounding is needed. In order to achieve this objective a complete 3D survey of two different environment (Bangbae metro station of Seoul and E.T.R.I. building in Daejeon – Republic of Korea) was performed using LiDAR (Light Detection And Ranging) instrument and the obtained scans were processed in order to obtain a spatial model of the environments. From this, two databases of reference images were generated using a specific software realized by the Geomatics group of Politecnico di Torino (ScanToRGBDImage). This tool allow to generate synthetically different RGB-D images) centered in the each scan position in the environment. Later, the external parameters (X, Y, Z, ω, φ, κ) and the range information extracted from the DB images retrieved, are used as reference information for pose estimation of a set of acquired mobile pictures in the IRBL procedure. In this paper the survey operations, the approach for generating the RGB-D images and the IRB strategy are reported. Finally the analysis of the results and the validation test are described.

The reasons for the circular sense of human color perception generated by two sorts of color opponent neurons and three cone types are not well understood. Here we use geometrical analysis to examine the hypothesis that opponency, the recursive nature of color perception, and trichromacy arise as the most efficient ways of distinguishing spectrally different points on a plane using a minimum of color classes and receptor types.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

Object segmentation on remotely-sensed images: aerial (or very high resolution, VHS) images and satellite (or high resolution, HR) images, has been applied to many application domains, especially road extraction in which the segmented objects are served as a mandatory layer in geospatial databases. Several attempts in applying deep convolutional neural network (DCNN) to extract roads from remote sensing images have been made; however, the accuracy is still limited. In this paper, we present an enhanced DCNN framework specifically tailored for road extraction on remote sensing images by applying landscape metrics (LMs) and conditional random fields (CRFs). To improve DCNN, a modern activation function, called exponential linear unit (ELU), is employed in our network resulting in a higher number of and yet more accurate extracted roads. To further reduce falsely classified road objects, a solution based on an adoption of LMs is proposed. Finally, to sharpen the extracted roads, a CRF method is added to our framework. The experiments were conducted on Massachusetts road aerial imagery as well as THEOS satellite imagery data sets. The results showed that our proposed framework outperformed Segnet, the state-of-the-art object segmentation technique on any kinds of remote sensing imagery, in most of the cases in terms of precision, recall, and F1.

Signal-to-noise ratio (SNR) is an important index to evaluate radiation performance and image quality of optical imaging systems under low illumination background. Under the nighttime lighting condition, the illumination of remote sensing objects is low and varies greatly, usually ranging from several lux to tens of thousands of lux. Nighttime light remote sensing imaging requires high sensitivity and large dynamic range of detectors. Luojia 1-01 is the first professional nighttime light remote sensing satellite in the world. In this paper, we took the nighttime light remote sensing camera carried on the satellite as research object, proposed an in-orbit SNR test method based on time series images to overcome the problem of low spatial resolution. We first analyzed the process of luminous flux transmission between objects and satellite and established a radiative transfer model. By combining the parameters of large relative aperture optical system and high sensitivity CMOS device, we established SNR model and specially analyzed the effect of exposure time and quantization bits on SNR. Finally we used the proposed in-orbit test method to calculate SNR of lighting images acquired by satellite. And the measured result is in good agreement with the model predicted data. Under the condition of 10lx illumination, the SNR of typical objects can reach 27.02dB, which is much better than the requirement of 20dB for engineering application.

Satellite scene classification is challenging because of the high variability inherent in satellite data. Although rapid progress in remote sensing techniques has been witnessed in recent years, the resolution of the available satellite images remains limited compared with the general images acquired using a common camera. On the other hand, a satellite image usually has a greater number of spectral bands than a general image, thereby permitting the multi-spectral analysis of different land materials and promoting low-resolution satellite scene recognition. This study advocates multi-spectral analysis and explores the middle-level statistics of spectral information for satellite scene representation instead of using spatial analysis. This approach is widely utilized in general image and natural scene classification and achieved promising recognition performance for different applications. The proposed multi-spectral analysis firstly learns the multi-spectral prototypes (codebook) for representing any pixel-wise spectral data, and then based on the learned codebook, a sparse coded spectral vector can be obtained with machine learning techniques. Furthermore, in order to combine the set of coded spectral vectors in a satellite scene image, we propose a hybrid aggregation (pooling) approach, instead of conventional averaging and max pooling, which includes the benefits of the two existing methods but avoids extremely noisy coded values. Experiments on three satellite datasets validated that the performance of our proposed approach is much more accurate than even the deep learning framework for spatial analysis.

The COVID-19 pandemic situation has created even more difficulties in the quick identification and screening of the COVID-19 patients for the medical specialists. Therefore, a significant study is necessary for detecting COVID-19 cases using an automated diagnosis method, which can aid in controlling the spreading of the virus. In this paper, the study suggests a Deep Convolutional Neural Network-based multi-classification approach (COV-MCNet) using eight different pre-trained architectures such as VGG16, VGG19, ResNet50V2, DenseNet201, InceptionV3, MobileNet, InceptionResNetV2, Xception which are trained and tested on the X-ray images of COVID-19, Normal, Viral Pneumonia, and Bacterial Pneumonia. The results from 3-class (Normal vs. COVID-19 vs. Viral Pneumonia) showed that only the ResNet50V2 model provides the highest classification performance (accuracy: 95.83%, precision: 96.12%, recall: 96.11%, F1-score: 96.11%, specificity: 97.84%) compared to rest of the models. The results from 4-class (Normal vs. COVID-19 vs. Viral Pneumonia vs. Bacterial Pneumonia) demonstrated that the pre-trained model DenseNet201 provides the highest classification performance (accuracy: 92.54%, precision: 93.05%, recall: 92.81%, F1-score: 92.83%, specificity: 97.47%). Notably, the ResNet50V2 (3-class) and DenseNet201 (4-class) models in the proposed COV-MCNet framework showed higher accuracy compared to the rest six models. This indicates that the designed system can produce promising results to detect the COVID-19 cases on the availability of more data. The proposed multi-classification network (COV-MCNet) significantly speeds up the existing radiology-based method, which will be helpful to the medical community and clinical specialists for early diagnosis of the COVID-19 cases during this pandemic.

Glaucoma is a disease associated with retina of eye. Presently, millions of human being is suffering from this disease. Early detection of these diseases can save the people from blindness. Therefore, various methods have been developed for its detection. In this paper, we have studied the reported methods and summarized their performance in terms of accuracy of detection.

Αbstract: To date, countless satellite image fusions have been made, mainly with panchromatic spatial resolution to a multispectral image ratio of 1/4, fewer fusions with lower ratios, and relatively recently fusions with much higher spatial resolution ratios have been published. Apart from this, there is a small number of publications studying the fusion of aerial photographs with satellite images, with the year of image acquisition varying and the dates of acquisition not mentioned. In addition, in these publications, either no quantitative controls are performed on the composite images produced, or the aerial photographs are recent and colorful and only the RGB bands of the satellite images are used for data fusion purposes. The objective of this paper is the study of the addition of multispectral information from satellite images to black and white aerial photographs of the 80s decade (1980–1990) with small difference (just a few days) in their image acquisition date, the same year and season. Quantitative tests are performed in two case studies and the results are encouraging, as the accuracy of the classification of the features and objects of the Earth’s surface is improved and the automatic digital extraction of their form and shape from the archived aerial photographs is now allowed. This opens up a new field of use for the black and white aerial photographs and archived multispectral satellite images of the same period in a variety of applications, such as the temporal changes of cities, forests and archaeological sites.

Unmanned Aerial Vehicle (UAV) based remote sensing (RS) studies in glaciology are mainly focusing on obtaining accurate high-resolution data from UAV images. Studies for identifying and minimising the challenges faced during the UAV-based RS data acquisition survey on inaccessible and harsh terrains of mountain glaciers is limited. This study aims to examine the practical challenges faced during UAV surveys of glaciers and derive strategies to minimize them. To the authors' knowledge, this is the first study that addresses such problems over the Himalayan region. Here, the UAV surveys were conducted using a fixed-wing commercial-grade off-the-shelf UAV (eBee plus, SenseFly) on three glacier sites (East Rathong, Hamtah and Panchinala-A) located in different zones and climate regimes lying within the Indian part of Himalayas. From UAV collected photos, the study was able to generate ultra-high-resolution ortho-mosaicked images and Digital Elevation Models (DEMs) at 0.1m GSD. UAV-derived DEMs was able to achieve vertical (horizontal) accuracy of 0.45 and 0.21 m (0.15 and 0.1 m) with 3 and 6 ground control points (GCPs) for an area of 0.75 km2 and 1.38 km2. Accuracy assessment of UAV DEMs generated with and without GCPs indicate that GCPs are must to obtain decimetre level accurate DEM especially on glaciers with steep-valleyed terrains. The utility of the obtained ultra-high-resolution ortho-mosaicked images was demonstrated by generating glacier surface feature maps. Based on the challenges observed during UAV surveys, the study identifies and recommends best-suited locations on a glacier and its adjacent regions for conducting UAV surveys efficiently in the glaciated terrain of Himalayas and possibly beyond. Recommendations reported in this article shall minimise the challenges faced and involved risks for data acquisition and thus enable UAVs to cover more glaciated area successfully.

A quantum hybrid (QH) intelligent approach that blends the adaptive search capability of the quantum-behaved particle swarm optimisation (QPSO) method with the intuitionistic rationality of traditional fuzzy k-nearest neighbours (Fuzzy k-NN) algorithm (known simply as the Q-Fuzzy approach) is proposed for efficient feature selection and classification of cells in cervical smeared (CS) images. From an initial multitude of seventeen (17) features describing the geometry, colour, and texture of the CS images, the QPSO stage of our proposed technique is used to select the best subset features (i.e. global best particles) that represent a pruned down collection of seven (7) features. Using a dataset of almost 1000 images, performance evaluation of our proposed Q-Fuzzy approach assesses the impact of our feature selection on classification accuracy by way of three experimental scenarios that are compared alongside two other approaches: The All-features (i.e. classification without prior feature selection) and another hybrid technique combining the standard PSO algorithm with the Fuzzy k-NN technique (P-Fuzzy approach). In the first and second scenarios, we further divided the assessment criteria in terms of classification accuracy based on the choice of best features and those in terms of the different categories of the cervical cells. In the third scenario, we introduced new QH hybrid techniques, i.e. QPSO combined with other supervised learning methods, and compared the classification accuracy alongside our proposed Q-Fuzzy approach. Furthermore, we employed statistical approaches to establish qualitative agreement with regards to the feature selection in scenarios 1 and 3. The synergy between the QPSO and Fuzzy k-NN in the proposed Q-Fuzzy approach marginally improves classification accuracy as manifest in the reduction in number cell features, which is crucial for effective cervical cancer detection and diagnosis.

The quantization error (QE) from Self-Organizing Map (SOM) output after learning is exploited in this studies. SOM learning is applied on time series of spatial contrast images with variable relative amount of white and dark pixel contents, as in monochromatic medical images or satellite images. It is proven that the QE from the SOM output after learning provides a reliable indicator of potentially critical changes in images across time. The QE increases linearly with the variability in spatial contrast contents of images across time when contrast intensity is kept constant. The hitherto unsuspected capacity of this metric to capture even the smallest changes in large bodies of image time series after using ultra-fast SOM learning is illustrated on examples from SOM learning studies on computer generated images, MRI image time series, and satellite image time series. Linear trend analysis of the changes in QE as a function of the time an image of a given series was taken gives proof of the statistical reliability of this metric as an indicator of local change. It is shown that the QE is correlated with significant clinical, demographic, and environmental data from the same reference time period during which test image series were recorded. The findings show that the QE from SOM, which is easily implemented and requires computation times no longer than a few minutes for a given image series of 20 to 25, is useful for a fast analysis of whole series of image data when the goal is to provide an instant statistical decision relative to change/no change between images.

In California, water is a perennial concern. As competition for water resources increases due to growth in population, California’s tree nut farmers are committed to improving the efficiency of water used for food production. There is an imminent need to have reliable methods that provide information about the temporal and spatial variability of crop water requirements, which allow farmers to make irrigation decisions at field scale. This study focuses on estimating the actual evapotranspiration and crop coefficients of an almond and pistachio orchard located in Central Valley (California) during an entire growing season by combining a simple crop evapotranspiration model with remote sensing data. A dataset of the vegetation index NDVI derived from Landsat-8 was used to facilitate the estimation of the basal crop coefficient (Kcb), or potential crop water use. The soil water evaporation coefficient (Ke) was measured from microlysimeters. The water stress coefficient (Ks) was derived from airborne remotely sensed canopy thermal-based methods, using seasonal regressions between the crop water stress index (CWSI) and stem water potential (Ystem). These regressions were statistically-significant for both crops, indicating clear seasonal differences in pistachios, but not in almonds. In almonds, the estimated maximum Kcb values ranged between 1.05 to 0.90, while for pistachios, it ranged between 0.89 to 0.80. The model indicated a difference of 97 mm in transpiration over the season between both crops. Soil evaporation accounted for an average of 16% and 13% of the total actual evapotranspiration for almonds and pistachios, respectively. Verification of the model-based daily crop evapotranspiration estimates was done using eddy-covariance and surface renewal data collected in the same orchards, yielding an r² >= 0.7 and average root mean square errors (RMSE) of 0.74 and 0.91 mm day^-1 for almond and pistachio, respectively. It is concluded that the combination of crop evapotranspiration models with remotely-sensed data is helpful for upscaling irrigation information from plant to field scale and thus may be used by farmers for making day-to-day irrigation management decisions.

Hyperspectral image (HSI) classification is a mechanism of analyzing differentiated land cover in remotely sensed hyperspectral images. In the last two decades, a number of different types of classification algorithms have been proposed for classifying hyperspectral data. These algorithms include supervised as well as unsupervised methods. Each of these algorithms has its own limitations. In this research, three different types of unsupervised classification methods are used to classify different datasets i-e Pavia Center, Pavia University, Cuprite, Moffett Field. The main objective is to assess the performance of all three classifiers K-Means, Spectral Matching, and Abundance Mapping, and observing their applicability on different datasets. This research also includes spectral feature extraction for hyperspectral datasets.

Object detection is one of the most critical tasks in the field of Computer vision. This task comprises identifying and localizing an object in the image. Architectural floor plans represent the layout of buildings and apartments. The floor plans consist of walls, windows, stairs, and other furniture objects. While recognizing floor plan objects is straightforward for humans, automatically processing floor plans and recognizing objects is a challenging problem. In this work, we investigate the performance of the recently introduced Cascade Mask R-CNN network to solve object detection in floor plan images. Furthermore, we experimentally establish that deformable convolution works better than conventional convolutions in the proposed framework. Identifying objects in floor plan images is also challenging due to the variety of floor plans and different objects. We faced a problem in training our network because of the lack of publicly available datasets. Currently, available public datasets do not have enough images to train deep neural networks efficiently. We introduce SFPI, a novel synthetic floor plan dataset consisting of 10000 images to address this issue. Our proposed method conveniently surpasses the previous state-of-the-art results on the SESYD dataset and sets impressive baseline results on the proposed SFPI dataset. The dataset can be downloaded from SFPI Dataset Link. We believe that the novel dataset enables the researcher to enhance the research in this domain further.

Speckle noise reduction is an important area of research in the field of ultrasound image processing. Several algorithms for speckle noise characterization and analysis have been recently proposed in the area. Synthetic ultrasound images can play a key role in noise evaluation methods as they can be used to generate a variety of speckle noise models under different interpolation and sampling schemes, and can also provide valuable ground truth data for estimating the accuracy of the chosen methods. However, not much work has been done in the area of modelling synthetic ultrasound images, and in simulating speckle noise generation to get images that are as close as possible to real ultrasound images. An important aspect of simulated synthetic ultrasound images is the requirement for extensive quality assessment for ensuring that they have the texture characteristics and gray-tone features of real images. This paper presents texture feature analysis of synthetic ultrasound images using local binary patterns (LBP) and demonstrates the usefulness of a set of LBP features for image quality assessment. Experimental results presented in the paper clearly show how these features could provide an accurate quality metric that correlates very well with subjective evaluations performed by clinical experts.

A problem with synthetic aperture radar (SAR) is that, due to the poor penetrating action of electromagnetic waves inside solid bodies, the capability to observe inside distributed targets is precluded. Under these conditions, imaging action is provided only on the surface of distributed targets. The present work describes an imaging method based on the analysis of micro-movements on the Khnum-Khufu Pyramid, which are usually generated by background seismic waves. The results obtained prove to be very promising, as high-resolution full 3D tomographic imaging of the pyramid's interior and subsurface was achieved. Khnum-Khufu becomes transparent like a crystal when observed in the micro-movement domain. Based on this novelty, we have completely reconstructed internal objects, observing and measuring structures that have never been discovered before. The experimental results are estimated by processing series of SAR images from the second-generation Italian COSMO-SkyMed satellite system, demonstrating the effectiveness of the proposed method.

The urban mangrove of the Vitória Bay, Espírito Santo, Southern Brazil suffers from anthropogenic impacts, which interfere in the foliar spectral response of its species. Identifying the spectral behavior of these species and creating regression models to indirectly obtain structure data like the Leaf Area Index (LAI) are powerful environmental monitoring tools. In this study, LAI was obtained in 32 plots distributed in four stations. In situ LAI regression analysis with the SAVI resulted in significant positive relationships (r² = 0.58). Forest variability regarding the degree of maturity and structural heterogeneity and LAI influenced the adjustment of vegetation indices (VIs). The highest regression values were obtained for the homogeneous field data, represented by R. mangle plots, which also had higher LAI values. The same field data were correlated with SAVI of a RapidEye image for comparison purposes. The results showed that, images obtained by a UAV have higher spatial resolution than the Rapideye image, and therefore had a greater influence of the background. Another point is that the statistical analysis of the field data with the IVs obtained from the RapidEye image did not present high regression coefficient (r² = 0.7), suggesting that the use of VIs applied to the study of urban mangroves needs to be better evaluated, observing the factors that influence the leaf spectral response.

Tables in the document image are one of the most important entities since they contain crucial information. Therefore, accurate table detection can significantly improve information extraction from tables. In this work, we present a novel end-to-end trainable pipeline, HybridTabNet, for table detection in scanned document images. Our two-stage table detector uses the ResNeXt-101 backbone for feature extraction and Hybrid Task Cascade (HTC) to localize the tables in scanned document images. Moreover, we replace conventional convolutions with deformable convolutions in the backbone network. This enables our network to detect tables of arbitrary layouts precisely. We evaluate our approach comprehensively on ICDAR-13, ICDAR-17 POD, ICDAR-19, TableBank, Marmot, and UNLV. Apart from the ICDAR-17 POD dataset, our proposed HybridTabNet outperforms earlier state-of-the-art results without depending on pre and post-processing steps. Furthermore, to investigate how the proposed method generalizes unseen data, we conduct an exhaustive leave-one-out-evaluation. In comparison to prior state-of-the-art results, our method reduces the relative error by 27.57% on ICDAR-2019-TrackA-Modern, 42.64% on TableBank (Latex), 41.33% on TableBank (Word), 55.73% on TableBank (Latex + Word), 10% on Marmot, and 9.67% on UNLV dataset. The achieved results reflect the superior performance of the proposed method.

Land cover change detection (LCCD) based on bi-temporal remote sensing images plays an important role in the inventory of land cover change. Due to the benefit of having spatial dependency properties within the image space while using remote sensing images for detecting land cover change, many contextual information based change detection methods have been proposed during past decades. However, there is still a space for improvement in accuracies and usability of LCCD. In this paper, a LCCD method based on adaptive contextual information is proposed. First, an adaptive region is constructed by gradually detecting the spectral similarity surrounding a central pixel. Second, the Euclidean distance between pairwise extended regions is calculated to measure the change magnitude between the pairwise central pixels of bi-temporal images. While the whole bi-temporal images are scanned pixel-by-pixel, the change magnitude image (CMI) can be generated. Then, the Otsu or a manual threshold is employed to acquire the binary change detection map (BCDM). The detection accuracies of the proposed approach are investigated by two land cover change cases with Landsat bi-temporal remote sensing images. In comparison to several widely used change detection methods, the proposed approach can achieve a land cover change inventory map with a competitive accuracy.

In this paper, we propose a novel approach to recognize radar targets on inverse synthetic aperture radar (ISAR) and synthetic aperture radar (SAR) images. This approach is based on the multiple salient keypoint descriptors (MSKD) and multitask sparse representation based classification (MSRC). Thus, to characterize the targets in the radar images, we combine the scale-invariant feature transform (SIFT) and the saliency map. The goal of this combination is to reduce the SIFT keypoints and their time computing time by maintaining only those located in the target area (salient region). Then, we compute the feature vectors of the resulting salient SIFT keypoints (MSKD). This methodology is applied for both training and test images. The MSKD of the training images leads to construct the dictionary of a sparse convex optimization problem. To achieve the recognition, we adopt the MSRC taking into consideration each vector in the MSKD as a task. This classifier solves the sparse representation problem for each task over the dictionary and determines the class of the radar image according to all sparse reconstruction errors (residuals). The effectiveness of the proposed approach method has been demonstrated by a set of extensive empirical results on ISAR and SAR images databases. The results show the ability of our method to predict adequately the aircraft and the ground targets.

Remote sensing technology, especially using satellite images, has become essential support in many aspects of decision-making, particularly in disaster risk management. It requires a shorter period of data updates and less cost compared to conventional field observations and surveys. Yet, the intensive processing and high-powered computing resources are necessary to analyze satellite imagery data through Geographic Information System (GIS). In this paper, we introduce the identification and mapping of natural disaster impact in Indonesia using the open-source collaborative tool of Google Earth Engine (GEE) application which analyzes the relative temporal difference of Earth surface from three major satellite images: Sentinel-1, Sentinel-2, and Landsat-8. Taking the advantage of the geographical, geological, and demographic conditions of Indonesia's disaster-prone areas, we analyze relative difference from normalized difference vegetation index (NDVI) out of months before and after natural disaster occurrence to measure the impact of natural disaster in focus study areas. Given the high-vegetation nature of three main natural disaster impacted areas in Indonesia: Aceh, Palu, and Yogyakarta, we are able to simplify the analysis by highlighting areas with vegetative loss or gain after the event. Using an open-source GEE application, namely HazMapper, we identify and visualize the aftermath of the tsunami disaster in Aceh and Palu as well as the earthquake in Yogyakarta. Our study is potentially beneficial for government and decision-makers to utilize publicly available satellite images for disaster recovery and mitigation policy.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

The technique of obtaining information or data about any feature or object from afar, called in technical parlance as remote sensing, has proven extremely useful in diverse fields. In the ecological sphere, especially, remote sensing has enabled collection of data or information about large swaths of areas or landscapes. Even then, in remote sensing the task of identifying and monitoring of different water reservoirs has proved a tough one. This is mainly because getting correct appraisals about the spread and boundaries of the area under study and the contours of any water surfaces lodged therein becomes a factor of utmost importance. Identification of water reservoirs is rendered even tougher because of presence of cloud in satellite images, which becomes the largest source of error in identification of water surfaces. To overcome this glitch, the method of the shape matching approach for analysis of cloudy images in reference to cloud-free images of water surfaces with the help of vector data processing, is recommended. It includes the database of water bodies in vector format, which is a complex polygon structure. This analysis highlights three steps: First, the creation of vector database for the analysis; second, simplification of multi-scale vector polygon features; and third, the matching of reference and target water bodies database within defined distance tolerance. This feature matching approach provides matching of one to many and many to many features. It also gives the corrected images that are free of clouds.

The prompt and accurate diagnosis of breast lesions, including the distinction between cancer, non-cancer, and suspicious cancer, plays a crucial role in the prognosis of breast cancer. In this paper, we introduce a novel method based on feature extraction and reduction for detection of breast cancer in mammography images. First, we extract features from multiple pre-trained convolutional neural network (CNN) models, and then concatenate them. The most informative features are selected based on their mutual information with the target variable. Subsequently, the selected features can be classified using a machine learning algorithm. We evaluate our approach using four different machine learning algorithms, and our results demonstrate that the neural network-based classifier yields an accuracy as high as 92% for the RSNA dataset which is a new dataset that provides two views and additional features such as age. We compare our proposed algorithm with state-of-the-art methods and demonstrate its superiority, particularly in terms of accuracy and sensitivity. For the MIAS dataset, we achieve an accuracy as high as 94.5%, and for the DDSM dataset, an accuracy of 96% is attained. These results highlight the effectiveness of our method in accurately diagnosing breast lesions and surpassing existing approaches.

Macula fovea detection is a crucial prerequisite towards screening and diagnosing macular diseases. Without early detection and proper treatment, any abnormality involving the macula may lead to blindness. However, with the ophthalmologist shortage and time-consuming artificial evaluation, neither accuracy nor effectiveness of the diagnose process could be guaranteed. In this project, we proposed a deep learning approach on ultra-widefield fundus (UWF) images for macula fovea detection. This study collected 2300 ultra-widefield fundus images from Shenzhen Aier Eye Hospital in China. Methods based on U-shape network (Unet) and Fully Convolutional Networks (FCN) are implemented on 1800 (before amplifying process) training fundus images, 400 (before amplifying process) validation images and 100 test images. Three professional ophthalmologists were invited to mark the fovea. A method from the anatomy perspective is investigated. This approach is derived from the spatial relationship between macula fovea and optic disc center in UWF. A set of parameters of this method is set based on the experience of ophthalmologists and verified to be effective. Results are measured by calculating the Euclidean distance between proposed approaches and the accurate grounded standard, which is detected by Ultra-widefield swept-source optical coherence tomograph (UWF-OCT) approach. Through a comparation of proposed methods, we conclude that, deep learning approach of Unet outperformed other methods on macula fovea detection tasks, by which outcomes obtained are comparable to grounded standard method.

Existing methods enhance mid-low resolution remote sensing ship detection by feeding super-resolved images to the detectors. Although these methods marginally improve the detection accuracy, the correlation between image super-resolution (SR) and ship detection is under-exploited. In this paper, we propose a simple but effective ship detection method called ShipSR-Det, in which both the output image and the intermediate features of the SR module are fed to the detection module. Using the super-resolved feature representation, the potential benefit introduced by image SR can be fully used for ship detection. We apply our method to the SSD and Faster-RCNN detectors and develop ShipSR-SSD and ShipSR-Faster-RCNN, respectively. Extensive ablation studies validate the effectiveness and generality of our method. Moreover, we compare ShipSR-Faster-RCNN with several state-of-the-art ship detection methods. Comparative results on the HRSC2016, DOTA and NWPU VHR-10 datasets demonstrate the superior performance of our proposed method.

Hyper spectral imaging (HSI) is a technique that is used to obtain the spectrum for each pixel in the image. It helps in finding objects and identifying materials etc. Such an identification is very difficult using other imaging techniques. It allows the researchers to investigate the documents without any physical contact. Nowadays detection of unequal Ink mismatch based on HSI has shown vast improvement in distinguishing the inks. Detection of unequal Ink mismatch is an unbalanced clustering problem. This paper used K-means Clustering for ink mismatch detection. K-means Clustering find same subgroups in the data based on Euclidean distance. This paper demonstrates performance in unequal Ink mismatch based on HSI.

Here, we report the prediction of vegetative stages variables of canary bean crop by means of RGB and multispectral images obtained from UAV during the ripening stage, correlating the vegetation indices with biometric variables measured manually in the field. Results indicated a highly significant correlation of plant height with eight RGB image vegetation indices for the canary bean crop, which were used for predictive models, obtaining a maximum correlation of R2 = 0.79. On the other hand, the estimated indices of multispectral images did not show significant correlations.

Hyperspectral images are an important tool to assess ecosystem biodiversity both on terrestrial and benthic habitats. To obtain more precise analysis of biodiversity indicators that agree with indicators obtained using field data, analysis of spectral diversity calculated from images have to be validated with field based diversity estimates. The plant species richness is one of the most important indicators of biodiversity. This indicator can be measured in hyperspectral images considering the Spectral Variation Hypothesis (SVH) which states that the spectral heterogeneity is related to spatial heterogeneity and thus to species richness. The goal of this research is to capture spectral heterogeneity from hyperspectral images for a terrestrial neo tropical forest site using Vector Quantization (VQ) method and then use the result for prediction of plant species richness. The results are compared with that of Hierarchical Agglomerative Clustering (HAC). The validation of the process index is done calculating the Pearson correlation coefficient between the Shannon entropy from actual field data and the Shannon entropy computed in the images. Terrestrial dry forest and marine coastal hyperspectral images with different resolutions have been used for spectral diversity feature validation.

Karst wetlands are being seriously damaged, and protecting it has become an important matter. Karst vegetation is the essential component of wetland and plays an important role in in the ecological functions of wetland ecosystems. Classifying karst vegetation is important for karst wetlands protection and management. This paper addressed to classify karst vegetation in Huixian National Wetland Park, located in China using the improved SegNet Deep-Learning Algorithm and UAV images. This study proposed a method to fuse single-class SegNet models using the maximum probability algorithm for karst vegetation classification, and compared with object-based RF classification and multi-class SegNet classification, respectively. This paper evaluated the performance of multi-class SegNet model and fusion of single-class SegNet model with different EPOCH values for mapping karst vegetation. A new optimized post-classification algorithm was proposed to eliminate the stitching traces caused by SegNet model prediction. The specific conclusions of this paper include the followings:(1) fusion of four single-class SegNet models produced better classification for karst wetland vegetation than multi-class SegNet model, and achieved the highest overall classification accuracy (87.34%); (2) The optimized post-classification algorithm was able to improve prediction accuracy of SegNet model, and it could eliminate splicing traces; (3) The karst wetland vegetation classifications produced by single-class SegNet model outperformed multi-class SegNet model, and improved classification accuracy(F1-Score) between 10%~25%;(4)The EPCOH values and textural feature important impact on karst wetland vegetation classifications. The SegNet model with EPCOH 15 achieved greater classification accuracy(F1-Score) than the model with EPOCH 5 or 10. The textural feature improved improves the capability of the SegNet model for mapping karst vegetation;(5) Fusion of single-class SegNet models and object-based RF model could provide high classifications results for karst wetland vegetation, and both achieved greater 87% overall accuracy.

Remote sensing technologies may play a fundamental role in the environmental assessment of open-cast mining and the accurate quantification of mine land rehabilitation efforts. Here, we developed a systematic geographic object-based image analysis (GEOBIA) approach to map the amount of revegetated area and to quantify the land-use changes in open-cast mines in the Carajás region situated in the eastern Amazon. Based on high-resolution satellite images from 2011 to 2015 from different sensors (GeoEye, WorldView-3 and Ikonos), we quantified forests, cangas (natural metalliferous savanna ecosystems), mine land, revegetated areas and water bodies. Based on the GEOBIA approach, threshold values were established to discriminate land cover classes using spectral bands, and the NDVI and NDWI indices and LiDAR digital ground and slope models. The overall accuracy was higher than 90%, and the Kappa indices varied between 0.82 and 0.88. During the observation period, the mining complex expanded; for that, canga and forest vegetation was converted to mine land. At the same time, the amount of revegetated area increased. Thus, we conclude that our approach is capable of providing consistent information regarding land cover changes in mines, with a special focus on the amount of revegetation necessary to fulfill environmental liabilities.

This paper aims at tackling with the task of fusion feature from images and its corresponding point clouds for 3D object detection in autonomous driving scenarios basing on AVOD, an Aggregate View Object Detection network. The proposed fusion algorithms fuse features targeted from Bird’s Eye View (BEV) LIDAR point clouds and its corresponding RGB images. Differs in existing fusion methods, which are simply the adoptions of concatenation module, element-wise sum module or element-wise mean module, our proposed fusion algorithms enhance the interaction between BEV feature maps and its corresponding images feature maps by designing a novel structure, where single level feature maps and another utilizes multilevel feature maps. Experiments show that our proposed fusion algorithm produces better results on 3D mAP and AHS with less speed loss comparing to existing fusion method used on the KITTI 3D object detection benchmark.

Although deep learning has received extensive attention and achieved excellent performances in various of scenarios, it suffers from adversarial examples to some extent. Especially, physical attack poses more threats than digital attack. However, existing researches pay less attention to physical attack of object detection in remote sensing images (RSIs). In this work, we systematically analyze the universal adversarial patch attack for multi-scale objects in the remote sensing field. There are two challenges for adversarial attack in RSIs. On one hand, the number of objects in remote sensing images is more than that of natural images. Therefore, it is difficult for adversarial patch to show adversarial effect on all objects when attacking a detector of RSIs. On the other hand, the wide range of height of photography platform causes that the size of objects diverse a lot, which brings challenges for generating universal adversarial perturbation for multi-scale objects. To this end, we propose an adversarial attack method on object detection for remote sensing data. One of the key ideas of the proposed method is the novel optimization of adversarial patch. We aim to attack as many objects as possible by formulating a joint optimization problem. Besides, we raise a scale factor to generate a universal adversarial patch that adapts to multi-scale objects, which ensures the adversarial patch is valid for multi-scale objects in the real world. Extensive experiments demonstrate the superiority of our method against state-of-the-art methods on YOLO-v3 and YOLO-v5. In addition, we also validate the effectiveness of our method in real-world applications.

Visual Question Generation (VQG) from images is a rising research topic in both fields of natural language processing and computer vision. Although there are some recent efforts towards generating questions from images in the open domain, the VQG task in the medical domain has not been well-studied so far due to the lack of labeled data. In this paper, we introduce a goal-driven VQG approach for radiology images called VQGRaD that generates questions targeting specific image aspects such as modality and abnormality. In particular, we study generating natural language questions based on the visual content of the image and on additional information such as the image caption and the question category. VQGRaD encodes the dense vectors of different inputs into two latent spaces, which allows generating, for a specific question category, relevant questions about the images, with or without their captions. We also explore the impact of domain knowledge incorporation (e.g., medical entities and semantic types) and data augmentation techniques on visual question generation in the medical domain. Experiments performed on the VQA-RAD dataset of clinical visual questions showed that VQGRaD achieves 61.86% BLEU score and outperforms strong baselines. We also performed a blinded human evaluation of the grammaticality, fluency, and relevance of the generated questions. The human evaluation demonstrated the better quality of VQGRaD outputs and showed that incorporating medical entities improves the quality of the generated questions. Using the test data and evaluation process of the ImageCLEF 2020 VQA-Med challenge, we found that relying on the proposed data augmentation technique to generate new training samples by applying different kinds of transformations, can mitigate the lack of data, avoid overfitting, and bring a substantial improvement in medical VQG.

Hyper-spectral images contain a wide range of bands or wavelength due to which they are rich in information. These images are taken by specialized sensors and then investigated through various supervised or unsupervised learning algorithms. Data that is acquired by hyperspectral image contain plenty of information hence it can be used in applications where materials can be analyzed keenly, even the smallest difference can be detected on the basis of spectral signature i.e. remote sensing applications. In order to retrieve information about the concerned area, the image has to be grouped in different segments and can be analyzed conveniently. In this way, only concerned portions of the image can be studied that have relevant information and the rest that do not have any information can be discarded. Image segmentation can be done to assort all pixels in groups. Many methods can be used for this purpose but in this paper, we discussed k means clustering to assort data in AVIRIS cuprite, AVIRIS Muffet and Rosis Pavia in order to calculate the number of regions in each image and retrieved information of 1st, 10th and100th band. Clustering has been done easily and efficiently as k means algorithm is the easiest approach to retrieve information.

Recent advances in open data initiatives allow us to free access to a vast amount of open LiDAR data in many cities. However, most of these open LiDAR data over cities are acquired by airborne scanning, where the points on façades are sparse or even completely missing due to the viewpoint and object occlusions in the urban environment. Integrating other sources of data, such as ground images, to complete the missing parts is an effective and practical solution. This paper presents an approach for improving open LiDAR data coverage on building façades by using point cloud generated from ground images. A coarse-to-fine strategy is proposed to fuse these two different sources of data. Firstly, the façade point cloud generated from terrestrial images is initially geolocated by matching the SFM camera positions to their GPS meta-information. Next, an improved Coherent Point Drift algorithm with normal consistency is proposed to accurately align building façades to open LiDAR data. The significance of the work resides in the use of 2D overlapping points on the outline of buildings instead of limited 3D overlap between the two point clouds and the achievement to a reliable and precise registration under possible incomplete coverage and ambiguous correspondence. Experiments show that the proposed approach can significantly improve the façades details of buildings in open LiDAR data and improving registration accuracy from up to 10 meters to less than half a meter compared to classic registration methods.

Breast cancer develops from cells lining the milk ducts and slowly grows into a lump or a tumour. Breast cancer may be invasive or non-invasive. Invasive cancer spreads from the milk duct or lobule to other tissues in the breast, whereas, non-invasive ones lack the ability to invade other breast tissues. Non-invasive breast cancer is called in situ and may remain inactive for entire lifetime. Due to heterogeneity nature of breast, density as well as masses is variable in size and shape. A dataset of 18056 patients are collected from 20 Government Hospitals and 50 Private Hospitals in West Bengal before COVID-19 and after COVID-19. The classification of patients are made on three classes- Normal, Sign of Abnormality and Abnormality. The reports of MRIs of patients in January 2020 and February 2020 are collected from different hospitals. It is treated as dataset before COVID-19 . MRIS of patients in April 2020 and May 2020 are dataset during COVID-19. The entire datasets are accumulated for testing of any change in patients MRIS after the official announcement of new virus COVID-19 in March 2020. The aim of the paper is to make a comparison of any change in size and shape of masses of MRIs of patients before and after COVId-19. All collected MRIs reports are diagnosed by radiologists of hospitals.

Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved super-resolution model which involves the self-attention augmented WGAN is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the HR results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we therefore design a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features, this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.

Miscanthus holds a great potential in the frame of the bioeconomy and yield prediction can help improving Miscanthus logistic supply chain. Breeding programs in several countries are attempting to produce high-yielding Miscanthus hybrids better adapted to different climates and end-uses. Multispectral images acquired from unmanned aerial vehicles (UAVs) in Italy and in the UK in 2021 and 2022 were used to investigate the feasibility of high-throughput phenotyping (HTP) of novel Miscanthus hybrids for yield prediction and crop traits estimation. An intercalibration procedure was performed using simulated data from the PROSAIL model to link vegetation indices (VIs) derived from two different multispectral sensors. Random forest algorithm estimated with good accuracy yield traits (light interception, plant height, green leaf biomass and standing biomass) using VIs time series and predicted yield using peak descriptor derived from VIs time series with 2.3 Mg DM ha-1 of RMSE. The study demonstrates the potential of UAVs multispectral in HTP applications and in yield prediction for providing important information needed to increase sustainable biomass production.

Digital Twin Cities (DTCs) play a fundamental role in city planning and management. They allow three-dimensional modeling and simulation of cities. 3D semantic segmentation is the foundation for automatically creating enriched DTCs, as well as their updates. Past studies indicate that prior level fusion approaches demonstrate more promising precisions in 3D semantic segmentation compared to point level fusion, features level fusion, and decision level fusion families. In order to improve point cloud enriched semantic segmentation outcomes, this article proposes a new approach for 3D point cloud semantic segmentation through developing and benchmarking three prior level fusion scenarios. A reference approach based on point clouds and aerial images was proposed to compare it with the different developed scenarios. In each scenario, we inject a specific prior knowledge (geometric features,classified images ,etc) and aerial images as attributes of point clouds into the neural network’s learning pipeline. The objective is to find the one that integrates the most significant prior knowledge and enhances neural network knowledge more profoundly, which we have named the "smart fusion approach". The advanced Deep Learning algorithm "RandLaNet" was adopted to implement the different proposed scenarios and the reference approach, due to its excellent performance demonstrated in the literature. The introduction of some significant features associated with the label classes facilitated the learning process and improved the semantic segmentation results that can be achievable with the same neural network alone. Overall, our contribution provides a promising solution for addressing some challenges, in particular more accurate extraction of semantically rich objects from the urban fabric. An assessment of the semantic segmentation results obtained by the different scenarios is performed based on metrics computation and visual investigations. Finally,the smart fusion approach was derived based on the obtained qualitative and quantitative results.

For Visually impaired People (VIPs), the ability to convert text to sound can mean a new level of independence or the simple joy of a good book. With significant advances in Optical Character Recognition (OCR) in recent years, a number of reading aids are appearing on the market. These reading aids convert images captured by a camera to text which can then be read aloud. However, all of these reading aids suffer from a key issue – the user must be able to visually target the text and capture an image of sufficient quality for the OCR algorithm to function – no small task for VIPs. In this work, a Sound-Emitting Document Image Quality Assessment metric (SEDIQA) is proposed which allows the user to hear the quality of the text image and automatically captures the best image for OCR accuracy. This work also includes testing of OCR performance against image degradations, to identify the most significant contributors to accuracy reduction. The proposed No-Reference Image Quality Assessor (NR-IQA) is validated alongside established NR-IQAs and this work includes insights into the performance of these NR-IQAs on document images.

Panoramic and periapical radiograph tools help dentists diagnose the most common dental diseases. Generally, dentists identify dental caries manually by inspecting X-ray images. However, due to their heavy workload, or poor image quality, dentists may sometimes overlook some unnoticeable dental caries, which may ultimately hinder the patient treatment. The purpose of this study was to develop an algorithm that classifies the teeth X-Ray images into three categories of “Normal”, “Caries”, and “Filled”. Our study used a dataset of 116 patients and 3712 single teeth images for training, validation and testing. Images were pre-processed using a sharpening filter and an intensity color map. We used a pre-trained transfer learning model, the NASNetMobile, which served as the feature extractor and the Convolutional Neural Network (CNN) model served as the classifier. The training dataset had a “Recall” of 0.92, 0.90 and 0.91 for “Normal”, “Caries” and “Filled” respectively and the test dataset had a “Recall” of 0.86, 0.81 and 0.85 for “Normal”, “Caries” and “Filled” respectively. The classification of the teeth X-Rays was successful and can be valuable for dentist as the artificial intelligence algorithm can serve as a decision support tool to aid dentists when they need to diagnose dental treatment.

In this study, we aimed to develop a deep learning model for identifying bacterial keratitis (BK) and fungal keratitis (FK) by using slit-lamp images. We retrospectively collected slit-lamp images of patients with culture-proven microbial keratitis between January 1, 2010, and December 31, 2019, from two medical centers in Taiwan. We constructed a deep learning algorithm, consisting of a segmentation model for cropping cornea images and a classification model that applies convolutional neural networks to differentiate between FK and BK. The model performance was evaluated and presented as the area under the curve (AUC) of the receiver operating characteristic curves. A gradient-weighted class activation mapping technique was used to plot the heatmap of the model. By using 1330 images from 580 patients, the deep learning algorithm achieved an average diagnostic accuracy of 80.00%. The diagnostic accuracy for BK ranged from 79.59% to 95.91% and that for FK ranged from 26.31% to 63.15%. DenseNet169 showed the best model performance, with an AUC of 0.78 for both BK and FK. The heat maps revealed that the model was able to identify the corneal infiltrations. The model showed better diagnostic accuracy than the previously reported diagnostic performance of both general ophthalmologists and corneal specialists.

Segmentation is an important step in medical imaging. In particular, machine learning, especially deep learning, has been widely used to efficiently improve and speed up the segmentation process in clinical practice. Despite the acceptable segmentation results of multi-stage models, little attention was paid to the use of deep learning algorithms for brain image segmentation, which could be due to the lack of training data. Therefore, in this paper, we propose a Generative Adversarial Network (GAN) model that performs transfer learning to segment MRI brain images.Our model enables the generation of more labeled brain images from existing labeled and unlabeled images. Our segmentation targets brain tissue images, including white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We evaluate the performance of our GAN model using a commonly used evaluation metric, which is Dice Coefficient (DC). Our experimental results reveal that our proposed model significantly improves segmentation results compared to the standard GAN model. We observe that our model is 2.1–10.83 minutes faster than stat-of-the-art-models.

Pieron's and Chocholle’s seminal psychophysical work predicts that human response time to information relative to visual contrast and/or sound frequency decreases when contrast intensity or sound frequency increases. The goal of this study is to bring to the fore the ability of individuals to use visual contrast intensity and sound frequency in combination for faster perceptual decisions of relative depth (“nearer”) in planar (2D) object configurations on the basis of physical variations in luminance contrast. Computer controlled images with two abstract patterns of varying contrast intensity, one on the left and one on the right, preceded or not by a pure tone of varying frequency, were shown to healthy young humans in controlled experimental sequences. Their task (two-alternative forced-choice) was to decide as quickly as possible which of two patterns, the left or the right one, in a given image appeared to “stand out as if it were nearer” in terms of apparent (subjective) visual depth. The results show that the combinations of varying relative visual contrast with sounds of varying frequency exploited here produced an additive effect on choice response times in terms of facilitation, where a stronger visual contrast combined with a higher sound frequency produced shorter forced-choice response times. This new effect is predicted by cross-modal audio-visual probability summation.

Recently the increased cost-effectiveness of high-throughput technologies has made available a large number of RNA sequencing datasets to identify circular RNAs (circRNAs). However, despite many computational tools were developed to predict circRNAs, a limited number of workflows exists to predict and to characterize circRNAs. Moreover, to the best of our knowledge, these available workflows do not ensure computational reproducibility and require advanced bash scripting skills to be correctly installed and used. To cope with these critical aspects we present Docker4Circ, a new computational framework designed for a comprehensive analysis of circRNAs composed of: circRNAs prediction, classification and annotation using public databases, the back-splicing sequence reconstruction; the internal alternative splicing of circularizing exons; the alignment-free circRNAs quantification from RNA-Seq reads, and, finally, their differential expression analysis. Docker4Circ was specifically designed for making easier and more accessible circRNAs analysis thanks to the following features: (i) its R interface; (ii) the encapsulation of its computational tasks into a docker image; (iii) an available user-friendly Java GUI Interface. Furthermore, Docker4Circ ensures a reproducible analysis because all its tasks were embedded into a docker image following the guidelines provided by Reproducible Bioinformatics Project (RBP, http://reproducible-bioinformatics.org/). The effectiveness of Docker4Circ was demonstrated on a real case study whose goal is to characterize the circRNAs predicted in colorectal cancer cell lines and quantified in public RNA-Seq experiments performed on primary tumor tissues. In conclusion, we propose Docker4Circ as a framework for reproducible and comprehensive analyses of circRNAs to efficiently exploit their biological role.

Yield calculation is an important link in modern precision agriculture, which is an effective means to improve breeding efficiency, and adjust planting and marketing plans. With the continuous progress of artificial intelligence and sensing technology, yield calculation schemes based on image processing technology have many advantages such as high accuracy, low cost, and non-destructive calculation, and have been favored by a large number of researchers. This article reviews the research progress of crop yield calculation based on remote sensing images and visible light images, describes the technical characteristics and applicable objects of different schemes, and focuses on detailed explanations of data acquisition, independent variable screening, algorithm selection and optimization. Common issues are also discussed and summarized. Finally, solutions are proposed for the main problems that have arisen so far, and future research directions are predicted, with the aim of achieving more progress and wider popularization of yield calculation solutions based on image technology.

The objective of this study was aimed to study the sensory processes of the “human-computer interaction” model when classifying visual images with an incomplete set of signs based on the analysis of early, middle, late and slow components of event-related potentials (ERPs). 26 healthy subjects (men) aged 20-22 years were investigated. ERPs in 19 monopolar sites according to the 10/20 system were recorded. Discriminant and factor analysis were applied. The component N450 is the most specialized indicator of the perception of unrecognizable (oddball) visual images. The amplitude of the ultra-late components N750 and N900 is also higher under conditions of presentation of the oddball image, regardless of the location of the registration points. The results of the study are discussed in the light of the paradigm of the P300 wave application in brain-computer interface systems, as well as with the peculiarities in brain pathology. Promising directions for the development of studies of the “Brain Computer Interface” (BCI) P300 systems are to increase the throughput of information flows. To extend the application of the P300 ERPs to multiple modalities, the underlying physiological mechanisms and responses of the brain for a particular sensory system and mental function must be carefully examined.

Research has been growing on object detection using semi-supervised methods in past few years. We examine the intersection of these two areas for floor-plan objects to promote the research objective of detecting more accurate objects with less labelled data. The floor-plan objects include different furniture items with multiple types of the same class, and this high inter-class similarity impacts the performance of prior methods. In this paper, we present Mask R-CNN based semi-supervised approach that provides pixel-to-pixel alignment to generate individual annotation masks for each class to mine the inter-class similarity. The semi-supervised approach has a student-teacher network that pulls information from the teacher network and feeds it to the student network. The teacher network uses unlabeled data to form pseudo-boxes, and the student network uses both unlabeled data with the pseudo boxes and labelled data as ground truth for training. It learns representations of furniture items by combining labelled and unlabeled data. On the Mask R-CNN detector with ResNet-101 backbone network, the proposed approach achieves mAP of 98.8%, 99.7%, and 99.8% with only 1%, 5% and 10% labelled data, respectively. Our experiment affirms the efficiency of the proposed approach as it outperforms the fully supervised counterpart using only 10% of the labels.

Fault detection is an important step for subsurface interpretation and reservoir characterization from 3D seismic images. Due to the numerous and complicated faulting structures of seismic images, manual seismic interpretation is time taking and need intensive work. To overcome this problem, geoscientists are coming up with productive computer-aided techniques for assisting in interpreter science for many years. However, in this paper, we used a pre-trained CNN model to predict faults from the 3D seismic volume of the Poseidon field of Browse Basin, Australia. Basically, this field is highly structured with complex normal faulting throughout the targeted Plover Formations. So, our motivation for this work in this field is to compare machine learning-based fault prediction to user interpreted faults identification with supported by seismic variance attribute. We found very satisfying result using DL with having an improved fault probability volume that outperform variance technology. Therefore, we propose that this workflow could reduce time and able to predict fault quite accurately in any field area.

Generative AI has gained enormous interest nowadays due to new applications like chatGPT, DALL E, Stable Difussion and Deep Fake. Particularly DALL E, Stable Difussion and others (Adobe Firefly, ImagineArt...) are able to create images from a text prompt and are also able to recreate real photographs. Due to this fact, intense research has arisen to create new image forensics applications able to distinguish between real captured images and videos and artificial ones. Detecting forgeries made with Deep Fake is one of the most researched issues. This paper is about another kind of forgery detection. The purpose of this research aims to detect photo realistic AI created images versus real photos coming from a physical camera. For this purpose, techniques that perform a pixel level feature extraction are used. First one is Photo Response Non-Uniformity (PRNU). PRNU is a special noise due to imperfections on the camera sensor that is used for source camera identification. The underlying idea is that AI images will have a different PRNU pattern. Second one is Error level analysis (ELA). This is other type of feature extraction traditionally used for detecting image editions. In fact, ELA is being used nowadays by photographers to detect manually AI created images. Both kinds of features are used to train Convolutional Neural Networks to differentiate between AI images and real photographs. Good results are obtained achieving accuracy rates over 95%. Both extraction methods are carefully assessed by computing precision/recall and F1-score measurements.

This study explores the changes in the landmass bounded by the coast of India during 1975-2005 by using on-screen visual interpretation technique (with 100m resolution and 1:50,000 scale) from NASA Landsat Imagery in three different time periods viz. 1975, 1990, and 2005. The result indicated an overall expansion of 130 sq. km area of the landmass that surrounded by the Indian coast during 1975-2005 (74 sq. km during 1975-1990 and 56 sq. km during 1991-2005). These estimations are based on the preliminary analysis and may be estimated more accurately by reducing the scale and using further higher resolution images.

While thunderstorms can pose severe risks to property and life, forecasting remains challenging, even at short lead times, as these often arise in meta-stable atmospheric conditions. In this paper, we examine the question of how well we could perform short-term (up to 180min) forecasts using exclusively multi-spectral satellite images and past lighting events as data. We employ representation learning based on deep convolutional neural networks in an “end-to-end” fashion. Here, a crucial problem is handling the imbalance of the positive and negative classes appropriately in order to be able to obtain predictive results (which is not addressed by many previous machine-learning-based approaches). The resulting network outperforms previous methods based on physically-based features and optical flow methods (similar to operational prediction models) and generalizes across different years. A closer examination of the classifier performance over time and under masking of input data indicates that the learned model actually draws most information from structures in the visible spectrum, with infrared imaging sustaining some classification performance during the night.

During the pandemic, home-cooked meals have received more attention as people get more time for themselves and their families. It cannot deny that people have more time to prepare meals, and it is safer to cook at home since they can avoid direct contact with people who can potentially F0 or F1. For that particular reason, the number of home cooking has increased rapidly. In the article, the author pointed out that in comparison to the previous time, 42.0 percent of respondents said they cooked more frequently during the lockdown, while just 7.0 percent said they cooked less frequently. The increase in cooking frequency had a more significant impact on women than on men (p<0.05). Those who said they cooked more regularly spent more time preparing meals (78\%) and trying new recipes (73.6\%), as well as spending more time baking (67.1 percent ). In particular, the consumption of “comfort” foods (salty snacks, sweets) showed a significant rise, ranging from (23\%) to (60\%) of respondents who declared snacking more studied.Moreover, articles pointed out that in conjunction with the dramatic reduction in energy expenditure due to the impossibility of going out, this situation could have led to energy imbalance and, thus, weight gain. Noticing the massive rise in home cooking, the search for new recipes, and the need for balance meals, the idea for a cooking app called "Cooking Papa" has been proposed. As far as the research goes, the concept of "cooking" seems close but yet not easy to define. The Oxford English Dictionary defines cooking as “to prepare food by the action of heat. However, limited evidence suggests that people interpret the meaning of cooking quite differently. Moreover, the terms ‘homemade’, ‘convenience,’ ‘proper cooking,’ ‘cook,’ ‘basic ingredients,’ and ‘ready prepared’ are not uniformly understood.

At INFN-LNS, and in collaboration with the ATOMKI laboratories, an innovative multi-diagnostic system with advanced analytical methods has been designed and implemented. This is based on several detectors and techniques (Optical Emission Spectroscopy, RF systems, Interfero-polarimetry, X-ray detectors) and here we focus on high resolution spatially-resolved X-ray spectroscopy, performed by means of a X-ray pin-hole camera setup operating in the 0.5−20 keV energy domain. The diagnostic system was installed at a 14 GHz Electron Cyclotron Resonance (ECR) ion source (ATOMKI, Debrecen), enabling high precision X-ray spectrally-resolved imaging of ECR plasmas heated by hundreds of Watts. The achieved spatial and energy resolution were 0.5 mm and 300 eV at 8 keV, respectively. We here present the innovative analysis algorithm that we properly developed for obtaining Single Photon-Counted (SPhC) images providing the local plasma emitted spectrum in a High-Dynamic-Range (HDR) mode, by distinguishing fluorescence lines of the materials of the plasma chamber (Ti, Ta) from plasma (Ar). This method allows a quantitative characterization of warm electrons population in the plasma (and its 2D distribution) which are the most important for ionization, and also to estimate local plasma density and spectral temperatures. The developed post-processing analysis is also able to remove the readout noise, that is often observable at very low exposure times (msec). The setup is now under update including fast shutters and trigger systems in order to allow simultaneously space and time-resolved plasma spectroscopy during transients, stable and turbulent regimes.

An image consisting of (m, n) pixels can be seen as a matrix of m × n size. Based on the formula of angles between two subspaces, a pair of angles can be defined between two matrices, by utilizing column spaces and row spaces of the two matrices. The singular values of each matrix can be used to calculate distances. Thus, a distance representation is obtained, and a pair of angles between 2 matrices of the same size.

Vegetation indexes help perform precision farming because they provide useful information regarding moisture, nutrient content, and crop health. Primary sources of those indexes are satellites and unmanned aerial vehicles equipped with expensive multispectral sensors. Reducing the price of obtaining such information would increase the availability of precision farming for small farms. Several studies have proposed deep neural network methods to estimate the indexes from RGB color images. However, these methods report relatively large errors for mature plants when highly non-linear relationships of images and vegetation indexes arise. One could apply multilayer random forest-based models (Deep Forests) to solve this problem, but the discriminative power of such models is limited: they cannot catch complex dependencies between image features. In this paper, we propose a method that combines ideas of deep forests, random forests of kernel trees, and global pruning of random forests to tackle the problem. As a result, the method considers the properties of objects with a complex structure: the presence of relationships between groups of features, displacement, and scaling of objects. The experimental results show that the proposed method outperforms neural network-based solutions in several datasets.

This article proposes application of a new mathematical model of spots for solving inverse problems using a learning method, which is similar to using the deep learning. In general, the spots represent vague figures in abstract “information spaces” or crisp figures with lack of in-formation about their shapes and are adequate for representation human mental images and reasoning in Artificial Intelligence (AI). However, crisp figures are regarded as a special and limiting case of spots. A basic mathematical apparatus, basing on L4 numbers, has been developed for the representation and processing of qualitative information of elementary spatial relations between spots. Also, we defined L4 vectors, L4 matrices, and mathematical operations on them. Developed apparatus can be used in AI, in particular, for knowledge representation and for modeling qualitative reasoning and learning. Another application area is the solution of inverse problems by learning. For example, this can be applied to image reconstruction using ultrasound, X-ray, magnetic resonance, or radar scan data. The introduced apparatus was verified by solving problems of reconstruction of images, utilizing only qualitative data of its elementary relations with some scanning figures. This article also demonstrates application of spot-based inverse Radon algorithm for binary image reconstruction.

This paper presents an Edge-based color image segmentation derived from the method of Particle Motion in a Vector Image Fields (PMVIF) that could previously be applied only to monochrome images. Instead of using an edge vector field derived from a gradient vector field and a normal compressive vector field derived from a Laplacian-gradient vector field, two novel orthogonal vector fields, directly computed from a color image, one parallel and another orthogonal to the edges, were used in the model to force a particle to move along the object edges. The normal compressive vector field is derived from the center-to-centroid vectors of local color distance images. Next, the edge vector field is derived by taking the normal compressive vector field, multiplied by differences of auxiliary image pixels to obtain a vector field analogous to a Hamiltonian gradient vector field. Using the PASCAL Visual Object Classes Challenge 2012 (VOC2012) and the Berkeley Segmentation Data Set and Benchmarks 500 (BSDS500), the benchmark score of the proposed method is provided in comparison with those of the traditional PMVIF, Watershed, SLIC, K-means, Mean shift, and JSEG. The proposed method yields better RI, GCE, NVI, BDE, Dice coefficients, faster computation time, and noise resistance.

This paper aims at trying to answer the question of whether a low cost drone equipped with a regular camera can serve as a simple device to estimate the size of objects. Ad-ditionally, it assesses if the accuracy of measurement is good enough for using a drone for measurements, relying solely on GPS position and camera. A review of the literature pertaining to ground object measurements was conducted. The availability of such in-struments was evaluated in terms of purchase and rental costs, the number of instru-ments on the market, and the time to obtain them. The most common measurement methods were considered and their unit costs were reviewed. The cost of professional surveying and measuring equipment was compared to the possibility of using low-cost, non-commercial drones to measure objects and surfaces. The quality of the images ob-tained was compared with high-resolution satellite systems. Is an ordinary drone with a standard camera suitable for length measurement without professional measuring equipment? Should the results be considered only in the category of size estimation?

Measuring and predicting Carbon Emission (CE) is important to enabling the main culprit of various urgent environmental issues including global warming. However, prior studies did not fully incorporate the impact of micro-level urban streetscapes, which might lead to biased prediction of urban CE. To fill the gap, we developed an effective framework to predict residential CE in urban areas from widely existing and publicly available street-view images (SVI) using machine learning. First, we used a semantic segmentation algorithm to classify more than 30 streetscape elements from SVI images to describe the built environment whose features might affect residential and transportation CE. Second, based on the streetscapes quantified, we trained a 10-fold cross-validation method with various machine learning models to predict the CE at the 1KM grid level using CE data from the PlanetData. We found first, built environment features such as sidewalks, roads, fences, buildings, and walls are significantly correlated with the residential CE. Second, the presence of buildings and subtle streetscape features (e.g., walls, fences) indicates higher-density residential areas which are related to more residential CE. Third, vegetation (e.g., trees and grass) are reversely related to residential CE. Our findings shed light on the feasibility of using a single and open data source (i.e., the SVI) to effectively model neighborhood-level CE for regions across diverse urban forms. Our framework is useful for urban planners to inform new town development and urban regeneration towards the low CE goals.

Due to the special characteristics of the shooting distance and angle of remote sensing satellites, the pixel area ratio of ship targets is small and the feature expression is insufficient, which leads to unsatisfactory ship detection performance and even situations such as missed detection and false detection. In this study, we propose an improved-YOLOv5 algorithm. The improvement strategies mainly include: (1) Add the Convolutional Block Attention Module (CBAM) into the Backbone to enhance the extraction of target-adaptive optimal features; (2) Introduce cross-layer connection channel and lightweight GSConv structure into the Neck to achieve higher-level multi-scale feature fusion and reduce the number of model parameters; (3) The Wise-IoU loss function is used to cal-culate the localization loss in the Output, and assign reasonable gradient gains to cope with dif-ferences in image quality. In addition, during the preprocessing stage of experimental data, a me-dian and bilateral filter method is used for noise reduction to reduce interference from ripples and waves and highlight the information of ship features. The experimental results show that Im-proved-YOLOv5 has a significant improvement in recognition accuracy compared to various mainstream target detection algorithms; Compared to the original YOLOv5s, the mean Average Precision (mAP) has improved by 3.2% and the Frames Per Second (FPN) has accelerated by 8.7%.

Recently, the mapping industry has been focusing on the possibility of large-scale mapping from unmanned aerial vehicles (UAVs) owing to advantages such as easy operation and cost reduction. In order to produce large-scale maps from UAV images, it is important to obtain precise orientation parameters. For this, various techniques have been developed and are included in most of the commercial UAV image processing software. For mapping, it is equally important to select images that can cover a region of interest (ROI) with the fewest possible images. Otherwise, to map the ROI, one may have to handle too many images, and commercial software does not provide information needed to select images, nor does it explicitly explain how to select images for mapping. For these reasons, stereo mapping of UAV images in particular is time consuming and costly. In order to solve these problems, this study proposes a method to select images intelligently. We can select a minimum number of image pairs to cover the ROI with the fewest possible images. We can also select optimal image pairs to cover the ROI with the most accurate stereo pairs. We group images by strips, and generate the initial image pairs. We then apply an intelligent scheme to iteratively select optimal image pairs from the start to the end of an image strip. According to the results of the experiment, the number of images selected is greatly reduced by applying the proposed optimal image–composition algorithm. The selected image pairs produce a dense 3D point cloud over the ROI without any holes. For stereoscopic plotting, the selected image pairs were map the ROI successfully on a digital photogrammetric workstation (DPW), and a digital map covering the ROI is generated. The proposed method should contribute to time and cost reductions in UAV mapping.

In recent years, there has been a growing interest in remote sensing image-text cross-modal retrieval due to the rapid development of space information technology and the significant increase in remote sensing image data volume. One approach that has shown promising results in cross-modal retrieval of natural images is the multimodal fusion encoding method. However, remote sensing images have unique characteristics that make the retrieval task challenging. Firstly, the semantic features of remote sensing images are fine-grained, meaning they can be divided into multiple basic units of semantic expression. Additionally, these images exhibit variations in resolution, color, and perspective. Different combinations of basic units of semantic expression can generate diverse text descriptions. These characteristics pose considerable challenges for cross-modal retrieval. To address these challenges, this paper proposes a multi-task guided fusion encoder (MTGFE) based on the multimodal fusion encoding method. The model incorporates three tasks: image-text matching (ITM), masked language modeling (MLM), and the newly introduced multi-view joint representations contrast (MVJRC) task. By jointly training the model with these tasks, we aim to enhance its capability to capture fine-grained correlations between remote sensing images and texts. Specifically, the MVJRC task is designed to improve the model’s consistency in feature expression and fine-grained correlation, particularly for remote sensing images with significant differences in resolution, color, and angle. Furthermore, to address the computational complexity associated with large-scale fusion models and improve retrieval efficiency, this paper proposes a retrieval filtering method. This method achieves higher retrieval efficiency while minimizing accuracy loss. Extensive experiments were conducted on four public datasets to evaluate the proposed method, and the results validate its effectiveness. Overall, this study focuses on remote sensing image-text cross-modal retrieval and introduces the MTGFE model, which combines multimodal fusion encoding with multiple tasks to enhance the model’s ability to capture fine-grained correlations. Additionally, a retrieval filtering method is proposed to improve retrieval efficiency. Experimental results demonstrate the effectiveness of the proposed method.

Three-dimensional reconstruction plays an important role in assisting doctors and surgeons in diagnosing bone defects’ healing progress. Common three-dimensional reconstruction methods include surface and volume rendering. As the focus is on the shape of the bone, volume rendering is omitted. Many improvements have been made on surface rendering methods like Marching Cubes and Marching Tetrahedra, but not many on working towards real-time or near real-time surface rendering for large medical images, and studying the effects of different parameter settings for the improvements. Hence, in this study, an attempt towards near real-time surface rendering for large medical images is made. Different parameter values are experimented on to study their effect on reconstruction accuracy, reconstruction and rendering time, and the number of vertices and faces. The proposed improvement involving three-dimensional data smoothing with convolution kernel Gaussian size 0.5 and mesh simplification reduction factor of 0.1, is the best parameter value combination for achieving a good balance between high reconstruction accuracy, low total execution time, and a low number of vertices and faces. It has successfully increased the reconstruction accuracy by 0.0235%, decreased the total execution time by 69.81%, and decreased the number of vertices and faces by 86.57% and 86.61% respectively.

A land cover map of two arctic catchments, nearby the Abisko Scientific Research Station, was obtained from a classification of a Sentinel-2 satellite image and a ground survey performed in July 2022. The two contiguous catchments, Miellajokka and Stordalen, are covered by various ecotypes, from boreal forest to alpine tundra and peatland. The Random Forest algorithm correctly identified 83% of polygon pixels reserved for testing. The developed workflow relied solely on open source software and acquired ground observations. Space organization was directed by the altitude as shown by the intersection of the land cover with the topography. Comparison between this new land cover map and previous ones based on data acquired between 2008 and 2011 demonstrates some trends of vegetation cover evolution in response to climate change in the considered area. The potential applications in terms of permafrost modeling (hiperborea.omp.eu) are finally discussed.

Maritime search and rescue is a crucial component of the national emergency response system, which currently mainly relies on Unmanned Aerial Vehicles (UAVs) to detect the objects. Most traditional object detection methods focus on boosting the detection accuracy while neglecting the detection speed of the heavy model. However, it is also essential to improve the detection speed which can provide timely maritime search and rescue. To address the issues, we propose a lightweight object detector named Shuffle-GhostNet-based detector (SG-Det). First, we construct a lightweight backbone, named Shuffle-GhostNet, which enhances the information flow between channel groups by redesigning the correlation group convolution and introducing the channel shuffle operation. Second, we propose an improved feature pyramid model, namely BiFPN-tiny, which has a lighter structure while being capable of reinforcing small object features. Furthermore, we incorporate the atrous spatial pyramid pooling module (ASPP) to the network, which employs atrous convolution with different sampling rates to obtain multi-scale information. Finally, we generate three sets of bounding boxes at different scales – large, medium, and small – to detect objects of different sizes. Compared with other lightweight detectors, SG-Det achieves better tradeoffs across performance metrics, and enables real-time detection with an accuracy rate of over 90% for maritime objects, which shows that it can be better meet the actual requirements of maritime search and rescue.

This study aimed to investigate the possibility of using one-shot hyperspectral airborne images to recognize crops for an area with many small plots. The results showed that unsupervised clustering methods could classify crops with an accuracy of 80%, which improved to 90% when restricted to only grain crops, using a single airborne hyperspectral recording. However, additional layers such as NDVI, DTM, slope, and aspect did not improve classification accuracy. For comparison, the accuracy of clustering time series Sentinel-2 images with NDVI layers and DTM-derived data yielded an accuracy of: 74% ,Sentinel-2 time series 68% and single one registration before harvest - 39%. The results of the random forest classification were slightly less accurate due to a lack of sufficient reference data. However, it is challenging to verify the reported accuracy of crop recognition in the literature above 90% due to differences in analysis methodologies, reference data selection, pixel/object approaches, metric choice, and calculation formulas used.

Spinal deformity refers to a range of disorders that are defined by anomalous curvature of the spine and may be classified as scoliosis, lordosis, or kyphosis. Among these, scoliosis stands out as the most common type of spinal deformity in human beings, and it can be distinguished by abnormal lateral spine curvature accompanied by axial rotation. Accurate identification of spinal deformity is crucial for a person's diagnosis, and numerous assessment methods have been developed by researchers. Therefore, the present study aims to systematically review recent works on spinal deformity as-assessment for scoliosis diagnosis, utilizing image processing techniques. To gather relevant studies, a search strategy was conducted on three electronic databases (Scopus, ScienceDirect, and PubMed) between 2012 and 2022, using specific keywords and focusing on scoliosis cases. A total of 17 papers fully satisfied the established criteria and were extensively evaluated. Despite variations in methodological designs across the studies, all reviewed articles obtained quality ratings higher than satisfactory. Various diagnostic approaches have been employed, including artificial intelligence mechanisms, image processing, and scoliosis diagnosis systems. These approaches have the potential to save time and, more significantly, can reduce the incidence of human error. While all assessment methods have potential in scoliosis diagnosis, they possess several limitations that can be ameliorated in forthcoming studies. Therefore, the findings of this study may serve as guidelines for the development of a more accurate spinal deformity assessment method that can aid medical personnel in the real diagnosis of scoliosis.

Image registration (IR) is a process that deforms images to align them with respect to a reference space, making it easier for medical practitioners to examine various medical images in a standardized reference frame, such as having the same rotation and scale. This document introduces image registration using a simple numeric example. It provides a definition of image registration along with a space-oriented symbolic representation. This review covers various aspects of image transformations, including affine, deformable, invertible, and bidirectional transformations, as well as medical image registration algorithms such as Voxelmorph, Demons, SyN, Iterative Closest Point, and SynthMorph. It also explores atlas-based registration and multistage image registration techniques, including coarse-fine and pyramid approaches. Furthermore, this survey paper discusses medical image registration taxonomies, datasets, evaluation measures, such as correlation-based metrics, segmentation-based metrics, processing time, and model size. It also explores applications in image-guided surgery, motion tracking, and tumor diagnosis. Finally, the document addresses future research directions, including the further development of transformers.

Forensic document examiners can determine the authenticity of questioned documents by analyzing the ink used to create them. If an ink mismatch is found, it could be a sign of scam, backdating, or forgery. In this research a Hyperspectral Images of iVision HHID dataset is used to detect number of possible inks used in document. By using Hyperspectral Images, it’s possible to detect ink mismatch in a given document. In this research unsupervised learning method K-means is used to detect number of inks. Approximate number of clusters are determined by Elbow and Silhouette method before implementation of K-means.

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

Urban spatial perception critically influences human behavior and emotional reactions, emphasizing the necessity of aligning urban spaces with human needs for enhanced urban living. However, functionality-based categorization of urban architecture is prone to biases, stemming from disparities between objective mapping and subjective perception. These biases can result in urban planning and designs that fail to cater adequately to the needs and preferences of city residents, negatively impacting their quality of life and the city's overall functionality. In this study, we apply machine learning to elucidate these biases within urban spatial perception research, utilizing a three-step methodology: objective mapping, subjective perception analysis, and perception deviation assessment. Our findings reveal that machine learning can expose hidden patterns within this research field, bearing substantial implications for urban planning and design. Of particular note, the study revealed significant discrepancies in the distribution centroids between commercial buildings and residential or public buildings. This result illuminates the spatial organization characteristics of urban architectural functions, serving as a valuable reference for urban planning and development. Moreover, it uncovers the advantages and disadvantages of different data sources and techniques in interpreting urban spatial perception, paving the way for a more comprehensive understanding of the subject. These findings underscore the importance of integrating both objective mapping and subjective perspectives in urban architectural functionality classification.

Disease control programs need to identify breeding sites of mosquitoes which transmit malaria and other diseases to target interventions and identify environmental risk factors. Increasing availability of very high resolution drone data provides new opportunities to find and characterize these vector breeding sites. Within this study, we identified land cover types associated with malaria vector breeding sites in West Africa. Drone images from two malaria endemic regions in Burkina Faso and Côte d’Ivoire were assembled and labeled using open-source tools. We developed and applied a workflow using region of interest-based and deep learning methods to classify these habitat types from very high resolution natural color imagery. Analysis methods achieved a dice coefficient ranging between 0.68 and 0.88 for different vector habitat types; however, this classifier consistently identified the presence of specific habitat types of interest. This establishes a framework for developing deep learning approaches to identify vector breeding sites and highlights the need to evaluate how results will be used by control programs.

The integration of artificial intelligence (AI) into medical imaging has guided in an era of transformation in healthcare. This literature review explores the latest innovations and applications of AI in the field, highlighting its profound impact on medical diagnosis and patient care. The innovation segment explores into cutting-edge developments in AI, such as deep learning algorithms, convolutional neural networks, and generative adversarial networks, which have significantly improved the accuracy and efficiency of medical image analysis. These innovations have enabled rapid and accurate detection of abnormalities, from identifying tumors during radiological examinations to detecting early signs of eye disease in retinal images. The article also highlights various applications of AI in medical imaging, including radiology, pathology, cardiology, and more. AI-based diagnostic tools not only speed up the interpretation of complex images but also improve early detection of disease, ultimately delivering better outcomes for patients. Additionally, AI-based image processing facilitates personalized treatment plans, thereby optimizing healthcare delivery. This literature review highlights the paradigm shift that AI has brought to medical imaging, highlighting its role in revolutionizing diagnosis and patient care. By combining cutting-edge AI techniques and their practical applications, it is clear that AI will continue shaping the future of healthcare in profound and positive ways.

Descriptive geometry has indispensable applications in many engineering activities, some of which are presented in the first chapter of this paper in order to place the development presented here among them. As a result of the continuous variability of the technological environment according to various optimization aspects, the engineering activities must also be continuously adapted to the changes, which an appropriate approach and formulation are required from the practitioners of descriptive geometry, and can even lead to improvement in the field of descriptive geometry. The imaging procedures are always based on the methods and theorems of descriptive geometry. Resolving contradictions in spatial geometry reconstruction research is a constant challenge, to which a possible answer in many cases is the search for the right projection direction. A special method of enumerating the possible infinite viewpoints for the representation of the surface edge curves is presented in another part of the paper. The procedure for determining the correct directions in a mathematically exact way is also presented through examples. The analysis and some of the results of the Monge mapping, which is suitable for the solution of a mechanical engineering task to be solved in a specific technical environment, are also presented.

Thermal Non-destructive Testing and Evaluation (NDT&E) is crucial in ensuring the quality and safety of industrial materials, components, and structures. It serves as a key tool for assessing their operational reliability, thus enhancing safety in a wide range of industries. There is a growing demand for dependable, swift, remote, and secure inspection and assessment techniques to detect hidden flaws, especially for sustainable solutions prompts adjustments in design and manufacturing standards. Hidden defects often emerge during the service life of these materials and structures due to various stress factors, potentially resulting in catastrophic failures. This study delves into the optimal and dependable experimental method for conducting fast, remote, and secure inspections and assessments of carbon fiber reinforced polymer materials using Infrared Imaging (IRI) as part of Thermal Non-Destructive Testing and Evaluation (TNDT&E). Additionally, it examines the post-processing approach associated with this technique. This perspective also sheds light on the current state-of-the-art infrared imaging methods employed in TNDT&E, emphasizing their strengths and weaknesses about their ability to detect subsurface defects present within the material Most of the methods discussed in previous research primarily focus on the thermal differences in specific areas of a sample using processed thermal images, even though these images come from analyzing a series of images captured over time. This study highlights the latest research in thermal/infrared non-destructive testing and evaluation, along with the related post-processing techniques. It aims to not only show hidden subsurface defects through thermal differences also provides information about how these defects change over time.

This study introduces SkinLiTE, a lightweight supervised contrastive learning model, tailored to enhance the detection and typification of skin lesions in dermoscopic images. The core of SkinLiTE lies in its unique integration of supervised and contrastive learning approaches, which leverages labeled data to learn generalizable representations. This approach is particularly adept at handling the complexities and imbalances inherent in skin lesions datasets. The methodology encompasses a two-phase learning process. In the first phase, SkinLiTE utilizes an encoder network and a projection head to transform and project dermoscopic images into a feature space where contrastive loss is applied, focusing on minimizing intra-class variations while maximizing inter-class differences. The second phase freezes the encoder's weights, leveraging the learned representations for classification through a series of dense and dropout layers. The model was evaluated using three datasets from Skin Cancer ISIC 2019-2020, covering a wide range of skin conditions. SkinLiTE demonstrated superior performance across various metrics—accuracy, AUC , and F1 score—particularly when compared with traditional supervised learning models. Notably, SkinLiTE achieved an accuracy of 0.9087 using AugMix augmentation for binary classification of skin lesions. It also showed comparable results with the state-of-the-art approaches of ISIC challenge without relying on external data, underscoring its efficacy and efficiency. The results highlight the potential of SkinLiTE as a significant step forward in the field of dermatological AI, offering a robust, efficient, and accurate tool for skin lesion detection and classification. Its lightweight architecture and ability to handle imbalanced datasets make it particularly suited for integration into Internet of Medical Things environments, paving the way for enhanced remote patient monitoring and diagnostic capabilities. This research contributes to the evolving landscape of AI in healthcare, demonstrating the impact of innovative learning methodologies in medical image analysis.

Detecting rotated objects in remote sensing images poses a substantial challenge. These images usually cover a wide field of view, containing diverse and complex backgrounds with variously sized ground objects densely distributed. Therefore, identifying objects of interest in remote-sensing images is challenging. While integrating Convolutional Neural Networks (CNNs) and Transformer networks has exhibited progress in detecting rotated objects, there is still scope for enhancing feature extraction and fusion. To address this issue, we propose a feature extraction module, a feature context aggregation module, and a multi-scale feature fusion module. Initially, we substitute the Spatial Pyramid Pooling Bottleneck (SPPFBottleneck) with a new module aimed at extracting multi-scale features, thereby enhancing the detection of small objects in complex backgrounds. Next, we develop a novel module for the multi-scale fusion of contextual information within feature maps, extracting valuable information. Finally, we combine the original features with the fused ones to prevent the loss of specific features in the fusion process. We refer to our newly proposed model as the "Multi-scale Feature Context Aggregation Network" (MFCANet). We assess our approach on three challenging remote sensing datasets: MAR20, SRSDD, and HRSC. Comprehensive experimental results show that our method surpasses baseline models by 2.13%, 10.28%, and 1.46% mAP on the MAR20, SRSDD, and HRSC datasets, respectively.

Deep convolutional neural networks (CNN) are favored methods widely used in medical image processing due to their assured shown performance. Recently, the emergence of new lung diseases and the possibility of early detection of their symptoms has attracted many researchers to classify diseases by training deep CNNs on lung CT images. The trained networks are expected to distinguish between lung indications in different diseases, especially at the early stages of them. With the hope of achieving this purpose, we proposed an efficient deep CNN called AFEX-Net with adaptive feature extraction layers that successfully extract distinguishing features and classify chest CT images. The efficiency of the proposed network has two aspects: it is a lightweight network with low number of parameters and fast training and it has adaptive pooling layers and adaptive activation functions to increase its level of compatibility to the input data. The proposed network has been evaluated on a dataset with more than 10K chest CT slices, while an efficient pre-processing method is developed to remove any bias from the images. Additionally, we evaluated the performance of the proposed model on the public COVID-CTset dataset to prove the generalisability of our model. The obtained results confirm the competence of the proposed network in confronting medical images, where prompt and accurate learning is required.

The aim of this study is to analyse problems related to thermal mapping obtained from thermal data acquired from Unmanned Aerial Systems (UAS) equipped with thermal cameras. We focused on an accurate analysis of uncertainties introduced by the PIX4D Mapper software used to obtain the surface temperature maps of thermal images acquired by the UAS. To achieve this aim, we used artificial thermal reference during the surveys, as well as natural hot targets, i.e. thermal anomalies in the Pisciarelli hydrothermal system in Campi Flegrei caldera (CFc). Artificial thermal targets, expressly created and designed for this goal, are a prototype here called “developed thermal target” (DTT) made by the drone Laboratory at Istituto Nazionale di Geofisica e Vulcanologia - Osservatorio Vesuviano (INGV-OV). We show the results obtained by three surveys during which thermal targets were positioned on land at different flight heights of the UAS. Different heights were also necessary to test spatial resolution of the DTT with the used thermal camera as well as possible temperature differences between the raw images acquired by UAS with the thermal mapping obtained from the PIX4D Mapper software. In this work we have estimated the uncertainty that may be introduced by the mosaic procedure and furthermore we find an attenuation of the measured temperatures introduced by the different distances between the thermal anomaly and sensor. These results appear to be of great importance for the subsequent calibration phase of the thermal maps especially in cases where these methodologies are applied for monitoring purposes of volcanic/geothermal areas.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

The purpose of this work was to achieve non-destructive detection of the internal defects of in-shell walnuts using X-ray radiography technology based on improved Faster R-CNN network model. First, the FPN structure was added to the feature extraction layer to extract richer image information. Then ROI Align was used to instead of ROI Pooling for eliminating the localization bias problem caused by quantization operation. Finally, the Softer-NMS module was introduced to the final regression layer with the predicted bounding box for improving the localization accuracy of the candidate boxes. The results indicated that the internal defects in intact walnuts with shells could be identified effectively using the proposed improved network model in this study. Specifically, the discrimination accuracy of the in-shell sound, shriveled and empty-shell walnuts were 96.14%, 91.72% and 94.80% respectively, and the highest overall accuracy can reach 94.22 %. Contrasted with original Faster R-CNN network model, the mAP and F1-value of the improved Faster R-CNN model increased by 5.86% and 5.65%, respectively. Consequently, the proposed method can be applied for the in-shell walnuts with shriveled and empty-shell defects.

Sea ice extraction and segmentation of remote sensing images is the basis for sea ice monitoring. Machine learning-based image segmentation methods rely on manual sampling and require complex feature extraction. Deep-learning semantic segmentation methods have the advantages of high efficiency, intelligence, and automation. Sea ice segmentation using deep learning methods faces the following problems: in terms of datasets, the high cost of sea ice image label production leads to fewer datasets for sea ice segmentation; in terms of image quality, remote sensing image noise and Severe weather conditions affects image quality, which affects the ac-curacy of sea ice extraction. To address the quantity and quality of the dataset, this study used multiple data augmentation methods for data expansion. To improve the semantic segmentation accuracy, the SC-U2-Net network was constructed using multi-scale inflation convolution and a multi-layer Convolutional Block Attention Module (CBAM) attention mechanism for the U2-Net network. The experiments showed that (1) data augmentation solved the problem of an insuffi-cient number of training samples to a certain extent and improved the accuracy of image seg-mentation. (2) This study designed a multilevel Gaussian noise data augmentation scheme to improve the network's ability to resist noise interference and achieve a more accurate segmenta-tion of images with different degrees of noise pollution. (3) The inclusion of a multi-scale inflation perceptron and multi-layer CBAM attention mechanism improved the ability of U2-Net network feature extraction and enhanced the model accuracy and generalization ability.

Fire regimes in mountain landscapes of southern Europe have been shifting from their baselines due to rural abandonment and fire exclusion policies. Understanding the effects of fire on biodiversity is paramount to implement adequate management. Herein, we evaluated the relative role of burn severity and heterogeneity on bird abundance in an abandoned mountain range located in the biogeographic transition between the Eurosiberian and Mediterranean region (the Natural Park ‘Baixa Limia–Serra do Xurés’). We surveyed the bird community in 206 census plots distributed across the Natural Park, both inside and outside areas affected by wildfires over the last 11 years (from 2010 to 2020). We used satellite images of Sentinel 2 and Landsat missions to quantify the burn severity and heterogeneity of each fire within each surveyed plot. We also accounted for the past land use (forestry or agropastoral use) by using a land cover information for year 2010 derived from satellite image classification. We recorded 1,735 contacts from 28 bird species. Our models, fitted by using GLMs with Poisson error distribution (pseudo-R²_-average of 0.22 ± 0.13), showed that up to 71% of the modelled species were linearly correlated with at least one attribute of the fire regime. The spatiotemporal variation in burnt area and severity were relevant factors for explaining the local abundance of our target species (39% of the species; Akaike weights > 0.75). We also found a quadratic effect of at least one fire regime attribute on bird abundance for 60% of the modeled species. The past land use, and its legacy after 10 years, was critical to understand the role of fire (Akaike weights > 0.75). Our findings confirm the importance of incorporating remotely sensed indicators of burn severity into the toolkit of decision makers to accurately anticipate the response of birds to fire management.

Accurate geometric modeling of blood vessels lumen given their 3D images is a basis for vessel quantification in support of cardiovascular diseases diagnosis, treatment and monitoring. Unlike other approaches, which assume circular or elliptical vessel cross-section, the proposed method employs parametric B-splines combined with the image formation system equations to accurately localize the highly curved lumen boundaries. No image segmentation is involved which might reduce the localization accuracy in effect of spatial discretization. It is shown that the model parameters can be reliably identified by a feedforward neural network which, driven by the cross-section images, predicts the parameter values many times faster than a reference least-squares (LS) model fitting algorithm. Two example applications: modeling the lower extremities artery-vein complexes visualized in steady-state contrast-enhanced magnetic resonance images (MRI) and the coronary arteries pictured in computed tomography angiograms (CTA), are presented and discussed to demonstrate the method potential. Besides application to medical diagnosis, blood-flow simulation and vessel-phantom design, it can serve as a tool for automated annotation of image datasets required to train machine-learning algorithms.

This research delves into the intricate challenges confronting the agricultural sector, with a specialized focus on mitigating infections in tomato crops, particularly powdery mildew induced by the Leveillula Taurica pathogen. Tomatoes, renowned for their nutritional richness, are vital to global food security. However, conventional methodologies for disease detection exhibit both laborious processes and limited accuracy. In response to these challenges, this study advocates for an innovative fusion of hyperspectral imaging and deep learning methodologies to detect crop disease and its severity. The systematic workflow commenced with the curation of a dataset, involving the acquisition of live images through OpenCV, followed by conversion to RGB format and subsequent feature extraction utilizing a pre-trained visual geometry group (VGG-16) model for enhanced analysis. Sequentially, RGB images were transformed into simulated hyperspectral images (SHSI) leveraging a Neural Network generator model, offering a distinctive viewpoint on spectral information. This novel approach transcends conventional constraints by delivering a three-dimensional perspective, seamlessly integrating spatial and spectral dimensions for holistic data acquisition. The SHSI is further transmuted into a 3D visualization cube comprehensive grasp of spatial and spectral aspects encompassing spectral, spatial, and Haralick features. The research concludes with severity detection, categorized as low, moderate, or high, employing a Gaussian Mixture Model (GMM) and K-means for visualization.

Document image binarization is a challenging task, especially when it comes to text segmentation in degraded document images. The binarization, as a pre-processing step of optical character recognition (OCR), is one of the most fundamental and commonly used segmentation methods. It separates the foreground text from the background of the document image to facilitate subsequent image processing. In view of the different degradation degree of document image, researchers have proposed a variety of solutions. This paper reviews the main binarization techniques, including both traditional algorithms and deep learning-based algorithms. We also summarize some difficulties and challenges in the field of document image binarization. Here, we evaluate various image binarization techniques to identify shortcomings in current methods and provide some help for future research.

Convolutional neural networks (CNN) have attracted much attention as a commonly used method for hyperspectral image (HSI) classification in recent years, however, CNNs can only be applied to Euclidean data and have limitations in dealing with relationships due to the limitations of local feature extraction. However, each pixel of a hyperspectral image contains a set of spectral bands that are correlated and interact with each other, and the methods used to process Euclidean data cannot effectively obtain these correlations. In contrast, the graph convolutional network (GCN) can be used in non-Euclidean data, but usually leads to oversmoothing and ignoring local detail features due to the need for superpixel segmentation processing to reduce computational effort. To overcome the above problems, we constructed a network a fusion network based on GCN and CNN, which contains two branches: a graph convolutional network based on superpixel segmentation and a convolutional network with added attention mechanism. The graph convolu-tional branch can extract the structural features and capture the relationships between the nodes, and the convolutional branch can extract the detailed features in the local fine region. Owing to the fact that the features extracted from the two branches are different, the classification performance can be improved by fusing the complementary features extracted from the two branches. To vali-date the proposed algorithm, experiments were conducted on three widely used datasets, namely Indian Pines, Pavia University, and Salinas, and the overall accuracy of 98.78% was obtained in the Indian Pines dataset, and the overall accuracy of 98.99% and 98.69% was obtained in the other two datasets. The results showed that the proposed fusion network can obtain richer features and achieve high classification accuracy.

Recently, deep learning-based image quality enhancement models have been proposed to improve the perceptual quality of distorted synthesized views impaired by compression and Depth Image Based Rendering (DIBR) process in multiview video systems. However, due to the lack of multi-view video plus depth data, the training data for quality enhancement models is small, which limits the performance and progress of these models. Augmenting the training data to enhance the Synthesized View Quality Enhancement (SVQE) models is a feasible solution. In this paper, we suggest a deep learning-based SVQE model using more synthetic Synthesized View Images (SVIs). To simulate the irregular geometric displacement of DIBR distortion, a random irregular polygon-based SVI synthesis method is proposed based on existing massive RGB/RGBD data, and a synthetic synthesized view database is constructed, which includes synthetic SVIs and DIBR distortion masks. Moreover, to further guide the SVQE models to focus more precisely on DIBR distortion, the DIBR distortion mask prediction network which could predict the position and variance of DIBR distortion is embedded into the SVQE models. The experimental results demonstrate that by pretraining on the synthetic SVI database, the performance of the existing SVQE models could be greatly promoted. In addition, by introducing the DIBR distortion mask prediction network, the SVI quality could be further enhanced.

A land cover map of two arctic catchments, nearby the Abisko Scientific Research Station, was obtained from a classification of a Sentinel-2 satellite image and a ground survey performed in July 2022. The two contiguous catchments, Miellajokka and Stordalen, are covered by various ecotypes, from boreal forest to alpine tundra and peatland. The random forests algorithm correctly identified 88% of polygon pixels reserved for testing. The developed workflow relied solely on open source software and acquired ground observations. Space organization was directed by the altitude as demonstrated by the intersection of the land cover with the topography. Comparison between this new land cover map and previous ones based on data acquired between 2008 and 2011 shows some trends of vegetation cover evolution in response to climate change in the considered area.

Unmanned Aerial Vehicles (UAVs) image object detection has great application value in military and civilian fields. However, the objects in the captured images from UAVs have problems of large scale variation, complex backgrounds, and a large proportion of small objects. To resolve these problems, a multi-scale object detector based on coordinate and global information aggregation is proposed, named CGMDet. Firstly, a Coordinate and Global Information Aggregation Module (CGAM) is designed by aggregating local, coordinate, and global information, which can obtain features with richer context information. Secondly, a Multi-Feature Fusion Pyramid Network (MF-FPN) is proposed, which can better fuse features of different scales and obtain features containing more context information through repeated use of feature maps, to better detect multi-scale targets. Moreover, more location information of low-level feature maps is integrated to improve the detection results of small targets. Furthermore, we modified the bounding box regression loss of the model to make the model more accurately regress the bounding box and faster convergence. Finally, the proposed CGMDet was tested on VisDrone and UAVDT datasets and mAP0.5 of 50.9% and 48% was obtained, respectively. At the same time, our detector achieved the best results compared to other detectors.

Chenodeoxycholic acid (CA) is a naturally occurring bile acid that is produced in the liver from cholesterol. Three CA complexes using Zn(II), Mg(II), and Ca(II) ions were synthesized to examine the chelation tendencies of CA towards these metal ions. The complexation reaction of CA with the metal ions under investigation was conducted with a 1:1 molar ratio (CA to metal) at 60-70°C in natural media (pH 7-8), which consisted of a binary solvent of MeOH and H2O (1:1). The resulting CA complexes were characterized using analytical data (metal, H, C, and Cl, analysis) and spectral data (UV-visible, FT-IR, and 1H NMR) to elucidate the complexes’ structures. The results suggested that CA in anion form utilized oxygen atoms of the carboxylate group (-COO−) to capture Zn(II), Mg(II), and Ca(II) ions. This produced complexes with the general compositions of [Zn(CA)(H2O)Cl], [Mg(CA)(H2O)Cl]H2O, and [Ca(CA)(H2O)Cl]2H2O, respectively. The Kirby-Bauer disc diffusion assay was then used to explore the bioactivity of the CA complexes toward three fungal species, three Gram-positive bacteria, and two Gram-negative bacteria. The Ca(II) and Mg(II) complexes exhibited marked inhibitory effects on the cell growth of the fungal species Aspergillus niger with potency equal to 127% and 116% of the activity of the positive control, respectively. The Zn(II) and Ca(II) complexes strongly inhibited the growth of Penicillium sp., while the Zn(II) and Mg(II) complexes showed strong growth inhibition towards the Gram-negative species Pseudomonas aeruginosa.

Knowledge on the health of banana trees is critical for farmers to profit from banana cultivation. Fusarium wilt and banana blood diseases (BDB), two significant diseases infecting banana trees, are caused by Fusarium oxysporum and Ralstonia syzygii, respectively. They have successfully caused a decline in crop yield as they destroy the trees, starting sequentially from the pseudostem to the fruits. The entire distribution of BDB and Fusarium on a plantation can be understood using advanced geospatial information obtained from multispectral aerial photographs taken using an unmanned aerial vehicle (UAV), combined with the reliable data field of infected trees. Vegetation and soil indices derived from a multispectral aerial photograph, such as normalized difference vegetation index, modified chlorophyll absorption ratio index, normalized difference water index (NDWI) and soil pH, may have to be relied on to explain the precise location of these two diseases. In this study, a random forest algorithm was used to handle a large dataset consisting of two models: the banana diseases multispectral model and the banana diseases spectral model. The results show that the soil indices, soil pH and NDWI are the most important variables for predicting the spatial distribution of these two diseases. Simultaneously, the plantation area affected by BDB is more extensive than that affected by Fusarium, if the variation of planted banana cultivars is not considered.

Alzheimer's disease (AD) is a progressive and evolving neurodegenerative disease with an insidious onset that can lead to memory loss and cognitive impairment. There is no effective treatment for this disease. However, early diagnosis plays an important role in treatment planning to slow down its progression, as treatment has the greatest impact in the early stages of the disease. Neurological images obtained through different imaging techniques provide powerful information and help diagnose the disease. With the wide application of deep learning techniques in disease diagnosis, especially the prominence of Convolutional Neural Networks (CNNs) in computer vision and image processing, more and more studies are proposing the use of this algorithm for the diagnosis of AD. In this paper, we first systematically introduce the impact of AD on people, detailing the biomarkers, early clinical symptoms, and risk factors of this disease. Secondly, it goes on to detail the development of CNNs, their form, and methods to help diagnose AD. It is proposed that CNNs can help diagnose AD by analyzing medical imaging data, particularly structural brain scans such as magnetic resonance imaging (MRI) and functional scans such as positron emission tomography (PET). Finally, it is concluded that CNNs are of great importance for the diagnosis of AD and that they are likely to play an increasingly important role in the early detection of the disease, the understanding of disease mechanisms, and ultimately, in the development of effective AD therapies and interventions. CNNs are playing an increasingly important role in the Their potential impact on healthcare emphasizes the importance of continued research and innovation in neural networks and medical imaging.

There has been considerable progress in implicit neural representation to upscale an image to any arbitrary resolution. However, existing methods are based on defining a function to predict the RGB value from just four specific loci. Relying on just four loci is insufficient as it leads to losing fine details from the neighboring region(s). We show that by taking into account the semi-local region leads to an improvement in performance. In this paper, we propose applying a new technique called Overlapping Windows on Semi-Local Region (OW-SLR) to an image to obtain any arbitrary resolution by taking the coordinates of the semi-local region around a point in the latent space. This extracted detail is used to predict the RGB value of a point. We illustrate the technique by applying the algorithm to the Optical Coherence Tomography-Angiography (OCT-A) images and show that it can upscale them to random resolution. This technique outperforms the existing state-of-the-art methods when applied to the OCT500 dataset. OW-SLR provides better results for classifying healthy and diseased retinal images such as diabetic retinopathy and normals from the given set of OCT-A images. The project page is available at https://rishavbb.github.io/ow-slr/index.html

Jalapeño peppers (Capsicum annuum L.) are an important agricultural product worldwide. Despite its high demand in recent years, there are few studies on its production under adverse conditions caused by environmental phenomena. Crops in protected environments such as aeroponics offer greater control of these phenomena and enable efficient use of resources. However, it is necessary to validate the cultivation technique for which new technologies are being used. One of these is the analysis of images captured in the visible and near and far infrared spectrum which involves using non-invasive techniques in order to characterize the growth of a plant and diagnose if it presents any type of stress. This study presents the characterization of vegetative growth and fruiting of jalapeño pepper plants in an aeroponic system, where the root, leaf development parameters and fruits were measured in four jalapeño pepper crops through images of plants captured in the visible (VIS), near infrared (NIR) and far infrared (IR) spectrums. Four crops of thirty jalapeño pepper plants were sown to obtain a total of one hundred and twenty plants which were characterized in the different phases of growth and fruiting. Each of the four jalapeño pepper crops were monitored for sixty days in an aeroponic system in a greenhouse. The first crop was intended to carry out tests to establish the appropriate fertigation times, the next three crops were grown under favorable conditions. Algorithms were developed in Matlab to obtain, over ten image capture sessions, the morphometric and thermal parameters of the roots (perimeter, area, length and average temperature), plants (perimeter, area, height and average temperature), and fruiting. (yield and number of fruits). The statistical analysis was carried out using the ANOVA and Tukey tests considering a value of p ≤ 0.05. The results obtained indicate that there is no significant difference between the characterizations of the four crops. This statement is also supported by the visual analysis of the growth curves parameters of the four crops. In addition, the temperature inside the aeroponic system was contrasted with the ambient temperature and it was verified that the temperature to which the roots are exposed was in the range of 10°C – 20°C. The thermal analysis determined that a plant that presents water stress and is also exposed to high temperatures has an average leaf temperature of 3.7 to 5 °C above the optimal condition for the plant, while a plant with stress at normal temperatures was 1.3 °C higher than the plant without stress.