In this study, we aimed to develop a deep learning model for identifying bacterial keratitis (BK) and fungal keratitis (FK) by using slit-lamp images. We retrospectively collected slit-lamp images of patients with culture-proven microbial keratitis between January 1, 2010, and December 31, 2019, from two medical centers in Taiwan. We constructed a deep learning algorithm, consisting of a segmentation model for cropping cornea images and a classification model that applies convolutional neural networks to differentiate between FK and BK. The model performance was evaluated and presented as the area under the curve (AUC) of the receiver operating characteristic curves. A gradient-weighted class activation mapping technique was used to plot the heatmap of the model. By using 1330 images from 580 patients, the deep learning algorithm achieved an average diagnostic accuracy of 80.00%. The diagnostic accuracy for BK ranged from 79.59% to 95.91% and that for FK ranged from 26.31% to 63.15%. DenseNet169 showed the best model performance, with an AUC of 0.78 for both BK and FK. The heat maps revealed that the model was able to identify the corneal infiltrations. The model showed better diagnostic accuracy than the previously reported diagnostic performance of both general ophthalmologists and corneal specialists.

Recently, the mapping industry has been focusing on the possibility of large-scale mapping from unmanned aerial vehicles (UAVs) owing to advantages such as easy operation and cost reduction. In order to produce large-scale maps from UAV images, it is important to obtain precise orientation parameters. For this, various techniques have been developed and are included in most of the commercial UAV image processing software. For mapping, it is equally important to select images that can cover a region of interest (ROI) with the fewest possible images. Otherwise, to map the ROI, one may have to handle too many images, and commercial software does not provide information needed to select images, nor does it explicitly explain how to select images for mapping. For these reasons, stereo mapping of UAV images in particular is time consuming and costly. In order to solve these problems, this study proposes a method to select images intelligently. We can select a minimum number of image pairs to cover the ROI with the fewest possible images. We can also select optimal image pairs to cover the ROI with the most accurate stereo pairs. We group images by strips, and generate the initial image pairs. We then apply an intelligent scheme to iteratively select optimal image pairs from the start to the end of an image strip. According to the results of the experiment, the number of images selected is greatly reduced by applying the proposed optimal image–composition algorithm. The selected image pairs produce a dense 3D point cloud over the ROI without any holes. For stereoscopic plotting, the selected image pairs were map the ROI successfully on a digital photogrammetric workstation (DPW), and a digital map covering the ROI is generated. The proposed method should contribute to time and cost reductions in UAV mapping.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

An image consisting of (m, n) pixels can be seen as a matrix of m × n size. Based on the formula of angles between two subspaces, a pair of angles can be defined between two matrices, by utilizing column spaces and row spaces of the two matrices. The singular values of each matrix can be used to calculate distances. Thus, a distance representation is obtained, and a pair of angles between 2 matrices of the same size.

This study explores the changes in the landmass bounded by the coast of India during 1975-2005 by using on-screen visual interpretation technique (with 100m resolution and 1:50,000 scale) from NASA Landsat Imagery in three different time periods viz. 1975, 1990, and 2005. The result indicated an overall expansion of 130 sq. km area of the landmass that surrounded by the Indian coast during 1975-2005 (74 sq. km during 1975-1990 and 56 sq. km during 1991-2005). These estimations are based on the preliminary analysis and may be estimated more accurately by reducing the scale and using further higher resolution images.

Karst wetlands are being seriously damaged, and protecting it has become an important matter. Karst vegetation is the essential component of wetland and plays an important role in in the ecological functions of wetland ecosystems. Classifying karst vegetation is important for karst wetlands protection and management. This paper addressed to classify karst vegetation in Huixian National Wetland Park, located in China using the improved SegNet Deep-Learning Algorithm and UAV images. This study proposed a method to fuse single-class SegNet models using the maximum probability algorithm for karst vegetation classification, and compared with object-based RF classification and multi-class SegNet classification, respectively. This paper evaluated the performance of multi-class SegNet model and fusion of single-class SegNet model with different EPOCH values for mapping karst vegetation. A new optimized post-classification algorithm was proposed to eliminate the stitching traces caused by SegNet model prediction. The specific conclusions of this paper include the followings:(1) fusion of four single-class SegNet models produced better classification for karst wetland vegetation than multi-class SegNet model, and achieved the highest overall classification accuracy (87.34%); (2) The optimized post-classification algorithm was able to improve prediction accuracy of SegNet model, and it could eliminate splicing traces; (3) The karst wetland vegetation classifications produced by single-class SegNet model outperformed multi-class SegNet model, and improved classification accuracy(F1-Score) between 10%~25%;(4)The EPCOH values and textural feature important impact on karst wetland vegetation classifications. The SegNet model with EPCOH 15 achieved greater classification accuracy(F1-Score) than the model with EPOCH 5 or 10. The textural feature improved improves the capability of the SegNet model for mapping karst vegetation;(5) Fusion of single-class SegNet models and object-based RF model could provide high classifications results for karst wetland vegetation, and both achieved greater 87% overall accuracy.

Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved super-resolution model which involves the self-attention augmented WGAN is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the HR results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we therefore design a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features, this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.

The objective of this study was aimed to study the sensory processes of the “human-computer interaction” model when classifying visual images with an incomplete set of signs based on the analysis of early, middle, late and slow components of event-related potentials (ERPs). 26 healthy subjects (men) aged 20-22 years were investigated. ERPs in 19 monopolar sites according to the 10/20 system were recorded. Discriminant and factor analysis were applied. The component N450 is the most specialized indicator of the perception of unrecognizable (oddball) visual images. The amplitude of the ultra-late components N750 and N900 is also higher under conditions of presentation of the oddball image, regardless of the location of the registration points. The results of the study are discussed in the light of the paradigm of the P300 wave application in brain-computer interface systems, as well as with the peculiarities in brain pathology. Promising directions for the development of studies of the “Brain Computer Interface” (BCI) P300 systems are to increase the throughput of information flows. To extend the application of the P300 ERPs to multiple modalities, the underlying physiological mechanisms and responses of the brain for a particular sensory system and mental function must be carefully examined.

The COVID-19 pandemic situation has created even more difficulties in the quick identification and screening of the COVID-19 patients for the medical specialists. Therefore, a significant study is necessary for detecting COVID-19 cases using an automated diagnosis method, which can aid in controlling the spreading of the virus. In this paper, the study suggests a Deep Convolutional Neural Network-based multi-classification approach (COV-MCNet) using eight different pre-trained architectures such as VGG16, VGG19, ResNet50V2, DenseNet201, InceptionV3, MobileNet, InceptionResNetV2, Xception which are trained and tested on the X-ray images of COVID-19, Normal, Viral Pneumonia, and Bacterial Pneumonia. The results from 3-class (Normal vs. COVID-19 vs. Viral Pneumonia) showed that only the ResNet50V2 model provides the highest classification performance (accuracy: 95.83%, precision: 96.12%, recall: 96.11%, F1-score: 96.11%, specificity: 97.84%) compared to rest of the models. The results from 4-class (Normal vs. COVID-19 vs. Viral Pneumonia vs. Bacterial Pneumonia) demonstrated that the pre-trained model DenseNet201 provides the highest classification performance (accuracy: 92.54%, precision: 93.05%, recall: 92.81%, F1-score: 92.83%, specificity: 97.47%). Notably, the ResNet50V2 (3-class) and DenseNet201 (4-class) models in the proposed COV-MCNet framework showed higher accuracy compared to the rest six models. This indicates that the designed system can produce promising results to detect the COVID-19 cases on the availability of more data. The proposed multi-classification network (COV-MCNet) significantly speeds up the existing radiology-based method, which will be helpful to the medical community and clinical specialists for early diagnosis of the COVID-19 cases during this pandemic.

This paper presents an Edge-based color image segmentation derived from the method of Particle Motion in a Vector Image Fields (PMVIF) that could previously be applied only to monochrome images. Instead of using an edge vector field derived from a gradient vector field and a normal compressive vector field derived from a Laplacian-gradient vector field, two novel orthogonal vector fields, directly computed from a color image, one parallel and another orthogonal to the edges, were used in the model to force a particle to move along the object edges. The normal compressive vector field is derived from the center-to-centroid vectors of local color distance images. Next, the edge vector field is derived by taking the normal compressive vector field, multiplied by differences of auxiliary image pixels to obtain a vector field analogous to a Hamiltonian gradient vector field. Using the PASCAL Visual Object Classes Challenge 2012 (VOC2012) and the Berkeley Segmentation Data Set and Benchmarks 500 (BSDS500), the benchmark score of the proposed method is provided in comparison with those of the traditional PMVIF, Watershed, SLIC, K-means, Mean shift, and JSEG. The proposed method yields better RI, GCE, NVI, BDE, Dice coefficients, faster computation time, and noise resistance.

Breast cancer develops from cells lining the milk ducts and slowly grows into a lump or a tumour. Breast cancer may be invasive or non-invasive. Invasive cancer spreads from the milk duct or lobule to other tissues in the breast, whereas, non-invasive ones lack the ability to invade other breast tissues. Non-invasive breast cancer is called in situ and may remain inactive for entire lifetime. Due to heterogeneity nature of breast, density as well as masses is variable in size and shape. A dataset of 18056 patients are collected from 20 Government Hospitals and 50 Private Hospitals in West Bengal before COVID-19 and after COVID-19. The classification of patients are made on three classes- Normal, Sign of Abnormality and Abnormality. The reports of MRIs of patients in January 2020 and February 2020 are collected from different hospitals. It is treated as dataset before COVID-19 . MRIS of patients in April 2020 and May 2020 are dataset during COVID-19. The entire datasets are accumulated for testing of any change in patients MRIS after the official announcement of new virus COVID-19 in March 2020. The aim of the paper is to make a comparison of any change in size and shape of masses of MRIs of patients before and after COVId-19. All collected MRIs reports are diagnosed by radiologists of hospitals.

Hyper spectral imaging (HSI) is a technique that is used to obtain the spectrum for each pixel in the image. It helps in finding objects and identifying materials etc. Such an identification is very difficult using other imaging techniques. It allows the researchers to investigate the documents without any physical contact. Nowadays detection of unequal Ink mismatch based on HSI has shown vast improvement in distinguishing the inks. Detection of unequal Ink mismatch is an unbalanced clustering problem. This paper used K-means Clustering for ink mismatch detection. K-means Clustering find same subgroups in the data based on Euclidean distance. This paper demonstrates performance in unequal Ink mismatch based on HSI.

Αbstract: To date, countless satellite image fusions have been made, mainly with panchromatic spatial resolution to a multispectral image ratio of 1/4, fewer fusions with lower ratios, and relatively recently fusions with much higher spatial resolution ratios have been published. Apart from this, there is a small number of publications studying the fusion of aerial photographs with satellite images, with the year of image acquisition varying and the dates of acquisition not mentioned. In addition, in these publications, either no quantitative controls are performed on the composite images produced, or the aerial photographs are recent and colorful and only the RGB bands of the satellite images are used for data fusion purposes. The objective of this paper is the study of the addition of multispectral information from satellite images to black and white aerial photographs of the 80s decade (1980–1990) with small difference (just a few days) in their image acquisition date, the same year and season. Quantitative tests are performed in two case studies and the results are encouraging, as the accuracy of the classification of the features and objects of the Earth’s surface is improved and the automatic digital extraction of their form and shape from the archived aerial photographs is now allowed. This opens up a new field of use for the black and white aerial photographs and archived multispectral satellite images of the same period in a variety of applications, such as the temporal changes of cities, forests and archaeological sites.

Unmanned Aerial Vehicle (UAV) based remote sensing (RS) studies in glaciology are mainly focusing on obtaining accurate high-resolution data from UAV images. Studies for identifying and minimising the challenges faced during the UAV-based RS data acquisition survey on inaccessible and harsh terrains of mountain glaciers is limited. This study aims to examine the practical challenges faced during UAV surveys of glaciers and derive strategies to minimize them. To the authors' knowledge, this is the first study that addresses such problems over the Himalayan region. Here, the UAV surveys were conducted using a fixed-wing commercial-grade off-the-shelf UAV (eBee plus, SenseFly) on three glacier sites (East Rathong, Hamtah and Panchinala-A) located in different zones and climate regimes lying within the Indian part of Himalayas. From UAV collected photos, the study was able to generate ultra-high-resolution ortho-mosaicked images and Digital Elevation Models (DEMs) at 0.1m GSD. UAV-derived DEMs was able to achieve vertical (horizontal) accuracy of 0.45 and 0.21 m (0.15 and 0.1 m) with 3 and 6 ground control points (GCPs) for an area of 0.75 km2 and 1.38 km2. Accuracy assessment of UAV DEMs generated with and without GCPs indicate that GCPs are must to obtain decimetre level accurate DEM especially on glaciers with steep-valleyed terrains. The utility of the obtained ultra-high-resolution ortho-mosaicked images was demonstrated by generating glacier surface feature maps. Based on the challenges observed during UAV surveys, the study identifies and recommends best-suited locations on a glacier and its adjacent regions for conducting UAV surveys efficiently in the glaciated terrain of Himalayas and possibly beyond. Recommendations reported in this article shall minimise the challenges faced and involved risks for data acquisition and thus enable UAVs to cover more glaciated area successfully.

Pieron's and Chocholle’s seminal psychophysical work predicts that human response time to information relative to visual contrast and/or sound frequency decreases when contrast intensity or sound frequency increases. The goal of this study is to bring to the fore the ability of individuals to use visual contrast intensity and sound frequency in combination for faster perceptual decisions of relative depth (“nearer”) in planar (2D) object configurations on the basis of physical variations in luminance contrast. Computer controlled images with two abstract patterns of varying contrast intensity, one on the left and one on the right, preceded or not by a pure tone of varying frequency, were shown to healthy young humans in controlled experimental sequences. Their task (two-alternative forced-choice) was to decide as quickly as possible which of two patterns, the left or the right one, in a given image appeared to “stand out as if it were nearer” in terms of apparent (subjective) visual depth. The results show that the combinations of varying relative visual contrast with sounds of varying frequency exploited here produced an additive effect on choice response times in terms of facilitation, where a stronger visual contrast combined with a higher sound frequency produced shorter forced-choice response times. This new effect is predicted by cross-modal audio-visual probability summation.

The technique of obtaining information or data about any feature or object from afar, called in technical parlance as remote sensing, has proven extremely useful in diverse fields. In the ecological sphere, especially, remote sensing has enabled collection of data or information about large swaths of areas or landscapes. Even then, in remote sensing the task of identifying and monitoring of different water reservoirs has proved a tough one. This is mainly because getting correct appraisals about the spread and boundaries of the area under study and the contours of any water surfaces lodged therein becomes a factor of utmost importance. Identification of water reservoirs is rendered even tougher because of presence of cloud in satellite images, which becomes the largest source of error in identification of water surfaces. To overcome this glitch, the method of the shape matching approach for analysis of cloudy images in reference to cloud-free images of water surfaces with the help of vector data processing, is recommended. It includes the database of water bodies in vector format, which is a complex polygon structure. This analysis highlights three steps: First, the creation of vector database for the analysis; second, simplification of multi-scale vector polygon features; and third, the matching of reference and target water bodies database within defined distance tolerance. This feature matching approach provides matching of one to many and many to many features. It also gives the corrected images that are free of clouds.

Remote sensing technologies may play a fundamental role in the environmental assessment of open-cast mining and the accurate quantification of mine land rehabilitation efforts. Here, we developed a systematic geographic object-based image analysis (GEOBIA) approach to map the amount of revegetated area and to quantify the land-use changes in open-cast mines in the Carajás region situated in the eastern Amazon. Based on high-resolution satellite images from 2011 to 2015 from different sensors (GeoEye, WorldView-3 and Ikonos), we quantified forests, cangas (natural metalliferous savanna ecosystems), mine land, revegetated areas and water bodies. Based on the GEOBIA approach, threshold values were established to discriminate land cover classes using spectral bands, and the NDVI and NDWI indices and LiDAR digital ground and slope models. The overall accuracy was higher than 90%, and the Kappa indices varied between 0.82 and 0.88. During the observation period, the mining complex expanded; for that, canga and forest vegetation was converted to mine land. At the same time, the amount of revegetated area increased. Thus, we conclude that our approach is capable of providing consistent information regarding land cover changes in mines, with a special focus on the amount of revegetation necessary to fulfill environmental liabilities.

Recently the increased cost-effectiveness of high-throughput technologies has made available a large number of RNA sequencing datasets to identify circular RNAs (circRNAs). However, despite many computational tools were developed to predict circRNAs, a limited number of workflows exists to predict and to characterize circRNAs. Moreover, to the best of our knowledge, these available workflows do not ensure computational reproducibility and require advanced bash scripting skills to be correctly installed and used. To cope with these critical aspects we present Docker4Circ, a new computational framework designed for a comprehensive analysis of circRNAs composed of: circRNAs prediction, classification and annotation using public databases, the back-splicing sequence reconstruction; the internal alternative splicing of circularizing exons; the alignment-free circRNAs quantification from RNA-Seq reads, and, finally, their differential expression analysis. Docker4Circ was specifically designed for making easier and more accessible circRNAs analysis thanks to the following features: (i) its R interface; (ii) the encapsulation of its computational tasks into a docker image; (iii) an available user-friendly Java GUI Interface. Furthermore, Docker4Circ ensures a reproducible analysis because all its tasks were embedded into a docker image following the guidelines provided by Reproducible Bioinformatics Project (RBP, http://reproducible-bioinformatics.org/). The effectiveness of Docker4Circ was demonstrated on a real case study whose goal is to characterize the circRNAs predicted in colorectal cancer cell lines and quantified in public RNA-Seq experiments performed on primary tumor tissues. In conclusion, we propose Docker4Circ as a framework for reproducible and comprehensive analyses of circRNAs to efficiently exploit their biological role.

This paper aims at tackling with the task of fusion feature from images and its corresponding point clouds for 3D object detection in autonomous driving scenarios basing on AVOD, an Aggregate View Object Detection network. The proposed fusion algorithms fuse features targeted from Bird’s Eye View (BEV) LIDAR point clouds and its corresponding RGB images. Differs in existing fusion methods, which are simply the adoptions of concatenation module, element-wise sum module or element-wise mean module, our proposed fusion algorithms enhance the interaction between BEV feature maps and its corresponding images feature maps by designing a novel structure, where single level feature maps and another utilizes multilevel feature maps. Experiments show that our proposed fusion algorithm produces better results on 3D mAP and AHS with less speed loss comparing to existing fusion method used on the KITTI 3D object detection benchmark.

Signal-to-noise ratio (SNR) is an important index to evaluate radiation performance and image quality of optical imaging systems under low illumination background. Under the nighttime lighting condition, the illumination of remote sensing objects is low and varies greatly, usually ranging from several lux to tens of thousands of lux. Nighttime light remote sensing imaging requires high sensitivity and large dynamic range of detectors. Luojia 1-01 is the first professional nighttime light remote sensing satellite in the world. In this paper, we took the nighttime light remote sensing camera carried on the satellite as research object, proposed an in-orbit SNR test method based on time series images to overcome the problem of low spatial resolution. We first analyzed the process of luminous flux transmission between objects and satellite and established a radiative transfer model. By combining the parameters of large relative aperture optical system and high sensitivity CMOS device, we established SNR model and specially analyzed the effect of exposure time and quantization bits on SNR. Finally we used the proposed in-orbit test method to calculate SNR of lighting images acquired by satellite. And the measured result is in good agreement with the model predicted data. Under the condition of 10lx illumination, the SNR of typical objects can reach 27.02dB, which is much better than the requirement of 20dB for engineering application.

LULC changes are major environmental challenges in many parts of the world which are adversely affecting ecosystem services. This study was aimed to analyze LULC changes in the ecological landscape of Ethiopia CRV areas from 1985 to 2015. Satellite images were accessed and pre-processing and classification is done. Major LULC types were detected and change analysis was executed. Nine LULC changes were successfully evaluated. The classification result revealed that in 1985, 44.34% of the land was covered with small scale farming followed by mixed cultivated/acacia (21.89%), open woodland (11.96%), and water bodies (9.77%). Whereas for the same study year open grazing land, forest, degraded savannah and settlements accounted the smallest proportion. Though the area varied among land use classes, the trend of share occupied by the LULC types in the study area remained the same in 1995 and 2015. Increase in small and large scale farming, settlements and mixed cultivation/acacia while a decrease in water bodies, forest, and open woodlands is noted. About 86.11% of the land showed major changes in land use/cover. Lastly, DPSIR framework analysis was done and integrated land use and development planning and policy reform are suggested for sustainable land use planning and management.

Geologists employ high-spatial-resolution (HR) remote sensing (RS) data for many diverse applications as they effectively reflect detailed geological information, enabling high-quality and efficient geological surveys. Applications of HR RS data to geological and related fields have grown recently. By analyzing these applications, we can better understand the results of previous studies and more effectively use the latest data and methods to efficiently extract key geological information. HR optical remote sensing data are widely used in geological hazard assessment, seismic monitoring, mineral exploitation, glacier monitoring, and mineral information extraction due to high accuracy and clear object features. Compared with optical satellite images, synthetic-aperture radar (SAR) images are stereoscopic and exhibit clear relief, strong performance, and good detection of terrain, landforms, and other information. SAR images have been applied to seismic mechanism research, volcanic monitoring, topographic deformation, and fault analysis. Furthermore, a multi-standard maturity analysis of the geological applications of HR images using literature from the Science Citation Index reveals that optical remote sensing data are superior to radar data for mining, geological disaster, lithologic, and volcanic applications, but inferior for earthquake, glacial, and fault applications. Therefore, geological remote sensing research needs to be truly multidisciplinary or interdisciplinary, ensuring more detailed and efficient surveys through cross-linking with other disciplines. Moreover, the recent application of deep learning technology to remote sensing data extraction has improved automatic processing and data analysis capabilities.

The urban mangrove of the Vitória Bay, Espírito Santo, Southern Brazil suffers from anthropogenic impacts, which interfere in the foliar spectral response of its species. Identifying the spectral behavior of these species and creating regression models to indirectly obtain structure data like the Leaf Area Index (LAI) are powerful environmental monitoring tools. In this study, LAI was obtained in 32 plots distributed in four stations. In situ LAI regression analysis with the SAVI resulted in significant positive relationships (r² = 0.58). Forest variability regarding the degree of maturity and structural heterogeneity and LAI influenced the adjustment of vegetation indices (VIs). The highest regression values were obtained for the homogeneous field data, represented by R. mangle plots, which also had higher LAI values. The same field data were correlated with SAVI of a RapidEye image for comparison purposes. The results showed that, images obtained by a UAV have higher spatial resolution than the Rapideye image, and therefore had a greater influence of the background. Another point is that the statistical analysis of the field data with the IVs obtained from the RapidEye image did not present high regression coefficient (r² = 0.7), suggesting that the use of VIs applied to the study of urban mangroves needs to be better evaluated, observing the factors that influence the leaf spectral response.

Hyperspectral images are an important tool to assess ecosystem biodiversity both on terrestrial and benthic habitats. To obtain more precise analysis of biodiversity indicators that agree with indicators obtained using field data, analysis of spectral diversity calculated from images have to be validated with field based diversity estimates. The plant species richness is one of the most important indicators of biodiversity. This indicator can be measured in hyperspectral images considering the Spectral Variation Hypothesis (SVH) which states that the spectral heterogeneity is related to spatial heterogeneity and thus to species richness. The goal of this research is to capture spectral heterogeneity from hyperspectral images for a terrestrial neo tropical forest site using Vector Quantization (VQ) method and then use the result for prediction of plant species richness. The results are compared with that of Hierarchical Agglomerative Clustering (HAC). The validation of the process index is done calculating the Pearson correlation coefficient between the Shannon entropy from actual field data and the Shannon entropy computed in the images. Terrestrial dry forest and marine coastal hyperspectral images with different resolutions have been used for spectral diversity feature validation.

In California, water is a perennial concern. As competition for water resources increases due to growth in population, California’s tree nut farmers are committed to improving the efficiency of water used for food production. There is an imminent need to have reliable methods that provide information about the temporal and spatial variability of crop water requirements, which allow farmers to make irrigation decisions at field scale. This study focuses on estimating the actual evapotranspiration and crop coefficients of an almond and pistachio orchard located in Central Valley (California) during an entire growing season by combining a simple crop evapotranspiration model with remote sensing data. A dataset of the vegetation index NDVI derived from Landsat-8 was used to facilitate the estimation of the basal crop coefficient (Kcb), or potential crop water use. The soil water evaporation coefficient (Ke) was measured from microlysimeters. The water stress coefficient (Ks) was derived from airborne remotely sensed canopy thermal-based methods, using seasonal regressions between the crop water stress index (CWSI) and stem water potential (Ystem). These regressions were statistically-significant for both crops, indicating clear seasonal differences in pistachios, but not in almonds. In almonds, the estimated maximum Kcb values ranged between 1.05 to 0.90, while for pistachios, it ranged between 0.89 to 0.80. The model indicated a difference of 97 mm in transpiration over the season between both crops. Soil evaporation accounted for an average of 16% and 13% of the total actual evapotranspiration for almonds and pistachios, respectively. Verification of the model-based daily crop evapotranspiration estimates was done using eddy-covariance and surface renewal data collected in the same orchards, yielding an r² >= 0.7 and average root mean square errors (RMSE) of 0.74 and 0.91 mm day^-1 for almond and pistachio, respectively. It is concluded that the combination of crop evapotranspiration models with remotely-sensed data is helpful for upscaling irrigation information from plant to field scale and thus may be used by farmers for making day-to-day irrigation management decisions.

Recent advances in open data initiatives allow us to free access to a vast amount of open LiDAR data in many cities. However, most of these open LiDAR data over cities are acquired by airborne scanning, where the points on façades are sparse or even completely missing due to the viewpoint and object occlusions in the urban environment. Integrating other sources of data, such as ground images, to complete the missing parts is an effective and practical solution. This paper presents an approach for improving open LiDAR data coverage on building façades by using point cloud generated from ground images. A coarse-to-fine strategy is proposed to fuse these two different sources of data. Firstly, the façade point cloud generated from terrestrial images is initially geolocated by matching the SFM camera positions to their GPS meta-information. Next, an improved Coherent Point Drift algorithm with normal consistency is proposed to accurately align building façades to open LiDAR data. The significance of the work resides in the use of 2D overlapping points on the outline of buildings instead of limited 3D overlap between the two point clouds and the achievement to a reliable and precise registration under possible incomplete coverage and ambiguous correspondence. Experiments show that the proposed approach can significantly improve the façades details of buildings in open LiDAR data and improving registration accuracy from up to 10 meters to less than half a meter compared to classic registration methods.

Glaucoma is a disease associated with retina of eye. Presently, millions of human being is suffering from this disease. Early detection of these diseases can save the people from blindness. Therefore, various methods have been developed for its detection. In this paper, we have studied the reported methods and summarized their performance in terms of accuracy of detection.

Land cover change detection (LCCD) based on bi-temporal remote sensing images plays an important role in the inventory of land cover change. Due to the benefit of having spatial dependency properties within the image space while using remote sensing images for detecting land cover change, many contextual information based change detection methods have been proposed during past decades. However, there is still a space for improvement in accuracies and usability of LCCD. In this paper, a LCCD method based on adaptive contextual information is proposed. First, an adaptive region is constructed by gradually detecting the spectral similarity surrounding a central pixel. Second, the Euclidean distance between pairwise extended regions is calculated to measure the change magnitude between the pairwise central pixels of bi-temporal images. While the whole bi-temporal images are scanned pixel-by-pixel, the change magnitude image (CMI) can be generated. Then, the Otsu or a manual threshold is employed to acquire the binary change detection map (BCDM). The detection accuracies of the proposed approach are investigated by two land cover change cases with Landsat bi-temporal remote sensing images. In comparison to several widely used change detection methods, the proposed approach can achieve a land cover change inventory map with a competitive accuracy.

In this paper, we propose a novel approach to recognize radar targets on inverse synthetic aperture radar (ISAR) and synthetic aperture radar (SAR) images. This approach is based on the multiple salient keypoint descriptors (MSKD) and multitask sparse representation based classification (MSRC). Thus, to characterize the targets in the radar images, we combine the scale-invariant feature transform (SIFT) and the saliency map. The goal of this combination is to reduce the SIFT keypoints and their time computing time by maintaining only those located in the target area (salient region). Then, we compute the feature vectors of the resulting salient SIFT keypoints (MSKD). This methodology is applied for both training and test images. The MSKD of the training images leads to construct the dictionary of a sparse convex optimization problem. To achieve the recognition, we adopt the MSRC taking into consideration each vector in the MSKD as a task. This classifier solves the sparse representation problem for each task over the dictionary and determines the class of the radar image according to all sparse reconstruction errors (residuals). The effectiveness of the proposed approach method has been demonstrated by a set of extensive empirical results on ISAR and SAR images databases. The results show the ability of our method to predict adequately the aircraft and the ground targets.

The quantization error (QE) from Self-Organizing Map (SOM) output after learning is exploited in this studies. SOM learning is applied on time series of spatial contrast images with variable relative amount of white and dark pixel contents, as in monochromatic medical images or satellite images. It is proven that the QE from the SOM output after learning provides a reliable indicator of potentially critical changes in images across time. The QE increases linearly with the variability in spatial contrast contents of images across time when contrast intensity is kept constant. The hitherto unsuspected capacity of this metric to capture even the smallest changes in large bodies of image time series after using ultra-fast SOM learning is illustrated on examples from SOM learning studies on computer generated images, MRI image time series, and satellite image time series. Linear trend analysis of the changes in QE as a function of the time an image of a given series was taken gives proof of the statistical reliability of this metric as an indicator of local change. It is shown that the QE is correlated with significant clinical, demographic, and environmental data from the same reference time period during which test image series were recorded. The findings show that the QE from SOM, which is easily implemented and requires computation times no longer than a few minutes for a given image series of 20 to 25, is useful for a fast analysis of whole series of image data when the goal is to provide an instant statistical decision relative to change/no change between images.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

A quantum hybrid (QH) intelligent approach that blends the adaptive search capability of the quantum-behaved particle swarm optimisation (QPSO) method with the intuitionistic rationality of traditional fuzzy k-nearest neighbours (Fuzzy k-NN) algorithm (known simply as the Q-Fuzzy approach) is proposed for efficient feature selection and classification of cells in cervical smeared (CS) images. From an initial multitude of seventeen (17) features describing the geometry, colour, and texture of the CS images, the QPSO stage of our proposed technique is used to select the best subset features (i.e. global best particles) that represent a pruned down collection of seven (7) features. Using a dataset of almost 1000 images, performance evaluation of our proposed Q-Fuzzy approach assesses the impact of our feature selection on classification accuracy by way of three experimental scenarios that are compared alongside two other approaches: The All-features (i.e. classification without prior feature selection) and another hybrid technique combining the standard PSO algorithm with the Fuzzy k-NN technique (P-Fuzzy approach). In the first and second scenarios, we further divided the assessment criteria in terms of classification accuracy based on the choice of best features and those in terms of the different categories of the cervical cells. In the third scenario, we introduced new QH hybrid techniques, i.e. QPSO combined with other supervised learning methods, and compared the classification accuracy alongside our proposed Q-Fuzzy approach. Furthermore, we employed statistical approaches to establish qualitative agreement with regards to the feature selection in scenarios 1 and 3. The synergy between the QPSO and Fuzzy k-NN in the proposed Q-Fuzzy approach marginally improves classification accuracy as manifest in the reduction in number cell features, which is crucial for effective cervical cancer detection and diagnosis.

Speckle noise reduction is an important area of research in the field of ultrasound image processing. Several algorithms for speckle noise characterization and analysis have been recently proposed in the area. Synthetic ultrasound images can play a key role in noise evaluation methods as they can be used to generate a variety of speckle noise models under different interpolation and sampling schemes, and can also provide valuable ground truth data for estimating the accuracy of the chosen methods. However, not much work has been done in the area of modelling synthetic ultrasound images, and in simulating speckle noise generation to get images that are as close as possible to real ultrasound images. An important aspect of simulated synthetic ultrasound images is the requirement for extensive quality assessment for ensuring that they have the texture characteristics and gray-tone features of real images. This paper presents texture feature analysis of synthetic ultrasound images using local binary patterns (LBP) and demonstrates the usefulness of a set of LBP features for image quality assessment. Experimental results presented in the paper clearly show how these features could provide an accurate quality metric that correlates very well with subjective evaluations performed by clinical experts.

Object segmentation on remotely-sensed images: aerial (or very high resolution, VHS) images and satellite (or high resolution, HR) images, has been applied to many application domains, especially road extraction in which the segmented objects are served as a mandatory layer in geospatial databases. Several attempts in applying deep convolutional neural network (DCNN) to extract roads from remote sensing images have been made; however, the accuracy is still limited. In this paper, we present an enhanced DCNN framework specifically tailored for road extraction on remote sensing images by applying landscape metrics (LMs) and conditional random fields (CRFs). To improve DCNN, a modern activation function, called exponential linear unit (ELU), is employed in our network resulting in a higher number of and yet more accurate extracted roads. To further reduce falsely classified road objects, a solution based on an adoption of LMs is proposed. Finally, to sharpen the extracted roads, a CRF method is added to our framework. The experiments were conducted on Massachusetts road aerial imagery as well as THEOS satellite imagery data sets. The results showed that our proposed framework outperformed Segnet, the state-of-the-art object segmentation technique on any kinds of remote sensing imagery, in most of the cases in terms of precision, recall, and F1.

Satellite scene classification is challenging because of the high variability inherent in satellite data. Although rapid progress in remote sensing techniques has been witnessed in recent years, the resolution of the available satellite images remains limited compared with the general images acquired using a common camera. On the other hand, a satellite image usually has a greater number of spectral bands than a general image, thereby permitting the multi-spectral analysis of different land materials and promoting low-resolution satellite scene recognition. This study advocates multi-spectral analysis and explores the middle-level statistics of spectral information for satellite scene representation instead of using spatial analysis. This approach is widely utilized in general image and natural scene classification and achieved promising recognition performance for different applications. The proposed multi-spectral analysis firstly learns the multi-spectral prototypes (codebook) for representing any pixel-wise spectral data, and then based on the learned codebook, a sparse coded spectral vector can be obtained with machine learning techniques. Furthermore, in order to combine the set of coded spectral vectors in a satellite scene image, we propose a hybrid aggregation (pooling) approach, instead of conventional averaging and max pooling, which includes the benefits of the two existing methods but avoids extremely noisy coded values. Experiments on three satellite datasets validated that the performance of our proposed approach is much more accurate than even the deep learning framework for spatial analysis.

This paper describes the first results of an Image Recognition Based Location (IRBL) for mobile application focusing on the procedure to generate a Database of range images (RGB-D). In an indoor environment, to estimate the camera position and orientation, a prior spatial knowledge of the surrounding is needed. In order to achieve this objective a complete 3D survey of two different environment (Bangbae metro station of Seoul and E.T.R.I. building in Daejeon – Republic of Korea) was performed using LiDAR (Light Detection And Ranging) instrument and the obtained scans were processed in order to obtain a spatial model of the environments. From this, two databases of reference images were generated using a specific software realized by the Geomatics group of Politecnico di Torino (ScanToRGBDImage). This tool allow to generate synthetically different RGB-D images) centered in the each scan position in the environment. Later, the external parameters (X, Y, Z, ω, φ, κ) and the range information extracted from the DB images retrieved, are used as reference information for pose estimation of a set of acquired mobile pictures in the IRBL procedure. In this paper the survey operations, the approach for generating the RGB-D images and the IRB strategy are reported. Finally the analysis of the results and the validation test are described.

The reasons for the circular sense of human color perception generated by two sorts of color opponent neurons and three cone types are not well understood. Here we use geometrical analysis to examine the hypothesis that opponency, the recursive nature of color perception, and trichromacy arise as the most efficient ways of distinguishing spectrally different points on a plane using a minimum of color classes and receptor types.