Use of a multi-sensor approach can provide citizens a holistic insight in the air quality in their immediate surroundings and assessment of personal exposure to urban stressors. Our work, as part of the ICARUS H2020 project, which included over 600 participants from 7 European cities, discusses data fusion and harmonization on a diverse set of multi-sensor data streams to provide a comprehensive and understandable report for participants, and offers possible solutions and improvements. Harmonizing the data streams identified issues with the used devices and protocols, such as non-uniform timestamps, data gaps, difficult data retrieval from commercial devices, and coarse activity data logging. Our process of data fusion and harmonization allowed us to automate the process of generating visualizations and reports and consequently provide each participant with a detailed individualized report. Results showed that a key solution was to streamline the code and speed up the process, which necessitated certain compromises in visualizing the data. A thought-out process of data fusion and harmonization on a diverse set of multi-sensor data streams considerably improved the quality and quantity of data that a research participant receives. Though automatization accelerated the production of the reports considerably, manual structured double checks are strongly recommended.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

Sensor fusion algorithms and models have been widely used in recent times. Although research evidence has informed the use of sensor fusion models in diverse applications, there is room for improvement, especially in home-based health monitoring applications which require less supervision and technical knowledge of users. The present work compares data mining-based fusion software packages such as RapidMiner Studio, Anaconda, Weka, and Orange, and proposes a data fusion framework suitable for in-home applications. 574 privacy-friendly (binary) images and 1,722 datasets gleaned from thermal and Radar sensing solutions respectively, were fused using the software packages on instances of homogeneous and heterogeneous data aggregation. Experimental results indicated that the proposed fusion framework achieved an average Classification Accuracy of 84.7% and 95.7% on homogeneous and heterogeneous datasets respectively, with the help of data mining and machine learning models such as Naïve Bayes, Decision Tree, Neural Network, Random Forest, Stochastic Gradient Descent, Support Vector Machine, K-Nearest Neighbours and CN2 induction. Further evaluation of the sensor data fusion framework based on cross validation of features indicated average values of 94.4% for Classification Accuracy, 95.7% Precision and 96.4% for Recall.

In order to perform multi-degree-of-freedom motion measurements of marine machinery such as ship-borne mechanical platform in an absolute environment without a reference, absolute measurement methods using acceleration sensors and tilt gyroscopes are typically employed. However, due to the influence of wave forces on ship-borne mechanical platform, the coupling between different degrees of freedom can cause mutual interference, resulting in significant sensor measurement disturbances that make efficient computation and real-time analysis challenging. Specifically, when ship-borne mechanical platform swings, the proof mass of the acceleration sensor produces an undesirable signal output in the vertical direction, which leads to imprecise acceleration integration, thereby affecting accurate motion collection and posture estimation. To address these challenges, by analyzing the influence of the inclination angle of the ship-borne mechanical platform on the sensor measurement, and using the working principle of the acceleration sensor and angle sensor, a correction method for the motion measurement of the ship-borne mechanical platform based on multi-sensor fusion is proposed. In this article, we first analyze the influence of inclination angle on the integral effect in the heave direction. Then the configuration using four groups of acceleration sensors to correct the integral effect is proposed. Finally, the optimal inclination angle is determined through Kalman filtering based on the measured value of angle sensors and estimated values from the acceleration sensor sets. Experiments have proved that the average error of the corrected heave displacement signal is 25.34 mm, which is better than the integral displacement signal of a single acceleration sensor. At the same time, the acceleration sensor is used to calculate the roll angle and pitch angle of the ship-borne mechanical platform, and combined with the angle sensor signal to perform Kalman filtering, which filters out the errors caused by the shaking and instability of the mechanical platform, and can more accurately estimate the true inclination of the platform. Therefore, this method can enhance the precision and accuracy of the ship-borne mechanical platform motion signal acquisition, providing more valuable experimental data for research in marine engineering and related fields.

A stable driver state is essential in the process of manually transition control, which inevitably occurs in Level 3 automated driving situations. To this end, this paper proposed a CNN algorithm-based driver state monitoring system that uses multi-sensor data such as driver's face image, biometric information, and vehicle behavior information as input. This system calculates the probability of drowsiness for each of the four time periods using a convolutional neural network (CNN) based on ToF camera-based eye blinking, ECG information (pulse rate) embedded in the steering wheel, and vehicle information (steering angle data). In order to build a reliable and high-quality training dataset (Ground Truth) for the CNN algorithm, a baseline was established by matching the driver's face image with the electrocardiogram (ECG) and electroencephalogram (EEG) changes in the drowsy and normal states. In a simulation test of the proposed CNN algorithm using more than 20,000 driver image data acquired using a driving simulator, the TNR was 94.8% and the accuracy was 94.2%. Our proposed method is expected to minimize human errors that may occur when switching control by monitoring inappropriate driver state (drowsiness) in real time.

In this work, we show that a late fusion approach to multi-modality in sign language recognition improves the overall ability of the model in comparison to the singular approaches of Computer Vision (88.14%) and Leap Motion data classification (72.73%). With a large synchronous dataset of 18 BSL gestures collected from multiple subjects, two deep neural networks are benchmarked and compared to derive a best topology for each. The Vision model is implemented by a CNN and optimised MLP and the Leap Motion model is implemented by an evolutionary optimised deep MLP topology search. Next, the two best networks are fused for synchronised processing which results in a better overall result (94.44%) since complementary features are learnt in addition to the original task. The hypothesis is further supported by application of the three models to a set of completely unseen data where a multi-modality approach achieves the best results relative to the single sensor method. When transfer learning with the weights trained via BSL, all three models outperform standard random weight distribution when classifying ASL, and the best model overall for ASL classification was the transfer learning multi-modality approach which scored 82.55% accuracy.

In the autonomous navigation of mobile robots, precise positioning is crucial. In forest environments with weak satellite signals or in sites disturbed by complex environments, satellite positioning accuracy has difficulty in meeting the requirements of autonomous navigation positioning accuracy for robots. This article proposes a binocular vision SLAM/UWB tightly coupled localization method. The core of this algorithm is based on an Extended Kalman Filter (EKF), which utilizes the displacement increment output by binocular vision ORB-SLAM and the positioning coordinates calculated via UWB positioning as measurement information to achieve data fusion. The research utilized the constructed experimental platform to collect images and UWB ranging data in outdoor environments and experimentally validated the combined positioning method. The experimental results show that this algorithm outperforms the use of the individual UWB or visual SLAM localization methods in terms of positioning accuracy. Compared with traditional single positioning algorithms, this algorithm exhibits better practicality and stability, and can effectively suppress the impact of UWB non line of sight errors. The average error under normal line of sight conditions is 0.058 m, the root mean square error (RMSE) is 0.080, and the average error under non-line-of-sight conditions is 0.081 m, with an RMSE of 0.084. There is no significant jump or drift. Through the tightly coupled processing of binocular vision SLAM and UWB positioning, more reliable and accurate mobile robot positioning can be achieved, providing a useful reference for the autonomous navigation of mobile robots in complex environments.

Recent deep learning frameworks draw a strong research interest in the application of ego-motion estimation as they demonstrate a superior result compared to geometric approaches. However, due to the lack of multimodal datasets, most of these studies primarily focused on a single sensor-based estimation. To overcome this challenge, we collect a unique multimodal dataset named LboroAV2, using multiple sensors including camera, Light Detecting And Ranging (LiDAR), ultrasound, e-compass and rotary encoder. We also propose an end-to-end deep learning architecture for fusion of RGB images and LiDAR laser scan data for odometry application. The proposed method contains a convolutional encoder, a compressed representation and a recurrent neural network. Besides feature extraction and outlier rejection, the convolutional encoder produces a compressed representation which is used to visualise the network's learning process and to pass useful sequential information. The recurrent neural network uses this compressed sequential data to learn the relation between consecutive time steps. We use the LboroAV2 and KITTI VO datasets to experiment and evaluate our results. In addition to visualising the network's learning process, our approach gives superior results compared to other similar methods. The code for the proposed architecture is released in GitHub and accessible publicly.

The quality of digital elevation models (DEMs) is inevitably affected by the limitations of the imaging modes and the generation methods. One effective way to solve this problem is to merge the available datasets through data fusion. In this paper, a fusion-based global DEM dataset (82°S-82°N) is introduced, which we refer to as GSDEM-30. This is a 30-m DEM mainly reconstructed from the unfilled SRTM1, AW3D30, and ASTER GDEM v2 datasets combining the multi-source and multi-scale fusion techniques. A comprehensive evaluation of the GSDEM-30 data, as well as the 30-m ASTER GDEM v2 and AW3D30 DEM, was presented. Global ICESat GLAS data and the local National Elevation Dataset (NED) were used as the reference for the vertical accuracy validation, while GlobeLand30 was introduced for the landscape analysis. Furthermore, we employed the maximum slope approach to detect the potential artefacts in the DEMs. The results show that the GDEM data are seriously affected by noise and artefacts. With the advantage of the multiple datasets and the refined post-processing, the GSDEM-30 are contaminated with fewer anomalies than both ASTER GDEM and AW3D30. The fusion techniques used can also be applied to the reconstruction of other fused DEM datasets.

In the mold machining process, the cutting tool is worn with machining time, thereby affecting the surface accuracy, leading to poor workpiece dimensions, even fracture. At present, many studies have used multiple sensors to detect the machining conditions of cutting tool and workpiece, including indirect measurement method and direct measurement method. The indirect measurement method, which has been studied widely, mainly uses sensors to capture signals for subsequent data analysis; the direct measurement method mainly analyzes the state of cutting shear zone. Due to the cut-in of cutting tool in the machining process, the workpiece is dislocated rapidly, generating considerable amount of heat, which is transferred to the chips, inducing color change on the surface of chips. Many engineers with machining experience often judge the machining state and tool life according to the chips. The engineers' experience is digitized in this study, and indirect measuring sensors are used to predict the tool life, so as to attain the objective for smart manufacturing, the average percentage error of MAPE using single vibration and voltage eigenvalues as input features is 10%, the voltage signal characteristic values and vibration signal characteristic values are combined. Finally, the chip surface chromaticity eigenvalue is combined with signal characteristic value. The average prediction error of BP-LM method is 7.85%, the average prediction error of GRNN method is 6.59%. Therefore, when the eigenvalue of chip surface chromaticity is added to the prediction result, it can enhance the accuracy of cutting tool wear value prediction more effectively than single sensor signal characteristic value.

This paper presents a methodology to design sensor fusion parameters using real performance indicators of navigation in UAVs based on PixHawk flight controller and peripherals. This methodology and the selected performance indicators allows to find the best parameters for the fusion system of a determined configuration of sensors and a predefined real mission. The selected real platform is described with stress on available sensors and data processing software, and the experimental methodology is proposed to characterize sensor data fusion output and determine the best choice of parameters using quality measurements of tracking output with performance metrics not requiring ground truth.

The RPL protocol is a routing protocol for low power and lossy networks. In such a network, energy is a very scarce resource; so many studies are focused on minimizing global energy consumption. End-to-end latency is another important performance indicator of the network, but existing research tends to focus more on energy consumption and ignore the end-to-end delay of data transmission. In this paper, we propose a kind of energy equalization routing protocol to maximize the surviving time of the restricted nodes so that the energy consumed by each node is close to each other. At the same time, a multi-path forwarding route is proposed based on the cache utilization. The data is sent to the sink node through different parent nodes at a certain probability, not only by selecting the preferred parent node, thus avoiding buffer overflow and reducing end-to-end delay. Finally, the two algorithms are combined to accommodate different application scenarios. The experimental results show that the proposed three improved schemes improve the reliability of the routing, extend the lifetime of the network, reduce the end-to-end delay, and reduce the number of DAG reconfiguration.

The multi-modal data fusion method based on IA-net and CHMM technical proposed is designed to solve the problem that the incompleteness of target behavior information in complex family environment leads to the low accuracy of human behavior recognition.The two improved neural networks(STA-ResNet50、STA-GoogleNet)are combined with LSTM to form two IA-Nets respectively to extract RGB and skeleton modal behavior features in video. The two modal feature sequences are input CHMM to construct the probability fusion model of multi-modal behavior recognition.The experimental results show that the human behavior recognition model proposed in this paper has higher accuracy than the previous fusion methods on HMDB51 and UCF101 datasets. New contributions: attention mechanism is introduced to improve the efficiency of video target feature extraction and utilization. A skeleton based feature extraction framework is proposed, which can be used for human behavior recognition in complex environment. In the field of human behavior recognition, probability theory and neural network are cleverly combined and applied, which provides a new method for multi-modal information fusion.

The robust fusion estimation problem of a multi-sensor system with communication constraints, random packet drops, d-step state delays, and deterministic control inputs is investigated. The state augmentation method is used to transform the time delay system into a non-time delay system, and then a robust fusion estimation algorithm based on sensitivity penalty is proposed and the pseudo-cross-covariance matrix is updated. An event-triggered robust fusion estimator with state delay and deterministic control inputs is considered to make the model closer to reality while effectively reducing network congestion and lowering communication costs. Conditions are given to ensure that the estimation errors of the robust fusion estimator are uniform boundedness. Two sets of numerical simulations are provided to illustrate the effectiveness of the derived fusion estimator.

Humans’ performance varies due to the mental resources that are available to successfully pursue a task. To monitor users’ current cognitive resources in naturalistic scenarios, it is essential to not only measure demands induced by the task itself but also consider situational and environmental influences. We conducted a multimodal study with 18 participants (nine female, M = 25.9 with SD = 3.8 years). In this study, we recorded, respiratory, ocular, cardiac, and brain activity using functional near-infrared spectroscopy (fNIRS) while participants performed an adapted version of the warship commander task with concurrent emotional speech distraction. We tested the feasibility of decoding the experienced mental effort with a multimodal machine learning architecture. The architecture comprised feature engineering, model optimisation, and model selection to combine multimodal measurements in a cross-subject classification. Our approach reduces possible overfitting and reliably distinguishes two different levels of mental effort. These findings contribute to the prediction of different states of mental effort and pave the way toward generalised state monitoring across individuals in realistic applications.

Aiming at the problems that are poor generalization performance, low retrieval accuracy and large time consumption of existing content-based image retrieval system, the hierarchical image retrieval method based on multi feature fusion is proposed in this paper. The retrieval accuracy rates on Corel5K, UKbeach and Holidays are 68.23(Top 1), 3.73(N-S) and 88.20(mAp), respectively. The experimental results show that the method proposed in this paper can effectively improve the deficiency of single feature retrieval and save time significantly in the premise of a small amount of loss of accuracy.

Gyroscopes are fascinating instruments with a history of about 200 years. When J.G.F. Bohnenberger presented his machine to his students in 1810 at the University of Tuebingen, Germany, nobody could have foreseen that this fascinating development would be used for complex orientation and positioning. At the University of Stuttgart, Germany, a collection of 160 exhibits is available and in transition for a sustainable future. Here, the systems are digitized in 2D, 2.5D and 3D and are made available for a world-wide community using OpenAccess platforms. The technologies being used are Computed Tomography, Computer Vision, Endoscopy and Photogrammetry. The workflows for combining voxel representations and colored point clouds are described, to create Digital Twins of the tangible assets. Advantages and disadvantages are discussed und work for near future is outlined in this new and challenging field of Tech Heritage digitization.

Gene regulation is vital for cellular function and homeostasis, involving diverse mechanisms controlling specific gene products and contributing to tissue-specific gene expression. Dysregulation leads to diseases, emphasizing the need for understanding these mechanisms. Non-coding regions, notably enhancers and super-enhancers (SEs), act as crucial gene regulators, orchestrating transcriptional activity via transcription factors (TFs). SEs, with high activity, are pivotal in cell identity and disease progression. Current computational approaches focus on individual regulators like TFs and miRNAs, neglecting SE interactions. We emphasize incorporating SEs into models to enhance understanding. Experimental studies have recently linked miRNAs and TFs to SEs. Chromatin immunoprecipitation followed by sequencing (ChIP-Seq) provides valuable SE information. In this review, we categorize computational methods leveraging TF and miRNA data into three areas and explore challenges integrating enhancers/SEs. These include unraveling indirect regulatory networks, identifying network motifs, and enriching pathway identification by dissecting gene regulators, including SEs. We hypothesize that addressing these challenges will enhance our understanding of gene regulation, aiding in identifying therapeutic targets and disease biomarkers. We believe that understanding the role of ChIP-Seq data in predicting the effect of miRNA on gene regulation is crucial to construct statistical/computational model that would tackle these challenges.

Pedestrian multi-target tracking technology plays an important role in artificial intelligence, driverless, virtual reality and other fields. The pedestrian multi-target tracking algorithm DeepSORT based on detection is widely used in industry. It mainly tracks multiple pedestrian targets continuously and keeps their ID unchanged. In order to improve the applicability and tracking accuracy of DeepSORT algorithm, this paper improved the IOU distance measurement in the matching process. At the same time, ResNet50 is used as the feature extraction backbone network, and combined with FPN (Feature Pyramid Network), the appearance features of multi-layer pedestrians are fused to improve the tracking accuracy of DeepSORT algorithm. The proposed algorithm is verified on the public data set MOT-16 and it’s tracking accuracy is enhanced to 4.1%.

A method for infrared and cameras sensor fusion, applied to indoor positioning in intelligent spaces, is proposed in this work. The fused position is obtained with a maximum likelihood estimator from infrared and camera independent observations. Specific models are proposed for variance propagation from infrared and camera observations (phase shifts and image respectively) to their respective position estimates and to the final fused estimation. Model simulations are compared with real measurements in a setup designed to validate the system. The difference between theoretical prediction and real measurements is between 0.4 cm (fusion) and 2.5 cm (camera), within a 95% confidence margin. The positioning precision is in the cm level (sub-cm level can be achieved at most tested positions) in a 4x3 m locating cell with 5 infrared detectors on the ceiling and one single camera, at distances from target up to 5 m and 7 m respectively. Due to the low cost system design and the results observed, the system is expected to be feasible and scalable to large real spaces.

Sensor fusion technology is one of extensive used methods in the field of robot, aerospace and target tracking control. In this paper, the generalized sensor fusion framework, named the closed-loop fusion (CLF) is analyzed and the optimal design principle of filter is proposed in detail. Fusion error optimization problem, which is the core issue of fusion design, is also solved better through the feedback compensation law of CLF framework. Differently from conventional methods, the fusion filter of CLF can be optimally designed and the determination of superposition of fusion information is avoided. To show the validity, simulation and experimental results are to be submitted.

This paper proposes a new approach for multi-focus images fusion based on Region Mosaicing on Contrast Pyramids (REMCP). A density-based region growing method is developed to construct a focused region mask for multi-focus images. The segmented focused region mask is decomposed into a mask pyramid, which is then used for supervised region mosaicking on a contrast pyramid. In this way, the focus measurement and the continuity of focused regions are incorporated and the pixel level pyramid fusion is improved at the region level. Objective and subjective experiments show that the proposed REMCP is more robust to noise than compared algorithms and can fully preserves the focus information of the multi-focus images meanwhile reducing distortions of the fused images.

This paper presents a new and enhanced fusion module for the Multi-Sensor Precipitation Estimator (MPE) that would objectively blend real-time satellite quantitative precipitation estimates (SQPE) with radar and gauge estimates. This module consists of a preprocessor that mitigates systematic bias in SQPE, and a two-way blending routine that statistically fuses adjusted SQPE with radar estimates. The preprocessor not only corrects systematic bias in SQPE, but also improves the spatial distribution of precipitation based on SQPE and makes it closely resemble that of radar-based observations. It uses a more sophisticated radar-satellite merging technique to blend preprocessed datasets, and provides a better overall QPE product. The performance of the new satellite-radar-gauge blending module is assessed using independent rain gauge data over a 5-year period between 2003-2007, and the assessment evaluates the accuracy of newly developed satellite-radar-gauge (SRG) blended products versus that of radar-gauge products (which represents MPE algorithm currently used in the NWS operations) over two regions: I) inside radar effective coverage and II) immediately outside radar coverage. The outcomes of the evaluation indicate a) ingest of SQPE over areas within effective radar coverage improve the quality of QPE by mitigating the errors in radar estimates in region I; and b) blending of radar, gauge, and satellite estimates over region II leads to reduction of errors relative to bias-corrected SQPE. In addition, the new module alleviates the discontinuities along the boundaries of radar effective coverage otherwise seen when SQPE is used directly to fill the areas outside of effective radar coverage.

Precision Agriculture is the ability to handle variations in productivity within a field and maximize financial return, optimize resource utilization and minimize impact of the environment. It is also the process of automated data collection, cloud storage and utilization to build robust decision support system. In case of Ethiopia, due to poor communication infrastructure coverage and absence of the state-of-the-art technology in the agriculture sector, implementing precision farming system is a challenging tasks in the domain area. In this work, we proposed a fusion of multiple sensors using IOT and IIOT infrastructure to collect critical data from farming fields to develop precision farming facility for decision makers. The main purpose was to monitor weather variability, automate irrigation process, extract critical soil properties. In addition, we have used time series data collected from sensor devices to build forecasting model. Fusion of multiple IoT device provide a mechanism in the agriculture area to deal with real-time monitoring of crops. It is cost-effective technology and required low-energy with edge computing sensor device. We employed the Message Queuing Telemetry Transport (MQTT) protocol to connect the Industrial/Internet of Things (I/IoT) to the cloud server. The communication between system user and sensor device has been done via cloud using Node-RED platform, web android APIs. The cloud-based Eco-system allows us to aggregate, visualize, and analyze live streams output from each sensor in real-time manner. Finally, we have built time series forecasting model using records collected by each sensor device. Using the multi-variate time series data-set, we have obtained about 99 forecasting accuracy on some important variables. Finally, we have developed mobile and web-based application for the end-user to monitor the proposed system remotely.

In this work, we propose an approach for the autonomous navigation of mobile robots using fusion of sensor data by a Double Deep Q-Network with collision avoidance by detecting moving people via computer vision techniques. We evaluate two data fusion methods for the proposed autonomous navigation approach: Interactive and Late fusion strategy. Both are used to integrate mobile robot sensors through the following sensors: GPS, IMU and, an RGB-D camera. The proposed collision avoidance module is implemented along with the sensor fusion architecture in order to prevent the autonomous mobile robot from colliding with moving people. The simulation results indicate a significant impact on the success of completing the proposed mission by the mobile robot with the fusion of sensors, indicating a performance increase (success rate) of 27% in relation to navigation without sensor fusion. With the addition of moving people in the environment, deploying the people detection and collision avoidance security module has improved about 14% the success rate when compared to that of the autonomous navigation approach without the security module. Video was developed with robot navigation using the DDQN-Late Fusion https://www.loom.com/share/684afa6a5b0148afadc9a200ab9f3483.

Water area segmentation in remote sensing is of great importance for flood monitoring. To overcome some challenges in this task, we construct the Water Index and Polarization Information (WIPI) multi-modality dataset and propose a multi-Modality Fusion and Gated multi-Filter U-Net (MFGF-UNet) convolutional neural network. The WIPI dataset enhances the water information and reduces the data dimension. In particular, the Cloud-Free label provided in the database effectively mitigates the issue of scarcity of labeled samples Since a single form or uniform kernel size cannot handle the variety in size and shape of water bodies, we proposed the gated multi-filter inception (GMF-Inception) module in our MFGF-UNet. Moreover, we utilize the attention mechanism by introducing the Gated Channel Transform (GCT) skip connection and integrating GCT into GMF- Inception to further improve model performance. Extensive experiments on three benchmarks, including WIPI, Chengdu and GF2020 datasets demonstrate that our method achieves favorable performance with lower complexity and better robustness against six competing approaches. For example, on WIPI, Chengdu and GF2020 datasets, the proposed MFGF-UNet model achieves F1 of 0.9191, 0.7410, and 0.8421, respectively, which average F1 on three datasets is 0.0045 higher than the U-Net model and reduces 62% average GFLOPs. New WIPI dataset, code and trained models have been released on GitHub

The monitoring of maternal and child health, using wearable devices made with wireless sensor technologies, is expected to reduce maternal and child death rates. Wireless sensor technologies have been used in wireless sensor networks to enable the acquisition of data for monitoring machines, smart cities, transportation, asset tracking, and tracking of human activity. Applications based on wireless body area network (WBAN) have been used in healthcare for measuring and monitoring of patient health and activity through integration with wearable devices. Wireless sensors used in WBAN can be cost-effective, enable remote availability, and can be integrated with electronic health record (EHR) management systems. Interoperability of WBAN sensor data with other linked data has the potential to improve health for all, including maternal and child health through the improvement of data access, data quality and healthcare access. This paper presents a survey of the state-of-the-art techniques for managing WBAN sensor data interoperability. The findings in this study will provide reliable support to enable policymakers and health care providers to take action to enhance the use of e-health to improve maternal-child health and reduce the mortality rates of women and children.

Recently, deep learning models have been widely applied to modulation recognition, which have become a hot topic due to their excellent end-to-end learning capabilities. However, current methods are mostly based on uni-modal inputs, which suffer from incomplete information and local optimization. To complement the advantages of different modalities, we focus on the multi-modal fusion method. Therefore, we introduce an iterative dual-scale attentional fusion (iDAF) method to integrate multimodal data. Firstly, two feature maps with different receptive field sizes are constructed using local and global embedding layers. Secondly, the feature inputs are iterated into the Iterative Dual Scale Attention Module (iDCAM), where the two branches capture the details of high-level features and the global weights of each modal channel, respectively. The iDAF not only extracts the recognition characteristics of each specific domains, but also complements the strengths of different modalities to obtain a fruitful view. Our iDAF achieves a recognition accuracy of 93.5\% at 10dB and 0.6232 at full SNR. The comparative experiments and ablation studies effectively demonstrate the effectiveness and superiority of the iDAF.

This paper applies a new artificial intelligence architecture, the Temporal Fusion Transformer (TFT), for the joint GDP forecasting of 25 OECD countries at different time horizons. This new attention-based architecture offers significant advantages over other deep learning methods. First, results are interpretable since the impact of each explanatory variable on each forecast can be calculated. Second, it allows to visualize persistent temporal patterns and to identify significant events and different regimes. Third, it provides quantile regressions and permits to train the model on multiple time series from different distributions. Results suggest that TFTs outperform regression models, especially in periods of turbulence such as the COVID-19 shock. Interesting economic interpretations are obtained depending on whether the country is domestic demand-led or export-led growth. In essence, TFT is revealed as a new tool that artificial intelligence provides to economists and policy makers, with enormous prospects for the future.

Land cover mapping provides spatial information on the physical properties of the Earth’s surface, for various classes of wetlands, artificial surface and constructions, vineyards, water bodies, etc. Having reliable information on land cover is crucial to developing solutions to a variety of environmental problems such as destruction of important wetlands/forests, and loss of fish and wildlife habitats. This has made land cover mapping one of the most widespread application areas in remote sensing computational imaging. However, due to the differences between modalities in terms of resolutions, content, and sensors, integrating complementary information that multi-modal remote sensing imagery exhibits into a robust and accurate system still remains challenging, and classical segmentation approaches generally do not give satisfactory results for land cover mapping. In this paper, we propose a novel dynamic deep network architecture, AMM-FuseNet, that promotes the use of multi-modal remote sensing images for the purpose of land cover mapping. The proposed network exploits the hybrid approach of the Channel Attention mechanism and Densely Connected Atrous Spatial Pyramid Pooling (DenseASPP). In the experimental analysis, in order to to verify the validity of the proposed method, we test AMM-FuseNet applied to four datasets whilst comparing it to the 6 state-of-the-art models of DeepLabV3+, PSPNet, UNet, SegNet, DenseASPP, and DANet. In addition, we also demonstrate the capability of AMM-FuseNet under minimal training supervision (reduced number of training samples) compared to the state-of-the-art, achieving less accuracy loss even for the case with 1/20 of the training samples.

Mapping forest extent and forest cover classification are important for the assessment of forest resources in socio-economic as well as ecological terms. Novel developments in the availability of remotely sensed data, computational resources, and advances in areas of statistical learning have enabled fusion of multi-sensor data, often yielding superior classification results. Most former studies of nemoral forests fusing multi-sensor and multi-temporal data have been limited in spatial extent and typically to a simple classification of landscapes into major land cover classes. We hypothesize that multi-temporal, multi-censor data will have a specific strength in further classification of nemoral forest landscapes owing to the distinct seasonal patterns of the phenology of broadleaves. This study aimed to classify the Danish landscape into forest/non-forest and further into forest types (broadleaved/coniferous) and species groups, using a cloud-based approach based on multi-temporal Sentinel 1 and 2 data and machine learning (random forest) trained with National Forest Inventory (NFI) data. Mapping of non-forest and forest resulted in producer accuracies of 99% and 90 %, respectively. The mapping of forest types (broadleaf and conifer) within the forested area resulted in producer accuracies of 95% for conifer and 96% for broadleaf forest. Tree species groups were classified with producer accuracies ranging 34-74%. Species groups with coniferous species were the least confused whereas the broadleaf groups, especially Oak, had higher error rates. The results are applied in Danish National accounting of greenhouse gas emissions from forests, resource assessment and assessment of forest biodiversity potentials.

The market for autonomous vehicles (AV) is expected to experience significant growth over the coming decades and to revolutionize the future of transportation and mobility. The AV is a vehicle that is capable of perceiving its environment and perform driving tasks safely and efficiently with little or no human intervention and is anticipated to eventually replace conventional vehicles. Self-driving vehicles employ various sensors to sense and perceive their surroundings and, also rely on advances in 5G communication technology to achieve this objective. Sensors are fundamental to the perception of surroundings and the development of sensor technologies associated with AVs has advanced at a significant pace in recent years. Despite remarkable advancements, sensors can still fail to operate as required, due to for example, hardware defects, noise and environment conditions. Hence, it is not desirable to rely on a single sensor for any autonomous driving task. The practical approaches shown in recent research is to incorporate multiple, complementary sensors to overcome the shortcomings of individual sensors operating independently. This article reviews the technical performance and capabilities of sensors applicable to autonomous vehicles, mainly focusing on vision cameras, LiDAR and Radar sensors. The review also considers the compatibility of sensors with various software systems enabling the multi-sensor fusion approach for obstacle detection. This review article concludes by highlighting some of the challenges and possible future research directions.

Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks(CNN) for face verification. In this work, we explore to use identification signal to supervise one CNN and the combination of semi-verification and identification to train the other one. In order to estimate semi-verification loss at a low computation cost, a circle, which is composed of all faces, is used for selecting face pairs from pairwise samples. In the process of face normalization, we propose to use different landmarks of faces to solve the problems caused by poses. And the final face representation is formed by the concatenating feature of each deep CNN after PCA reduction. What's more, each feature is a combination of multi-scale representations through making use of auxiliary classifiers. For the final verification, we only adopt the face representation of one region and one resolution of a face jointing Joint Bayesian classifier. Experiments show that our method can extract effective face representation with a small training dataset and our algorithm achieves 99.71% verification accuracy on LFW dataset.

Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localisation using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localisation system, MM-Loc, relying on zero hand-engineered features, learning them automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures is capable of estimating the location with good accuracy independently. But for better accuracy, a multimodal neural network fusing the features of early modality-specific representations is a better proposition. Our proposed MM-Loc solution is tested on cross-modality samples characterised by different sampling rates and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

Robotic odor source localization (OSL) is a technology that enables mobile robots or autonomous vehicles to find an odor source in unknown environments. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. While traditional OSL approaches primarily utilize an Olfaction-only strategy, guiding robots to find the odor source by tracing emitted odor plumes, our work introduces a fusion navigation algorithm that combines both vision and olfaction-based techniques. This hybrid approach addresses challenges such as turbulent airflow, which disrupts olfaction sensing, and physical obstacles inside the search area, which may impede vision detection. In this work, we propose a hierarchical control mechanism that dynamically shifts the robot’s search behavior among four strategies: crosswind maneuver, Obstacle-avoid Navigation, Vision-based Navigation, and Olfaction-based Navigation. Our methodology includes a custom-trained deep-learning model for visual target detection and a moth-inspired algorithm for Olfaction-based navigation. To assess the effectiveness of our approach, we implemented the proposed algorithm on a mobile robot in a search environment with obstacles. Experimental results demonstrate that our Vision and Olfaction Fusion algorithm significantly outperforms Vision-only and Olfaction-only methods, reducing average search time by 54% and 30%, respectively.

Purposes: To provide abdominal contrast-enhanced MR image synthesis, we developed an image gradient regularized multi-modal multi-discrimination sparse-attention fusion generative adversarial network (GRMM-GAN) to avoid repeated contrast injections to patients and facilitate adaptive monitoring. Methods: With IRB approval, 165 abdominal MR studies from 61 liver cancer patients were retrospectively solicited from our institutional database. Each study included T2, T1 pre-contrast (T1pre), and T1 contrast-enhanced (T1ce) images. The GRMM-GAN synthesis pipeline consists of a sparse attention fusion network, an image gradient regularizer (GR), and a generative adversarial network with multi-discrimination. The studies were randomly divided into 115 for training, 20 for validation, and 30 for testing. The two pre-contrast MR modalities, T2 and T1pre images, were adopted as inputs in the training phase. The T1ce image at the portal venous phase was used as an output. The synthesized T1ce images were compared with the ground truth T1ce images. The evaluation metrics include peak signal-to-noise ratio (PSNR), structural-similarity-index (SSIM), and mean-squared-error (MSE). A Turing test and experts’ contours evaluated the image synthesis quality. Results: The proposed GRMM-GAN model achieved a PSNR of 28.56, an SSIM of 0.869, and an MSE of 83.27. The proposed model showed statistically significant improvements in all metrics tested with p-values <0.05 over the state-of-the-art model comparisons. The average Turing test score was 52.33%, close to random guessing, supporting the model's effectiveness for clinical application. In the tumor-specific region analysis, the average tumor contrast-to-noise ratio (CNR) of the synthesized MR images was not statistically significant from the real MR images. The average DICE from real vs. synthetic images was 0.90, compared to the inter-operator DICE of 0.91. Conclusion: We demonstrated the function of a novel multi-modal MR image synthesis neural network, GRMM-GAN, for T1ce MR synthesis based on pre-contrast T1 and T2 MR images. GRMM-GAN shows promise for avoiding repeated contrast injections during radiation therapy treatment.

In this paper, a multi-mode waveguide-based optical resonator is proposed for an integrated optical refractive index sensor. Conventional optical resonators have been studied for single-mode waveguide-based resonators to enhance the performance, but mass production is limited owing to the high fabrication costs of nano-scale structures. To overcome this problem, we designed an S-bend resonator based on a micro-scale multi-mode waveguide. In general, multi-mode waveguides cannot be utilized as optical resonators, because of a performance degradation resulting from modal dispersion and an output transmission with multi-peaks. Therefore, we exploited the mode discrimination phenomenon using the bending loss, and the resulting S-bend resonator yielded an output transmission without multi-peaks. This phenomenon is utilized to remove higher-order modes efficiently using the difference in the effective refractive index between the higher-order and fundamental modes. As a result, the resonator achieved a Q-factor and sensitivity of 2.3x10³ and 52 nm/RIU, respectively, using the variational finite-difference time-domain method. These results show that the multi-mode waveguide-based S-bend resonator with a wide line width can be utilized as a refractive index sensor.

The satellite Earth observation (EO) sector is burgeoning with hundreds of commercial satellites being launched each year, delivering a rich source of data that could be exploited for societal benefit. Data streams from the growing constellation of commercial satellites are of variable quality, limiting the potential for their combined use in science applications that need long time-series data from multiple sources. The quality of calibration performed on optical sensors onboard many satellite systems is highly variable due to calibration methods, sensor design, mission objective, budget, or other operational constraints. A small number of currently operating well-characterised satellite systems with onboard calibration, such as Landsat-8/9, Sentinel-2, and planned future missions like the NASA Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder, the European Space Agency (ESA) Traceable Radiometry Underpinning Terrestrial and Helio Studies (TRUTHS), and LIBRA from China, are considered benchmarks for optical data quality due to their traceability to international measurement standards. This paper describes the concept of a space-based transfer calibration radiometer called the Satellite Cross-Calibration Radiometer (SCR) that would enable the calibration parameters from satellites such as Landsat-8/9, Sentinel-2, or other benchmark systems to be transferred to a range of commercial optical EO satellite systems while in orbit. A description of the key characteristics of the SCR to successfully operate in orbit and transfer calibration from Reference systems to Client systems is presented. A system like the SCR in orbit could complement SI-Traceable satellites (SITSats) to improve data quality and consistency and facilitate the interoperable use of data from multiple optical sensor systems for delivering higher returns on the global investment in EO.

Often, engineers with machining experience often judge machining state and tool life according to chips’ features. Engineers' experience is digitized in this study. During the cutting process, the cutting tool coming in contact with the workpiece produces a shear zone, which causes plastic deformation and shear slip. The chips closest to the shear zone can directly show the state of the tool and workpiece when the material is SKD61. This study used chip color, vibration, and current signal integration for prediction of machining state and cutting tool life. When the cutting tool wears increased, the chip surface color changed in the following way: purpleè purple blueè blue ècyan, or even green and yellow. When the cutting tool was in the accelerating wear phase, the color change was particularly obvious. The Back-Propagation Levenberg–Marquardt (BP-LM) predictive methodology was used to compare the predictive ability of voltage, vibration signal, and chip color. The Mean Absolute Percentage Error (MAPE) for the voltage signal was 12.28%, for the vibration signal it was 11.38%, and for the chip color combined with multi-sensor characteristics it was 7.85%. The MAPE of the chip color was the smallest. Using the General Regression Neural Network (GRNN) methodology, the MAPE for the voltage signal was 10.74%, for the vibration signal 7.96%, and for the chip color combined with multi-sensor characteristics was 6.59%. The MAPE of the chip color was the smallest. Obviously, the chip color combined with multi-sensor signals provided better predictive results than the vibration signal or voltage signal alone. There is currently no research on the usefulness of monitoring chip color for tool life prediction.

AVs suffer reduced maneuverability and performance due to the degradation in sensor performances in fog. Such degradation causes significant object detection errors essential for AVs' safety-critical conditions. For instance, YOLOv5 performs significantly well under favorable weather but suffers miss detections and false positives due to atmospheric scattering caused by fog particles. Existing deep object detection techniques often exhibit a high degree of accuracy. The drawback is being sluggish at object detection in fog. Object detection methods with fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persist. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar's object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image on the camera image. Using the attention mechanism, we emphasized and improved important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our result shows that the proposed method significantly enhances the detection of distant and small objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed with an accuracy of 0.849 at 69 fps.

In the framework of maritime surveillance, vessel detection techniques based on spaceborne Synthetic Aperture Radar (SAR) images have promoted extensive applications for the effective understanding of unlawful activities at sea. The paper deal with this topic presenting a novel approach exploiting a cascade application of a pre-screening, and discrimination phase. The latter leverage the SAR spectrum by means of sub-looks analysis. For the first time, the method has been validated with experiments on multi-frequency (C-, X-, and L-band) SAR images. For a future syngergic exploitation of more SAR missions, the developed dataset, composed of Sentinel-1, SAOCOM and COSMO-SkyMed images, is comprehensive of multiple images gathered over the same area with short time lag (below 15 minutes). Finally, the diversified processing chains and the results for each mission product and scenarios are discussed. Being the first dataset of SLC (Single Look Complex) SAR multi-frequency data, the present work intends to encourage additional research in this promising field of research.

Digital Elevation Models (DEMs) are widely used in geographic and environmental studies. In the current work, the fusion of multi-source DEMs is investigated to improve the overall accuracy of public domain DEMs. Multi-scale decomposition is an important analytical method in data fusion. Three multi-scale decomposition methods – the wavelet transform (WT), bidimensional empirical mode decomposition (BEMD) and nonlinear adaptive multi-scale decomposition (N-AMD) - are applied to the 1-arc-second Shuttle Radar Topography Mission Global digital elevation model (SRTM-1 DEM) and the Advanced Land Observing Satellite World 3D – 30 m digital surface model (AW3D30 DSM) in China. Of these, the WT and BEMD are popular image fusion methods. A new approach for DEM fusion is developed using N-AMD (which is originally invented to remove the cycle from sunspots). Subsequently, a window-based rule is proposed for the fusion of corresponding frequency components obtained by these methods. Quantitative results show that N-AMD is more suitable for multi-scale fusion of multi-source DEMs, taking the ice cloud and land elevation satellite (ICESat) global land surface altimetry data as a reference. The vertical accuracy of the fused DEM shows significant improvements of 29.6% and 19.3% in a mountainous region and 27.4% and 15.5% in a low-relief region, compared to the SRTM-1 and AW3D30 respectively. Furthermore, a slope position-based linear regression method is developed to calibrate the fused DEM for different slope position classes, by investigating the distribution of the fused DEM error with topography. The results indicate that the accuracy of the DEM calibrated by this method is improved by 16% and 13.6%, compared to the fused DEM in the mountainous region and low-relief region respectively, proving that it is a practical and simple means of further increasing the accuracy of the fused DEM.

In response to reducing the energy cost of unmanned surface vehicles (USVs) while overcoming the low accuracy problem in surface target detection, a lightweight detection algorithm with multi-scale feature fusion is proposed. Based on the popular one-stage lightweight Yolov7-tiny target detection model, a lightweight extraction module is designed first by introducing the multiscale residual module to reduce the number of parameters and computational complexity while improving accuracy. The Mish and SiLU activation functions are used to enhance network feature extraction. Second, the path aggregation network employs coordinate convolution to strengthen spatial information perception. Finally, the dynamic head, which is based on the at-tention mechanism, improves the representation ability of object detection heads without any computational overhead. According to the experimental findings, the proposed model has 22.1% fewer parameters than the original model, 15% fewer GFLOPs, a 6.2% improvement in mAP@0.5, a 4.3% rise in mAP@0.5:0.95, and it satisfies the real-time criteria. According to the research, the suggested lightweight water surface detection approach includes a lighter model, a simpler computational architecture, more accuracy, and a wide range of generalizability. It performs bet-ter in a variety of difficult water surface circumstances.

The essence of cross-modal generation and retrieval modeling for image-text interactions lies in semantic consistency. Among these, cross-modal representation alignment serves as the foundational requirement for achieving cross-modal semantic consistency. The crux of our proposed method entails the collaborative training of an image captioning model(referred to as the ’captioner’) and a pair of contrastive encoders for image-text matching(referred to as the ’concoder’). This synergistic approach yields concurrent enhancements in concoder’s performance, captioner’s proficiency, and cross-modal semantic coherence. We coin the proposed method as ‘ReCap’. To begin, we initialize the concoder through knowledge distillation from a pre-trained model. During the training process, we use the output of the initialized concoder as input to a residual attention network, jointly training it with the captioner to achieve semantic consistency. Subsequently, we iteratively update the concoder during the image-text momentum encoding phase using the residual attention network, creating a closed-loop for semantic consistency resolution. Upon completion of training, the concoder and captioner modules can be used independently to perform tasks related to cross-modal retrieval and cross-modal generation of text and images. In order to substantiate the efficacy of our proposed method, we initially conducted empirical experiments encompassing image-text retrieval and image captioning tasks, employing a widely recognized benchmark dataset, MSCOCO. Subsequently, we assessed the fine-grained cross-modal alignment performance of the concoder through an image classification task on the iNaturalist 2018 dataset. The achieved performance metrics notably surpassed those achieved by several incumbent state-of-the-art models, thus validating the proficiency of our method. Finally, motivated by the practical requirements of handling the nature conservation image data, we performed caption annotation for the iNaturalist 2018 dataset. Subsequently, we trained the ReCap on this annotated data. Experimental results demonstrate that our proposed method can maintain semantic consistency between cross-modal retrieval and image caption generation for species with similar visual features but distinct semantics. This achievement signifies a meaningful exploration in the field of cross-modal semantic consistency representation, holding significant practical value in the domain of biological research.

Visual Sensor Networks (VSNs) have been the focus of numerous studies, emphasizing the quality of the information they generate. The primary goal of these networks is to capture data from an area, extract the pertinent information from the visual scene, and facilitate communication. However, the presence of objects in the study area can impacted the network's efficiency, linking the quality of acquired data directly to the positioning of the cameras. Strategically positioning multiple cameras in a potentially complex area, while ensuring effective communication between nodes, presents a challenging issue in VSNs applications. This paper introduces a specific method to enhance the deployment of visual sensors in indoor environments. The research addresses the theme of multi-objective optimization of VSN deployment, integrating various criteria: maximizing overall visual coverage, maximizing the observation of zones of interest, maximizing observation redundancy of zones of interest and ensuring communication connectivity for data transfers. To tackle this problem, we simulate the observed environment incorporating cameras, obstacles, and considering zones of interest. Camera positioning is performed while considering visual constraints and the scene's characteristics. The quality of positioning is evaluated based on the defined objective functions. Initially, a comparative study is conducted with a state-of-the-art approach, integrating the first three objective functions. Subsequently, we incorporate the fourth objective function to ensure data transfers. The proposed method demonstrates efficient camera network deployments in indoor areas, considering global coverage and observation redundancy. In contrast to the state-of-the-art, these results are achieved in areas with visual obstacles while ensuring communication connectivity between the different cameras.

Multiple sensor nodes known as detection stations make the sensor networks; each node is light and portable. Every sensor node contains power source, microcomputer, transducer and transceiver. Power source provides power to each node. Micro-computer is used for storing and processing the output coming from the sensors. The transducer is used to generate the signals and the transceiver is used to receive and transmit data to the central computer. Eavesdropping gets facilitated with wireless communication, and it has many useful applications in military, homeland, hostile and uncontrolled environments. So it is prone to the high level of security. The process in which information is gathered to form a summarized type for analysis is known as data aggregation, as it is used to reduce the energy consumption in wireless sensor networks. The security issues have become crucial in data aggregation, especially when gets deployed in hostile and remote environment. In wireless sensor networks many secure aggregations have been proposed. It still faces some resource constrained that’s why new techniques are needed. In our survey we will discuss those approaches and their pros and cons.

The central goal of few-shot scene classification is to learn a model that can generalize well to a novel scene category (UNSEEN) from only one or a few labeled examples. Recent works in the remote sensing (RS) community tackle this challenge by developing algorithms in a meta-learning manner. However, most prior approaches have either focused on rapidly optimizing a meta-learner or aimed at finding good similarity metrics while overlooking the embedding power. Here we propose a novel Task-Adaptive Embedding Learning (TAEL) framework that complements the existing methods by giving full play to feature embedding’s dual roles in few-shot scene classification - representing images and constructing classifiers in the embedding space. First, we design a lightweight network that enriches the diversity and expressive capacity of embeddings by dynamically fusing information from multiple kernels. Second, we present a task-adaptive strategy that helps to generate more discriminative representations by transforming the universal embeddings into task-specific embeddings via a self-attention mechanism. We evaluate our model in the standard few-shot learning setting on two challenging datasets: NWPU-RESISC4 and RSD46-WHU. Experimental results demonstrate that, on all tasks, our method achieves state-of-the-art performance by a significant margin.

This article proposes the use of a multi-scale and multi-sensor approach to collect and modelling 3D data concerning wide and complex areas in order to obtain a variety of metric information in the same 3D archive, based on a single coordinate system. The employment of these 3D georeferenced products is multifaceted and the fusion or integration among different sensors data, scales and resolutions is promising and could be useful for the generation of a model that could be defined as hybrid. The correct geometry, accuracy, radiometry and weight of the data models are hereby evaluated comparing integrated processes and results from Terrestrial Laser Scanner (TLS), Mobile Mapping System (MMS), Unmanned Aerial Vehicle (UAV), terrestrial photogrammetry, using Total Station (TS) and Global Navigation Satellite System (GNSS) as topographic survey. The entire analysis underlines the potentiality of the integration and fusion of different solutions and is a crucial part of the “Torino 1911” project whose main purpose is mapping and virtually reconstructing the 1911 Great Exhibition settled in the Valentino Park in Turin (Italy).

The nature of contemporary Spatial Data Infrastructures lies in the provision of geospatial information in an on-demand fashion. Though recent applications identified the need to react to real-time information in a time-critical way. In particular, research efforts in the field of geospatial Internet of Things have identified substantial gaps in this context, ranging from a lack of standardization for event-based architectures to the meaningful handling of real-time information as ''events''. This manuscript presents work in the field of Event-driven Spatial Data Infrastructures with a particular focus on sensor networks and the devices capturing in-situ measurements. The current landscape of Spatial Data Infrastructures is outlined and used as the basis for identifying existing gaps that retain certain geospatial applications from using real-time information. We present a selection of approaches - developed in different research projects - to overcome these gaps. Being designed for specific application domains, these approaches share commonalities as well as orthogonal solutions and can build the foundation of an overall Event-driven Spatial Data Infrastructure.

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled colour correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields better edge and contrast enhancement results without halo effect, colour degradation and is faster and more adaptive than all other algorithms from the literature.

Metabolomics deals with multiple and complex chemical reactions within living organisms and how these are influenced by external or internal perturbations. It lies at the heart of omics profiling technologies not only as the underlying biochemical layer that reflects information expressed by the genome, the transcriptome and the proteome, but also as the closest layer to the phenome. The combination of metabolomics data with the information available from genomics, transcriptomics, and proteomics offers unprecedented possibilities to enhance current understanding of biological functions, elucidate their underlying mechanisms and uncover hidden associations between omics variables. As a result, a vast array of computational tools have been developed to assist with integrative analysis of metabolomics data with different omics. Here, we review and propose five criteria – hypothesis, data types, strategies, study design and study focus – to classify statistical multi-omics data integration approaches into state-of-the-art classes under which all existing statistical methods fall. The purpose of this review is to look at various aspects that lead the choice of the statistical integrative analysis pipeline in terms of the different classes. We will draw a particular attention to metabolomics and genomics data to assist those new to this field in the choice of the integrative analysis pipeline.

Rollover prevention of partially-filled tank trucks is an industry teaser, with the core challenge being real-time perception and observation of the liquid state inside the tank. In order realize re-liable observation of sloshing liquid, this article firstly proposes a sloshing modeling method based on multi-degree-of-freedom pendulum model, and derives the double mass trammel pendulum model (DMTP, 2DOF) accordingly, which accurately reflects the sloshing dynamics under more pervasive working conditions. Secondly, a free surface fluctuation sensor is designed based on magnetostriction, capable of measuring the inclination and height of the liquid level inside tanks filled with hazardous chemical. Finally, the unscented Kalman filter (UKF) is utilized to synthesize the information of the two, establishing a credible real-time observation of the sloshing liquid. Verified through vehicle-fluid coupled co-simulation, under condition of con-secutive double lane change, observation error of the proposed method is only 25.9% that of the open-loop calculation, providing a secure guarantee for the observation of the state variables of the single pendulum model (SP) used for most kinds of anti-rollover controller.

Unmanned construction machinery vehicles mostly carry work in bridges, tunnels, and outdoor open spaces. Obtaining accurate pose estimation of the entire vehicle and establishing a map of the surrounding environment is of great significance for path planning and control in the later stage. Traditional simultaneous localization and mapping (SLAM) schemes, which mostly use a single sensor, but there are problems with localization drift and mapping failure in scenarios where there are few geometric features and the environment is prone to degradation. Currently, the multi-sensor fusion strategy has been proven to be an effective solution and widely used in the field of unmanned vehicle localization and mapping. This paper proposes a SLAM framework that tightly couples a LiDAR, IMU and camera to achieve accurate and reliable pose estimation. The framework is based on LiDAR-inertial system(LIS) and factor graph optimization theory. Texture information provided by vision is integrated into the LiDAR-inertial odometry to generate a new visual-inertial subsystem(VIS).The two subsystems, VIS and LIS, can assist each other and work jointly. Through real vehicle tests, the system can perform incremental, real-time state estimation, reconstruct dense 3D point cloud maps,and effectively solve the problems of localization drift and mapping failure in the lack of geometric features or challenging construction environments. Meanwhile, the system has a safety redundancy mechanism. When any subsystem fails, the system can also operate normally, to ensure the reliability and robustness of vehicle positioning.

Big Data in medicine includes possibly fast processing of large data sets, both current and historical in purpose supporting the diagnosis and therapy of patients' diseases. Support systems for these activities may include pre-programmed rules based on data obtained from the interview medical and automatic analysis of test results diagnostic results will lead to classification of observations to a specific disease entity. The current revolution using Big Data significantly expands the role of computer science in achieving these goals, which is why we propose a Big Data computer data processing system using artificial intelligence to analyze and process medical images.

In this work, a systematic study was conducted on the fabrication of multi-material components obtained employing Laser-Powder Bed Fusion (L-PBF) technology. The idea of making multi-material components is a winning capability of additive technologies because it allows the fabrication of Functionally Graded Materials (FGMs) with the customization of parts according to different required properties. The transition from one material to another was achieved gradually and continuously within the same layer using ad-hoc equipment designed for L-PBF systems with a powder spreading technique based on coaters or rollers. The influence of the relative position of the different materials within the powder chamber and the geometry of the developed equipment on the metallurgical and mechanical properties of the manufactured samples was evaluated. The performed tests involved the use of two materials, a nickel-based superalloy, and a stainless steel, having different chemical, physical and mechanical properties to obtain gradual properties variation in the manufactured samples. Based on the results of post-process characterization obtained through metallographic, chemical, and mechanical analysis, the relative positions of the materials and the geometry of the developed equipment have a limited effect on the sample’s manufactured properties. The characteristics of the FGM zone depend on the nature of the employed powders, and its extent coincides with that defined during the design of the divider.

Gender recognition is trivial for physiotherapist, but it is considered a challenge for computers. The electromyography (EMG) and heart rate variability (HRV) were utilized in this work for gender recognition during the stepping exercise using a stepper. The relevant features were extracted and selected. The selected features were then fused to automatically predict gender recognition. However, the feature selection for gender classification became a challenge to ensure better accuracy. Thus, in this paper, a feature selection approach based on both the performance and the diversity between the two features from the rank-score characteristic (RSC) function in a combinatorial fusion approach (CFA) was employed. Then, the features from the selected feature sets were fused using a CFA. The results were then compared with other fusion techniques such as naive bayes (NB), decision tree (J48), k-nearest neighbor (KNN) and support vector machine (SMO). Besides, the results were also compared with previous researches in gender recognition. The experimental results showed that the CFA was efficient for feature selection. The fusion method was also able to improve the accuracy of the gender recognition rate. The CFA provides much better gender classification results which is 94.51% compared to Nazarloo's work (90.34%) and other classifiers.

In recent years, how to combine intelligent prospecting algorithms such as random forest with a large number of geological and mineral data for quantitative prediction of exploration geochemistry has become an important topic of concern to quantitatively improve the accuracy of target delineation. The ore-forming geological conditions in the central Kunlun area of Xinjiang are great and have good prospecting prospects. However, due to the exhaustion of shallow deposits and the lag of geological prospecting work in the past ten years, there has been no expected breakthrough in the search for large and super-large metal deposits for many years. There has been a serious shortage of reserve resources. The use of new theories, new methods and new technologies for mineral resources investigation and evaluation has become an urgent need in the current prospecting work. In view of this, based on the existing spatial database of geological and mineral resources in the central Kunlun of Xinjiang, combined with the geological characteristics, genesis and metallogenic regularity of the area, this paper carried out a series of studies on gold polymetallic minerals with the help of geographic information system and data science programming software platform. The researchers integrated geological and regional geochemical data, and constructed a random forest metallogenic discriminant model based on two different sampling methods (integrated random undersampling and selection of training samples) to predict the mineralization of gold polymetallic minerals in the central Kunlun area of Xinjiang and delineate the metallogenic target area. The quantitative prediction of gold polymetallic mineral resources in the central Kunlun area of Xinjiang by two random forest models is compared and discussed: the known ore spots, fault structures and geochemical information are extracted, and the known gold polymetallic ore spots and geochemical data are used to form a training set and a prediction set to construct a machine learning random forest model. The results of prediction evaluation and metallogenic prospect division show that for different sampling methods, the performance evaluation parameters of the training process show that the prediction accuracy of the selected training samples is higher, and the selected training samples are more reliable because they can fully learn the complex information of the original data. In the metallogenic prospect prediction and metallogenic potential division, the random forest model of selecting training samples has more reference value and further exploration research significance in the production problem considering the actual exploration cost because of its small area of high potential prediction area and high proportion of ore bearing per unit area. At the same time, this study innovatively improves the prediction accuracy, reduces the exploration risk, and expands the prospecting idea of machine learning algorithm in mathematical geology in the central Kunlun area of Xinjiang. The delineated metallogenic potential area has positive guiding significance for the actual gold polymetallic prospecting work in this area.

Drone and aerial remote sensing images are widely used, but their imaging environment is complex and prone to image blurring. Existing CNN deblurring algorithms usually use multi-scale fusion to extract features in order to make full use of aerial remote sensing blurred image information, but images with different degrees of blurring use the same weights, leading to increasing errors in the feature fusion process layer by layer. Based on the physical properties of image blurring, this paper proposes an adaptive multi-scale fusion blind deblurred generative adversarial network (AMD-GAN), which innovatively applies the degree of image blurring to guide the adjustment of the weights of multi-scale fusion, effectively suppressing the errors in the multi-scale fusion process and enhancing the interpretability of the feature layer. The research work in this paper reveals the necessity and effectiveness of a priori information on image blurring levels in image deblurring tasks. By studying and exploring the image blurring levels, the network model focuses more on the basic physical features of image blurring. Meanwhile, this paper proposes an image blurring degree description model, which can effectively represent the blurring degree of aerial remote sensing images. The comparison experiments show that the algorithm in this paper can effectively recover images with different degrees of blur, obtain high-quality images with clear texture details, outperform the comparison algorithm in both qualitative and quantitative evaluation, and can effectively improve the object detection performance of aerial remote sensing blurred images. Moreover, the average PSNR of this paper's algorithm tested on the publicly available dataset RealBlur-R reached 41.02dB, surpassing the latest SOTA algorithm.

This paper focuses on optimal sensor positioning for monitoring activities of daily living and investigates different combinations of features and models on different sensor positions, i.e., the side of the waist, front of the waist, chest, thigh, head, upper arm, wrist, and ankle. Sixteen features are extracted and the feature importance is measured by using the Relief-F feature selection algorithm. Eight classification algorithms are evaluated on a dataset collected from young subjects and that collected from elderly subjects, with two different experimental settings. To deal with different sampling rates, signals with a high data rate are down-sampled and a transformation matrix is used for aligning signals to the same coordinate system. The thigh, chest, side of the waist, and front of the waist are the best four sensor positions for the first dataset (young subjects), with average accuracy values being greater than 95%. The best model obtained from the first dataset for the side of the waist is validated on the second dataset (elderly subjects). The most appropriate number of features for each sensor position is reported. The results provide a reference for building activity recognition models for different sensor positions, as well as for data acquired from different hardware platforms and subject groups.

In this paper, an ultracompact combined sensor for displacement and angle synchronous measurement is proposed based on self-imaging effect of optical microgratings. Using a two-grating structure, linear and angular displacement can be measured by detecting the change of phase and amplitude of the optical transmission respectively within one single structure in meantime. The optical transmitted properties of the two-grating structure are investigated in both theory and simulation. Simulated results indicate that, the optical transmission changes in a sinusoidal relationship to the input linear displacement. Meanwhile, the amplitude of the curve decreases with an input pitch angle, indicating the ability for synchronous measurement within one single compact structure. The synchronous measurement of the linear displacement and the angle is also demonstrated experimentally. The results show a resolution down to 4nm for linear displacement measurement, and a sensitivity of 0.26mV/arcsec within a range of ±1° for angle measurement. Benefitting from a simple common-path structure without using optical components including reflectors and polarizers, the sensor shows an ultrahigh compactness for multiple-degrees-of-freedom measuring, indicating the great potential for this sensor in the fields such as integrated mechanical positioning and semiconductor fabrication.

Drones have been used in a variety of scenarios such as atmospheric monitoring, fire rescue, agricultural irrigation, etc., in which accurate environmental perception is of crucial importance for both decision-making and control. Among the drone sensors, the RGB camera is indispensable for capturing rich visual information for vehicle navigation but encounters a grand challenge in high-dynamic-range scenes that occur frequently in real applications. Specifically, the recorded frames suffer from under-exposure and over-exposure simultaneously and degenerate the successive vision tasks. To solve the problem, we take object tracking as an example and leverage the superior response of event cameras over a large intensity range to propose an event-assisted object tracking algorithm that can achieve reliable tracking under large intensity variations. Specifically, we propose to pursue feature matching from dense event signals, and based on which to (i) design a UNet-based image enhancement algorithm to balance the RGB intensity with the help of neighboring frames in the time domain, and then (ii) construct a dual-input tracking model to track the moving objects from intensity balanced RGB video and event sequence. The proposed approach is comprehensively validated in both simulation and real experiments.

Distributed fiber optic vibration sensors based on Φ-OTDR using Rayleigh backscattering of highly coherent light source pulses are very popular type in the area of sensors due to many attractive features, mainly due to its distributed manner of sensing, i.e. they can operate as thousands of local sensors simultaneously. The paper summarizes and describes several important modifications of the original sensor scheme to enhance its key performance parameters and to extend its application potential. A multi-fiber sensor form was proposed. Single- and two-fiber sensors were designed, constructed and tested both in the laboratory and in a real environment. Variants of two-fiber sensor utilizing optical switches for the sensor flexibility enhancement are proposed and their applications are described.

Wireless Sensor Networks (WSN) is designed to collect information across a large number of limited battery sensor nodes. Therefore, it is important to minimize the energy consumption of each node, which leads to the extension of the network life. Our goal is to design an intelligent WSN that collects as much information as possible to process it intelligently. To achieve this goal, an agent has been migrated to each node in order to process the information and to cooperate with these neighboring nodes while Mobile Agents (MA) can be used to reduce information between nodes and send those to the base station (Sink). This work proposes to use communication architecture for wireless sensor networks based on the Multi Agent System (MAS) to ensure optimal information collection. The collaboration of these agents generates a simple message that summarizes the important information in order to transmit it by a mobile agent. To reduce the size of the MA, the nodes of the network have been grouped into sector. As for each MA, we have established an optimal itinerary, consuming a minimum amount of energy with the data aggregation efficiency in a minimum time. Successive simulations in large scale wireless sensor networks through the SINALGO simulator show the performance of our proposal, in terms of energy consumption and package delivery rate.

Continuous object tracking in WSNs, such as monitoring of mud-rock flows, forest fires etc., is a challenging task due to characteristic nature of continuous objects. They can appear randomly in the network field, move continuously, and can change in size and shape. Monitoring such objects in real-time generally require tremendous amount of messaging between sensor nodes to synergistically estimate object’s movement and track its location. In this paper, we propose a novel twofold-sink mechanism, comprising of a mobile and a static sink node. Both sink nodes gather information about boundary sensor nodes, which is then used to uniformly distribute energy consumption across all network nodes, thus helping in saving residual energy of network nodes. Numerous object tracking schemes, using mobile sink, have been proposed in the literature. However, existing schemes employing mobile sink cannot be applied to track continuous objects, because of momentous variation of network topology. Therefore, we present in this paper a mechanism, transformed from K-means algorithm, to find the best sensing location of the mobile sink node. It helps to reduce transmission load on the intermediate network nodes situated between static sink node and the ordinary network sensing nodes. The simulation results show that the proposed scheme can distinctly improve life time of the network, compared to one-sink protocol employed in continuous object tracking.

A multi-decadal change analysis of the irrigation ponds in Taoyuan, Taiwan was conducted by using multi-source data including digitized ancient maps, declassified single-band CORONA satellite images, and multispectral SPOT images. Supervised LULC classifications were conducted using four textural features derived from the single-band CORONA images and spectral features derived from SPOT images. Post-classification analysis revealed that the number of irrigation ponds in the study area decreased during the post-World War II farmland consolidation period (1945 – 1965) and the subsequent industrialization period (1970 – 2000). However, efforts on restoration of irrigation ponds in recent years have resulted in gradual increases in the number (9%) and total area (12%) of irrigation ponds in the study area.

Traditional soil characterization methods are time consuming, laborious and invasive and do not allow long-term repeatability of measurements. The overall aim of this paper was to assess and model spatial variability of the soil in an olive grove in south Italy by using data from two sensors of different type: a multi-spectral on-board drone radiometer and a hyperspectral visible-near infrared-shortwave infrared (VIS-NIR-SWIR) reflectance radiometer as well as sample data, to arrive at a delineation of homogeneous areas. The hyperspectral data were processed using continuum removal methodology to obtain information about the content and composition of clay. Differently, the multispectral data were firstly upscaled to the support of soil data using geostatistics and taking into account change of support. Secondly, the two-sensor data were integrated with soil granulometric properties by using the multivariate geostatistical techniques of multi-collocated cokriging and factor cokriging, in order to achieve a more exhaustive and finer-scale soil characterisation. The paper shows the impact of change of support on the uncertainty of soil prediction that can have a significant effect on decision making in Precision Agriculture. Moreover, four regionalised factors at two different scales (two per each scale) were retained and mapped. Each factor provided a different delineation of the field with areas characterised by different granulometry and clay composition. The applied method is sufficiently flexible and could be applied to any number and type of sensors.

A waterbody detection technique is an essential part of digital elevation model (DEM) generation to delineate land-water boundaries and set flattened elevations. This paper describes the technical methodology for improving the initial tile-based waterbody data that are created during production of the ASTER GDEM, because without improvement such tile-based waterbody data are not suitable for incorporating into the new ASTER GDEM Version 3. Waterbodies are classified into three categories: sea, lake, and river. For sea-waterbodies, the effect of sea ice is removed to better delineate sea shorelines in high latitude areas, because sea ice prevents accurate delineation of sea shorelines. For lake-waterbodies, the major part of the processing is to set the unique elevation value for each lake using a mosaic image that covers the entire lake area. Rivers present a unique challenge, because their elevations gradually step down from upstream to downstream. Initially, visual inspection is required to separate rivers from lakes. A stepwise elevation assignment, with a step of one meter, is carried out by manual or automated methods, depending on the situation. The ASTER GWBD product consists of a global set of 1º latitude-by-1º longitude tiles containing water body attribute and elevation data files in geographic latitude and longitude coordinates and with one arc second posting. Each tile contains 3601-by-3601 data points. All improved waterbody elevation data are incorporated into the ASTER GDEM to reflect the improved results.

Linear regression is a basic tool in mobile robotics, since it enables accurate estimation of straight lines from range-bearing scans or in digital images, which is a prerequisite for reliable data association and sensor fusing in the context of feature-based SLAM. This paper discusses, extends and compares existing algorithms for line fitting applicable also in case of strong covariances between the coordinates at each single data point, which must not be neglected if range-bearing sensors are used. Besides, particularly the determination of the covariance matrix is considered, which is required for stochastic modeling. The main contribution is a new error model of straight lines in closed form for calculating fast and reliably the covariance matrix dependent on just a few comprehensible and easily obtainable parameters. The model can be applied widely in any case when a line is fitted from a number of distinct points also without a-priori knowledge of the specific measurement noise. By means of extensive simulations the performance and robustness of the new model in comparison to existing approaches is shown.

Attribute reduction is a core technique in the rough set domain and an important step in data preprocessing. Researchers have proposed numerous innovative methods to enhance the capability of attribute reduction, such as the emergence of multi-granularity rough set models, which can effectively process distributed and multi-granularity data. However, these innovative methods still have many shortcomings, such as how to deal with complex constraints and how to perform multi-angle effectiveness evaluations. Based on the multi-granularity model, this study proposes a new method of attribute reduction, namely using multi-granularity neighborhood information gain ratio as the measurement criterion. This method combines both supervised and unsupervised perspectives, and by integrating multi-granularity technology with neighborhood rough set theory, constructs a model that can adapt to multi-level data features. This model can select the optimal granularity level or attribute set according to the requirements. Finally, the proposed method is experimented with on 15 UCI datasets against six other attribute reduction algorithms. The experimental outcomes, upon analysis and comparative review, substantiate the reliability and consistency of the attribute reduction approach introduced in this study.

With a high proportion of distributed photovoltaic and lower fossil energy integrated into the distribution network, it is very difficult to ensure the reliability of power supply. The distributed photovoltaic planning model based on big data is proposed. According to the impact stochastic photovoltaics and loads on reliability planning, the static and dynamic capacity-load ratios are proposed. The big data analysis model of distributed photovoltaic planning is established. The big data multi-scenario generation and reduction algorithm of stochastic distributed photovoltaic and load planning is studied, and a source-load big data scenario matching model is proposed. Ac-cording to the source load big data scenario, the dynamic capacity-load ratio of the distribution network is obtained. The static capacity-load ratio calculation method in distribution network planning is studied to ensure the reliability of power supply. Finally, the IEEE 33-bus system is used as an example. The results show that distributed photovoltaic planning based on big data and multi-scenario methods can improve photovoltaic utilization and power supply reliability.

Mining interspecies interactions remain a challenge due to the complex nature of microbial communities and the need for computational power to handle big data. Our meta-analysis indicates that genetic potential alone does not resolve all issues involving mining of microbial interactions. Nevertheless, it can be used to define the building blocks to infer synergistic interspecies interactions and to limit the search space (i.e., number of species and metabolic reactions) to a manageable size. A reduced search space decreases the number of additional experiments necessary to validate the inferred putative interactions. As validation experiments, we examine how multi-omics and state of the art imaging techniques may further improve our understanding of species interactions’ role in ecosystem processes. Finally, we analyze pros and cons from the current methods to infer microbial interactions from genetic potential and propose a new theoretical framework based on: (i) genomic information of key members of a community; (ii) information of ecosystem processes involved with a specific hypothesis or research question; (iii) the ability to identify putative species’ contributions to ecosystem processes of interest; and, (iv) validation of putative microbial interactions through integration of other data sources.

Cervical fusion has been a standard procedure for treating the abnormalities associated with the cervical spine. However, the reliability of anterior cervical discectomy and fusion (ACDF) has become arguable due to its adverse effects on the biomechanics of adjacent segments. One of the drawbacks associated with ACDF is adjacent segment degeneration (ASD) which has served as the base for the development of dynamic stabilization systems (DSS) and total disc replacement (TDR) devices for cervical spine. However, the hybrid surgical technique has also gained popularity recently but their effect on the biomechanics of cervical spine is not well researched. Thus, the objective of this FE study was to draw the comparison among single, bi-level and hybrid surgery with DCI implant with traditional fusion. Reduction in range of motion (ROM) for all the implanted models was observed for all the motions except extension, compared to intact model. The maximum increase in ROM of 42% was observed at C5-C6 level in Hybrid-DCI model. The maximum increase in adjacent segment’s ROM of 8.7% was observed in multilevel fusion model. The maximum von Mises stress in the implant was highest for the multilevel DCI model. Our study also showed that the shape of DCI implant permits flexion/extension relatively more compared to lateral bending and axial rotation.

The availability of multi-rotor UAVs with lifting capacities of several kilograms, allows for a new paradigm in atmospheric measurement techniques, i.e. the integration of research-grade sonic anemometers for airborne turbulence measurements. With their ability to hover and move very slowly, this approach yields an unrevealed flexibility compared to mast-based sonic anemometers, for a wide range of boundary layer investigations that require an accurate characterization of the turbulent flow. For an optimized sensor placement, potential disturbances by the propeller-induced flow (PIF), as well as the potential impact of the sensor weight and angular momentum on the flight performance in the case of a boom-mounted sensor, have to be considered.

This paper is focused on two topics very relevant in water distribution networks (WDNs): vulnerability assessment and the optimal placement of water quality sensors. The main novelty element of this paper is to represent the data of the problem, in this case all objects in a graph underlying a water distribution network, as discrete probability distributions. For vulnerability (and the related issue of re-silience) the metrics from network theory, widely studied and largely adopted in the water research community, reflect connectivity expressed as closeness centrality or, betweenness centrality based on the average values of shortest paths between all pairs of nodes. Also network efficiency and the related vulnerability measures are related to average of inverse distances. In this paper we propose a different approach based on the discrete probability distribution, for each node, of the node-to-node distances. For the optimal sensor placement, the elements to be represented as dis-crete probability distributions are sub-graphs given by the locations of water quality sensors. The objective functions, detection time and its variance as a proxy of risk, are accordingly represented as a discrete e probability distribution over contamination events. This problem is usually dealt with by EA algorithm. We’ll show that a probabilistic distance, specifically the Wasserstein (WST) distance, can naturally allow an effective formulation of genetic operators. Usually, each node is associated to a scalar real number, in the optimal sensor placement considered in the literature, average detection time, but in many applications, node labels are more naturally expressed as histograms or probability distributions: the water demand at each node is naturally seen as a histogram over the 24 hours cycle. The main aim of this paper is twofold: first to show how different problems in WDNs can take advantage of the representational flexibility inherent in WST spaces. Second how this flexibility translates into computational procedures.

Blade Health Monitoring (BHM) is often necessary in power plants and in aviation to prevent excessive blade vibration and cracks. This article proposes a network of blade tip timing sensors operated in a distributed BHM system. A number of cooperating agents is implemented in smart conditioning units which can autonomously operate in an adverse environment and communicate with other nodes via a serial interface. The project uses special versions of reduced instruction set chips that are able to operate near the hot section of the engine. Due to the limited number of types of microprocessors available in the extended temperature range grading, it was necessary to fully utilize the limited hardware resources and implement preemptive multitasking. For this purpose, a custom operating system and communication protocol were designed. The protocol hosts the middle layer which hides the implementation of the distributed system. The presented architecture ensures the sufficient computational capacity in individual nodes of the network operated in adverse conditions. It is scalable and resistant to transmission errors.

Air quality is one of the most concerning problems in major industrialized cities in the world. Prediction of future air quality is highly relevant to public health. In some big cities, multiple air quality measurement stations are deployed at different locations to monitor air pollutants, such as NO2, CO, PM 2.5 and PM 10, over time. At every monitoring time stamp t, we observe one station×feature matrix xt of the pollutant data, which represents a spatio–temporal process. Traditional methods on prediction of air quality typically use data from one station or can only predict a single pollutant (such as PM 2.5) at a time, which ignores the spatial correlation among different stations. Moreover, the air pollution data are typically highly nonstationary, We propose a de-trending graph convolutional LSTM (long short term memory) to continuously predict the whole station×feature matrix in the next 1 to 48 hours, which not only captures the spatial dependency among multiple stations by replacing an inner product with convolution, but also incorporates the de-trending signals (transform a nonstationary process to a stationary one by differencing the data) into our model. Experiments on the air quality data of the city Chengdu and multiple major cities in China demonstrate the feasibility of our method and show promising results.

Abstract: Comparing outcrop data to laboratory results is important to verify and validate experiments of analogue and reservoir materials especially regarding conditions for deformation experiments. This is important better understand highly complex carbonate reservoir strata and their response to changes in subsurface conditions, reducing subsurface uncertainty. This study develops methods to allow for a more straightforward comparison of outcrop data (m-scale) with experimentally created fracture arrays developed in cylindrical samples (cm-scale). The main objective is to assess usefulness of experimentally-produced fracture networks as analogues for subsurface structures, typically at the meter and above scale by developing new techniques to use the lab deformation. It analyses key characteristics of laboratory-induced fracture networks by adapting scanline methods to use with x-ray tomography (XRT) images to allow for comparison with outcrop and field data. To test and verify these new methods two low permeability carbonate samples were used for deformation testing and analysis. Applying the different scanline methods we show that they can be used to analyse lab induced fractures (mm to cm-scale) identified in XRT images for comparison with outcrop data (m-scale). In addition, these methods also allow for quantification of fracture network attributes e.g. fracture spacing, fracture apertures, orientation. This new data bridges the gap between micro-scanlines using thin sections and outcrop scanlines.

This paper proposes a linear eddy-current feature to determine the radius of a metallic ball in a non-contact manner. An electromagnetic eddy-current sensor with two coils is placed co-axially to the metal ball during measurement. It is well known that the distance between the sensor and test piece (i.e. lift-off) affects eddy-current signals. In this paper, it is found that the peak frequency feature of inductance spectrum is linear to the lift-off spacing between the centre of coil and ball. Besides, the slope of peak frequencies versus lift-offs is linked to the radius of ball. The radius of metallic balls is retrieved from the experimental and embedded analytical result of the slope. Measurements have been carried out on 6 metallic balls with different radii. The radius of the metallic ball can be retrieved with an error of less than 2 %.

The increased availability of high resolution remote sensor data for precision agriculture 1 applications permits users to aquire deeper and more relevant knowledge about crops states that lead 2 inevitably to better decisions. The algorithm libraries being developed and evolved around these 3 applications rely on multi-spectral or hyper-spectral data acquired by using manned or unmanned 4 platforms. The current state of the art makes thorough use of vegetational indicies to guide the 5 operational management of agricultural land plots. One of the most challenging sub-problems is 6 to correctly identify and separate crop from soil. Thresholding techniques based on Normalized 7 Difference Vegetation Index (NDVI) or other such similar metrics have the advantage of being simple, 8 easy to read transformations of the data packed with useful information. Obvious difficulties arise 9 when crop/tree and soil have similar spectral responses as in case of grass filled areas in vineyards. 10 In this case grass and canopy are close in terms of NDVI values and thresholding techniques will 11 generally fail. Radiometric approaches could be integrated or replaced by a geometric approach that 12 is based on terrain data like Digital Surface Models (DSMs). These models are one of the ouputs 13 of orthorectification engines usually present in data acquired by using unmanned platforms. In 14 this paper we present two approaches based on DSM that are able to segment crop/tree from soil 15 while over gradient terrain. The DSM data are processed through a two dimensional data slicing or 16 reduction technique. Each slice is separately processed as a one dimensional time series to derive the 17 terrain and tree structures separately, here interpreted as object probability densities. In particular 18 the first approach is a Cartesian grid rasterization (CARSCAN) of the terrain and the second is its 19 immediate generalisation or radial grid rasterization of the DSM model (FANSCAN). The FANSCAN 20 recovers information from the original image at greater frequencies on the Fourier plane. These 21 approaches enable the identification of crop/tree from soil in case of slopes or hilly terrain without 22 any constraint on the displacement / direction of plant/tree row. The proposed algorithm uses pure 23 DSM information even if it is possible to fuse its output with other classifiers.

In research applications across several areas, noise removal is indispensable for accuracy of final results. Noise is caused due to physical principals, such as background electronic noise, quantum effect, and wave rebound effect to name a few. Noise removal can help improve results in medical, astronomy, defense, and numerous other fields. Addressing this limitation would result in potentially low cost, automatic, and reliable systems. In this paper, a generalized new approach i.e. Multi-Frame Noise Removal (MFNR) is proposed for noise removal. Given any type of data, the probability density function (PDF) of the noise can be determined. Herein, we extracted the noise PDF parameters using KDE (Kernel Density Estimation). Because the data is corrupted by “deterministic” noise, hence can be cleaned. This could be used as a general purpose noise removal tool. The data point with same position in multiple frames helps us determine the noise PDF characteristics and hence making it possible to remove noise. The conventional wisdom which states that noise removal and detail preservation are contrary to each other is not true for MFNR. Experimental results validate our proposed method which showed practically complete noise reduction based on number of frames used, as compared to existing benchmark methods.

We describe a new approach for integrating multiple views of data into a common latent space using non-negative tensor factorization (NTF). This approach, which we refer to as the "Integrated Sources Model" (ISM), consists of two main steps: embedding and analysis. In the embedding step, each view is transformed into a matrix with common non-negative components. In the analysis step, the transformed views are combined into a tensor and decomposed using NTF. Noteworthy, ISM can be extended to process multi-view data sets with missing views. We illustrate the new approach using two examples: the UCI digit dataset and a public cell type gene signatures dataset, to show that multi-view clustering of digits or marker genes by their respective cell type is better achieved with ISM than with other latent space approaches. We also show how the non-negativity and sparsity of the ISM model components enable straightforward interpretations, in contrast to latent factors of mixed signs. Finally, we present potential applications to single-cell multi-omics and spatial mapping, including spatial imaging and spatial transcriptomics, and computational biology, which are currently under evaluation. ISM relies on state-of-the-art algorithms invoked via a simple workflow implemented in a Jupyter Python notebook.

With the recent advances in Machine Learning (ML), several models have been successfully applied to financial and accounting data to predict the likelihood of companies’ bankruptcy. However, time series have received little attention in literature with a lack of studies on the application of Deep Learning sequence models as Recurrent Neural Networks (RNN) and the recent Attention-based models in general. In this research work, we investigated the application of Long Short Term Memory (LSTM) networks to exploit time series of accounting data for bankruptcy prediction. The main contributions of our work are the following: a) we have proposed a Multi-head LSTM that models each financial variable in a time window independently and compared it with a single-input LSTM and other traditional ML models. The Multi-head LSTM outperforms all the other models; b) We identify the optimal time series length for bankruptcy prediction to be equal to 4 years of accounting data; c) We made public the dataset we used for the experiments that include data from 8262 different public companies in the American stock market generated in the period between 1999-2018. Furthermore, we prove the efficacy of the Multi-head LSTM models in terms of lower false positives and better division of the two classes.

Wireless Sensor Network is an emerging technology and the collaboration of wireless sensors becomes one of the active research areas to utilize sensor data. Various sensors collaborate to recognize the changes of a target environment, to identify, if occurs, any radical change. For the accuracy improvement, the calibration of sensors has been discussed, and sensor data analytics are becoming popular in research and development. However, they are not satisfactorily efficient for the situations where sensor devices are dynamically moving, abruptly appearing or disappearing. If the abrupt appearance of sensors is a zero-day attack and the disappearance of sensors is an ill-functioning comrade, then sensor data analytics of untrusted sensors will result in an indecisive artifact. The pre-defined sensor requirements or meta-data based sensors verification is not adaptive to identify dynamically moving sensors. This paper describes a deep-learning approach to verify the trustworthiness of sensors by considering the sensor data only, without having to use meta-data about sensors or to request consultation from a cloud server. The contribution of this paper includes 1) quality preservation of sensor data for mining analytics and 2) authenticity verification of dynamically moving sensors with no external consultation.

With the proliferation and development of social media platforms, social media data has become an important source for acquiring spatio-temporal information on various urban events. Providing accurate spatio-temporal information for events contributes to enhancing the capabilities of urban management and emergency response. However, existing research on mining spatio-temporal information of events often focuses solely on textual content, neglecting data from other modalities such as images and videos. Therefore, this study proposes an innovative spatio-temporal information extraction method for multi-modal social media data (MIST-SMMD), which extracts the spatio-temporal information of events from multi-modal data on Weibo at coarse and fine-grained hierarchical levels, serving as a beneficial supplement to existing urban event monitoring methods. This paper takes the "July 20th Zhengzhou Heavy Rainfall" incident as an example, to evaluate and analyze the effectiveness of the proposed method. The results indicate that in the coarse-grained spatial information extraction using only textual data, our method achieves a Spatial Precision of 87.54% within a 60m range, and reaches 100% Spatial Precision for ranges beyond 200m. For fine-grained spatial information extraction, the introduction of other modal data such as images and videos results in a significant improvement in Spatial Error. These results demonstrate the ability of the MIST-SMMD method to extract spatio-temporal information from urban events at both coarse and fine levels, and confirms the significant advantages of multi-modal data in enhancing the precision of spatial information extraction.

Exoskeletons designed to assist patients with activities of daily living are becoming increasingly popular, but still are subject to research. In order to gather requirements for the design of such systems, long-term gait observation of the patients over the course of multiple days in an environment of daily living are required. In this paper a wearable all-in-one data acquisition system for collecting and storing biomechanical data in everyday life is proposed. The system is designed to be cost efficient and easy to use, using off-the-shelf components and a cloud server system for centralized data storage. The measurement accuracy of the system was verified, by measuring the angle of the human knee joint at walking speeds between 3 and 12 km/h in reference to an optical motion analysis system. The acquired data was uploaded to a cloud database via a smartphone application. Verification results showed that the proposed toolchain works as desired. The system reached an RMSE from 2.9° to 8°, which is below most of the comparable system. The system provides a powerful, scalable platform for collecting and processing biomechanical data, which can help to automize the generation of an extensive database for human kinematics.

We analyze damage propagation modeling of turbo-engines in a data-driven approach. We investigate subspace tracking assuming a low dimensional manifold structure and a static behavior during the healthy state of the machines. Our damage propagation model is based on the deviation of the data from the static behavior and uses the notion of health index as a measure of the condition. Hence, we incorporate condition-based maintenance and estimate the remaining useful life based on the current and previous health indexes. This paper proposes an algorithm that adapts well to the dynamics of the data and underlying system, and reduces the computational complexity by utilizing the low dimensional manifold structure of the data. A significant performance improvement is demonstrated over existing methods by using the proposed algorithm on CMAPSS Turbo-engine datasets.

Machine fault diagnosis systems need to collect and transmit dynamic monitoring signals, like vibration and current signals, at high-speed. However, industrial wireless sensor networks (IWSNs) and Industrial Internet of Things (IIoT) are generally based on low-speed wireless protocols, such as ZigBee and IEEE802.15.4. To address this tension when implementing machine fault diagnosis applications in IIoT, this paper proposes a novel IWSN with on-sensor data processing. On-sensor wavelet transforms using four popular mother wavelets are explored for fault feature extraction, while an on-sensor support vector machine classifier is investigated for fault diagnosis. The effectiveness of the presented approach is evaluated by a set of experiments using motor bearing vibration data. The experimental results show that compared with raw data transmission, the proposed on-sensor fault diagnosis method can reduce the payload transmission data by 99.95%, and reduce the node energy consumption by about 10%, while the fault diagnosis accuracy of the proposed approach reaches 98%.

A heterogeneous disease like cancer is activated through multiple pathways and different perturbations. Depending upon the activated pathway(s), patients’ survival vary significantly and show different efficacy to various drugs. Therefore, cancer subtype detection using genomics level data is a significant research problem. Subtype detection is often a complex problem, and in most cases, needs multi-omics data fusion to achieve accurate subtyping. Different data fusion and subtyping approaches have been proposed, such as kernel-based fusion, matrix factorization, and deep learning autoencoders. In this paper, we compared the performance of different deep learning autoencoders for cancer subtype detection. We performed cancer subtype detection on four different cancer types from The Cancer Genome Atlas (TCGA) datasets using four autoencoder implementations. We also predicted the optimal number of subtypes in a cancer type using the silhouette score. We observed that the detected subtypes exhibit significant differences in survival profiles. Furthermore, we also compared the effect of feature selection and similarity measures for subtype detection. To evaluate the results obtained, we selected the Glioblastoma multiforme (GBM) dataset and identified the differentially expressed genes in each of the subtypes identified by the autoencoders; the obtained results coincide well with other genomic studies and can be corroborated with the involved pathways and biological functions. Thus, it shows that the results from the autoencoders, obtained through the interaction of different datatypes of cancer, can be used for the prediction and characterization of patient subgroups and survival profiles.

The proportion of area under various crops at a given point in time, known as a cropping pattern, plays an essential role in determining the level of agricultural production. In this study, cropping patterns of three sub-counties in Murang’a County, a typical African smallholder farming area in Kenya, were mapped. Specifically, we compared the performance of eight classification scenarios for mapping cropping patterns; namely using (i) only Sentinel-2 reflectance bands (S2), (ii) S2 and S2 derived vegetation indices (VIs); (iii) S2 and S2 vegetation phenology (VP); (iv) S2 and Sentinel-1 radar backscatter data (S1); (v) S2, VIs, and S1; (vi) S2, VP, and S1; (vii) S2, VIs and VP, and (viii) S2, VIs, VP and S1. Reference data of the dominant cropping patterns and non-croplands were collected. The guided regularized random forest (GRRF) algorithm was used to select the optimum variables and to perform the respective classification for each scenario. The most accurate result of the overall accuracy of 93.16% was attained from the scenario (viii) S2, VIs, VP, and S1. The McNemar’s test of significance did not show significant differences (p≤0.05) among the tested scenarios. Our study demonstrated the strength of GRRF and the synergetic advantage of S2 and S1 derivatives to map cropping patterns in a heterogeneous landscape where high resolution imagery are inaccessible. Our cropping pattern mapping approach can be used in other sites of relatively similar agro-ecological conditions.

Integration of multi-view datasets which are comprised of heterogeneous sources or different representations is challenging to understand the subtle and complex relationship in data. Such data integration methods attempt to combine efficiently the complementary information of multiple data types to construct a comprehensive view of underlying data. Nonnegative matrix factorization (NMF), an approach that can be used for signal compression and noise reduction, has aroused widespread attention in the last two decades. The Kullback–Leibler divergence (or relative entropy) information distance can be used to measure the loss function of NMF. In this article, we propose a fast and robust framework (RSNMF) based on symmetric nonnegative matrix factorization (SNMF) and similarity network fusion (SNF) for clustering human microbiome data including functional, metabolic and phylogenetic profiles. Many existing methods typically utilize all the information provided by each view to create a consensus representation, which often suffers a lot from noise in data and cannot provide a precise representation of the latent data structures. In contrast, RSNMF combines the strength of SNMF and the advantage of SNF to form a robust clustering indicator matrix thus can reduce the noise influence. We conduct experiments on one synthetic and two real dataset (microbiome data, text data) and the results show that the proposed RSNMF has better performance over the baseline and the state-of-art methods, which demonstrates the potential application of RSNMF for microbiome data analysis.

As technologies such as eco-friendly ships, electric propulsion vessels, and multi-fuel propulsion systems advance, the scope of IoT applications in maritime field is expanding, resulting in increased complexity in control factors. The gradual progression towards Maritime Autonomous Surface Ships (MASS) is further driving the evolution of ship-based IoT applications. These advancements underscore the necessity for a platform capable of ensuring reliable connectivity between ships and onshore, while also being adaptable for deployment and operation to meet the demands of service availability. The limitations of the existing single cloud architecture become evident in this context. In response to these emerging challenges, this paper presents a cloud-based horizontal data platform structure anchored in the architecture of a Multi-Region Fog Cloud. This approach is tailored to fulfill the crucial requirement of maintaining robust and seamless connectivity for vessels navigating globally. Leveraging the capabilities of the Fog Cloud, the platform enhances service responsiveness by facilitating localized data collection and distribution, complemented by efficient data caching from the Cloud Center, serving users within the same geographical region. We outline a strategic framework for enhancing and executing key ship services within the proposed architecture. These services encompass data sharing between ships to elevate collision avoidance, disseminating weather data for optimized route planning, and constructing an operator training simulator (OTS) environment through the integration of digital twin technology. After, we implement an architecture using the AWS Cloud and gauges latency and Packet Loss Rate (PLR) through connections to Seoul, California, and Frankfurt regions. The test results reveal that latency in different regions is about 2-5 times higher than that in the same region for the payload. Furthermore, packet loss occurred at roughly 2-3 Hz packet generation rate (PGR) in different regions, whereas in the same region, it commenced at approximately 10-20 Hz PGR.

In order to solve the problem of fault diagnosis for CNC machine feed system under the condition of variable speed conditions, an intelligent fault diagnosis method based on multi-domain feature extraction and ensemble learning model is proposed. First, various monitoring signals including vibration signal, noise signal and current signal are collected. Then, the monitoring signals are preprocessed and the time-domain, frequency-domain and time-frequency domain feature indexes are extracted to construct a multi-dimensional mixed domain feature set. Finally, the feature set is putting into the constructed DoubleEnsemble-LightGBM model to realize the fault diagnosis of the feed system. The experimental results show that the model can achieve good diagnosis results under different working conditions for both the public data set and the feed system test bench data set, and the average overall accuracy is 91.07% and 98.06% respectively. Compared with XGBoost and other advanced ensemble learning models, the method has better accuracy. It provides technical support for the stable operation and intelligent of CNC machine tools..

This work analyzes a new indoor laboratory data set looking at early fire indicators in controlled and realistic experiments representing different incipient fire scenarios. The experiments were performed within the confines of an indoor laboratory setting using multiple distributed sensor nodes on different room positions. Each sensor node collected data of particulate matter (PM), volatile organic compounds (VOC), CO, CO2, H2, UV, air temperature and humidity in terms of a multivariate time series. These data hold immense value for researchers within the machine learning and data science communities who are keen on exploring innovative advanced statistical and machine learning techniques. They serve as a valuable resource for the development of early fire detection systems. The analysis of the collected data was carried out in dependence of the manhattan distance between the fire source and the sensor node. We found that especially larger particles (&gt; 0.5 μm) and VOCs show a significant dependency with respect to the intensity as a function of the manhattan distance to the source. Moreover, we observed differences in the propagation behavior of VOCs, PM, and CO, which are particularly relevant in incipient fire scenarios due to the presence of strand popagation effects.

Water covers a greater part of the earth's surface. Even though we know very little about the underwater world as most parts of it remain unexplored. Oceans including other water bodies hold huge natural resources and also the aquatic lives. These are mostly unexplored and very few of those are known due to unsuited and hazardous environments for the human to explore. This vast underwater world can be monitored remotely from a distant location with much ease and less risk. To monitor water-bodies remotely in real-time, sensor networking has been playing a great role. It is needed to deploy a wireless sensor network over the volume which we want to surveil. For vast water bodies like oceans, rivers and large lakes, data is collected from the different heights of the water level which is sent to the surface sink. Unlike terrestrial communication, radio waves and other conventional mediums can't serve the purpose of underwater communication as they pose high attenuation and very reduced transmission range. Rather an acoustic medium can transmit data more efficiently and reliably in comparison to other mediums. To transmit data reliably from the bottom of the sea to the sinks at the surface, multi-hop communication is needed which must involve a certain scheme. For seabed to surface sink communication, leading researchers have proposed different routing protocols. The goal of these routing protocols is to make underwater communication more reliable, energy-efficient and delay efficient thus to improve the performance of the overall communication. This paper surveys the advancement and applications of the routing protocols which eventually helps in finding the most efficient routing protocol for the Underwater Wireless Sensor Network (UWSN).

Spatio-temporal aspects of data lead to critical information. Sensors capture data at all scales continually so it is imperative that useful information be extracted ubiquitously and regularly. Location plays a vital part by helping understand relations between datasets. It is crucial to link developmental works with spatial attributes and current challenge is to create an open platform that manages real-time sensor data and provides critical spatial analytics atop expert domain knowledge provided in the system. That is a two-faced problem where the solution tackles not only data from multiple sources but also runs data management platform, a spatial data infrastructure(SDI) as backbone framework able to harness sensor web(SW). The paper proposes development of such a globally shared open spatial expert system(ES), SmaCiSENS, a first of a kind geo-enabled knowledge based(KB) ES for multiple fields, smarter cities to climate modeling. SmaCiSENS is integration of SW and SDI with domain KB on data and problems, ready to infer solutions. The paper describes an architecture for semantic enablement for SW, SDI; connect interfaces, functions of SDI and SW, and sensor data application program interfaces (APIs) to better manage climate modeling, geohazard, global changes, and other vital areas of attention and action.

In recent years, demand has been increasing for target detection and tracking from aerial imagery via drones using onboard powered sensors and devices. We propose a very effective method for this application based on a deep learning framework. A state-of-art embedded hardware system empowers small flying robots to carry out the real-time onboard computation necessary for object tracking. Two types of embedded modules were developed: one is designed using a Jetson TX or AGX Xavier, and the other is based on an Intel Neural Compute Stick. These are suitable for real-time onboard computing power on small flying drones with limited space. A comparative analysis of current state-of-art deep-learning-based multi-object detection algorithms was carried out utilizing the designated GPU-based embedded computing modules to obtain detailed metric data about frame rates as well as the computation power. We also introduce an effective target tracking approach for moving objects. The algorithm for tracking moving objects is based on the extension of simple online and real-time tracking. It was developed by integrating a deep-learning-based association metric approach (Deep SORT), which uses a hypothesis tracking methodology with Kalman filtering and a deep-learning-based association metric. In addition, a guidance system that tracks the target position using a GPU-based algorithm is introduced. Finally, we demonstrate the effectiveness of the proposed algorithms by real-time experiments with a small multi-rotor drone.

With the megatrend of digitalization, the demand for sensors in previously difficult to access scenarios is increasing. Filament-shaped sensors (FSS) are ideal for this demand especially in applications in which the monitoring of textile structures is the focus. Electrically conductive bicomponent filaments based on thermoplastic polyurethane (TPU) and doped with carbon nanotubes (CNTs) offer great potential due to the flexible mechanical properties. Through the core-conducting, bicomponent structure the sensing material is protected from environmental factors such as surrounding conductive materials and external moisture. The insulating material, however, simultaneously complicates the contacting method in order to measure sensing changes in the conductive core. In this work laser cutting is employed as a technology in order to expose the conductive core of the filaments. The filament is then coated with silver and mechanically crimped, providing both a conductive interface for the data acquisition device as well as a protective layer. Laser parameters (power and speed) are investigated in order to identify the parameters with the best cutting properties which is analyzed visually as well as electrically. The work conducted here can then be used in order to provide a robust and reproducible contacting method for core-conducting TPU filaments for strain sensing applications.

In recent years, the emergence of spatiotemporal big data has made the transition of functional identification from the physical dimension to socioeconomic or human activities becoming more common. In the identification of urban functional areas, most studies considered only a single data source and a single division scale, the research results have problems such as low update frequency or incomplete information in a single data set, and overfitting or underfitting in a single spatial resolution. Using taxi trajectory data and point of interest (POI) data as the main data source, this study proposes a multi-scale recursive identification method for urban functional areas based on cross-validation. First, used the dynamic time warping (DTW) algorithm generates a time series similarity matrix, the CA-RFM model combines the clustering algorithm and random forest model is constructed, the model uses a clustering algorithm (K-MEDOIDS) to extract sig-nificant feature regions as input, which are imported into the random forest model for UFZ identification. Then, to overcome the shortcomings of single scale in expressing urban structural characteristics, a recursive model of different levels of urban road networks is established to classify multi-scale functional areas. Finally, cross-validation using the CA-RFM model and POI quantitative identification method, obtains the final identification results of urban functional areas. This paper selects Shenzhen as the study area for the case study, the results show that the com-bination of clustering algorithm and random forest model greatly reduces the error of manual selection of training samples. In addition, the research shows the superiority of the multi-scale recursive identification method that fuses multi-source data and performs cross-validation from two aspects, that is, the division speed of urban functional area identification results is accelerated and the accuracy is improved.