Over recent years, the importance of patent literature has become more recognized in the academic setting. In the context of artificial intelligence, deep learning, and data sciences, patents are relevant to not only industry but also academe and other communities. In this article, we focus on deep tomographic imaging and perform a preliminary landscape analysis of the related patent literature. Our search tool is PatSeer . Our patent bibliometric data is summarized in various figures and tables. In particular, we qualitatively analyze key deep tomographic patent literature.

A hybrid smart process and material design system for nanoimprinting is proposed, which combines with a learning system based on experimental and numerical simulation results. Instead of carrying out extensive learning experiments for various condition, the simulation learning results are partially complimented where the results can be theoretically predicted by numerical simulation. In other word, the lacking data in experimental learning are complimented by simulation-based learning results. Therefore, the prediction of nanoimprint results under various conditions without experimental learning could be realized even for unknown materials. In this study, material and process design for a low-temperature nanoimprint process using glycerol-containing polyvinyl alcohol are demonstrated. Experimental results under limited conditions are learned to investigate optimum Glycerol concentrations and process temperatures. On the other hand, simulation-based learning is used to predict the dependence on press pressure and shape parameters. The prediction results for unknown Glycerol concentrations agreed well with the follow-up experiments.

In this paper, we introduce an innovative approach to distinguish Gliosarcoma (GSM) from Glioblastoma (GBM). Our method combines causal fuzzy logic rules with the Big Bird architecture, a Transformer-based Deep Learning algorithm. Unlike prior research, which often relied on statistical models to reduce dataset dimensions before causal analysis, our approach harnesses the complete dataset in tandem with our causal fuzzy Big Bird architecture. Additionally, we benchmark our results not only against previous Gliosarcoma/Glioblastoma studies but also against GPT-2 for a comprehensive evaluation.

Digital Microfluidic Biochips (DMFBs), used in various kinds of fields like DNA analysis, clinical diagnosis, and PCR testing, have made biochemical experiments more compact, efficient, and user-friendly than previous ways. However, their reliability is often compromised by their inability to adapt to all kinds of errors. All errors in biochips can be categorized into two types: known errors and unknown errors. Known errors are detectable before the start of the routing process through sensors or cameras. Unknown errors, in contrast, become apparent only during the routing process and remain undetected by sensors or cameras, which is the biggest issue to unexpectedly stop the routing process and diminishes the reliability of biochips. This paper introduces a deep reinforcement learning-based routing algorithm designed to manage not only known errors but also unknown errors. Our experiments demonstrate that our algorithm outperforms previous ones in terms of the success rate of the routing in the scenario including both known errors and unknown errors. Additionally, our algorithm contributes to detecting unknown errors during the routing process and identifying the most efficient routing path with high probability.

One of the most common forms of dementia is Alzheimer’s disease (AD), which leads to progressive mental deterioration. Unfortunately, there is no definitive diagnosis and cure that can stop the condition progressing. The diagnosis is often performed based on the clinical history and neuropsychological data, including magnetic resonance imaging (MRI). Deep neural networks (DNN) algorithms are gaining popularity for medical diagnosis, and have been used widely for the analysis of MRI data. DNNs can extract hidden features from thousands of training images automatically. However, they cannot judge how confident they are about their predictions. To use DNNs in safety-critical applications such as medical diagnosis, uncertainty quantification of DNNs predictions is crucial. For this purpose, Monte Carlo dropout (MCD) has been widely used, however, it may lead to overconfident and miss calibrated results. This paper proposes a framework in which the MCD algorithm’s hyper-parameters are optimized during training using Bayesian optimization for the first time. The conducted optimization leads to assigning high predictive entropy to erroneous predictions and making it possible to recognize risky predictions. The proposed framework is used for AD diagnosis, which has not been done before. We compare our method with some existing methods in the literature based on different uncertainty quantification criteria. The results of comprehensive experiments on the Kaggle dataset using a deep model pre-trained on the ImageNet dataset show that the proposed algorithm can quantify uncertainty much better than the existing methods.

Deep learning machines are computational models composed of multiple processing layers of adaptive weights to learn representations of data with multiple levels of abstraction. Their structure is mainly reflecting the intuitive plausibility of decomposing a problem into multiple levels of computation and representation since it is believed that higher layers of representation allow a system to learn complex functions. Surprisingly, after decades of research, from learning and design perspectives these models are still deployed in a heuristic manner. In this paper, deep learning feed-forward machines are modeled from a statistical mechanics point of view as disordered physical systems where its macroscopic behavior is determined in terms of the interactions defined between the basic constituent of these models, namely, the artificial neuron. They are viewed as the equilibrium states of a theoretical body that is subject to the law of increase of the entropy. The study of the changes in energy of the body when passing from one equilibrium state to another is used to understand the structure and role of the phase space of the system, the stability of the equilibrium states, and the resulting degree of disorder. It is shown that the topology of these models is strongly linked to their stability and resulting level of disorder. Furthermore, the proposed theoretical characterization permit to assess the thermodynamic efficiency with which information can be processed by these models, and to provide a practical methodology to quantitatively estimate and compare their expected learning and generalization capabilities. These theoretical results provides new insights to the theory of deep learning and their implications are shown to be consistent through a set of benchmarks designed to experimentally assess their validity.

Deep learning has taken over - both in problems beyond the realm of traditional, hand-crafted machine learning paradigms as well as in capturing the imagination of the practitioner sitting on top of petabytes of data. While the public perception about the efficacy of deep neural architectures in complex pattern recognition tasks grows, sequentially up-to-date primers on the current state of affairs must follow. In this review, we seek to present a refresher of the many different stacked, connectionist networks that make up the deep learning architectures followed by automatic architecture optimization protocols using multi-agent approaches. Further, since guaranteeing system uptime is fast becoming an indispensable asset across multiple industrial modalities, we include an investigative section on testing neural networks for fault detection and subsequent mitigation. This is followed by an exploratory survey of several application areas where deep learning has emerged as a game-changing technology - be it anomalous behavior detection in financial applications or financial time-series forecasting, predictive and prescriptive analytics, medical imaging, natural language processing or power systems research. The thrust of this review is on outlining emerging areas of application-oriented research within the deep learning community as well as to provide a handy reference to researchers seeking to embrace deep learning in their work for what it is: statistical pattern recognizers with unparalleled hierarchical structure learning capacity with the ability to scale with information.

In August 2020, the World Health Assembly launched a global initiative to eliminate cervical cancer by 2030, setting three primary targets. One key goal is to achieve a 70% screening coverage rate for cervical cancer, primarily relying on the precise analysis of Papanicolaou (Pap) or digital Pap smears. However, the responsibility of reviewing Pap smear samples to identify potentially cancerous cells primarily falls on pathologists, a task known to be exceptionally challenging and time-consuming. This paper proposes a solution to address the shortage of pathologists for cervical cancer screening. It leverages the OpenAI-GYM API to create a deep reinforcement learning environment utilizing liquid-based Pap smear images. By employing the Proximal Policy Optimization algorithm, autonomous agents navigate Pap smear images, identifying cells with the aid of rewards, penalties, and accumulated experiences. Furthermore, the use of a pre-trained convolutional neuronal network like Res-Net54 enhances the classification of detected cells based on their potential for malignancy. The ultimate goal of this study is to develop a highly efficient, automated Papanicolaou analysis system, ultimately reducing the need for human intervention in regions with limited pathologists.

Image registration (IR) is a process that deforms images to align them with respect to a reference space, making it easier for medical practitioners to examine various medical images in a standardized reference frame, such as having the same rotation and scale. This document introduces image registration using a simple numeric example. It provides a definition of image registration along with a space-oriented symbolic representation. This review covers various aspects of image transformations, including affine, deformable, invertible, and bidirectional transformations, as well as medical image registration algorithms such as Voxelmorph, Demons, SyN, Iterative Closest Point, and SynthMorph. It also explores atlas-based registration and multistage image registration techniques, including coarse-fine and pyramid approaches. Furthermore, this survey paper discusses medical image registration taxonomies, datasets, evaluation measures, such as correlation-based metrics, segmentation-based metrics, processing time, and model size. It also explores applications in image-guided surgery, motion tracking, and tumor diagnosis. Finally, the document addresses future research directions, including the further development of transformers.

Physical inactivity increases the risk of many adverse health conditions, including the world’s major non-communicable diseases, such as coronary heart disease, type 2 diabetes, and breast and colon cancers, shortening life expectancy. There are minimal medical care and personal trainers’ methods to monitor a patient’s actual physical activity types. To improve activity monitoring, we propose an artificial-intelligence-based approach to classify the physical movement activity patterns. In more detail, we employ two deep learning (DL) methods, namely a deep feed-forward neural network (DNN) and a deep recurrent neural network (RNN) for this purpose. We evaluate the proposed models on two physical movement datasets collected from several volunteers who carried tri-axial accelerometer sensors. The first dataset is from the UCI machine learning repository, which contains 14 different activities-of-daily-life (ADL) and is collected from 16 volunteers who carried a single wrist-worn tri-axial accelerometer. The second dataset includes ten other ADLs and is gathered from 8 volunteers who placed the sensors on their hips. Our experiment results show that the RNN model provides the accuracy performance compared to the state-of-the-art methods in classifying the fundamental movement patterns with an overall accuracy of 84.89% and an overall F1-score of 82.56%. Our results indicate that the proposed method will provide the medical doctors and trainers a promising way to precisely track and understand a patient’s physical activities for better treatment.

We propose a deep reinforcement learning based manipulator path tracking method to solve the computationally difficult and non-unique problem of manipulator path tracking methods based on inverse kinematics. By transforming the path tracking task into a sequence decision problem, our method adopts an end-to-end learning method for closed-loop control and avoids the process of finding the inverse solution. We first explored the feasibility of the deep reinforcement learning method in the path tracking of the manipulator. After verifying the feasibility, the path tracking of the multi-degree-of-freedom(multi-DOF) manipulator was realized by combining the maximum entropy deep reinforcement learning algorithm. The experimental results show that our method has a good effect on the path tracking of the manipulator, which not only avoids the process of finding the inverse kinematics solution, but also requires no dynamic model. Therefore, we believe that our method has great significance in the study of manipulator path tracking.

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs have not yet achieved high output for their well-established two-dimensional (2D) equivalents in still photographs. Board 3D Convolutional Memory and Spatiotemporal fusion face training difficulty preventing 3D CNN from accomplishing remarkable evaluation. In this paper, we implement Hybrid Deep Learning Architecture that combines STIP and 3D CNN features to enhance the performance of 3D videos effectively. After implementation, the more detailed and deeper charting for training in each circle of space-time fusion. The training model further enhances the results after handling complicated evaluations of models. The video classification model is used in this implemented model. Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning is introduced to further understand space-time association in human endeavors. In the implementation of the result, the well-known dataset, i.e., UCF101 to, evaluates the performance of the proposed hybrid technique. The results beat the proposed hybrid technique that substantially beats the initial 3D CNNs. The results are compared with state-of-the-art frameworks from literature for action recognition on UCF101 with an accuracy of 95%.

Over a billion people live in slums, with poor sanitation, education, property rights and working conditions having direct impact on current residents and future generations. A key problem in relation to slums is slum mapping. Without delineations of where all slum settlements are, informed decisions cannot be made by policymakers in order to benefit the most in need. Satellite images have been used in combination with machine learning models to try and fill the gap in data availability of slum locations. Deep learning has been used on RGB images with some success but since labeled satellite images of slums are relatively low quality and the physical/visual manifestation of slums significantly varies within and across countries, it is important to quantify the uncertainty of predictions for reliable application in downstream tasks. Our solution is to train Monte Carlo dropout U-Net models on multispectral 13-band Sentinel-2 images from which we can calculate pixelwise epistemic (model) and aleatoric (data) uncertainty in our predictions. We trained our model on labelled images of Mumbai and verified our epistemic and aleatoric uncertainty quantification approach using altered models trained on modified datasets. We also used SHAP values to investigate how the different features contribute towards the model’s predictions and this showed that certain short-wave infrared and red-edge image bands are powerful features for determining the locations of slums within images. Having created our model with uncertainty quantification, in the future it can be applied to downstream tasks and decision-makers will know where predictions have been made with low uncertainty, giving them greater confidence in its deployment.

Layer-wise 3D surface morphology information is critical for the quality monitoring and control of additive manufacturing (AM) processes. However, most of the existing 3D scan technologies are either contact or time consuming, which are not capable of obtaining the 3D surface morphology data in a real-time manner during the process. Therefore, the objective of this study is to achieve real-time 3D surface data acquisition in AM, which is achieved by a supervised deep learning-based image analysis approach. The key idea of this proposed method is to capture the correlation between 2D image and 3D point cloud, and then quantify this relationship by using a deep learning algorithm, namely, convolutional neural network (CNN). To validate the effectiveness and efficiency of the proposed method, both simulation and real-world case studies were performed. The results demonstrate that this method has strong potential to be applied for real-time surface morphology measurement in AM, as well as other advanced manufacturing processes.

With the continuous development of network technology, complex network systems generate massive unbalanced attack traffic. Due to the severe imbalance in the quantities of normal samples and attack samples, as well as among different types of attack samples, intrusion detection systems suffer from low detection rates for rare class attack data. In this paper, we propose a geometric synthetic minority oversampling technique based on optimized kernel density estimation algorithm. This method can generate diverse rare class attack data by learning the distribution of rare class attack data while maintaining similarity with the original sample features. Meanwhile, the balanced data is input to a feature extraction module built upon multiple denoising autoencoders, reducing information redundancy in high-dimensional data and improving the detection performance for unknown attacks. Subsequently, a soft voting ensemble learning technique is utilized for multi-class anomaly detection on the balanced and dimensionally reduced data. Finally, an intrusion detection system is constructed based on data preprocessing, imbalance handling, feature extraction, and anomaly detection modules, and validated on the NSL-KDD and N-BaIoT datasets. Comparative experiments with baseline models and other state-of-the-art methods demonstrate that the proposed system improves the detection rate of rare class attack data. Furthermore, it achieves a good overall detection rate on the Internet of Things dataset (N-BaIoT), indicating its strong applicability.

With the developments of smart technologies, the use of rare earth elements (REEs) knows a widespread use, thus, their importance as valuable and strategic metals boosted to levels never known before. Due to their scarcity in Earth crust, the recovery of these elements from secondary resources also knows further developments. Traditional pyrometallurgical and hydrometallurgical processing, though of wide use, in the recovery of these REEs, have some environmental drawbacks, thus, the development of new recovery approaches are under developments. Here, Solvometallurgy appeared as a friendly environmental technology, and ionic liquids and deep eutectic solvents re-sulted as a first-row chemicals to be used in the different unit operations used in solvometallurgical processing: leaching, liquid-liquid extraction, ion exchange (adsorption), precipitation and elec-trolysis. This manuscript reviewed the most recent literature concerning the use of ionic liquids and deep eutectic solvents in the recovery of REEs from various sources.

People localization is a key building block in many applications. In this paper, we propose a deep learning based approach that significantly improves the localization accuracy and reduces the runtime of Wi-Fi based localization systems. Three variants of the deep learning approach are proposed, a sub-task architecture, an end-to-end architecture, and an architecture that incorporates prior knowledge. The performance of the three architectures under different conditions is evaluated and the significant improvement of the three architectures over existing approaches is demonstrated.

The combustion of fuel oil releases sulfur compounds, which react to form sulfur oxides that are harmful to the environment and pose a threat to human health. To mitigate these negative effects, it is crucial to pretreat fuel oil through desulfurization processes. One promising approach involves the use of deep eutectic solvents (DESs), carbon nanotubes (CNTs), and their composites (DESs/CNTs) to effectively reduce sulfur content in fuel oil.However, the conventional methods of DES-based extraction desulfurization and CNT-based adsorption desulfurization suffer from low desulfurization rates. Additionally, the composite material DESs/CNTs is in a semi-solidified form, resulting in high viscosity, complex operation procedures, and increased waste and environmental pollution. To address these challenges, this study focused on the preparation of CNTs/PEG-PVA hydrogel. This hydrogel not only maintains the high desulfurization rate observed in the DESs/CNTs composite material but also possesses several advantages. Firstly, it is convenient to use, offering ease of handling and application. Secondly, it is biodegradable, meaning it can break down naturally over time, reducing its impact on the environment. Lastly, the hydrogel is reusable, allowing for repeated use, thereby minimizing material waste. The desulfurization rate achieved with the CNTs/PEG-PVA hydrogel is remarkably high, reaching up to 99.8%. Moreover, the material utilization rate is close to 100%, meaning that almost all of the hydrogel is utilized in the desulfurization process, reducing unnecessary material consumption. In summary, the innovative CNTs/PEG-PVA hydrogel presents a highly efficient and environmentally friendly solution for desulfurization in fuel oil. Its superior desulfurization rate, alongside its convenience, biodegradability, and reusability, positions it as a promising alternative that not only ensures effective desulfurization but also contributes to sustainable practices in the energy industry.

Accurately mapping individual tree species in densely forested environments is crucial to forest inventory. When considering only RGB images, this is a challenging task for many automatic photogrammetry processes. The main reason for that is the spectral similarity between species in RGB scenes, which can be a hindrance for most automatic methods. State-of-the-art deep learning methods could be capable of identifying tree species with an attractive cost, accuracy, and computational load in RGB images. This paper presents a deep learning-based approach to detect an important multi-use species of palm trees (Mauritia flexuosa; i.e., Buriti) on aerial RGB imagery. In South-America, this palm tree is essential for many indigenous and local communities because of its characteristics. The species is also a valuable indicator of water resources, which comes as a benefit for mapping its location. The method is based on a Convolutional Neural Network (CNN) to identify and geolocate singular tree species in a high-complexity forest environment, and considers the likelihood of every pixel in the image to be recognized as a possible tree by implementing a confidence map feature extraction. This study compares the performance of the proposed method against state-of-the-art object detection networks. For this, images from a dataset composed of 1,394 airborne scenes, where 5,334 palm-trees were manually labeled, were used. The results returned a mean absolute error (MAE) of 0.75 trees and an F1-measure of 86.9%. These results are better than both Faster R-CNN and RetinaNet considering equal experiment conditions. The proposed network provided fast solutions to detect the palm trees, with a delivered image detection of 0.073 seconds and a standard deviation of 0.002 using the GPU. In conclusion, the method presented is efficient to deal with a high-density forest scenario and can accurately map the location of single species like the M flexuosa palm tree and may be useful for future frameworks.

Deep learning techniques, such as convolutional neural networks (CNN), generative adversarial networks (GAN), and graph neural networks (GNN), have over the past decade changed the ac-curacy of prediction in many diverse fields. In recent years, the application of deep learning tech-niques in computer vision tasks in pathology demonstrated extraordinary potential in assisting clinicians, automating diagnosis, and reducing costs for patients. Formerly unknown pathologi-cal evidence, such as morphological features related to specific biomarkers, copy number varia-tions, and other molecular features, were also able to be captured by deep learning models. In this paper, we review popular deep learning methods and some recent publications about their appli-cations in pathology.

The study aimed to investigate the impact of incorporating deep learning strategies in mathematics instruction on students' problem-solving abilities, critical thinking skills, academic achievement, and mathematical skills development. The study population consisted of 280 students, with a sample size of 162 participants. Employing a purely quantitative approach, data collection utilized questionnaires and achievement tests as instruments. Data analysis involved simple linear regression, descriptive analysis, and Pearson correlation. The results of the study revealed that there was no significant enhancement observed in students' problem-solving abilities and critical thinking skills when deep learning strategies were incorporated into mathematics instruction. Additionally, students' attitudes towards deep learning activities in mathematics showed no effect on their academic achievement. Furthermore, students' engagement levels in deep learning activities did not impact their development of mathematical skills. Lastly, the frequency of deep learning activities in the mathematics classroom did not show a significant relationship with students' academic performance. These findings suggest that the implementation of deep learning strategies in mathematics instruction did not yield notable improvements in the specified areas based on the study outcomes.

A novel indole, microindolinone A (1), was isolated from a deep-sea-derived actinomycete Microbacterium sp. MCCC 1A11207, together with 18 known compounds (2–19). By detailed analysis of the ¹H, ¹³C, HSQC, COSY, HMBC, HRESIMS, and CD data, the absolute configuration of 1 was elucidated as 5R-hydroxy-4,5,6,7-tetrahydroindole-4-one. Noteworthily, 1 is the second example of a saturated indole isolated from nature.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

The Ebola virus disease (EVD) is an extremely contagious and fatal illness caused by the Ebola virus. Recently, Uganda witnessed an outbreak of EVD, which generated a lot of attention on various social media platforms. To ensure effective communication and implementation of targeted health interventions, it is crucial for stakeholders to comprehend the sentiments expressed in the posts and discussions on these online platforms. In this study, we used deep learning techniques to analyze the sentiments expressed in Ebola-related tweets during the outbreak. We explored the application of three deep learning techniques to classify the sentiments in 8,395 tweets as positive, neutral, or negative. The techniques examined included a 6-layer convolutional neural network (CNN), a 6-layer long-short-term memory model (LSTM), and an 8-layer Bidirectional Encoder Representations from Transformers (BERT) model. The study found that the BERT model outperformed both the CNN and LSTM-based models across all the evaluation metrics, achieving a remarkable classification accuracy of 95\%. These findings confirm the reported effectiveness of transformer-based architectures in tasks related to natural language processing, such as sentiment analysis.

Chlorophyll-a (Chla) is a crucial pigment in phytoplankton, playing a vital role in determining phytoplankton biomass and water nutrient status. However, in optically complex water bodies, Chla concentration is no longer the primary factor influencing remote sensing spectral reflectance signals, leading to significant errors in traditional Chla concentration estimation methods. With advancements in in-situ measurements, synchronized satellite data, and computer technology, machine learning algorithms have become popular in Chla concentration retrieval. Nevertheless, when using machine learning methods to estimate Chla concentration, abrupt changes in Chla values can disrupt the spatiotemporal smoothness of the retrieval results. Therefore, this study proposes a two-stage approach to enhance the accuracy of Chla concentration estimation in optically complex water bodies. In the first stage, a one-dimensional convolutional neural network (1DCNN) is employed for precise Chla retrieval, and in the second stage, the regression layer of the 1DCNN is replaced with Support Vector Regression (SVR). The research findings are as follows: (1) In the first stage, the performance metrics (R², RMSE, RMLSE, Bias, MAE) of the 1DCNN outperform state-of-the-art algorithms (OCI, SVR, RFR) on the test dataset. (2) After the second stage, the performance further improves, with the metrics achieving values of 0.892, 11.243, 0.052, 1.056, and 1.444, respectively. (3) In mid-to-high latitude regions, the inversion performance of 1DCNN\SVR is superior to other algorithms, exhibiting richer details and higher noise tolerance in nearshore areas. (4) 1DCNN\SVR demonstrates high inversion capabilities in water bodies with medium to high nutrient levels.

The classification of vessel types in SAR imagery is of crucial importance for maritime applications. However, the ability to use real SAR imagery for deep learning classification is limited, due to the general lack of such data and/or the labor-intensive nature of labeling them. Simulating SAR images can overcome these limitations, allowing the generation of an infinite number of datasets. In this contribution, we present a synthetic SAR imagery dataset with ship wakes, which comprises 46080 images for ten different real vessel models. The variety of simulation parameters includes 16 ship heading directions, 6 ship velocities, 8 wind directions, 2 wind velocities, and 3 incidence angles. In addition, we extensively investigate classification performance for noise-free, noisy, and denoised ship wake scenes. We utilize the standard AlexNet architecture and employ training from scratch. To achieve the best classification performance, we conduct Bayesian optimization to determine hyperparameters. Results demonstrate that the classification of vessel types based on their SAR signatures is highly efficient, with maximum accuracies of 96.16%, 92.7%, and 93.59%, when training using noise-free, noisy, and denoised datasets respectively. Thus, we conclude that the best strategy in practical applications should be to train convolutional neural networks on denoised SAR datasets. The results show that the versatility of the SAR simulator can open up new horizons in the application of machine learning to a variety of SAR platforms.

In this brief letter we report our initial results on the application of deep-learning to the massive MIMO channel estimation challenge. We show that it is possible to estimate wireless channels and that the possibility of mitigating pilot-contamination with deep-learning is possible given that the leaning model underwent an extensive training-phase and that it has been presented with a large number of different channel conditions.

Breast cancer is a common malignant tumour and studies have shown that early and accurate detection is crucial for patients. With the maturity of medical imaging and deep learning development, significant progress has been made in breast cancer classification, which greatly improves the accuracy and efficiency of classification. This review focuses on deep learning, migration learning, GAN, and lifelong learning to elaborate and summarise the important roles arising from breast cancer detection. This review also examines the dataset and labeling issues required for breast cancer classification. In conclusion, at the end of the article, we look at future directions for breast cancer classification research, including cross-migration learning, multimodal data fusion, model interpretability, and lifelong learning, and also explore how to provide personalized treatment plans for patients.

Infrared thermography has already been proven to be a significant method in non-destructive evaluation since it gives information with immediacy, rapidity, and low cost. However, the thorniest issue for the wider application of IRT is quantification. In this work, we proposed a specific depth quantifying technique by employing the Gated Recurrent Units (GRU) in composite material samples via pulsed thermography (PT). Finite Element Method (FEM) modeling provides the economic examination of the response pulsed thermography. In this work, Carbon Fiber Reinforced Polymer (CFRP) specimens embedded with flat bottom holes are stimulated by a FEM modeling (COMSOL) with precisely controlled depth and geometrics of the defects. The GRU model automatically quantified the depth of defects presented in the stimulated CFRP material. The proposed method evaluated the accuracy and performance of synthetic CFRP data from FEM for defect depth predictions.

In the field of autonomous vehicles, lane detection and control plays an important role. In autonomous driving the vehicle has to follow the path to avoid the collision. A deep learning technique is used to detect the curved path in autonomous vehicles. In this paper a customized lane detection algorithm was implemented to detect the curvature of the lane. A ground truth labelling tool box for deep learning is used to detect the curved path in autonomous vehicle. By mapping point to point in each frame 80-90% computing efficiency and accuracy is achieved in detecting path.

The recently explored synergistic combination of graphene-based materials and deep eutectic solvents (DESs) is opening novel and effective avenues for developing sensing devices with optimized features. In more detail, remarkable potential in terms of simplicity, sustainability, and cost-effectiveness have been demonstrated for sensors, resulting in the creation of hybrid devices with enhanced signal-to-noise ratio, linearity, and selectivity. Therefore, this review aims to provide a comprehensive overview of the currently available scientific literature discussing investigations and applications of sensors that integrate graphene-based materials and deep eutectic solvents, with an outlook for the most promising developments of this approach.

To ensure the security of highly sensitive remote sensing images (RSI) during their transmission, it is essential to implement effective content security protection methods. Generally, secure distribution schemes for remote sensing images often employ cryptographic techniques. However, sending encrypted data exposes communication behavior, which poses significant security risks to the distribution of remote sensing images. Therefore, this paper introduces deep information hiding to achieve secure distribution of remote sensing images, which can serve as an effective alternative in certain specific scenarios. Specifically, the Deep Information Hiding for RSI Distribution (hereinafter referred to as DIH4RSID) based on encoder-decoder network architecture with Parallel Attention Mechanisms (PAM) by adversarial training was proposed. Our model is constructed with four main components: a preprocessing network (PN), an embedding network (EN), a revealing network (RN) and a discriminating network (DN). The PN module is primarily based on Inception to capture more details of RSI and targets of different scales. The PAM module obtains features in two spatial directions to realize feature enhancement and context information integration. The experimental results indicate that our proposed algorithm achieves relatively higher visual quality and secure level compared to related methods. Additionally, after extracting the concealed content from hidden images, the average classification accuracy is unaffected.

Our daily activities hinge on the flexibility of our fingers, and a fractured finger can significantly disrupt these routines. The finger bones enable us to bend and fold the fingers and thumb to pick up or grasp objects and do all of our daily activities. A broken finger can cause adverse effects on our daily life activities. It is important to treat broken finger as soon as possible. Swift and precise treatment begins with capturing multiple X-rays, followed by the critical step of fracture detection in these images. Relying on the naked eye for this task carries the risk of overlooking small fractures. To address this issue an automated diagnoses of fractured fingers from images is required for which the current research employs advanced deep learning models—ResNet34, ResNet50, ResNet101, ResNet152, VGG-16, and VGG-19—to classify finger images from the Musculoskeletal Radiographs (MURA) dataset as either fractured or non-fractured. The results emphasize the consistently strong performance of ResNet models, attaining an impressive accuracy of 81.9%. This surpasses VGG models by 3.4% and establishes ResNet as the new benchmark for state-of-the-art accuracy.

Biofuels construct an essential pillar of energy systems. Biofuels are considered as a popular resource for electricity production, heating, household, and industrial usage, liquid fuels, and mobility around the world. Thus, the need for handling, modeling, decision-making, demand, and forecasting for biofuels are of utmost importance. Recently, machine learning (ML) and deep learning (DL) techniques have been accessible in modeling, optimizing, and handling biofuels production, consumption, and environmental impacts. The main aim of this study is to review and evaluate ML and DL techniques and their applications in handling biofuels production, consumption, and environmental impacts, both for modeling and optimization purposes. Hybrid and ensemble ML methods, as well as DL methods, have found to provide higher performance and accuracy in modeling the biofuels.

A continuous Deep Belief Network (cDBN) with two hidden layers is proposed in this paper, focusing on the problem of weak feature learning ability when dealing with continuous data. In cDBN, the input data is trained in an unsupervised way by using continuous version of transfer functions, the contrastive divergence is designed in hidden layer training process to raise convergence speed, an improved dropout strategy is then implemented in unsupervised training to realize features learning by de-cooperating between the units, and then the network is fine-tuned using back propagation algorithm. Besides, hyper-parameters are analysed through stability analysis to assure the network can find the optimal. Finally, the experiments on Lorenz chaos series, CATS benchmark and other real world like CO2 and waste water parameters forecasting show that cDBN has the advantage of higher accuracy, simpler structure and faster convergence speed than other methods.

This study aimed to determine shifts in microbial populations regarding richness and diversity from daily use of a popular over-the-counter nasal spray. In addition, the finding of nasal commensal bacterial species that overlap with the oral microbiome may prove to be potential probiotics for the “gateway microbiomes.” Nasal swab samples were obtained before and after using the most popular over-the-counter (OTC) nasal spray in 10 participants aged 18–48 years. All participants were healthy volunteers with no significant medical histories. The participants were randomly assigned a number by randomizing software and consisted of five men and five women. The sampling consisted of placing a nasal swab atraumatically into the nasal cavity, which is similar to the sampling performed for COVID-19 testing, with only very slight discomfort, if any. The samples were preserved and sent to Northwestern University Sequencing Center for whole-genome deep sequencing. After 21 days of OTC nasal spray use twice daily, the participants returned for further nasal microbiome sampling. The microbial analysis included all bacteria, archaea, viruses, molds, and yeasts via deep sequencing for species analysis. The Northwestern University Sequencing Center utilized artificial intelligence analysis to determine shifts in species and strains following nasal spray use that resulted in changes in diversity and richness.

Fresh potatoes were deep-fried in olive oil (OO) & extra virgin olive oil (EVOO) and their blends with 5%, 10% and 20% v/v sesame oil (SO). This is the first report on the use of sesame oil as natural source of antioxidant for olive oil deep-frying. Oil was evaluated for Peroxide Value (PV), Free Fatty Acids (FFA), K₂₃₂, K₂₇₀, Trolox Equivalent Antioxidant Capacity (TEAC) and Total Phenols (TP) until Total Polar Compounds (TPCs) reached 25%. Sesame lignan transformations were monitored through Reverse-phase HPLC. While TPCs in olive oils increased at a steady rate, the addition of 5%, 10% and 20% v/v SO created a time window lasting 1, 2 and 3 hours, respectively, where TPCs were constant. SO addition to OO increased the total frying time. Furthermore, the addition of SO reduced the peroxides formation rate for both OO and EVOO. EVOO was more resistant to oxidation than OO as measured by TPCs and TEAC, while frying time raised from 21.5 to 25.25 h when EVOO replaced OO. The increase in frying time for olive oil but not for extra virgin olive oil, after SO addition, is pointing out a niche market for extra virgin olive oil in deep-frying.

Deep eutectic solvents (DESs) are one of the most rapidly evolving types of solvents, appearing in a broad range of applications such as nanotechnology, electrochemistry, biomass transformation, pharmaceuticals, membrane technology, biocomposite development, modern 3D-printing, and many others. The range of their applicability continues to expand, which demands the development of new DESs with improved properties. To do so requires an understanding of the fundamental relationship between the structure and properties of DESs. Computer simulation and machine learning techniques provide a fruitful approach as they can provide predictions, reveal physical mechanisms and readily be linked to experiments. This review is devoted to the computational research of DESs and describes technical features of DES simulations and the corresponding perspectives on various DES applications. The aim is to demonstrate the current frontiers of computational research of DESs and discuss future perspectives.

Scaffoldings play a critical role as temporary structures in supporting construction processes. Accidents at construction sites frequently stem from issues related to scaffoldings, including insufficient support caused by deviations from the construction design, insecure rod connections, or absence of cross bracing, which result in uneven loading and potential collapse, leading to casualties. In this study, we introduce a deep-learning-based, augmented reality (AR)-enabled system called scaffolding assembly deficiency detection system (SADDS) to assist field inspectors in identifying deficiencies in scaffolding assemblies. Inspectors have the flexibility to utilize SADDS through various devices, such as video cameras, mobile phones, or AR goggles (i.e., Microsoft HoloLens 2), for automated detection of deficiencies in scaffolding assemblies. The training test yielded satisfactory results, with a mean average precision of 0.89 and individual precision values of 0.96, 0.82, 0.90, and 0.89 for “qualified” frames and frames with the “missing cross-tie rod,” “missing lower-tie rod,” and “missing footboard” deficiencies, respectively. Field tests conducted at two construction sites demonstrated improved system performance compared to that in the training test. However, these field tests also revealed certain limitations of the SADDS system.

Depression is considered by WHO as the main contributor to global disability and it poses dangerous threats to approximately all aspects of human life, in particular public and private health. This mental disorder is usually characterized by considerable changes in feelings, routines, or thoughts. With respect to the fact that early diagnosis of this illness would be of critical importance ineffective treatment, some development has occurred in the purpose of depression detection. EEG signals reflect the working status of the human brain by which are considered the most proper tools for a depression diagnosis. Deep learning algorithms have the capacity of pattern discovery and extracting features from the raw data which is fed into them. Owing to this significant characteristic of deep learning, recently, these methods have intensely utilized in the diverse field of researches, specifically medicine and healthcare. Thereby, in this article, we aimed to review all papers concentrated on using deep learning to detect or predict depressive subjects with the help of EEG signals as input data. Regarding the adopted search method, we finally evaluated 22 articles between 2016 and 2021. This article which is organized according to the systematic literature review (SLR) method, provides complete summaries of all exploited studies and compares the noticeable aspects of them. Moreover, some statistical analysis performs to gain a depth perception of the general ideas of the latest researches in this area. A pattern of a five-step procedure was also established by which almost all reviewed articles fulfilled the goal of depression detection. Finally, open issues and challenges in this way of depression diagnosis or prediction and suggested works as the future directions discussed.

In the recent years, intelligent data-driven faultdiagnosis methods on gearboxes have been successfully developedand popularly applied in the industries. Currently, most ofthe machine learning techniques require that the training andtesting data are from the same distribution. However, thisassumption is difficult to be met in the real industries, sincethe gearbox operating conditions usually change in practice,which results in significant data distribution gap and diagnosticperformance deteriorations in applying the learned knowledgeon the new conditions. This paper proposes a deep learning-based domain adaptation method to address this issue. Theraw current signals are directly used as the model inputs fordiagnostics, which are easy to collect in the real industries andfacilitate practical applications. The maximum mean discrepancymetric is introduced to the deep neural network, the optimizationof which guarantees the extraction of generalized machineryhealth condition features across different operating conditions.The experiments on a real-world gearbox condition monitoringdataset validate the effectiveness of the proposed method, whichoffers a promising tool for cross-domain diagnosis in the realindustries.

This paper investigates the use of deep learning techniques to perform energy demand forecasting. Specifically, the authors have adapted a deep neural network originally thought for image classification and composed of a convolutional neural network (CNN) followed by a multilayered fully connected artificial neural network (ANN). The convolutional part of the network was fed with a grid of temperature forecasting data distributed in the area of interest in order to extract a featured temperature. The subsequent ANN is then fed with this calculated temperature along with other data related to the timing of the forecast. The proposed structure was first trained and then used in a real setting aimed to provide the French energy demand forecast using ARPEGE forecasting weather data. The results show that the performance of this approach is in the line of the performance provided by the reference RTE subscription-based service, which opens the possibility to obtain high accuracy forecasting using widely accessible deep learning techniques through open-source machine learning platforms.

The exploitation and use of alternative synthetic methods, in the face of classical procedures that do not conform to the ethics of Green Chemistry, represent an ever present problem in pharmaceutical industry. The procedures for the synthesis of benzimidazoles have become a focus in synthetic organic chemistry, as they are building blocks of strong interest for the development of compounds with pharmacological activity. Various benzimidazole derivatives exhibit important activities such as antimicrobial, antiviral, anti-inflammatory and analgesic and some of the already synthesized compounds have found very strong application in medicine praxis. Here we report a selective and sustainable method for the synthesis of 1,2-disubstituted or 2-substituted benzimidazoles, starting from o-phenylenediamine in the presence of different aldehydes. The use of deep eutectic solvent (DES) both as reaction medium and reagent without any external solvent provides advantages in terms of yields as well as in the work up procedure of the reaction.

Hundreds of millions of people on the planet are affected by malnourishment. This contributes to the vulnerability of large swaths of the population, especially children under five years old extremely vulnerable to diseases and even death in the least developed countries. Today, by providing a substantial share of global protein intake, as well as fatty acids and micronutrients, fisheries contribute to global food security. As fish stocks in the upper sea levels have already been over-exploited, there might not be enough in supplying food security, deep-sea fisheries have been increasingly discussed to address this problem. Some mesopelagic fishes show the potential to provide important nutrients. Another way of supplying food security might be through using mesopelagic fish as fish feed. However, fishing in the mesopelagic zone could lead to severe ecological problems and the impact on the biological carbon pump is uncertain. This paper highlights and juxtaposes different perspectives regarding exploitation pathways of the fish riches of deep seas and reviews best practice model projects that deal with uncertainties related to fishery management in the mesopelagic zone.

Deep learning has recently attracted much attention due to its excellent performance in processing audio, image, and video data. However, few studies are devoted to the field of automatic modulation classification (AMC). It is one of the most well-known research topics in communication signal recognition, which remains challenging for traditional methods due to the complex disturbance from other sources. This paper proposes a heterogeneous deep model fusion (HDMF) method to solve the problem in a unified framework. The contributions include: 1) The convolutional neural network (CNN) and long short-term memory (LSTM) are combined by two different ways without prior knowledge involved; 2) A large database, including eleven types of single-carrier modulation signals with various noises as well as a fading channel, is collected with various signal-to-noise ratios (SNRs) based on a real geographical environment; and 3) Experimental results demonstrate that HDMF is super capable of copping with the AMC problem, and achieves much better performance when compared with the independent network. The source code and the database will be publically available.

In this case series, we examine the impact of the Titan-iR Pro® deep spectrum biotherapeutic device on brain function in healthy individuals. Here we present 15 participants, aged 26-68 years, who enrolled in this open-label study, designed to assess the effect of a single 15-minute course of deep spectrum biotherapy on brain function. Although symptom-free upon enrollment, participants had diverse medical histories with some displaying early signs of cognitive decline. As part of the evaluation, all participants engaged in electroencephalogram (EEG) recording sessions that focused on assessing event-related potential (ERP) evaluations, including audio P300 amplitudes and latencies (speeds), neurocognitive testing, and physical reaction times. Following the Titan-iR Pro intervention an improvement in EEG-based cognitive markers was observed. These results underscore the importance of further investigation into the potential of advanced and deep spectrum photobiomodulation in the prevention and treatment of cognitive decline and other neurological disorders.

Moving object detection plays a crucial role in various applications, particularly in traffic surveillance and collision warning systems. However, the high cost of training and slow detection pose significant challenges to the practicality and real-time performance of existing methods. These challenges hinder the practicality and real-time performance of existing methods. The need for a reliable and efficient moving object detection system prompts the search for cost-effective strategies. Enhancing detection speed without sacrificing accuracy is crucial for real-time applications. Overcoming these challenges is essential to advance the field of moving object detection and improve its applicability in various domains. This paper presents a comprehensive review of the literature on moving object detection, proposes novel strategies to overcome the challenges of high training costs and slow detection. The study emphasizes the importance of reliable speed monitoring systems and advancements in control systems to enhance driver assistance on urban highways. Each frame in the dataset undergoes YOLOv6 processing to detect and classify objects, generating bounding box predictions and class probabilities. Optical flow, specifically the Lucas-Kanade method, is then utilized to compute motion vectors between consecutive frames. These motion vectors facilitate object tracking across frames, enabling refined bounding box positions and improving overall object tracking accuracy. The results demonstrate the effectiveness of the proposed technique in reducing training costs, improving detection speed, and maintaining a high level of accuracy when compared to existing methods. The paper concludes by summarizing the findings and highlighting the potential of the proposed strategy for precise and reliable moving object recognition in real-world traffic scenarios

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

MicroRNAs (miRNAs) are small non-coding RNAs that play a central role in the post-transcriptional regulation of biological processes. miRNAs regulate transcripts by direct binding involving the Argonaute protein family. The exact rules of binding are not known, and several in silico miRNA target prediction methods have been developed to date. Deep Learning has recently revolutionized miRNA target prediction. However, the higher predictive power comes with decreased ability to interpret increasingly complex models. Here, we present a novel interpretation technique, called attribution sequence alignment, for miRNA target site prediction models that can interpret such Deep Learning models on a two-dimensional representation of miRNA and putative target sequence. Our method produces a human readable visual representation of miRNA:target interactions and can be used as a proxy for further interpretation of biological concepts learned by the neural network. We demonstrate applications of this method in clustering of experimental data into binding classes, as well as using the method to narrow down predicted miRNA binding sites on long transcript sequences. Importantly, the presented method works with any neural network model trained on a two-dimensional representation of interactions and can be easily extended to further domains such as protein-protein interactions.

Most machine learning and deep learning algorithms can only use low-dimensional data as input, but the data that must be processed in practical applications is diverse and irregular. There are two main problems with big dynamic data. (1) The size of the embedding table grows linearly with the vocabulary size, resulting in massive memory consumption. (2) For different newly added vocabularies. To solve these two problems, this paper proposes a novel embedding algorithm that can learn attribute associations with entities based on deep and hash algorithms. Taking movie data as an example, the encoding method and the specific flow of the algorithm are presented in detail, and the effect of dynamic reuse of data models is realized. Compared with the four existing embedding algorithms which can fuse entity attribute information, the deep hash embedding algorithm proposed in this paper has obvious optimization of time and space complexity.

COVID-19 has a severe risk of spreading rapidly, the quick identification of which is essential. In this regard, chest radiology images have proven to be a practical screening approach for COVID-19 affected patients. This study proposes a deep learning-based approach using Densenet-121 to detect COVID-19 patients effectively. We have trained and tested our model on the COVIDx dataset and performed both 2-class and 3-class classification, achieving 96.49% and 93.71% accuracy, respectively. By successfully utilizing transfer learning, we achieve comparable performance to the state-of-the-art method while using 15x fewer model parameters. Moreover, we performed an interpretability analysis using Grad-CAM to highlight the most significant image regions at test time. Finally, we developed a website that takes chest radiology images as input and detects the presence of COVID-19 or pneumonia and a heatmap highlighting the infected regions. Source code for reproducing results and model weights are available.

Carbon dioxide capture and storage (CCS) is highly expected to be mitigating the discharges of carbon dioxide in a surrounding environment. Solvents are an integral part of CCS. So far, several solvents have been explored the interest of meeting the requirements such as accessibility, non-harmfulness, biocompatibility, recyclability, and inexpensiveness. However, most solvents face failure in fulfilling the requirements due to many factors, so, this review paper gives a brief discussion about another category of solvent, an analogue of ionic liquids (ILs) named deep eutectic solvent (DES). Extensive research has been done on DES in recent years because of their various attractive advantages, i.e., non-poisonousness, biodegradability, cheap cost and easy preparation, that make them as a promising green solvent for many industrial procedure and application, for instance, polymer synthesis, biodiesel treatment, green chemistry, electrochemistry etc. Therefore, this manuscript mainly focusses on CO2 capturing through DES in oil and gas field. In addition, the preparation and chemical structures of this novel solvent (DES) is also discussed. Moreover, a detailed study based on experimental solubility of CO2 in DESs is also reported in this article.

We overview recent progress in growth aspects of group III-nitride heterostructures for deep ultraviolet (DUV) light-emitting diodes (LEDs), with particular emphasis on the growth approaches for attaining high-quality AlN and high Al-molar fraction AlGaN. The discussion commences with the introduction of the current status of group III-nitride DUV LEDs and the remaining challenges. This segues into discussion of LED designs enabling high device performance followed by the review of advances in the methods for the growth of bulk single crystal AlN intended as a native substrate together with a discussion of its UV transparency. It should be stated, however, that due to the high-cost of bulk AlN substrates at the time of this writing, the growth of DUV LEDs on foreign substrates such as sapphire still dominates the field. On the deposition front, the heteroepitaxial growth approaches incorporate high-temperature metal organic chemical vapor deposition (MOCVD) and pulsed-flow growth, a variant of MOCVD, with the overarching goal of enhancing adatom surface mobility, and thus epitaxial lateral overgrowth which culminates in minimization the effect of lattice- and thermal-mismatches. This is followed by addressing the benefits of pseudomorphic growth of strained high Al-molar fraction AlGaN on AlN. Finally, methods utilized to enhance both p- and n-type conductivity of high Al-molar fraction AlGaN are reviewed.

Deep eutectic solvents have emerged as a greener alternative and have attracted so much interest in the last two decades. This paper present alternative synthesis method to classical heating-stirring. The ultrasound method is one of the most promising syntheses DESs in terms of yield and energy. So, ultrasound synthesis method was studied to obtain hydrophobic (Aliquat 336: L-Menthol 3:7; Li-docaine: decanoic acid 1:2) and hydrophilic DESs based on Choline chloride and urea, ethylene glycol and oxalic acid. The physical characterization of DESs by comparison of FTIR spectra no show difference between DESs obtained by heating-stirring and ultrasound synthesis methods. The RMN spectra of the DESs obtained by heating-stirring revealed the DESs formation. Density and viscosity properties of DESs were evaluated. The density values are similar for both synthesis methods. However, lower viscosity values are obtained to the hydrophilic DESs prepared by ul-trasound methods.

Unmanned aerial vehicle (UAV) photogrammetry allows the generation of orthophoto and digital surface model (DSM) rasters of a terrain. However, DSMs of water bodies mapped using this technique often reveal distortions in the water surface, thereby impeding the accurate sampling of water surface elevation (WSE) from DSMs. This study investigates the capability of deep neural networks to accommodate the aforementioned perturbations and effectively estimate WSE from photogrammetric rasters. Convolutional neural networks (CNNs) were employed for this purpose. Two regression approaches utilizing CNNs were explored: direct regression employing an encoder and solution based on prediction of the weight mask by an encoder-decoder architecture, subse-quently used to sample values from the photogrammetric DSM. The dataset employed in this study comprises data collected from five case studies of small lowland streams in Poland and Denmark, consisting of 322 DSM and orthophoto raster samples. Each sample corresponds to a 10 by 10 meter area of the stream channel and adjacent land. A grid search was employed to identify the optimal combination of encoder, mask generation architecture, and batch size among multiple candidates. Solutions were evaluated using two cross-validation methods: stratified k-fold cross-validation, where validation subsets maintained the same proportion of samples from all case studies, and leave-one-case-out cross-validation, where the validation dataset originates entirely from a single case study, and the training set consists of samples from other case studies. The proposed solution was compared with existing methods for measuring WSE in small streams using a drone. The results indicate that the solution outperforms previous photogrammetry-based methods and is second only to the radar-based method, which is considered the most accurate method available. The solution is characterized by a high degree of explainability and generalization.

Neutral facial expression recognition is of great importance in various domains and applications. This study introduces a data-centric approach for neutral facial expression recognition, presenting a comprehensive study that explores different methodologies, techniques, and challenges in the field to foster a deeper understanding. The results show that data augmentation plays a crucial role in improving dataset performance. Additionally, the study investigates different model architectures and training techniques to identify the most effective approach, with the InceptionV3 model achieving the highest accuracy of 72%. Furthermore, the research examines the influence of preprocessing methods on the performance of both InceptionV3 and a simplified CNN model. Interestingly, the results indicate that preprocessing techniques positively affect the performance of the simpler CNN model but negatively impact the InceptionV3 model. The implemented system, used to evaluate the findings, demonstrates promising results, correctly classifying 77% of neutral expressions. However, there are still areas for improvement. Creating a specialized dataset that includes both neutral and non-neutral expressions would greatly enhance the accuracy of the system. By addressing limitations and implementing suggested improvements, neutral facial expression recognition can be significantly enhanced, leading to more effective and accurate results.

A long time has passed since COVID-19 was discovered and widely disseminated. Both machine learning and deep learning have moved towards the research of diagnosing COVID-19. Compared to deep learning, traditional machine learning-based methods can also achieve good diagnostic results if they are improved based on innovative points. And deep learning remains a more popular research object. Based on the deep neural network in the field of deep learning, the convolutional neural network, recurrent neural network, long and short-term memory network, and Transformer model have been extended. These models improve the performance and processing power of neural networks by introducing new structures and algorithms. This paper will introduce the basic concepts of machine learning and deep learning, as well as the details of using the relevant methods of both to help diagnose COVID-19.

Objective A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data. Approach PyCharm, a Python platform, will be used to house and process the CNN. The raw data used for the training of the CNN will be sourced from the PhysioBank website. The EEG signal data will then be pre-processed using Brainstorm software that is a toolbox used in conjunction with MATLAB. The sample data used to validate and test the trained CNN, will be also be extracted from Brainstorm but in a much smaller size compared to the training data which is comprised of thousands of images. The sample size would be comparable to a person wearing a Brain Computer Interface (BCI), offering approximately 20 seconds of motor imagery signal data. Results The raw EEG data was successfully extracted and pre-processed. The deep learning model was trained using the extracted image data along with their corresponding labels. After training, it was able to accurately identify the T1 class label at 100 percent. The python coding was then modified to restore the trained model and feed it test sample data in which it was found to recognise 6 out of 10 lines of T1 signal image data. The result suggested that the initial training of the model required a different, more varying approach, so that it would be able to detect varying sample signal image data. The outcome of which could mean that the model could be used in applications for multiple patients wearing the same BCI hardware to control a device or interface.

The use of Attitude and Heading Reference Systems (AHRS) for orientation estimation is now common practice in a wide range of applications, e.g., robotics and human motion tracking, aerial vehicles and aerospace, gaming and virtual reality, indoor pedestrian navigation and maritime navigation. The integration of the high-rate measurements can provide very accurate estimates, but these can suffer from errors accumulation due to the sensors drift over longer time scales. To overcome this issue, inertial sensors are typically combined with additional sensors and techniques. As an example, camera-based solutions have drawn a large attention by the community, thanks to their low-costs and easy hardware setup; moreover, impressive results have been demonstrated in the context of Deep Learning. This work presents the preliminary results obtained by DOES , a supportive Deep Learning method specifically designed for maritime navigation, which aims at improving the roll and pitch estimations obtained by common AHRS. DOES recovers these estimations through the analysis of the frames acquired by a low-cost camera pointing the horizon at sea. The training has been performed on the novel ROPIS dataset, presented in the context of this work, acquired using the FrameWO application developed for the scope. Promising results encourage to test other network backbones and to further expand the dataset, improving the accuracy of the results and the range of applications of the method.

Segmentation of Magnetic Resonance Images (MRI) of abdominal organs is useful for analysis prior to surgical procedures and for further processing. Deep Learning (DL) has become the standard, researchers have proposed improvements that include multiple views, ensembles and voting. Loss function alternatives, while being crucial to guide automated learning, have not been compared in detail. In this work we analyze limitations of popular metrics and their use as loss, study alternative loss variations based on those and other modifications and search for the best approach. An experimental setup was necessary to assess the alternatives. Results for the top scoring network and top scoring loss show improvements between 2 and 11 percentage points (pp) in Jaccard Index (JI), depending on organ and patient (sequence), for a total of 22 pp over 4 organs, all this being obtained just by choosing the best performing loss function instead of cross-entropy or dice. Our results apply directly to MRI of abdominal organs, with important practical implications for other architectures, as they can be applied easily to any of them. They also show the worth of variants of loss function and loss tuning, with future work needed to generalize and test in other contexts.

State-of-the-art remote sensing scene classification methods employ different Convolutional Neural Network architectures for achieving very high classification performance. A trait shared by the majority of these methods is that the class associated with each example is ascertained by examining the activations of the last fully connected layer, and the networks are trained to minimize the cross-entropy between predictions extracted from this layer and ground-truth annotations. In this work, we extend this paradigm by introducing an additional output branch which maps the inputs to low dimensional representations, effectively extracting additional feature representations of the inputs. The proposed model imposes additional distance constrains on these representations with respect to identified class representatives, in addition to the traditional categorical cross-entropy between predictions and ground-truth. By extending the typical cross-entropy loss function with a distance learning function, our proposed approach achieves significant gains across a wide set of benchmark datasets in terms of classification, while providing additional evidence related to class membership and classification confidence.

The establishment of thresholds is integral to environmental management. This paper introduces the use of thresholds in the context of deep-seabed mining, a nascent industry for which an exploitation regime of regulations, standards and guidelines is still in the process of being developed, and for which the roles and values of thresholds have yet to be finalised. There are several options for integrating thresholds into the International Seabed Authority’s regulatory regime, from being stipulated in regulations to being part of a mining contract, each option having its own advantages and disadvantages. Here we explore the range of ways that thresholds can be derived, set out the challenges in translating ecological and management data into thresholds, highlight factors for acceptance and operationalisation of thresholds in deep-seabed mining, and explain the necessity of refining thresholds as knowledge on impacts to features improves. Some comparable marine industries already use thresholds and these could potentially be used as starting points for the development of thresholds for deep-seabed mining. In order to be acceptable to the wide range of deep-seabed mining stakeholders, thresholds need to strike a balance among levels of harm acceptable by society, levels of environmental precaution justifiable by governments, scientific robustness, and operational practicality.

Data collection and analysis are becoming more and more important in a variety of application domains as long as the novel technologies advance. At the same time, we are experiencing a growing need for human-machine interaction with expert systems pushing research through new knowledge representation models and interaction paradigms. In particular, in the last years eHealth - that indicates all the health-care practices supported by electronic elaboration and remote communications - calls for the availability of smart environment and big computational resources. The aim of this paper is to introduce the HOLMeS (Health On-Line Medical Suggestions) framework. The introduced system proposes to change the eHealth paradigm where a trained machine learning algorithm, deployed on a cluster-computing environment, provides medical suggestion via both chat-bot and web-app modules. The chat-bot, based on deep learning approaches, is able to overcome the limitation of biased interaction between users and software, exhibiting a human-like behavior. Results demonstrate the effectiveness of the machine learning algorithms showing 74.65% of Area Under ROC Curve (AUC) when first-level features are used to assess the occurrence of different prevention pathways. When disease-specific features are added, HOLMeS shows 86.78% of AUC achieving a more specific prevention pathway evaluation.

Deep learning has already revolutionised the way we process a wide range of data, in many areas of our daily life. The ability to learn abstractions and relationships from heterogeneous data, has provided impressively accurate prediction and classification tools to handle increasingly big datasets. This has a significant impact on the growing wealth of omics datasets, with the unprecedented opportunity for a better understanding of the complexity of living organisms. While this revolution is transforming the way we analyse these data, explainable deep learning is emerging as an additional tool with the potential to change the way we interpret biological data. Explainability addresses critical issues such as transparency, so important when computational tools are introduced especially in clinical environments. Moreover, it empowers artificial intelligence with the capability to provide new insights in the input data, thus adding an element of discovery to these already powerful resources. In this review we provide an overview of the transformative effects explainable deep learning is having on multiple sectors, ranging from genome engineering and genomics, from radiomics to drug design and clinical trials. We offer a perspective to life scientists, to better understand the potential of these tools, and a motivation to implement them in their research, by suggesting learning resources they can use to move their first steps in this field.

The Bayes filters, such as Kalman and particle filters, have been used in sensor fusion to integrate two sources of information and obtain the best estimate of the unknowns. Efficient integration of multiple sensors requires deep knowledge of their error sources and it is not trivial for complicated sensors, such as Inertial Measurement Unit (IMU). Therefore, IMU error modelling and efficient integration of IMU and Global Navigation Satellite System (GNSS) observations has remained a challenge. In this paper, we develop deep Kalman filter to model and remove IMU errors and consequently, improve the accuracy of IMU positioning. In other words, we add modelling step to the prediction and update steps of Kalman filter and the IMU error model is learned during integration. Therefore, our deep Kalman filter outperforms Kalman filter and reaches higher accuracy.

Background: Genome-wide association studies (GWAS) have shed light on various complex diseases and traits, by detecting more than 400,000 associated genetic loci. This number is expected to drastically increase because of the use of novel artificial intelligence methods offering new ways to study the effects of variants. Deep learning using artificial neural networks (ANN) is a sub-field of artificial intelligence, which simulates how the human brain learns. We aimed at assessing the potential of deep learning in human genetic studies of Alzheimer’s Disease (AD) and how these compare to the traditional statistical methods used in GWAS, by simultaneously testing the two approaches on the same dataset, while discovering new genetic loci associated to AD. Methods: To address this aim, phenotypic and genome-wide SNP data from the UK Biobank was analysed on a binary outcome, AD diagnosis, in two different data balance options, of one-to-one and one-to-two case-control datasets, using 2,764 cases vs 2,764 controls and 5,528 controls respectively matched on gender, age, ethnicity, PC1-20 and genotyping array. Genetic data handling and GWAS were performed using PLINK, whereas neural networks were trained using GenNet, a new ANN tool, with the same datasets, separated into training (60%), validation (20%) and test (20%) sets. Neural network layers were determined using biological knowledge, by annotating SNPs to genes and genes to AD related pathways, using ANNOVAR annotations followed by GeneSCF and KEGG. Results: Significant associations were detected between four SNPs linked to two different genes and AD for the 1 to 1 case-control study design and six SNPs linked to four different genes for the 1 to 2 case-control study design by using PLINK. All identified regions have been previously associated to AD. GenNet identified twelve SNPs on seven genes to be associated with AD, all with biological plausibility, achieving an AUC of 0.80 when using three biologically determined layers and 0.73 when using two layers at the neural networks. No common top SNPs were identified between the machine learning and GWAS models. Conclusion: This is one of the first studies attempting to compare the traditional GWAS to more sophisticated state-of-art methods for understanding the genetic architecture of complex phenotypes using the same dataset. More systematic comparisons with such approaches on real data are needed to enable best practises for machine learning in the analysis of genome-wide genetic data.

This paper explores the use of different deep learning models for predicting precipitation in 56 meteorological stations in Jilin Province, China. The models used include Stacked-LSTM, Transformer, and SVR, and Gaussian noise is added to the data to improve their robustness. Results show that the Stacked-LSTM model performs the best, achieving high prediction accuracy and stability. The study also conducts variable attribution analysis using LightGBM and finds that temperature, dew point, precipitation in previous days, and air pressure are the most important factors affecting precipitation prediction, which is consistent with traditional meteorological theory. The paper provides detailed information on the data processing, model training, and parameter settings, which can serve as a reference for future precipitation prediction tasks. The findings suggest that adding Gaussian noise to the dataset can improve the model's generalization ability, especially for predicting days with zero precipitation. Overall, this study provides useful insights into the application of deep learning models in precipitation prediction and can contribute to the development of meteorological forecasting and applications.

Automatic and real-time pose estimation is important in monitoring animal behavior, health and welfare. In this paper, we utilized pose estimation for monitoring farrowing process to prevent piglet mortality and preserve the health and welfare of sow. State-of-the-art Deep Learning (DL) methods have lately been used for animal pose estimation. The aim of this paper was to probe the generalization ability of five common DL networks (ResNet50, ResNet101, MobileNet, EfficientNet and DLCRNet) for sow and piglet pose estimation. These architectures predict body parts of several piglets and the sow directly from input video sequences. Real farrowing data from a commercial farm was used for training and validation of the proposed networks. The experimental results demonstrated that MobileNet was able to detect seven body parts of the sow with median test error of 0.61 pixels.

This paper presents an improved SOC estimation method for lithium ion batteries in Electric Vehicles using Bayesian optimized feedforward network. This innovative bayesian optimized neural network method attempts to minimize a scalar objective function by extracting hyperpa-rameters (hidden neurons in both layers) using a surrogate model. Furthemore, the hyperparameters are built and data samples are trained and validated. The performance of the proposed deep learning neural network is evaluated. Two reasonable size data samples are ex-tracted from Panasonic 18650PF Li-ion Mendeley datasets that are used for training and valida-tion. RNN and LSTM neural network algorithms offer the common core property of retaining past information and/or hidden states for better SOC estimation. However, the feature of this pro-posed method is the inclusion of Bayesian optimization that chooses optimal double layer hidden neurons. Analysis of results shows that Bayesian optimized feedforward algorithm with average MAPE (0.20%) is the lowest and is the best selection compared with average MAPE for other five deep learning algorithms. In the last quarter of fuel gauge, where fuel anxiety is severe, feed-forward with Bayesian Optimization algorithm is still the best selection (with MAPE of 0.64%).

3D reconstruction from a single 2D input is a classic problem in the field of computer vision. With the advancements in deep learning, the performance of 3D reconstruction has also significantly improved. The reconstruction task is more difficult for objects with no textures or complex deformations. This paper serves as a review of recent literature on 3D reconstruction from a single view, with a focus on deep learning methods from 2018 to 2021. Due to lack of standard datasets or 3D shape representation methods, it is hard make direct comparisons between all reviewed methods. However, this paper reviews different approaches for reconstructing 3d shape as depth maps, surface normals, point clouds and meshes; along with various loss functions and evaluation metrics used to train and evaluate these methods.

Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and explain the results of deep learning algorithms by depicting the anatomical areas which influence the decision of the algorithm most. Moreover, this research presents a unified framework, TorchEsegeta, for applying various interpretability and explainability techniques for deep learning models and generate visual interpretations and explanations for clinicians to corroborate their clinical findings. In addition, this will aid in gaining confidence in such methods. The framework builds on existing interpretability and explainability techniques that are currently focusing on classification models, extending them to segmentation tasks. In addition, these methods have been adapted to 3D models for volumetric analysis. The proposed framework provides methods to quantitatively compare visual explanations using infidelity and sensitivity metrics. This framework can be used by data scientists to perform post-hoc interpretations and explanations of their models, develop more explainable tools and present the findings to clinicians to increase their faith in such models. The proposed framework was evaluated based on a use case scenario of vessel segmentation models trained on Time-of-fight (TOF) Magnetic Resonance Angiogram (MRA) images of the human brain. Quantitative and qualitative results of a comparative study of different models and interpretability methods are presented. Furthermore, this paper provides an extensive overview of several existing interpretability and explainability methods.

Mineral identification is an important part of geological analysis. Traditional identification methods rely on either the experiences of the appraisers or the various measuring instruments and the methods are either easily influenced by the experiences or need too much work. To solve the above problems, there have been studies using image recognition and intelligent algorithms to identify minerals. But the current studies can not identify many minerals, and the accuracy is low. To increase the number of identified mineral categories and the accuracy, we proposed the method that uses both the mineral images and the Mohs hardness in the deep neural networks to identify the minerals. The experimental results showed that the method can reach 94.0% Top-1 accuracy and 99.9% Top-5 accuracy for 28 common minerals. The model that combines image and Mohs hardness together can identify more minerals and increase the accuracy using less training data.

A regularization approach to model selection, within a generalized HJM framework, is introduced which learns the closest arbitrage-free model to a prespecified factor model. This optimization problem is represented as the limit of a one-parameter family of computationally tractable penalized model selection tasks. General theoretical results are derived and then specialized to affine term-structure models where new types of arbitrage-free machine learning models for the forward-rate curve are estimated numerically and compared to classical short-rate and the dynamic Nelson-Siegel factor models.

The escalation of climate change and the increasing frequency of extreme weather events have amplified the importance of precise and timely lightning prediction. This predictive capability is pivotal for the preservation of life, protection of property, and maintenance of crucial infrastructure safety. Recently, the rapid advancement and successful application of data-driven deep learning across diverse sectors, particularly in computer vision and spatio-temporal data analysis, have opened up innovative avenues for enhancing both the accuracy and efficiency of lightning prediction. This article presents a comprehensive review of the broad spectrum of existing lightning prediction methodologies. Starting from traditional numerical forecasting techniques, we traverse the path to the most recent breakthroughs in deep learning research. We encapsulate these diverse methods, shedding light on their progression and summarizing their capabilities, while also predicting their future development trajectories. This exploration is designed to enhance our understanding of these methodologies, allowing us to better utilize their strengths, navigate their limitations, and potentially integrate these techniques to create novel and powerful lightning prediction tools. Through such endeavors, our aim is to bolster our preparedness against the growing unpredictability of our climate and ensure a proactive stance towards lightning prediction.

Osteoporosis is a common problem in orthopedic medicine, and it has become an important medical issue in orthopedics as Taiwan is gradually becoming an aging society. In the diagnosis of osteoporosis, the bone mineral density (BMD) derived from dual-energy X-ray absorptiometry (DXA) is the main criterion for orthopedic diagnosis of osteoporosis, but due to the high cost of this equipment and the lower penetration rate of the equipment compared to the X-ray images, the problem of osteoporosis has not been effectively solved for many people who suffer from osteoporosis, however, at present, in clinical diagnosis, doctors are not yet able to accurately interpret X-ray images for osteoporosis manually, and must rely on the data obtained from DXA. In recent years, with the continuous development of artificial intelligence, especially in machine learning and deep learning, significant progress has been made in image recognition. Therefore, it is worthwhile to revisit whether it is possible to use a convolutional neural network model to read a hip X-ray image and then predict the patient's BMD. In this study, we proposed a hip X-ray image segmentation model and a hip X-ray image recognition classification model. First, we used the U-Net model as a framework to segment the femoral neck, greater trochanter, wards triangle, and the total hip in the hip X-ray images. We then performed image matting and data augmentation. Finally, we constructed a predictive model for osteoporosis using deep learning algorithms. In the segmentation experiments, we used intersection over union (IoU) as the evaluation metric for image segmentation, and both the U-Net and U-Net++ models achieved segmentation results greater than or equal to 0.5. In the classification experiments, using the T-score as the classification basis, the total hip using the DenseNet121 model has the highest accuracy of 74%.

During the last few years, several approaches have been proposed to improve early warning systems for reducing rock-fall risk. In this regard, this paper introduces a Deep learning-and (IoT) based Framework for Rock-fall Early Warning, devoted to reducing the rock-fall risk with high accuracy. In this framework, the prediction accuracy was augmented by eliminating the uncertainties and confusion plaguing the prediction model. In order to achieve augmented prediction accuracy, this framework fused the prediction model-based deep learning with a detection model-based Internet of Things. In order to determine the framework’s performance, this study adopted parameters, namely overall prediction performance measures, based on a confusion matrix and the ability to reduce the risk. The result indicates an increase in prediction model accuracy from 86% to 98.8%. In addition, a framework reduced the risk probability from (1.51 ×10-3) to (8.57 ×10-9). Our results indicate the framework’s high prediction accuracy; it also provides a robust decision-making process for delivering early warning and lowering the rock-fall risk probability.

Smart devices such as smartphones, smartwatches, etc. are promising platforms that are being used for automatic recognition of human activities. However, it is difficult to accurately monitor complex human activities due to inter-class pattern similarity, which occurs when different human activities exhibit similar signal patterns or characteristics. Current smartphone-based recognition systems depend on the traditional sensors such as accelerometer and gyroscope, which are inbuilt in these devices. Therefore, apart from using information from the traditional sensors, these systems lack contextual information to support automatic activity recognition. In this article, we explore environment contexts such as illumination(light conditions) and noise level to support sensory data obtained from the traditional sensors using a hybrid of Convolutional Neural Networks and Long Short Time Memory(CNN_LSTM) learning models. The models performed sensor fusion by augmenting the low-level sensor signals with rich contextual data to improve recognition and generalisation ability of the proposed solution. Two sets of experiments were performed to validate the proposed solution. The first set of experiments used inertial sensing data whilst the second set of extensive experiments combined inertial signals with contextual information from environment sensing data. Obtained results demonstrate that contextual information such as environment noise level and illumination using hybrid deep learning models achieved better recognition accuracy than the traditional activity recognition models without contextual information.

Computer network attacks are evolving in parallel with the evolution of hardware and neural network architecture. Despite major advancements in Network Intrusion Detection System (NIDS) technology, most implementations still depend on signature-based intrusion detection systems, which can’t identify unknown attacks. Deep learning can help NIDS to detect novel threats since it has a strong generalization ability. The deep neural network’s architecture has a significant impact on the model’s results. We propose a genetic algorithm based model to find the optimal number of hidden layers and the number of neurons in each layer of the deep neural network (DNN) architecture for the network intrusion detection binary classification problem. Experimental results demonstrate that the proposed DNN architecture shows better performance than classical machine learning algorithms at a lower computational cost.

In urban areas, deep excavation-induced ground deformation may damage adjacent existing structures and is conventionally evaluated by levelling at installed settlement points. However, a small number of measurements cannot represent the total change in ground deformation adjacent to excavation sites. Furthermore, significant local subsidence may occur in places where settlement points have not been installed and only noticed after an accident. For deep excavation sites located in urban areas, paved pedestrian sidewalks are often located adjacent to sites, and construction activity can cause these paving blocks to displace. This study introduces a method to detect paving block displacement adjacent to deep excavation sites using terrestrial photogrammetry. A digital camera creating point cloud data (PCD) and an acquisition method satisfying the frontal and side overlap requirements were demonstrated. To investigate the displacement detection and measurement capabilities by PCD analysis, an experimental program was conducted, including a PCD comparison containing the uplift, settlement, and horizontal paving block displacement and reference data. The cloud-to-cloud distance computation algorithm was adopted for PCD comparison. Paving block displacement was detected for displacements of 5, 7.5, and 10 mm in the uplift, settlement, and horizontal directions; however, the horizontal displacements were less clear. PCD analysis enabled satisfactory measurements between 0.024 and 0.881 mm for the vertical-displacement cases, but a significant error was observed for the horizontal-displacement cases owing to the cloud-comparison algorithm. The measurement blind spot of limited settlement points was overcome by the proposed method that detected and measured paving block displacement adjacent to excavation sites.

Chronic venous disease (CVD) occurs in a substantial proportion of the world's population. If the onset of CVD looks like a cosmetic defect, then over time, it can develop into serious problems that require surgical intervention. The aim of the work is to use deep learning (DL) methods for automatic classification of the stage of CVD for self-diagnosis of a patient by using the image of the patient’s legs. The required for DL algorithms images of legs with CVD were obtained by using Internet Data Mining. For images preprocessing, the binary classification problem “legs - no legs” was solved based on Resnet50 with accuracy 0.998. The application of this filter made it possible to collect a data set of 11,118 good quality leg images with various stages of CVD. For classification of various stages of CVD according to CEAP classification, the multi classification problem was set and resolved by using two neural networks with completely different architecture - Resnet50 and DeiT. The model based on DeiT without any tuning shows better results than the model based on Resnet50 (precision = 0.770 (DeiT) and 0.615 (Resnet50)). To demonstrate the results of the work, a telegram bot was developed, in which fully functioning DL algorithms are implemented. This bot allows evaluating the condition of the patient's legs with a fairly good accuracy for the CVD classification.

This study proposes a mobile positioning method which adopts recurrent neural network algorithms to analyze the received signal strength indications from heterogeneous networks (e.g., cellular networks and Wi-Fi networks) for estimating the locations of mobile statioThis study proposes a mobile positioning method which adopts recurrent neural network algorithms to analyze the received signal strength indications from heterogeneous networks (e.g., cellular networks and Wi-Fi networks) for estimating the locations of mobile stations. The recurrent neural networks with multiple consecutive timestamps can be applied to extract the features of time series data for the improvement of location estimation. In practical experimental environments, there are 4,525 records, 59 different base stations, and 582 different Wi-Fi access points detected in Fuzhou University in China. The lower location errors can be obtained by the recurrent neural networks with multiple consecutive timestamps (e.g., 2 timestamps and 3 timestamps); the experimental results can be observed that the average error of location estimation was 9.19 meters by the proposed mobile positioning method with 2 timestamps.

Artificial Intelligence (AI) is becoming increasingly important, especially in the medical field. While AI has been used in medicine for some time, its growth in the last decade has been remarkable. Specifically, Machine Learning (ML) and Deep Learning (DL) techniques in medicine have been increasingly adopted thanks to the growing abundance of health-related data, improved suitability of such techniques for managing large data-sets, and more computational power. The Italian scientific community has been instrumental in advancing this research area. This article aims to conduct a comprehensive investigation of the ML and DL methodologies and applications used in medicine by the Italian research community in the last five years.

Stagnation at local optima represents a significant challenge in bio–inspired optimization algorithms, often leading to suboptimal solutions. This paper addresses this issue by proposing a hybrid model that combines the Orca Predator Algorithm with Deep Q–Learning. Orca Predator Algorithm is an optimization technique that mimics the hunting behavior of orcas. It solves complex optimization problems by exploring and exploiting search spaces efficiently. Deep Q–Learning is a reinforcement learning technique that combines Q–Learning with deep neural networks. This integration aims to turn the stagnation problem into an opportunity for more focused and effective exploitation, enhancing the optimization technique’s performance and accuracy. The proposed hybrid model leverages the biomimetic strengths of Orca Predator Algorithm to identify promising regions nearby in the search space, complemented by the fine–tuning capabilities of Deep Q–Learning to navigate these areas precisely. The practical application of this approach is evaluated using the high–dimensional Heartbeat Categorization Dataset, focusing on the feature selection problem. This dataset, comprising complex electrocardiogram signals, provided a robust platform for testing the feature selection capabilities of our hybrid model. Our experimental results are encouraging, showcasing the hybrid strategy capability to identify relevant features without significantly compromising the performance metrics of machine learning models. This analysis was performed by comparing the improved method of Orca Predator Algorithm against its native version and a set of state–of–the–art algorithms.

The intrinsic non-linearity and complexity of suspended sediment dynamics, which are impacted by the geographical variability of basin parameters and temporal climatic patterns, make it difficult to estimate suspended sediment concentration (SSC) accurately in hydrological processes. Deep neural networks (DNNs), a cutting-edge modeling method that can capture the innate non-linearity in hydrological systems, have emerged as a solution to this problem. Using primary data on discharge, SSC, and turbidity, the long short-term memory method of DNNs was employed in this study to simulate the discharge-suspended sediment connection for the Esopus Creek, NY, USA as the first objective. To develop effective modeling strategies, multiple scenarios of feature selection, including combinations of discharge, turbidity and SSC for preceding days, were considered. Secondly, the variations in SSC and discharge between the three USGS gages along Esopus Creek that were upper stream, lower stream, and downstream, adjacent to the pourpoint were analyzed. Statistical metrics and scenarios of feature importance were used to evaluate the effectiveness of the DNN-based models. The study shows that among 24 DNN approaches feature selection is crucial in simulating the daily SSC, and discharge and presenting novel research directions for utilizing machine learning algorithms in water quality.

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a reference signal of different magnitude, or under system parameter change. Such properties make the DL control more attractive for applications that may undergo parameter variation, like sensor networks.

Face recognition is a valuable forensic tool for criminal investigators since it certainly helps in identifying individuals in scenarios of criminal activity like fugitives or child sexual abuse. It is, however, a very challenging task as it must be able to handle low-quality images of real world settings and fulfill real time requirements. Deep learning approaches for face detection have proven to be very successful but they require a large computation power and processing time. In this work, we evaluate the speed-accuracy tradeoff of three popular deep-learning-based face detectors on the WIDER Face and UFDD data sets in several CPUs and GPUs. We also develop a regression model capable to estimate the performance, both in terms of processing time and accuracy. We expect this to become a very useful tool for the end user in forensic laboratories in order to estimate the performance for different face detection options. Experimental results showed that the best speed-accuracy tradeoff is achieved with images resized to 50% of the original size in GPUs and images resized to 25% of the original size in CPUs. Moreover, performance can be estimated using multiple linear regression models with a Mean Absolute Error (MAE) of 0.113 what is very promising for the forensic field.

The necessity for effective intrusion detection systems (IDS) in big data environments has grown critical due to the rising prevalence of big data systems and the rising amount of security threats. Applying conventional intrusion detection methods to the enormous and intricate data produced by big data ecosystems presents difficulties. Deep learning, has proven to be exceptionally adept at deciphering complex, large-scale data. This study proposes a Deep Learning-based Intrusion Detection System (IDS) created specifically for the Big Data environment. Traditional intrusion detection systems struggle to efficiently identify and prevent cyber threats due to the ever-increasing volume and complexity of data in current networks. We suggest an IDS that makes use of Deep Learning (CNN, LSTM, GAN, etc.), to address this problem. These cutting-edge neural network topologies give the system the ability to process and analyze massive amounts of data for precise intrusion detection. Data collection, data preprocessing, feature engineering, DL model training, intrusion detection, warning generation, and reaction are some of the crucial parts of the suggested IDS. The data collection module mines the Big Data environment for network traffic, system logs, and security event information. To make sure the data is suitable for analysis, it is preprocessed. To improve the detection abilities of the DL models, important features are extracted from the data using feature engineering approaches.

Intelligent systems are transforming the world, as well as our healthcare system. We propose a deep learning-based cough sound classification model that can distinguish between children with healthy versus pathological coughs such as asthma, upper respiratory tract infection (URTI), and lower respiratory tract infection (LRTI). In order to train a deep neural network model, we collected a new dataset of cough sounds, labelled with clinician's diagnosis. The chosen model is a bidirectional long-short term memory network (BiLSTM) based on Mel Frequency Cepstral Coefficients (MFCCs) features. The resulting trained model when trained for classifying two classes of coughs -- healthy or pathology (in general or belonging to a specific respiratory pathology), reaches accuracy exceeding 84\% when classifying cough to the label provided by the physicians' diagnosis. In order to classify subject's respiratory pathology condition, results of multiple cough epochs per subject were combined. The resulting prediction accuracy exceeds 91\% for all three respiratory pathologies. However, when the model is trained to classify and discriminate among the four classes of coughs, overall accuracy dropped: one class of pathological coughs are often misclassified as other. However, if one consider the healthy cough classified as healthy and pathological cough classified to have some kind of pathologies, then the overall accuracy of four class model is above 84\%. A longitudinal study of MFCC feature space when comparing pathologicial and recovered coughs collected from the same subjects revealed the fact that pathological cough irrespective of the underlying conditions occupy the same feature space making it harder to differentiate only using MFCC features.

An adaptive deep neural network is used in an inverse system identification setting to approximate the inverse of a nonlinear plant with the aim of constituting the plant controller by copying to the latter the weights and architecture of the converging deep neural network. This deep learning (DL) approach to the adaptive inverse control (AIC) problem is shown to outperform adaptive filtering techniques and algorithms normally used in adaptive control, especially when the plant is nonlinear. The deeper the controller the better the inverse function approximation, provided that the nonlinear plant have an inverse and that this inverse can be approximated. Simulation results prove the feasibility of this DL-based adaptive inverse control scheme. The DL-based AIC system is robust to parameter change of the nonlinear plant in that, under such change, the plant output reassumes the value of the reference signal considerably faster than with the adaptive filter counterpart of the deep neural network. Settling times and rise times of the step response are shown to improve in the DL-based AIC system.

We live in a complex world characterised by complex people, complex times, and complex social, technological, and ecological environments. There is clear evidence that governments are failing at most public matters. The recent COVID-19 pandemic is a high example of global governance failure both at preventing such pandemics and managing the COVID-19 pandemic. It is time that all of us take responsibility and look into ways of collaboratively improving the governance of public matters, our matters. While there are many reasons for government failures, we believe the lack of information availability is a fundamental reason that limits the government’s ability to act smartly and allows the lack of transparency to creep into policy and action leading to corruption and failure. To this end, this paper introduces the concept of deep journalism, a data-driven deep learning-based approach for discovering multi-perspective parameters related to a topic of interest. We build three datasets (a newspaper, a technology magazine, and a Web of Science dataset) and discover the academic, industrial, public, governance, and political parameters for the transportation sector as a case study to introduce deep journalism and our tool DeepJournal (Version 1.0) that implements our proposed approach. We elaborate on 89 transportation parameters and hundreds of dimensions reviewing 400 technical, academic, and news articles. The findings related to the multi-perspective view of transportation reported in this paper show that there are many important problems seen by the public that industry and academia seem to not place their focus on. On the other hand, academia produces much broader and deeper knowledge on the subject such as a wide range of pollutions affecting the people and planet do not get to reach the public eye. Our deep journalism approach could find the gaps and highlight them to the public and other stakeholders.

The IEEE 802.11ah standard is introduced to address the growing scale of Internet of Things (IoT) applications. To reduce contention and enhance energy efficiency within the system, the restricted access window (RAW) mechanism is introduced at the medium access control (MAC) layer to manage the significant number of stations accessing the network. However, the RAW parameters need to be appropriately determined to achieve optimal network performance. In this paper, we optimize the configuration of RAW parameters in the IEEE 802.11ah-based IoT network. We analyze and propose an RAW parameters optimization problem with the objective of improving network throughput and formulate it as a Markov decision process. To cope with the complex and dynamic network conditions, we propose a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm to find the optimal RAW parameters. We construct network environments with periodic and random traffic in the NS-3 simulator to validate the performance of the proposed PPO-based RAW parameters optimization algorithm. Simulation results reveal that using the PPO-based DRL algorithm, optimal RAW parameters can be obtained under different network conditions, thereby significantly improving network throughput.

This review provides a systematic analysis of the literature data on the electrodeposition of composite coatings using plating baths based on a new generation of room-temperature ionic liquids, known as deep eutectic solvents (DESs). Such systems offer several advantages over traditionally used aqueous electrolytes and organic solvent-based electrolytes. The colloidal-chemical properties of suspension and colloidal electrolytes for composite deposition are thoroughly examined. New theories describing the kinetics of co-deposition of composite layers are characterized. The kinetics and mechanism of electrochemical deposition processes of composite coatings with metallic matrices are discussed. Case studies regarding the electrodeposition of composite coatings based on electrodeposited copper, silver, zinc, tin, nickel, cobalt, and chromium from DES-assisted electroplating baths are described and systematized. The main prospective directions for further research in the discussed scientific area are highlighted.

As one of the critical state parameters of the battery management system, lithium battery state of charge (SOC) can provide an essential reference for battery safety management, charge/discharge control, and energy management of electric vehicles. To analyze the application of deep learning in electric vehicle power battery SOC estimation, this study reviewed the technical process, common public datasets, and the neural networks used, structural characteristics, advantages and disadvantages of lithium battery SOC estimation in deep learning method. First, the specific technical processes of the deep learning method for SOC estimation were analyzed, including data collection, data preprocessing, feature engineering, model training, and model evaluation. Secondly, the current commonly and publicly used lithium battery dataset was summarized. Then, the input variables, data sets, errors, and advantages and disadvantages of four types of deep learning methods, were concluded using the structure of neural network used for training as the classification criterion. Finally, the challenges and future development directions of lithium battery SOC estimation in deep learning method were explained.

In this review we summarize existing trends of flow control used to improve the aerodynamic efficiency of wings. We first discuss active methods to control turbulence, starting with flat-plate geometries and building towards the more complicated flow around wings. Then, we discuss active approaches to control separation, a crucial aspect towards achieving high aerodynamic efficiency. Furthermore, we highlight methods relying on turbulence simulation, and discuss various levels of modelling. Finally, we thoroughly revise data-driven methods, their application to flow control, and focus on deep reinforcement learning (DRL). We conclude that this methodology has the potential to discover novel control strategies in complex turbulent flows of aerodynamic relevance.

This paper presents the results of the experimental research and numerical analysis of three reinforced concrete deep beams with openings, designed by the Strut-and-Tie method according to the EN 1992-1-1 recommendations. All tested specimens were made in full size, with the same geometric characteristics and quality of the materials. The specimens, constructed as simply supported beams, were loaded with two concentrated forces and were tested for bending until failure. Each specimen was reinforced with different reinforcement layout determined by parameter variation within the Strut-and-Tie method. Based on the results of experimental research, it was concluded that the behavior of loaded members was in agreement with the proposed forms of the Strut-and-Tie models that were used for their design.

The paper presents a synthesis of deep eutectic solvents (DESs) based on choline chloride (ChCl) as hydrogen bond acceptor and phenol (Ph), glycol ethylene (EG), and levulinic acid (Lev) as hydrogen bond donors in 1:2 molar ratio. DESs were successfully used as absorption solvents for removal of dimethyl disulfide from (DMDS) from model biogas steam. Several parameters affecting the absorption capacity and absorption rate has been optimized including kind of DES, temperature, the volume of absorbent, model biogas flow rate, and initial concentration of DMDS. Furthermore, reusability and regeneration of DESs by means of adsorption and nitrogen barbotage followed by the mechanism of absorptive desulfurization by means of density functional theory (DFT) as well as FT-IR analysis were investigated. Experimental results indicate that the most promising DES for biogas purification is ChCl:Ph, due to high absorption capacity, relatively long absorption rate, and easy regeneration. The research on the absorption mechanism revealed that van der Waal interaction is the main driving force for DMDS removal from model biogas.

To improve the tangerine crop yield, the work of recognizing and then disposing of specific pests is becoming increasingly important. The task of recognition is based on the features extracted from the images that have been collected from websites and outdoors. Traditional recognition and deep learning methods, such as KNN (k-nearest neighbors) and AlexNet, are not preferred by knowledgeable researchers, who have proven them inaccurate. In this paper, we exploit four kinds of structures of advanced deep learning to classify 10 citrus pests. The experimental results show that Inception-ResNet-V3 obtains the minimum classification error.

Recent advances in artificial intelligence combined with behavioral sciences have led to the development of cutting-edge tools for recognizing human emotions based on text, video, audio, and physiological data. However, these data sources are expensive, intrusive, and regulated, unlike plants which have been shown to be sensitive to human steps and sounds. A methodology is proposed to use plants as human emotion detectors. Electrical signals from plants are tracked and labeled based on video data. Labeled data are then used for classification. MLP, biLSTM, MFCC-CNN, MFCC-ResNet, and additionally, Random Forests, 1-Dimensional CNN, and biLSTM without windowing models are set using a grid search algorithm with cross-validation. Finally, best-parameterized models are trained and used with the test set for classification. The performance of this methodology is measured with a case study with 54 participants, who were watching an emotionally charged video, as ground truth their facial emotions were simultaneously measured using face emotion analysis. The Random Forest model shows the best performance, particularly in recognizing high-arousal emotions, achieving an overall weighted accuracy of 55.2% and demonstrating high weighted recall in emotions such as fear 61.0% and happiness 60.4%. The MFCC-ResNet model offers decently balanced results, with Accuracy(MFCC-ResNet)=0.318 and Recall (MFCC-ResNet)=0.324. With the MFCC-ResNet model fear and anger are recognized with 75% and 50% recall respectively. Thus, using plants as an emotion recognition tool seems worth investigating, addressing both cost and privacy concerns.

Autism Spectrum Disorder (ASD) is a neuro developmental condition that impacts social interac-tion, communication, and behavior. It is called a spectrum because its symptoms and degrees of severity can vary greatly from one person to the next. Differentiations in brain structure and function have been observed between autistic and typically developing brains. Various aspects of brain function, including information processing, sensory perception, and the capacity to interpret and respond to social cues, may be affected by these differences. The signs and symptoms of ASD are readily apparent to parents in the first few years of their child’s life. The symptoms of ASD, it is said, first appear in early childhood and continue into maturity. Brain MRI analysis utilizing deep learning methods show encouraging findings in the study of ASD. In this study, we look at how well a customized VGG16 architecture compares models that have already been trained. Inception v3, ResNet50, DenseNet121, and MobileNet are used to identify and analyze ASD problems in a brain MRI dataset from people with ASD. The proposed methods have been vali-dated on the unlabeled ABIDE 1 dataset that is freely available to the public. After the unlabeled data has been clustered, five different Deep Learning (DL) methods are used and compared. The results are compared to those of other studies that have already been conducted.

Over the last several decades, large wildfires are increasingly common across the United States causing disproportionate impact on forest health and function, human well-being, and economy. Here, we examine the severity of large wildfires across the Contiguous United States over the past decade (2011-2020) using a wide array of meteorological, vegetational, and topographical features in the Deep Neural Network model. A total of 4,538 wildfire incidents were used in the analysis covering 87,305 square miles of burned area. We observed the highest number of large wildfires in California, Texas, and Idaho, with lightning causing 43 % of these incidents. Importantly, results indicate that the severity of wildfire occurrences is highly correlated with the climatological forcings, land cover, location, and elevation of the ecosystem. Overall, results may serve useful guide in managing landscapes under changing climate and disturbance regimes.