Deep learning has taken over - both in problems beyond the realm of traditional, hand-crafted machine learning paradigms as well as in capturing the imagination of the practitioner sitting on top of petabytes of data. While the public perception about the efficacy of deep neural architectures in complex pattern recognition tasks grows, sequentially up-to-date primers on the current state of affairs must follow. In this review, we seek to present a refresher of the many different stacked, connectionist networks that make up the deep learning architectures followed by automatic architecture optimization protocols using multi-agent approaches. Further, since guaranteeing system uptime is fast becoming an indispensable asset across multiple industrial modalities, we include an investigative section on testing neural networks for fault detection and subsequent mitigation. This is followed by an exploratory survey of several application areas where deep learning has emerged as a game-changing technology - be it anomalous behavior detection in financial applications or financial time-series forecasting, predictive and prescriptive analytics, medical imaging, natural language processing or power systems research. The thrust of this review is on outlining emerging areas of application-oriented research within the deep learning community as well as to provide a handy reference to researchers seeking to embrace deep learning in their work for what it is: statistical pattern recognizers with unparalleled hierarchical structure learning capacity with the ability to scale with information.

The world's growing population is highly dependent on animal agriculture. Animal products provide nutrient-packed meals that help to sustain individuals of all ages in communities across the globe. As the human demand for animal proteins grows, the agricultural industry must continue to advance its efficiency and quality of production. One of the most commonly farmed livestock is poultry and their significance is felt on a global scale. Current poultry farming practices result in the premature death and rejection of billions of chickens on an annual basis before they are processed for meat. This loss of life is concerning regarding animal welfare, agricultural efficiency, and economic impacts. The best way to prevent these losses is through the individualistic and/or group level assessment of animal on a continuous basis. On large-scale farms, such attention to detail was generally considered to be inaccurate and inefficient, but with the integration of Artificial Intelligence (AI) assisted technology individualized and per-herd assessments of livestock are possible and accurate. Various studies have shown cameras linked with specialized systems of AI can properly analyze flocks for health concerns, thus improving the survival rate and product quality of farmed poultry. Building on the recent advancements, this review explores the aspects of AI in the detection, counting and tracking of the poultry in commercial and research-based applications.

In recent years, applying deep learning to solve physics problems has attracted much attention. Data-driven deep learning methods produce operators that can learn solutions to the whole system of partial differential equations. However, the existing methods are only evaluated on simple flow equations (e.g., Burger's equation), and only consider the generalization ability on different initial conditions. In this paper, we construct CFDBench, a benchmark with four classic problems in computational fluid dynamics (CFD): lid-driven cavity flow, laminar boundary layer flow in circular tubes, dam flows through the steps, and periodic Karman vortex street. Each flow problem includes data with various boundary conditions, fluid physical properties, and domain geometries. Compared to existing datasets, the advantages of CFDBench are (1) comprehensive. It contains common physical parameters such as velocity, pressure, and cavity fraction. (2) realistic. It is very suitable for deep learning solutions of fluid mechanics equations. (3) challenging. It has a certain learning difficulty, prompting to find models with strong learning ability. (4) standardized. CFDBench facilitates a comprehensive and fair comparison of different deep learning methods for CFD. We make appropriate modifications to popular deep neural networks to apply them to CFDBench and enable the accommodation of more changing inputs. The evaluation on CFDBench reveals some new shortcomings of existing works and we propose possible directions for solving such problems.

Through the development of the metaverse concept from the Sumerian myth (5500 - 1800 BC) and mind-altering novel, “Snow Crash” in 1992, to today’s information age, human- and society-centred urban metaverse worlds, an extension of residents and urban society where the virtual and the physically real blend and are more organically integrated, are meant to mirror the fabric of urban life with no harm to their residents. The success of urban metaverse cybercommunities depends on the quality of data-driven Smart City (SC) Digital Twins (DTs), the seamless exchange of data between cyber and physical worlds (e.g. between residents and their counterpart “Avatars’’) and the processing of the data effectively and efficiently with no vicious interventions. The potential risks in this ecosystem that incorporates Web3 can be extremer than the ones in Web2 since users are immersed with multiple tightly coupled wearable sensor-rich devices perceiving the blend of the real and the virtual with possible imminent negative experiences. This study, by analysing potential cyberthreats in the urban metaverse cyberspaces, proposes a blockchain-based Decentralised Privacy-Preserving Machine Learning (DPPML) authentication and verification technique, which uses the metaverse immersive devices and can be instrumented effectively against identity impersonation and theft of credentials, identity, or avatars.

A radial basis function network (RBFN) method is proposed to reconstruct daily Sea surface temperatures (SSTs) with limited SST samples. For the purpose of evaluating the SSTs using this method, non-biased SST samples in the Pacific Ocean (10°N–30°N, 115°E–135°E) are selected when the tropical storm Hagibis arrived in June 2014, and these SST samples are obtained from the OISST products according to the distribution of AVHRR L2p SST and in-situ SST data. Furthermore, an improved nearest neighbor cluster (INNC) algorithm is designed to search the optimal hidden knots for RBFNs from both the SST samples and the background fields. Then the reconstructed SSTs from the RBFN method are compared with the results from the optimum interpolation (OI) method. The statistical results show that the RBFN method has a better performance of reconstructing SST than the OI method in the study, and the average RMSE is 0.48°C for the RBFN method, which is quite smaller than the value of 0.69°C for the OI method. Additionally, the RBFN methods with different basis functions and clustering algorithms are tested, and we discover that the INNC algorithm with multi-quadric function is quite suitable for the RBFN method to reconstruct SSTs when the SST samples are sparsely distributed.

We present a method to improve the reconstruction and generation performance of variational autoencoder (VAE) by injecting an adversarial learning. On the other hand, instead of comparing the reconstructed with the original data to calculate the reconstruction loss, we use a consistency principle for deep features. The training process of the VAE is then divided into two steps, training the encoder and then training the decoder. By using this two-step learning process, our method can be more widely used in applications other than image processing. While training the encoder, the label information is integrated to better structure the latent space in a supervised way. The adversarial constraints allow the decoder to generate data with better authenticity and more realistic than the conventional VAE. We present experimental results to show that our method gives better performance than the original VAE.

Deep reinforcement learning (DRL) has achieved significant results in many Machine Learning (ML) benchmarks. In this short survey we provide an overview of DRL applied to trading on financial markets, including a short meta-analysis using Google Scholar, with an emphasis on using hierarchy for dividing the problem space as well as using model-based RL to learn a world model of the trading environment which can be used for prediction. In addition, multiple risk measures are defined and discussed, which not only provide a way of quantifying the performance of various algorithms, but they can also act as (dense) reward-shaping mechanisms for the agent. We discuss in detail the various state representations used for financial markets, which we consider critical for the success and efficiency of such DRL agents. The market in focus for this survey is the cryptocurrency market.

Rainfall retrieval using geostationary satellites provides critical means to the monitoring of extreme rainfall events. Using the relatively new Himawari 8 meteorological satellite with three times more channels than its predecessors, the deep learning framework of “convolutional autoencoder” (CAE) was applied to the extraction of cloud and precipitation features. The CAE method was incorporated into the Convolution Neural Network version of the PERSIANN precipitation retrieval that uses GOES satellites. By applying the CAE technique with the addition of Residual Blocks and other modifications of deep learning architecture, the presented derivation of PERSIANN operated at the Central Weather Bureau of Taiwan (referred to as PERSIANN-CWB) expands four extra convolution layers to fully use Himawari 8’s infrared and water vapor channels, while preventing degradation of accuracy caused by the deeper network. The development of PERSIANN-CWB was trained over Taiwan for its diverse weather systems and localized rainfall features, and the evaluation reveals an overall improvement from its CNN counterpart and superior performance over all other rainfall retrievals analyzed. Limitation of this model was found in the derivation of typhoon rainfall, an area requiring further research.

One of the most important challenges in the Machine and Deep Learning areas today is to build good models using small datasets, because sometimes it is not possible to have large ones. Several techniques have been proposed in the literature to address this challenge. This paper aims at studying the different available Deep Learning techniques and performing a thorough experimentation to analyze which technique or combination thereof improves the performance and effectiveness of the models. A complete comparison with classical Machine Learning techniques was carried out, to contrast the results obtained using both techniques when working with small datasets. Thirteen algorithms were implemented and trained using three different small datasets (MNIST, Fashion MNIST, and CIFAR-10). Each experiment was evaluated using a well-established set of metrics (Accuracy, Precision, Recall, F1, and the Matthews correlation coefficient). The experimentation allowed concluding that it is possible to find a technique or combination of them to mitigate a lack of data, but this depends on the nature of the dataset, the amount of data, and the metrics used to evaluate them.

Data collected at the Cascais tide gauge, located on the west coast of Portugal Mainland, have been analyzed and sea level rise rates have been updated. Based on a bootstrapping linear regression model and on polynomial adjustments, time series are used to calculate different empirical projections for the 21^st century sea level rise, by estimating the initial velocity and its corresponding acceleration. The results are consistent to an accelerated sea level rise, showing evidence of a faster rise than previous century estimates. Based on different numerical methods of second order polynomial fitting, it is possible to build a set of projection models of relative sea level rise. Appling the same methods to regional sea level anomaly from satellite altimetry, additional projections are also built with good consistency. Both data sets, tide gauge and satellite altimetry data, enabled the development of an ensemble of projection models. The relative sea level rise projections are crucial for national coastal planning and management since extreme sea level scenarios can potentially cause erosion and flooding. Based on absolute vertical velocities obtained by integrating global sea level models, neo-tectonic studies and permanent Global Positioning System (GPS) station time series, it is possible to transform relative into absolute sea level rise scenarios, and vice-versa, allowing the generation of absolute sea level rise projection curves and its comparison with already established global projections. The sea level rise observed at the Cascais tide gauge has always shown a significant correlation with global sea level rise observations, evidencing relatively low rates of composed vertical land velocity from tectonic and post-glacial isostatic adjustment, and residual synoptic regional dynamic effects rather than a trend. An ensemble of sea level projection models for the 21st century is proposed with its corresponding probability density function, both for relative and absolute sea level rise for the west coast of Portugal Mainland.

Skin cancer is an uncommon but serious malignancy. Dermoscopic images examination and biopsy are required for cancer detection. Deep learning (DL) is extremely effective in learning characteristics and predicting malignancies. However, DL requires a large number of images to train. Image augmentation and transferring learning were employed to overcome the lack of images issue. In this study we divided images into two categories: benign and malignant. To train and test our models, we used the public ISIC 2020 database. Melanoma is classified as malignant in the ISIC 2020 dataset. Along with categorization, the dataset was studied to demonstrate variation. The performance of three top pretrained models was then benchmarked in terms of training and validation accuracy. Three optimizers were employed to optimize the loss: RMSProp, SGD, and ADAM. Using ResNet, VGG16, and MobileNetV2, we obtained training accuracy of 98.73%, 99.12%, and 99.76%, respectively. Using these three pretrained models, we attained a validation accuracy of 98.39%.

Groundwater is the most extracted raw material in the world with global annual withdrawal rates of 800–1500 km3/year. In East and Southern Africa, 70 % of the population are reliant on shallow groundwater as their primary drinking water source. With increased population growth, intensification of agriculture and industrialization, conflicting demands on groundwater present a challenge to achieve the Sustainable Development Goals (6,3,11,12,15). Between 2015 and 2018, the Horn of Africa was affected by a series of climatic induced events, namely El Nino, La Nina and the Indian Ocean Diopole. These events modified the variability of rainfall patterns and resulted in long periods of low rainfall, low recharge and high evapotranspiration. As a result, shallow aquifers in alluvial deposits of Somali region have low yields and produce brackish and saline water. That situation prompted humanitarian water professionals to finance the transportation of water from selected locations with high groundwater potential through water trucks to areas facing groundwater depletion and drought. To address this challenge, UNICEF explored alternative, sustainable deeper groundwater sources that could be extracted using solar water pumping technology for multi water use. This paper describes a three-phase methodology of deep groundwater development of wells in the Ogaden Jesoma sandstone aquifers of the Somali region of the Horn of Africa to a depth of 600 meters below ground level. The results concluded that the deep sandstone aquifer of Jesoma can provide fresh water with yields of 15 l/s to the local population of Somali region. to the study provided insights into deep groundwater identification and development as well as adaptive deep boreholes drilling as a source for climate resilient water supplies.

To understand great disparities in disease outcomes between CIVID-19 patients, we explore infection and host responses in kinetics. From existing data, we deduced a model that the lungs are damaged by rapidly rising flow resistance as a result of retaining white blood cells in lung tissues. The retention of white blood cells is initially triggered by viral infection but aggravated by injuries caused by low temperature. Lungs are initially damaged by fluid leakage, rapidly followed by extruding blood into alveolar spaces. The step of blood extruding is predicted to take place in a very short time. Our simulations show that as little as 0.1% retention of white blood cells in the lungs can lead to their failure in 5 to 10 days. The small degrees of imbalance implies that this imbalance could be corrected by a large number of factors that are known to reduce flow resistance. The model implies that the top priority is maintaining blood micro-circulation and preserving organ functions in the entire disease course, especially after the virus has spread the whole lungs. From exploring a large number of hypothetical infection modes, we propose preventive, mitigating and treatment strategies for ultimately ending the pandemic. The first strategy is avoiding exposures that could result in widespread damages to lungs and taking post exposure mitigating measures that would reduce disease severity. The second strategy is reducing death rate and disability rate from the current levels to one tenth for infected patients by using multiple factors health optimization method. The double reduction strategies are expected to generate a series of chain reactions that favor mitigating or ending the pandemic. Some reactions include a big reduction of the amount of viral discharges from infected patients into the air, the avoidance of panic, chronic stress and emotional distress, and cross-infections which are expected in quarantines. The double reductions would have a final effect of ending the pandemic.

Hateful and abusive speech presents a major challenge for all online social media platforms. Recent advances in Natural Language Processing and Natural Language Understanding allow more accurate detection of hate speech in textual streams. This study presents a multimodal approach to hate speech detection by combining Computer Vision and Natural Language processing models for abusive context detection. Our study focuses on Twitter messages and, more specifically, on hateful, xenophobic and racist speech in Greek aimed at refugees and migrants. In our approach we combine transfer learning and fine-tuning of Bidirectional Encoder Representations from Transformers (BERT) and Residual Neural Networks (Resnet). Our contribution includes the development of a new dataset for hate speech classification, consisting of tweet ids, along with the code to obtain their visual appearance, as they would have been rendered in a web browser. We have also released a pre-trained Language Model trained on Greek tweets, which has been used in our experiments. We report a consistently high level of accuracy (accuracy score=0.970, f1-score=0.947 in our best model) in racist and xenophobic speech detection.

We examine the use of deep learning (neural networks) to predict the movement of the S&P 500 Index using past returns of all the stocks in the index. Our analysis finds that the future direction of the S&P 500 index can be weakly predicted by the prior movements of the underlying stocks in the index. Decomposition of the prediction error indicates that most of the lack of predictability comes from randomness and only a little from nonstationarity. We believe this is the first test of S&P500 market efficiency that uses a very large information set, and it extends the domain of weak-form market efficiency tests.

Interest in drone solutions in forestry applications is growing. Using drones, datasets can be captured flexibly and at high spatial and temporal resolutions when needed. In forestry applications, fundamental tasks include the detection of individual trees, tree species classification, bio-mass estimation, etc. Deep Neural Networks (DNN) have shown superior results when comparing with conventional machine learning methods such as Multi-Layer Perceptron (MLP) in cases of huge input data. The objective of this research was to investigate 3D convolutional neural networks (3D-CNN) to classify three major tree species in a boreal forest: pine, spruce, and birch. The proposed 3D-CNN models were employed to classify tree species in a test site in Finland. The classifiers were trained with a dataset of 3039 manually labelled trees. Then the accuracies were assessed by employing independent datasets of 803 records. To find the most efficient set of feature combination, we compare the performances of 3D-CNN models trained with hyperspectral (HS) channels, RGB channels, and canopy height model (CHM), separately and combined. It is demonstrated that the proposed 3D-CNN model with RGB and HS layers produces the highest classification accuracy. The producer accuracy of the best 3D-CNN classifier on the test dataset were 99.6%, 94.8%, and 97.4% for pines, spruces, and birches, respectively. The best 3D-CNN classifier produced ~5% better classification accuracy than the MLP with all layers. Our results suggest that the proposed method provides excellent classification results with acceptable performance metrics for HS datasets. Our results show that pine class was detectable in most layers. Spruce was most detectable in RGB data, while birch was most detectable in the HS layers. Furthermore, the RGB datasets provide acceptable results for many low-accuracy applications.

Preliminaries Convolutional Neural Network (CNN) applications have recently emerged in Structural Health Monitoring (SHM) systems focusing mostly on vibration analysis. However, the SHM literature shows clearly that there is a lack of application regarding the combination of PZT (Lead Zirconate Titanate) based method and CNN. Likewise, applications using CNN along with the Electromechanical Impedance (EMI) technique applied to SHM systems are rare. To encourage this combination, an innovative SHM solution through the combination of the EMI-PZT and CNN is presented here. To accomplish this, the EMI signature is split into several parts followed by computing the Euclidean distances among them to form a RGB (red, green and blue) frame. As a result, we introduce a dataset formed from the EMI-PZT signals of 720 frames, encompassing a total of 4 types of structural conditions for each PZT. In a case study, the CNN-based method was experimentally evaluated using three PZTs glued onto an aluminum plate. The results reveal an effective pattern classification; yielding a 100% hit rate which outperforms other SHM approaches. Furthermore, the method needs only a small dataset for training the CNN, providing several advantages for industrial applications.

The upsurge of Generative Adversarial Networks (GANs) in the previous five years has led to advancements in unsupervised data manipulation, sourced feature translation, and precise input-output synthesis through a competitive optimization of the discriminator and generator networks. More specifically, the recent rise of cycle-consistent GANs enables style transfers from a discrete source (input A) to target domain (input B) by preprocessing object features for a multi-discriminative adversarial network. Traditionally, cyclical adversarial networks have been exploited for unpaired image-to-image translation and domain adaptation by determining mapped relationships between an input A graphic and an input B graphic. However, this integral mechanism of domain adaptation can be applied to the complex acoustical features of human speech. Although well-established datasets, such as the 2018 Voice Conversion Challenge repository, paved way for female-male voice transformation, cycle-GANs have rarely been re-engineered for voices outside the datasets. More critically, cycle-GANs have massive potential to extract surface-level and hidden feature to distort an input A source into a texturally unrelated target voice. By preprocessing, compressing, and packaging unique acoustical voice properties, CycleGANs can learn to decompose speech signals and implement new translation models while preserving emotion, the intent of words, rhythm, and accents. Due to the potential of CycleGAN’s autoencoder in realistic unsupervised voice-voice conversion/feature adaptation, the researchers raise the ethical implications of controlling source input A to manipulate target voice B, particularly in cases of defamation and sabotage of target B’s words. This paper analyzes the potential of cycle-consistent GANs in deceptive voice-voice conversion by manipulating interview excerpts of political candidates.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

Layer-wise 3D surface morphology information is critical for the quality monitoring and control of additive manufacturing (AM) processes. However, most of the existing 3D scan technologies are either contact or time consuming, which are not capable of obtaining the 3D surface morphology data in a real-time manner during the process. Therefore, the objective of this study is to achieve real-time 3D surface data acquisition in AM, which is achieved by a supervised deep learning-based image analysis approach. The key idea of this proposed method is to capture the correlation between 2D image and 3D point cloud, and then quantify this relationship by using a deep learning algorithm, namely, convolutional neural network (CNN). To validate the effectiveness and efficiency of the proposed method, both simulation and real-world case studies were performed. The results demonstrate that this method has strong potential to be applied for real-time surface morphology measurement in AM, as well as other advanced manufacturing processes.

Machine learning (ML) has emerged as a critical tool for making sense of the growing amount of genetic and genomic data available because of its ability to find complex patterns in high dimensional and heterogeneous data. While the complexity of ML models is what makes them powerful, it also makes them difficult to interpret. Fortunately, recent efforts to develop approaches that make the inner workings of ML models understandable to humans have improved our ability to make novel biological insights using ML. Here we discuss the importance of interpretable ML, different strategies for interpreting ML models, and examples of how these strategies have been applied. Finally, we identify challenges and promising future directions for interpretable ML in genetics and genomics.

The Bayes filters, such as Kalman and particle filters, have been used in sensor fusion to integrate two sources of information and obtain the best estimate of the unknowns. Efficient integration of multiple sensors requires deep knowledge of their error sources and it is not trivial for complicated sensors, such as Inertial Measurement Unit (IMU). Therefore, IMU error modelling and efficient integration of IMU and Global Navigation Satellite System (GNSS) observations has remained a challenge. In this paper, we develop deep Kalman filter to model and remove IMU errors and consequently, improve the accuracy of IMU positioning. In other words, we add modelling step to the prediction and update steps of Kalman filter and the IMU error model is learned during integration. Therefore, our deep Kalman filter outperforms Kalman filter and reaches higher accuracy.

Prediction of stock groups values has always been attractive and challenging for shareholders. This paper concentrates on the future prediction of stock market groups. Four groups named diversified financials, petroleum, non-metallic minerals and basic metals from Tehran stock exchange are chosen for experimental evaluations. Data are collected for the groups based on ten years of historical records. The values predictions are created for 1, 2, 5, 10, 15, 20 and 30 days in advance. The machine learning algorithms utilized for prediction of future values of stock market groups. We employed Decision Tree, Bagging, Random Forest, Adaptive Boosting (Adaboost), Gradient Boosting and eXtreme Gradient Boosting (XGBoost), and Artificial neural network (ANN), Recurrent Neural Network (RNN) and Long short-term memory (LSTM). Ten technical indicators are selected as the inputs into each of the prediction models. Finally, the result of predictions is presented for each technique based on three metrics. Among all algorithms used in this paper, LSTM shows more accurate results with the highest model fitting ability. Also, for tree_based models, there is often an intense competition between Adaboost, Gradient Boosting and XGBoost.

To generate a probability density function (PDF) for fitting probability distributions of real data, this study proposes a deep learning method which consists of two stages: (1) a training stage for estimating the cumulative distribution function (CDF) and (2) a performing stage for predicting the corresponding PDF. The CDFs of common probability distributions can be adopted as activation functions in the hidden layers of the proposed deep learning model for learning actual cumulative probabilities, and the differential equation of trained deep learning model can be used to estimate the PDF. To evaluate the proposed method, numerical experiments with single and mixed distributions are performed. The experimental results show that the values of both CDF and PDF can be precisely estimated by the proposed method.

This paper presents a new method : HIVEC to learn latent vector representations of graphs in a manner that captures the semantic dependencies of sub-structures. The representations can then be used in machine learning algorithms for tasks such as graph classification, clustering etcetera. The method proposed is unsupervised and uses the information of co-occurrence of sub-structures. It introduces a notion of hierarchical embeddings that allows us to avoid repetitive learning of sub-structures for every new graph. As an alternative to deep learning methods, the edit distance similarity between sub-structures is also used to learn vector representations. We compare the performance of these methods against previous work.

Three-dimensional convolutional neural networks (3D CNN) as a type of artificial intelligence (AI) are powerful in image processing and recognition using deep learning to perform generative and descriptive tasks. The advantage of CNN compared to its predecessors is that it automatically detects the important features without any human supervision. 3D CNN are used to extract features in three dimensions where input is a 3D volume or a sequence of 2D pictures e.g., slices in a cone-beam computer tomography scan (CBCT). The main aim of this article was to bridge interdisciplinary cooperation between forensic medical experts and deep learning engineers. With emphasis activating clinical forensic experts in the field with possibly basic knowledge of advanced artificial intelligence techniques with interest in its implementation in their efforts to advance the forensic research further. This paper introduces a novel workflow of 3D CNN analysis of full-head CBCT scans. Authors explore and present 3D CNN method for forensic research design concept in five perspectives: (1) sex determination, (2) biological age estimation, (3) 3D cephalometric landmark annotation, (4) growth vectors prediction, (5) facial soft-tissue estimation from the skull and vice versa. In conclusion, 3D CNN application can be a watershed moment in forensic medicine, leading to unprecedented improvement of forensic analysis workflows based on 3D neural networks.

Typhoon Durian forming over the Western North Pacific Ocean and entering into the South China Sea (SCS), caused extreme and widespread damages in 2006. In this research, sensitivity analyses on different physical parameterization schemes of the Weather Research and Forecasting Atmospheric Model (WRF-ATM) have been utilized to study typhoon Durian. Model accuracy and performance testing were investigated with different initial conditions during the tropical cyclone simulation in the SCS. The initial and boundary conditions (IBCs) for all experiments were derived from the European Centre for Medium Range Weather Forecasts (ECMWF), Re-Analysis Interim (ERAI), and the National Centers for Environmental Prediction (NCEP) with Final (FNL) analysis data compiled through the WRF-ATM model. The sensitivity analysis results indicated a major improvement for the cumulus scheme by using the Grell-Devenyi scheme along with the PBL scheme of Yonsei University, mixed-phase microphysics scheme of the WRF Single Moment 5-class and IBCs for ECMWF-ERAI of TC simulation under the context of Wind-Pressure Relationships. This predicted better track and intensity comparing with these of the Joint Typhoon Warning Center. The results revealed that the TC track and intensity were well simulated by the WSM5-GD combination for the WRF-ATM model with an intensity error of 1.69 hPa for minimum surface level pressure, maximum wind speed of 1.83 knots and average track error of 25 km in 72 hours. The simulations showed that the potential track and intensity error decreased with the delayed IBCs, suggesting that the model simulation is more dependable when the coast is approached by the TC.

Background: Post-traumatic stress disorder (PTSD) is a common debilitating psychiatric condition for which pharmacological therapy is not always solvable. Various treatments have been suggested for these patients. Deep brain stimulation (DBS) is currently under investigation for patients affected by PTSD. 2) Methods: We review the neurocircuitry and up to date clinical concepts that may be of relevance for the implementation of DBS in posttraumatic stress disorder (PTSD). 3) Results: The role of DBS in treatment-refractory PTSD patients has been investigated relying on both preclinical and clinical studies. 4) Conclusions: DBS for PTSD is in its preliminary phases and likely to provide hope to patients with medical refractory PTSD following the results of randomized controlled studies.

Artificial Intelligence (AI) has many advantages over humans in that it can detect incredibly subtle patterns within large quantities of data. This study suggests using AI algorithms in user research tasks for mining variables ranging from the tone of voice, image banks, historical records, and product use to determine where brands sit and where there could be competitive advantages. This study reviews the current design processes of User Experience (UX) designers and the advancements in Deep Learning (DL). It identifies potential areas of automation in the Preparation, Incubation and Illumination stages of the design process. It recognises the possibility of using Long Short-Term Memory (LSTM) models to automate design feedback and the creation of alternate designs with Generative Adversarial Networks (GANs).

In this review we summarize existing trends of flow control used to improve the aerodynamic efficiency of wings. We first discuss active methods to control turbulence, starting with flat-plate geometries and building towards the more complicated flow around wings. Then, we discuss active approaches to control separation, a crucial aspect towards achieving high aerodynamic efficiency. Furthermore, we highlight methods relying on turbulence simulation, and discuss various levels of modelling. Finally, we thoroughly revise data-driven methods, their application to flow control, and focus on deep reinforcement learning (DRL). We conclude that this methodology has the potential to discover novel control strategies in complex turbulent flows of aerodynamic relevance.

Advancements in deep learning and availability of medical imaging data have led to use of CNN based architectures in disease diagnostic assisted systems. In spite of the abundant use of reverse transcription-polymerase chain reaction (RT-PCR) based tests in COVID-19 diagnosis, CT images offer an applicable supplement with its high sensitivity rates. Here, we study classification of COVID-19 pneumonia (CP) and non-COVID-19 pneumonia (NCP) in chest CT scans using efficient deep learning methods to be readily implemented by any hospital. We report our deep network framework design that encompasses Convolutional Neural Networks (CNNs) and bidirectional Long Short Term Memory (biLSTM) architectures. Our study achieved high specificity (CP: 98.3%, NCP: 96.2% Healthy: 89.3%) and high sensitivity (CP: 84.0%, NCP: 93.9% Healthy: 94.9%) in classifying COVID-19 pneumonia, non-COVID-19 pneumonia and healthy patients. Next, we provide visual explanations for the CNN predictions with gradient-weighted class activation mapping (Grad-CAM). The results provided a model explainability by showing that Ground Glass Opacities (GGO), indicators of COVID-19 pneumonia disease, were captured by our CNN network. Finally, we have implemented our approach in three hospitals proving its compatibility and efficiency.

The increasing trend of studying the innate softness of robotic structures and amalgamating it with the benefits of the extensive developments in the field of embodied intelligence has led to sprouting of a relatively new yet extremely rewarding sphere of technology. The fusion of current deep reinforcement algorithms with physical advantages of a soft bio-inspired structure certainly directs us to a fruitful prospect of designing completely self-sufficient agents that are capable of learning from observations collected from their environment to achieve a task they have been assigned. For soft robotics structure possessing countless degrees of freedom, it is often not easy (something not even possible) to formulate mathematical constraints necessary for training a deep reinforcement learning (DRL) agent for the task in hand, hence, we resolve to imitation learning techniques due to ease of manually performing such tasks like manipulation that could be comfortably mimicked by our agent. Deploying current imitation learning algorithms on soft robotic systems have been observed to provide satisfactory results but there are still challenges in doing so. This review article thus posits an overview of various such algorithms along with instances of them being applied to real world scenarios and yielding state-of-the-art results followed by brief descriptions on various pristine branches of DRL research that may be centers of future research in this field of interest.

Deep neural networks are hegemonic approaches to many machine learning areas, including natural language processing (NLP). Thanks to the availability of large corpora collections and the capability of deep architectures to shape internal language mechanisms in self-supervised learning processes (also known as "pre-training"), versatile and performing models are released continuously for every new network design. But these networks, somehow, learn a probability distribution of words and relations across the training collection used, inheriting the potential flaws, inconsistencies and biases contained in such a collection. As pre-trained models have found to be very useful approaches to transfer learning, dealing with bias has become a relevant issue in this new scenario. We introduce bias in a formal way and explore how it has been treated in several networks, in terms of detection and correction. Also, available resources are identified and a strategy to deal with bias in deep NLP is proposed.

This paper compares a series of traditional and deep learning methodologies for the segmentation of textures. Six well-known texture composites first published by Randen and Hus{\o}y were used to compare traditional segmentation techniques (co-occurrence, filtering, local binary patterns, watershed, multiresolution sub-band filtering) against a deep-learning approach based on the U-Net architecture. For the latter, the effects of depth of the network, number of epochs and different optimisation algorithms were investigated. Overall, the best results were provided by the deep-learning approach. However, the best results were distributed within the parameters, and many configurations provided results well below the traditional techniques.

The investigation of submerged speleothems for sea level studies has made significant contributions to the understanding of the global and regional sea level variations during the Middle and Late Quateranry. This has been especially the case for the Mediterranean Sea, where more than 300 submerged speleothems sampled in 32 caves have been analysed so far. Here, we present a comprehensive review of the results obtained from the study of submerged speleothems since 1978. The studied speleothems cover the last 1.4 Ma and are focused mainly on Marine Isotope Stages (MIS) 1, 2, 3, 5.1, 5.3, 5.5, 7.1, 7.2, 7.3 and 7.5. Results reveal that submerged speleothems represent extraordinary archives providing accurate information on former sea level changes, also considering that the Mediterranean Sea is devoid of any tropical corals since the Miocene. New results from a stalagmite collected at Palinuro (Campania, Italy) characterized by marine overgrowth are also reported. The measured elevations of speleothems are contaminated by the local response to glacial- and hydro-isostatic adjustment (GIA), and thus might significantly deviate from the global eustatic signal. Age and altitude comparation between Mediterranean speleothems, flowstone from Bahamas with local GIA provide a new scenario for MIS 5 and 7 sea level reconstrutions.

Electromyographic (EMG) signals provide information about a person's muscle activity. For hand movements, in particular, the execution of each gesture involves the activation of different combinations of the forearm muscles, which generate distinct electrical patterns. Conversely, the analysis of these muscle activation patterns, represented by EMG signals, allows recognizing which gesture is being performed. In this study, we aimed to implement an automatic identification system of hand or wrist gestures based on supervised Machine Learning (ML) techniques. We trained different computational models and determined which of these showed the best capacity to identify six hand or wrist gestures and generalize between different subjects. We used an open access database containing recordings of EMG signals from 36 subjects. Among the results obtained, we highlight the performance of the Random Forest model, with an accuracy of 95.39%, and the performance of a convolutional neural network with an accuracy of 94.77%.

Mouthbrooding or oral incubation, the retention of early developmental stages inside of the mouth for an extended period of time, has evolved multiple times in bony fishes1,2. Though uncommon, this form of parental care has been documented and well-studied in several groups of freshwater fishes but is also known to occur in a small number of marine fishes, all inhabiting coastal waters1,2. A recent paper3, reported for the first time mouthbrooding in a deep-water fish species, the zeiform Parazen pacificus, which according to the authors “fills in a gap in the larval literature for this family of fishes and prompts further investigation into other novel reproductive modes of deep-sea fauna.”

Electricity demand prediction is vital for energy production management and proper exploitation of the present resources. Recently, several novel machine learning (ML) models have been employed for electricity demand prediction to estimate the future prospects of the energy requirements. The main objective of this study is to review the various ML models applied for electricity demand prediction. Through a novel search and taxonomy, the most relevant original research articles in the field are identified and further classified according to the ML modeling technique, perdition type, and the application area. A comprehensive review of the literature identifies the major ML models, their applications and a discussion on the evaluation of their performance. This paper further makes a discussion on the trend and the performance of the ML models. As the result, this research reports an outstanding rise in the accuracy, robustness, precision and the generalization ability of the prediction models using the hybrid and ensemble ML algorithms.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

In the field of autonomous vehicles, lane detection and control plays an important role. In autonomous driving the vehicle has to follow the path to avoid the collision. A deep learning technique is used to detect the curved path in autonomous vehicles. In this paper a customized lane detection algorithm was implemented to detect the curvature of the lane. A ground truth labelling tool box for deep learning is used to detect the curved path in autonomous vehicle. By mapping point to point in each frame 80-90% computing efficiency and accuracy is achieved in detecting path.

Diseases of cereals caused by pathogenic fungi can significantly reduce crop yields. Many cultures are exposed to them. The disease is difficult to control on a large scale, thus one of the relevant approaches is the crop field monitoring, which helps to identify the disease at an early stage and take measures to prevent its spread. One of the effective control methods is disease identification based on the analysis of digital images with the possibility of obtaining them in field conditions using mobile devices. In this work, we propose a method for the recognition of five fungal diseases of wheat shoots (leaf rust, stem rust, yellow rust, powdery mildew, and septoria), both separately and in combination, with the possibility of identifying the stage of plant development. A set of 2414 images of wheat fungi diseases (WFD2020) was generated, for which expert labeling was performed by the type of disease. WFD2020 data are available freely at http://wfd.sysbio.ru/. In the process of creating this set, a method was applied to reduce the degeneracy of the training data based on the image hashing algorithm. The disease recognition algorithm is based on the convolutional neural network with the EfficientNet architecture. The best accuracy (0.942) was shown by a network with a training strategy based on augmentation and transfer of image styles. The recognition method was implemented by the authors as a bot on the Telegram platform, which allows assessing plants by lesions in the field conditions.

Immunotherapy is an effective therapeutic option for several cancers. In the last years, the introduction of checkpoint inhibitors (ICIs) has shifted the therapeutic landscape in oncology and improved patient prognosis in a variety of neoplastic diseases. However, to date, the selection of the best patients eligible for these therapies, as well as the response assessment is still challenging. Patients are mainly stratified using immunohistochemical analysis of the expression of anti-gens on biopsy specimens, such as PD-L1 and PD-1, on tumor cells, on peritumoral immune cells, and/or in the tumor microenvironment (TME). Recently, the use and development of imaging biomarkers able to assess in-vivo cancer-related processes are becoming more important. Today, positron emission tomography (PET) with 2-deoxy-2-[18F]fluoro-D-glucose ([18F]FDG) is used routinely to evaluate tumor metabolism, and also to predict and monitor response to immunotherapy. Although highly sensitive, FDG-PET, in general, is rather unspecific. Novel radiopharmaceuticals (immuno-PET radiotracers) able to identify specific immune system targets are under investigation in pre-clinical and clinical settings. In this review, we will provide an overview of the main new immuno-PET radiotracers in development. We will also review the main players (immune cells, tumor cells, and molecular targets) involved in immunotherapy. Furthermore, we report current applications and the evidence of using [18F]FDG PET in immunotherapy, including the use of artificial intelligence (AI).

The world has been evolving with new technologies and advances day-by-day. With the advent of various learning technologies in every field, the research community is able to provide solution in every aspect of life with the applications of Artificial Intelligence, Machine Learning, Deep Learning, Computer Vision, etc. However, with such high achievements, it is found to lag behind the ability to provide explanation against its prediction. The current situation is such that these modern technologies are able to predict and decide upon various cases more accurately and speedily than a human, but failed to provide an answer when the question of why to trust its prediction is put forward. In order to attain a deeper understanding into this rising trend, we explore a very recent and talked-about novel contribution which provides rich insight on a prediction being made -- ``Explainability.'' The main premise of this survey is to provide an overview for researches explored in the domain and obtain an idea of the current scenario along with the advancements published to-date in this field. This survey is intended to provide a comprehensive background of the broad spectrum of Explainability.

Fusarium head blight (FHB) disease is extensively distributed worldwide. This disease damages grain quality and reduces yield. The detection of this disease in a high throughput way is crucial to planters and breeders. Our study focused on developing a method for processing wheat color images and accurately detecting disease areas using deep learning and image processing techniques. The color images of wheat at the milky stage were collected and processed to construct datasets, which were used to retrain a deep convolutional neural network model using transfer learning. Testing results showed that the model can detect spikes, and the coefficient of determination of the number of spikes between the manual count and the detection was 0.80. The model was assessed, and the mean average precision for the testing dataset was 0.9201. On the basis of the results of spike detection, a new color feature was applied to obtain the gray image of each spike. Then, a modified region growing algorithm was implemented to segment and detect the diseased areas of each spike. Results show that the region growing algorithm performs better than K-means and Otsu’s method in segmenting the FHB disease. Overall, this study demonstrates that deep learning techniques enable the accurate detection of FHB in wheat using color images, and the proposed method can effectively detect spikes and diseased areas, thereby improving the efficiency of FHB detection.

The ongoing revolution in Deep Learning is redefining the nature of computing that is driven by the increasing amount of pattern classification and cognitive tasks. Specialized digital hardware for deep learning still holds its predominance due to the flexibility offered by the software implementation and maturity of algorithms. However, it is being increasingly desired that cognitive computing occurs at the edge, i.e. on hand-held devices that are energy constrained, which is energy prohibitive when employing digital von Neumann architectures. Recent explorations in digital neuromorphic hardware have shown promise, but offer low neurosynaptic density needed for scaling to applications such as intelligent cognitive assistants (ICA). Large-scale integration of nanoscale emerging memory devices with Complementary Metal Oxide Semiconductor (CMOS) mixed-signal integrated circuits can herald a new generation of Neuromorphic computers that will transcend the von Neumann bottleneck for cognitive computing tasks. Such hybrid Neuromorphic System-on-a-chip (NeuSoC) architectures promise machine learning capability at chip-scale form factor, and several orders of magnitude improvement in energy efficiency. Practical demonstration of such architectures has been limited as performance of emerging memory devices falls short of the expected behavior from the idealized memristor-based analog synapses, or weights, and novel machine learning algorithms are needed to take advantage of the device behavior. In this work, we review the challenges involved and present a pathway to realize ultra-low-power mixed-signal NeuSoC, from device arrays and circuits to spike-based deep learning algorithms, with ‘brain-like’ energy-efficiency.

Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today's Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals.

Many reported sea level records are often not a single measurement. They are then a composition of different records from several tide gauges. Sometimes, they are from the same tide gauge, but the tide gauge stability has been affected by earthquakes. This is the case of Guam as discussed in the present manuscript. The claimed sea level acceleration of Guam is only the result of two earthquakes that have compromised the stability of the tide gauge.

Abstract: Predation of eggs and emerging hatchlings of olive ridley turtle (Lepidochelys olivacea) by wild animals and feral dogs are known. They reduce the hatching success rate considerably affecting the conservation management of this vulnerable species. Hatchery management is practised in India to overcome predation. Ant predation is a serious threat to turtle nest protected by ex situ or in situ erected hatchery. This article reports the first direct evidence of turtle eggs predation by Dorylus orientalis Westwood, 1835 commonly called red ants. Native to India, Oriental, Indo Australian and Palearctic regions they are notorious as an agricultural pest. Chlorpyrifos pesticides recommended for their control could become fatal for the developing embryos of turtles if applied near the hatchery. In the turtle nesting site of the west coast of India, D. orientalis has more of an ecological role than as a pest. Natural pesticide such as Neem powder (Azadirachta indica) shows promising results for preventing their infestation.

The exploitation and use of alternative synthetic methods, in the face of classical procedures that do not conform to the ethics of Green Chemistry, represent an ever present problem in pharmaceutical industry. The procedures for the synthesis of benzimidazoles have become a focus in synthetic organic chemistry, as they are building blocks of strong interest for the development of compounds with pharmacological activity. Various benzimidazole derivatives exhibit important activities such as antimicrobial, antiviral, anti-inflammatory and analgesic and some of the already synthesized compounds have found very strong application in medicine praxis. Here we report a selective and sustainable method for the synthesis of 1,2-disubstituted or 2-substituted benzimidazoles, starting from o-phenylenediamine in the presence of different aldehydes. The use of deep eutectic solvent (DES) both as reaction medium and reagent without any external solvent provides advantages in terms of yields as well as in the work up procedure of the reaction.

People localization is a key building block in many applications. In this paper, we propose a deep learning based approach that significantly improves the localization accuracy and reduces the runtime of Wi-Fi based localization systems. Three variants of the deep learning approach are proposed, a sub-task architecture, an end-to-end architecture, and an architecture that incorporates prior knowledge. The performance of the three architectures under different conditions is evaluated and the significant improvement of the three architectures over existing approaches is demonstrated.

The question of molecular similarity is core in cheminformatics, and is usually assessed via a pairwise comparison based on vectors of properties or molecular fingerprints. We recently exploited variational autoencoders to embed 6M molecules in a chemical space, such that their (Euclidean) distance within the latent space so formed could be assessed within the framework of the entire molecular set. However, the standard objective function used did not seek to manipulate the latent space so as to cluster the molecules based on any perceived similarity. Using a set of some 160,000 molecules of biological relevance, we here bring together three modern elements of deep learning to create a novel and disentangled latent space, viz transformers, contrastive learning, and an embedded autoencoder. The effective dimensionality of the latent space was varied such that clear separation of individual types of molecules could be observed within individual dimensions of the latent space. The capacity of the network was such that many dimensions were not populated at all. As before, we assessed the utility of the representation by comparing clozapine with its near neighbours, and did the same for various antibiotics related to flucloxacillin. Transformers, especially when as here coupled with contrastive learning, effectively provide one-shot learning, and lead to a successful and disentangled representation of molecular latent spaces that at once uses the entire training set in their construction while allowing ‘similar’ molecules to cluster together in an effective and interpretable way.

Ongoing COVID-19 Pandemic has resulted into massive damage to various platforms of global economy which has caused disruption to human livelihood. Natural Language Processing has been extensively used in different organizations to categorize sentiments, perform recommendation, summarizing information and topic modelling. This research aims to understand the non-medical impact of COVID-19 on global economy by leveraging the natural language processing methodology. This methodology comprises of text classification which includes topic modelling on unstructured COVID-19 media articles dataset provided by Anacode. Like other Natural Language Processing algorithms, Latent Dirichlet allocation (LDA) and Non-negative matrix factorization (NMF) has been proposed to classify the media articles dataset in order to analyze COVID-19 pandemic impacts in the different sectors of global economy. Model Accuracy was examined based on the coherence and perplexity score which came out to be 0.51 and -10.90 using LDA algorithm. Both the LDA and NMF algorithm identified similar prevalent topics that was impacted by COVID-19 pandemic in multiple sectors of economy. Through intertopic distance map visualization produced by LDA algorithm, it can be reciprocated that general industries which includes children schooling, parental care, and family gatherings had the major impact followed by business sector and the financial industry.

A checklist of parasitic cymothoids from Malaysian waters is presented based on available literature and material collected from 2010 to 2020. Most of the collected specimens were recorded from waters of Terengganu, east coast of Peninsular Malaysia (facing South China Sea), whereas literature records were represented from Sarawak, along the Miri coast of northwest Borneo. The checklist comprises 18 species under 10 genera, seven of which are new records from Malaysia, which includes Anilocra nemipteri Bruce, 1987; Ceratothoa barracuda Martin, Bruce and Nowak, 2015; Ceratothoa carinata (Bianconi, 1869); Cymothoa epimerica Avdeev, 1979; Elthusa sigani Bruce, 1990; Joryma engraulidis (Barnard, 1936) and Renocila richardsonae Williams and Bunkley-Williams, 1992. Eight new host records are based on collected specimens: Anilocra nemipteri was dorsally attached on Nemipterus nemurus (Bleeker 1857), Nemipterus nematophorus (Bleeker 1854), Nemipterus tambuloides (Bleeker 1853), and Nemipterus thosaporni Russell 1991 (family Nemipteridae); Ceratothoa carinata was found in the buccal cavity of Decapterus macrosoma Bleeker 1851 (family Carangidae); Cymothoa eremita (Brunnich, 1783) was attached in the buccal cavity of Nemipterus tambuloides and Nemipterus furcosus (Valenciennes 1830); Elthusa sigani was found attached on Pterois russelli Bennett 1831 (family Scorpaenidae); and Renocila richardsonae was attached on the caudal fin of Upeneus japonicus (Houttuyn 1782) (family Mullidae). All cymothoid species listed here are known to have a Central Indo Pacific distribution, with some ranging as far as the western Indian Ocean. The cymothoid-host association is here listed from 28 fish families, with the most common reported from Carangidae (pompanos, jack mackerels, runners, scads), Engraulidae (anchovies) and Leiognathidae (ponyfishes, slipmouths). This paper is the first comprehensive treatment to update both verified literature data and deposited specimens, with a key for the family Cymothoidae in Malaysian waters.

White matter hyperintensity (WMH) has been considered the primary biomarker from small-vessel cerebrovascular disease to Alzheimer’s disease (AD) and has been reported for its correlation of brain structural changes. To perform WMH related analysis with brain structure, both T1-weighted (T1w) and (Fluid Attenuated Inversion Recovery(FLAIR) are required. However, in a clinical situation, it is limited to obtain 3D T1w and FLAIR images simultaneously. Also, the most of brain segmentation technique supports 3D T1w only. Therefore, we introduced the semi-supervised learning method that can perform brain segmentation using FLAIR image only. Our method achieved a dice overlap score of 0.86 for brain tissue segmentation on FLAIR, with the relative volume difference between T1w and FLAIR segmentation under 4.8%, which is just as reliable as the segmentation done by its paired T1w image. We believe our semi-supervised learning method has a great potential to be used to other MRI sequences and provide encouragement to people who seek brain tissue segmentation from a non-T1w image.

Causality is the most important topic in the history of Western Science, and since the beginning of the statistical paradigm, it meaning has been reconceptualized many times. Causality entered into the realm of multi-causal and statistical scenarios some centuries ago. Despite of widespread critics, today Deep Learning and Machine Learning advances are not weakening causality but are creating a new way of finding indirect factors correlations. This process makes possible us to talk about approximate causality, as well as about a situated causality.

Object detection is one of the most critical tasks in the field of Computer vision. This task comprises identifying and localizing an object in the image. Architectural floor plans represent the layout of buildings and apartments. The floor plans consist of walls, windows, stairs, and other furniture objects. While recognizing floor plan objects is straightforward for humans, automatically processing floor plans and recognizing objects is a challenging problem. In this work, we investigate the performance of the recently introduced Cascade Mask R-CNN network to solve object detection in floor plan images. Furthermore, we experimentally establish that deformable convolution works better than conventional convolutions in the proposed framework. Identifying objects in floor plan images is also challenging due to the variety of floor plans and different objects. We faced a problem in training our network because of the lack of publicly available datasets. Currently, available public datasets do not have enough images to train deep neural networks efficiently. We introduce SFPI, a novel synthetic floor plan dataset consisting of 10000 images to address this issue. Our proposed method conveniently surpasses the previous state-of-the-art results on the SESYD dataset and sets impressive baseline results on the proposed SFPI dataset. The dataset can be downloaded from SFPI Dataset Link. We believe that the novel dataset enables the researcher to enhance the research in this domain further.

Sea anemones are a remarkable source of active principles due to a decentralized venom system. Blood vessel formation or angiogenesis is a very promising target against cancer, but the few available anti-angiogenic compounds have a limited efficacy. In this study, a protein fraction was purified from tentacles of Anemonia viridis able to limit endothelial cells proliferation and vessel network formation or angiogenesis at low concentration (14 nM). The sequences in this protein fraction were determined with Edman degradation and Mass Spectrometry In Source Decay and revealed homologies with BDS sea anemones. The presence of a two turn alpha helix observed with Circular Dichroism and a trypsin activity inhibition suggested that the active principle could be a Kunitz-type inhibitor, which may interact with an integrin due to a RGD motif well exposed to the solvent as revealed by Molecular Modeling. This active principle could improve antiangiogenic therapy from existing antiangiogenic compounds binding on the VEGF.

The paper demonstrates the analysis of Corona Virus Disease based on a CNN probabilistic model. It involves a technique for classification and prediction by recognizing typical and diagnostically most important CT images features relating to Corona Virus. The main contributions of the research include predicting the probability of recurrences in no recurrence (first time detection) cases at applying our proposed Convolution neural network structure. The Study is validated on 2002 chest X-ray images with 60 confirmed positive covid19 cases and (650 bacterial – 412 viral -880 normal) x-ray images. The proposed CNN compared with traditional classifiers with proposed CHFS feature extraction model. The experimental study has done with real data demonstrates the feasibility and potential of the proposed approach for the said cause. The result of proposed CNN structure has been successfully done to achieve 98.20% accuracy of covid19 potential cases with comparable of traditional classifiers.

We conducted many model simulations to understand the causes of the damages of coronavirus (COVID-19) to lung tissue and constructed a diagram showing apparent viral reproduction, immune response and damage accumulation curves. We found that lung damages include virus-caused damage, tissue damage caused by immune responses and tissue damage caused by accumulated wastes. The virus-caused damage is proportional to the phase lag between the viral reproduction curve and the delayed adaptive immune response curve, while waste-induced damage is attributed to imbalance in removing viral, cellular and metabolic by-products. We found that treatment strategies should slow down viral reproduction and speed up immune response, and improve blood micro-circulation in the lungs. Consistent with the strategies, measures are taken to void direct lung infection, strengthen innate responses, promote immune responses, dilute viral concentration in lung tissue, maintain waste removal balance, protect heart and kidneys, control other infections, avoid allergic reactions and other inflammation, etc. We show that medical, dietary, emotional, lifestyle, environmental, mechanical factors, etc. may be simultaneously used to mitigate lung damages and prove that multiple factor health optimization method is magnitudes more powerful than a single factor treatment. Such a method does not depend on molecular specificity and can be used in parallel to antiviral drugs.

Alzheimer's is a disease for which there is no cure. Diagnosing Alzheimer's Disease (AD) early facilitates family planning and cost control. The purpose of this study is to predict the presence of AD using socio-demographic, clinical, and Magnetic Resonance Imaging (MRI) data. Early detection of AD enables family planning and may reduce costs by delaying long-term care. Accurate, non-imagery methods also reduce patient costs. The Open Access Series of Imaging Studies (OASIS-1) cross-sectional MRI data were analyzed. A gradient boosted machine (GBM) predicted the presence of AD as a function of gender, age, education, socioeconomic status (SES), and Mini-Mental State Exam (MMSE). A Residual Network with 50 layers (ResNet-50) predicted CDR presence and severity from MRI's (multi-class classification). The GBM achieved a mean 91.3% prediction accuracy (10-fold stratified cross validation) for dichotomous CDR using socio-demographic and MMSE variables. MMSE was the most important feature. ResNet-50 using image generation techniques based on an 80% training set resulted in 98.99% three class prediction accuracy on 4,139 images (20% validation set) at Epoch 133 and nearly perfect multi-class predication accuracy on the training set (99.34%). Machine Learning methods classify AD with high accuracy. GBM models may help provide initial detection based on non-imagery analysis, while ResNet-50 network models might help identify AD patients automatically prior to provider review.

: Mistrust, amplified by numerous artificial intelligence (AI) related incidents, has caused the energy and industrial sectors to be amongst the slowest adopter of AI methods. Central to this issue is the black-box problem of AI, which impedes investments and fast becoming a legal hazard for users. Explainable AI (XAI) is a recent paradigm to tackle this challenge. Being the backbone of the industry, the prognostic and health management (PHM) domain has recently been introduced to XAI. However, many deficiencies, particularly lack of explanation assessment methods and uncertainty quantification, plague this young field. In this paper, we elaborate a framework on explainable anomaly detection and failure prognostic employing a Bayesian deep learning model to generate local and global explanations from the PHM tasks. An uncertainty measure of the Bayesian model is utilized as marker for anomalies expanding the prognostic explanation scope to include model’s confidence. Also, the global explanation is used to improve prognostic performance, an aspect neglected from the handful of PHM-XAI publications. The quality of the explanation is finally examined employing local accuracy and consistency properties. The method is tested on real-world gas turbine anomalies and synthetic turbofan data failure prediction. Seven out of eight of the tested anomalies were successfully identified. Additionally, the prognostic outcome showed 19% improvement in statistical terms and achieved the highest prognostic score amongst best published results on the topic.

Abstract: The main contribution of this paper is to introduce a new iterative training algorithm for restricted Boltzmann machines. The proposed learning path is inspired from online sequential extreme learning machine one of extreme learning machine variants which deals with time accumulated sequences of data with fixed or varied sizes. Recursive least squares rules are integrated for weights adaptation to avoid learning rate tuning and local minimum issues. The proposed approach is compared to one of the well known training algorithms for Boltzmann machines named “contrastive divergence”, in term of time, accuracy and algorithmic complexity under the same conditions. Results strongly encourage the new given rules during data reconstruction.

Mercury is a toxic pollutant emitted from both natural sources and through human activities. A global interest in atmospheric mercury has risen ever since the discovery of the Minamata disease in 1956. Properties of gaseous elemental mercury enable long range transport which can cause pollution even in pristine environments. Total gaseous mercury (TGM) was measured from winter 2016 to spring 2017 over the Baltic Sea. A Tekran 2357A mercury analyser was installed aboard the research and icebreaking vessel Oden for the purpose of continuous measurements of gaseous mercury in ambient air. Measurements were performed during a campaign along the Swedish east coast and in the Bothnian Bay near Lulea during the icebreaking season. Data was evaluated from Gothenburg using a plotting software and back trajectories for air masses were calculated. The TGM average of 1.365 ± 0.054 ng/m³ during winter and 1.288 ± 0.140 ng/m³ during spring was calculated as well as a total average of 1.362 ± 0.158 ng/m³. Back trajectories showed a possible correlation of anthropogenic sources elevating the mercury background level in some areas. There were also indications of depleted air, i.e., air with lower concentrations than average, being transported from the Arctic to northern Sweden resulting in a drop in TGM levels.

Aiming at the problem of model error and tracking dependence in the process of intelligent vehicle motion planning, an intelligent vehicle model transfer trajectory planning method based on deep reinforcement learning is proposed, which obtain an effective control action sequence directly. Firstly, an abstract model of the real environment is extracted. On this basis, Deep Deterministic Policy Gradient (DDPG) and vehicle dynamic model are adopted to jointly train a reinforcement learning model, and to decide the optimal intelligent driving maneuver. Secondly, the actual scene is transferred to equivalent virtual abstract scene by transfer model, furthermore, the control action and trajectory sequences are calculated according to trained deep reinforcement learning model. Thirdly, the optimal trajectory sequence is selected according to evaluation function in the real environment. Finally, the results demonstrate that the proposed method can deal with the problem of intelligent vehicle trajectory planning for continuous input and continuous output. The model transfer method improves the model generalization performance. Compared with the traditional trajectory planning, the proposed method output continuous rotation angle control sequence, meanwhile, the lateral control error is also reduced.

Recently, the use of drones/unmanned aerial vehicles (UAVs) has notably increased due to their broad commercial spread and low cost. The wide diffusion of drones increases the hazards of their misuse in illegitimate actions such as drug smuggling and terrorism. Thus, the surveillance and automated detection of drones are crucial for safeguarding restricted regions or special zones from illegal drone interventions. One of the most challenging issues in drone detection in surveillance videos is the apparent similarity of drones and birds against complex backgrounds. In this work, an automated image-based drone-detection system utilizing an advanced deep-learning-based object-detection method known as you only look once (YOLOv5) is introduced for protecting restricted regions or special zones from unlawful drone interventions. Due to the lack of sufficient data, transfer learning was utilized to pretrain the object-detection method to increase the performance. The experiments showed outstanding results, and an average precision of 94.7% was accomplished.

Beyond semantic segmentation,3D instance segmentation(a process to delineate objects of interest and also classifying the objects into a set of categories) is gaining more and more interest among researchers since numerous computer vision applications need accurate segmentation processes(autonomous driving, indoor navigation, and even virtual or augmented reality systems…) This paper gives an overview and a technical comparison of the existing deep learning architectures in handling unstructured Euclidean data for the rapidly developing 3D instance segmentation. First, the authors divide the 3D point clouds based instance segmentation techniques into two major categories which are proposal based methods and proposal free methods. Then, they also introduce and compare the most used datasets with regard to 3D instance segmentation. Furthermore, they compare and analyze these techniques performance (speed, accuracy, response to noise…). Finally, this paper provides a review of the possible future directions of deep learning for 3D sensor-based information and provides insight into the most promising areas for prospective research.

Synesthesia is a psychological phenomenon where sensory signals become mixed. Input to one sensory modality produces an experience in a second, unstimulated modality. In “grapheme-color synesthesia”, viewed letters and numbers evoke mental imagery of colors. The study of this condition has implications for increasing our understanding of brain architecture and function, language, memory and semantics, and the nature of consciousness. In this work, we propose a novel application deep learning to model perception in grapheme-color synesthesia. Achromatic letter images, taken from database of handwritten characters, are used to induce synesthesia. Results show the model learns to accurately create a colored version of the inducing stimulus, according to a statistical distribution from experiments on a sample population of grapheme-color synesthetes. The spontaneous, creative mental imagery characteristic of the synesthetic perceptual experience is reproduced by the model. A model of synesthesia that generates testable predictions on brain activity and behavior is needed to complement large scale data collection efforts in neuroscience, especially when articulating simple descriptions of cause (stimulus) and effect (behavior). The research and modeling approach reported here begins to address this need.

Anomaly detection is an active area of research with numerous methods and applications. This survey reviews the state-of-the-art of data-driven anomaly detection techniques and their application to the the aviation domain. After a brief introduction to the main traditional data-driven methods for anomaly detection, we review the recent advances in the area of neural networks, deep learning and temporal-logic based learning. We cover especially unsupervised techniques applicable to time series data because of their relevance to the aviation domain, where the lack of labeled data is the most usual case, and the nature of flight trajectories and sensor data is sequential, or temporal. The advantages and disadvantages of each method are presented in terms of computational efficiency and detection efficacy. The second part of the survey explores the application of anomaly detection techniques to aviation and their contributions to the improvement of the safety and performance of flight operations and aviation systems. As far as we know, some of the presented methods have not yet found an application in the aviation domain. We review applications ranging from the identification of significant operational events in air traffic operations to the prediction of potential aviation system failures for predictive maintenance.

High temperatures (HT) and high hydrostatic pressures (HHP) are characteristic of deep-sea hydrothermal vents and other deep crustal settings. These environments host vast and diverse microbial populations, yet only a small fraction of those populations have been successfully cultured. This is due, in part, to the difficulty of sampling while maintaining these in situ conditions and also replicating those high-temperature and high-pressure conditions in the laboratory. In an effort to facilitate more HT-HHP cultivation, we present two HT-HHP batch culture incubation systems for cultivating deep-sea vent and subsurface (hyper)thermophilic microorganisms. One HT-HHP system can be used for batch cultivation up to 110 MPa and 121°C, and requires sample decompression during subsampling. The second HT-HHP system can be used to culture microorganisms up to 100 MPa and 160°C with variable-volume, pressure-retaining vessels that negate whole-sample decompression during subsampling. Here, we describe how to build cost effective heating systems for these two types of high-pressure vessels, as well as the protocols for HT-HHP microbial batch cultivation in both systems. Additionally, we demonstrate HHP transfer between the variable-volume vessels, which has utility in sampling and enrichment without decompression, laboratory isolation experiments, as well as HHP filtration.

Scoring targets in shooting sports is a crucial and time-consuming task that relies on manually counting bullet holes. This paper introduced an automatic score detection model using object detection techniques. The performance of seven models belonging to two different architectural setups was compared. Models like YOLOv8n, YOLOv8s, YOLOv8m, RetinaNet-50, and RetinaNet-101 are single-shot detectors, while Faster RCNN-50 and Faster RCNN-101 belong to the two-shot detectors category. The dataset was manually captured from the shooting range and expanded by generating more versatile data using Python code. Before the dataset was trained to develop models, it was resized (640x640) and augmented using Roboflow API. The trained models were then assessed on the test dataset, and their performance was compared using matrices like mAP50, mAP50-90, precision, and recall. The results showed that YOLOv8 models can detect multiple objects with good confidence scores. Among all, YOLOv8m performed the best with the highest mAP50 value of 96.7%, followed by the performance of YOLOv8s with the mAP50 value of 96.5%. It is suggested that if the system is to be implemented in a real-time environment, YOLOv8s is a better choice since it took significantly less inference time (2.3ms) than YOLOv8m (5.7ms) and yet generated the competitive mAP50.

This is an article or technical note which is intended to provides an insight journey of Machine Learning Systems (MLS) testing, its evolution, current paradigm and future work. Machine Learning Models, used in critical applications such as healthcare industry[1], Automobile [2], [3] and Air Traffic control, Share Trading etc., and failure of ML Model can lead to severe consequences in terms of loss of life or property. To remediate this, developers, scientists, and ML community around the world, must build a highly reliable test architecture for critical ML application. At the very foundation layer, any test model must satisfy the core testing attributes such as test properties and its components. This attribute comes from the software engineering [5], [6], but the same cannot be applied in as-is form to the ML testing and we will tell you “why”.

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines, using machine learning, deep learning and neural networks. AI enables machines to learn from experience and perform human-like tasks. The field of AI research has been developing fast over the past five to ten years, due to the rise of ‘big data’ and increasing computing power. In the medical area, AI can be used to improve diagnosis, prognosis, treatment, surgery, drug discovery, or for other applications. Therefore, both academia and industry are investing a lot in AI. This review investigates the biomedical literature (in the PubMed and Embase databases) by looking at bibliographical data, observing trends over time and occurrences of keywords. Some observations are made: AI has been growing exponentially over the past few years; it is used mostly for diagnosis; COVID-19 is already in the top-5 of diseases studied using AI; the United States, China, United Kingdom, South Korea and Canada are publishing the most articles in AI research; MIT is the world’s leading university in AI research; and convolutional neural networks are by far the most popular deep learning algorithms at this moment. These trends could be studied in more detail, by studying more literature databases or by including patent databases. More advanced analyses could be used to predict in which direction AI will develop over the coming years. The expectation is that AI will keep on growing, in spite of stricter privacy laws, more need for standardization, bias in the data, and the need for building trust.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

Exercise-based cardiac rehabilitation requires patients to perform a set of certain prescribed exercises a specific number of times. Local muscular endurance (LME) exercises are an important part of the rehabilitation program. Automatic exercise recognition and repetition counting, from wearable sensor data is an important technology to enable patients to perform exercises independently in remote settings, e.g. their own home. In this paper we first report on a comparison of traditional approaches to exercise recognition and repetition counting, corresponding to supervised machine learning and peak detection from inertial sensing signals respectively, with more recent machine learning approaches, specifically Convolutional Neural Networks (CNNs). We investigated two different types of CNN: one using the AlexNet architecture, the other using time-series array. We found that the performance of CNN based approaches were better than the traditional approaches. For exercise recognition task, we found that the AlexNet based single CNN model outperformed other methods with an overall 97.18% F1-score measure. For exercise repetition counting , again the AlexNet architecture based single CNN model outperformed other methods by correctly counting repetitions in 90% of the performed exercise sets within an error of ±1. To the best of our knowledge, our approach of using a single CNN method for both recognition and repetition counting is novel. In addition to reporting our findings, we also make the dataset we created, the INSIGHT-LME dataset, publicly available to encourage further research.

The time required to reach a correct diagnosis is one of the most important problems for rare disease (RD) patients. Diagnostic delay can be intolerably long, to the point that it is usually described as a “diagnostic odyssey” and, sometimes, a diagnosis might never occur. The International Rare Disease Research Consortium proposed, as ultimate goal for 2017-2027, to enable all people with a suspected RD to be diagnosed within one year if the disorder is known, and to enter a globally coordinated diagnostic and research pipeline for the unsolved cases. In-depth analysis of the genotype through next generation sequencing, together with a standardized in-depth phenotype description and sophisticated high-throughput approaches, have been applied as diagnostic tools to increase the chance of a timely and accurate diagnosis. This approach is very fruitful as, according to the Orphanet database, from 2010 to March 2017 more than 600 new RDs have been described and about 3600 genes linked to RDs have been identified. However, combination of -omics and phenotype data and international sharing of this information raise ethical concerns. Values to be assessed include not only patient autonomy but also family implications, beneficence, non-maleficence, justice, solidarity and reciprocity, which must be respected and promoted and, at the same time, balanced among each other. In this work we suggest that, to maximise patients involvement in the search for a diagnosis and identification of new causative genes, undiagnosed patients should have the possibility to: 1) actively participate in the description of their phenotype; 2) choose the level of visibility of their profile in matchmaking databases; 3) express their preferences regarding return of new findings, in particular which level of Variant of Unknown Significance (VUS) significance should be considered relevant to them. The quality of the relation between individual patients and physicians, and between the patient community and the scientific community is critically important for making the best use of available data and combining efforts in the search for matches with similar cases worldwide that will help to solve unsolved cases. The contribution of patients to collecting and coding data comprehensively is critical for efficient use of data downstream of data collection.

An increase in the use of smartphones has laid to the use of the internet and social media platforms. The most commonly used social media platforms are Twitter, Facebook, WhatsApp and Instagram. People are sharing their personal experiences, reviews, feedbacks on the web. The information which is available on the web is unstructured and enormous. Hence, there is a huge scope of research on understanding the sentiment of the data available on the web. Sentiment Analysis (SA) can be carried out on the reviews, feedbacks, discussions available on the web. There has been extensive research carried out on SA in the English language, but data on the web also contains different other languages which should be analyzed. This paper aims to analyze, review and discuss the approaches, algorithms, challenges faced by the researchers while carrying out the SA on Indigenous languages.

The location and number data of individual fruit trees are critical for planting area investigation, fruit yield prediction, and smart orchard management and planning. These data are conventionally obtained through manual investigation and statistics with time-consuming and laborious effort. Object detection models in deep learning used widely in computer vision could provide an opportunity for accurate detection of individual fruit trees, which is essential for rapidly obtaining the data and reducing human operations errors. This study proposes an approach to detecting individual fruit trees and mapping their spatial distribution by integrating deep learning with unmanned aerial vehicle (UAV) remote sensing. UAV remote sensing collected high-resolution true-color images of fruit trees in the experimental pomelo tree orchards in Meizhou city, South China. An image dataset of deep learning samples of individual pomelo trees (IPTs) was constructed through visual interpretation and field investigation based on the fruit tree images captured by UAV remote sensing. Four different scales of YOLOv5 (YOLOv5s, YOLOv5m, YOLOv5l, and YOLOv5x) for object detection were selected to train, validate, and test on the image dataset of pomelo trees. The results show that the average precision (AP@0.5) of the four YOLOv5 models for validation reach 87.8%, 88.5%, 89.1%, and 90.7%, respectively. The larger the model scale, the higher the average accuracy of the detection result of validation. It suggests that YOLOv5x is a preferred high-accuracy model among the YOLOv5 family and is suitable to realize the detection of IPTs. The number of the IPTs in the study area was counted using YOLOv5x, and their spatial distribution map was made using the non-maximum suppression method and ArcGIS software. This study will provide primary data and technical support for smart orchard management in Meizhou city and other fruit-producing areas.

Otolith morphology analysis is one of the main tools used for fish or fish stock identification. Moreover, otolith shape can also be used in fish dietary studies (stomach content) for the identification of prey fishes and their size according to the relationship between fish and otolith sizes. In the present study, the relationship between fish length and otolith morphological dimensions was investigated for the sabre squirrelfish, Sargocentron spiniferum (Forsskål, 1775) (family: Holocentridae). Samples of 185 fish were collected from the coast of the Red Sea, Egypt. To analyze the relationship between fish and otolith, otolith morphometric measurements (length, width, area, perimeter, weight, sulcus, and ostium) and shape factors (aspect ratio, compactness, form factor, rectangularity, roundness, ellipticity, squareness) describing outline shape were extracted using image analysis. Generalized linear models were applied for the relationship between body length and each otolith morphology feature. From the relationships between the total length of fish and fourteen morphology features, only otolith length, caudal length, and squareness were significantly correlated with fish size. Our results provide more information for the relationship between fish length and otolith morphometric features.

To improve the tangerine crop yield, the work of recognizing and then disposing of specific pests is becoming increasingly important. The task of recognition is based on the features extracted from the images that have been collected from websites and outdoors. Traditional recognition and deep learning methods, such as KNN (k-nearest neighbors) and AlexNet, are not preferred by knowledgeable researchers, who have proven them inaccurate. In this paper, we exploit four kinds of structures of advanced deep learning to classify 10 citrus pests. The experimental results show that Inception-ResNet-V3 obtains the minimum classification error.

This last decade, the amount of data exchanged in the Internet increased by over a staggering factor of 100, and is expected to exceed well over the 500 exabytes by 2020. This phenomenon is mainly due to the evolution of high speed broadband Internet and, more specifically, the popularization and wide spread use of smartphones and associated accessible data plans. Although 4G with its long-term evolution (LTE) technology is seen as a mature technology, there is continual improvement to its radio technology and architecture such as in the scope of the LTE Advanced standard, a major enhancement of LTE. But for the long run, the next generation of telecommunication (5G) is considered and is gaining considerable momentum from both industry and researchers. In addition, with the deployment of the Internet of Things (IoT) applications, smart cities, vehicular networks, e-health systems, and Industry 4.0, a new plethora of 5G services has emerged with very diverging and technologically challenging design requirements. These include: high mobile data volume per area, high number of devices connected per area, high data rates, longer battery life for low-power devices, and reduced end-to-end latency. Several technologies are being developed to meet these new requirements. Among these we list ultra-densification, millimeter Wave usage, antennas with massive multiple-input multiple-output (MIMO), antenna beamforming to increase spacial diversity, edge/fog computing, among others. Each of these technologies brings its own design issues and challenges. For instance, ultra-densification and MIMO will increase the complexity to estimate channel condition and traditional channel state information (CSI) estimation techniques are no longer suitable due to the complexity of the new scenarios. As a result, new approaches to evaluate network condition such as by continuously collecting and monitoring key performance indicators become necessary. Timely decisions are needed to ensure the correct operation of such network. In this context, deep learning (DL) models could be seen as one of the main tools that can be used to process monitoring data and automate decisions. As these models are able to extract relevant features from raw data (images, texts, and other types of unstructured data), the integration between 5G and DL looks promising and one that requires exploring. As main contributions, this paper presents a systematic review about how DL is being applied to solve some 5G issues. We examine data from the last decade and the works that addressed diverse 5G problems, such as physical medium state estimation, network traffic prediction, user device location prediction, self network management, among others. We also discuss the main research challenges when using DL models in 5G scenarios and identify several issues that deserve further consideration.

Classification of human actions from uni-modal and multi-modal datasets is an ongoing research problem in computer vision. This review is aimed to scope current literature on data-fusion and action-recognition techniques and to identify gaps and future research direction. Success in producing cost-effective and portable vision-based sensors has dramatically increased the number and size of datasets. The rise in number of action recognition datasets intersects with advances in deep-learning architectures and computational support, both of which offer significant research opportunities. Naturally, each action-data modality - such as RGB, depth, skeleton, and infrared - has distinct characteristics; therefore, it is important to exploit the value of each modality for better action recognition. In this article we will focus solely on areas such as data fusion and recognition techniques in the context of vision with a uni-modal and multi-modal perspective. We conclude by discussing research challenges, emerging trends, and possible future research directions.

The sea level rise, a consequence of climate change, is one of the biggest challenges that countries and regions with coastal lowland areas will face in the medium term. This study proposes a methodology for assessing the vulnerability to sea level rise (SLR) on the Atlantic coast of Portugal mainland. Some scenarios of extreme sea level for different return periods and extreme flooding events were estimated for 2050 and 2100, as proposed by the European Union Directive 2007/60/EC. A set of physical parameters are considered for the multi-attribute analysis technique implemented by the Analytic Hierarchy Process, in order to define a Physical Vulnerability Index fundamental to assess coastal vulnerability. For each SLR scenario, coastal vulnerability maps, with spatial resolution of 20 m, are produced at national scale to identify areas most at risk of SLR, constituting key documents for triggering adaptation plans for such vulnerable regions. For 2050 and 2100, it is estimated 903 km² and 1146 km² of vulnerable area, respectively, being the district of Lisbon the most vulnerable district in both scenarios. Results are available through a Web Map Service, for Portuguese public entities, and through a web map viewer for public and communities in general.

An application of deep convolutional neural network and recurrence plot for financial market movement prediction is presented. Though it is challenging and subjective to interpret its information, the pattern formed by a recurrence plot provide a useful insight into the dy- namical system. We used a recurrence plot of seven financial time series to train a deep neural network for financial market movement predic- tion. Our approach is tested on our dataset and achieved an average of 53.25% classification accuracy. The result suggests that a well trained deep convolutional neural network can learn a recurrence plot and pre- dict a financial market direction.

Understanding surfactant self-assembly in deep eutectic solvents (DES) is important to their potential use in industrial formulations. We have recently reported the formation of a fracto-eutectogel comprising SDS fractal aggregates at a concentration as low as 1.6 wt% in glyceline (a DES comprising glycerol and choline chloride) at room temperature. The building units of the fractals consisted of multilayers of self-assembled SDS lamellae arranged in a dendritic pattern. Here we report that this fractal phase transitions into a fluid phase above a critical gelation temperature, TCG ~ 45 oC, evident from polarized light microscopy (PLM) observations. Small-angle neutron scattering (SANS) reveals that this phase transition is underpinned by the nanoscopic morphological transformation of the SDS lamellae into cylindrical micelles at T > TGC. Fitting SANS profiles confirms that the morphology of the micelles is SDS-concentration (cSDS) dependent at T > TGC: cylindrical at cSDS > 0.6 wt% and spherical at cSDS = 0.6 wt%. At cSDS < 0.6 wt%, only isotropic scattering was observed in the SANS profiles. Such SDS self-assembly behaviors contrast with those we have previously observed in glycerol, which we attribute to the presence of ions (i.e. choline chloride) in glyceline. Our findings have general implications to surfactant self-assembly in DES, solvents that are rich in hydrogen bonding and ions.

The basal ganglia (BG) are a central component of the brain, crucial to the initiation, execution and learning of adaptive actions. The BG are the major site of the action of dopamine. An important aspect of the BG architecture is the existence of two paths, direct and indirect, having different projection targets and dopamine receptor expression. To understand the BG, dopamine, and related disorders, it is imperative to understand the two paths. The standard account used in neuroscience research for decades posits that the role of the direct path is to support movements, while that of the indirect path is to suppress unselected or completed movements. This account is contradicted by converging evidence. Here, we explain why the arguments supporting the standard account are flawed, and present a new account, in which the role of the indirect path is completely opposite: to support automated execution. During acute events, the direct path allows coarse responses. These are refined by competition, and the resulting focused response is executed and learned by the indirect path, assisted by cholinergic interneurons and the subthalamic nucleus (STN). The new account allows a novel understanding of the symptoms of Parkinson's disease, in particular tremor and rigidity, and of its treatment by STN deep brain stimulation.

Power disaggregation aims at determining the appliance-by-appliance electricity consumption leveraging upon a single meter only, which measures the entire power demand. Data-driven procedures based on Factorial Hidden Markov Models have been proven remarkable results on energy disaggregation. Nevertheless, those procedures have various weaknesses: there is a scalability problem as the number of devices to observe raises and the algorithmic complexity of the inference step is severe. DNN architectures, such as Convolutional Neural Networks, have demonstrated to be a viable solution to deal with FHMMs shortcomings. Nonetheless, there are two significant limitations: a complicated and time-consuming training system based on back-propagation has to be employed to estimates the neural architecture parameters, and large amounts of training data covering as many operation conditions as possible need to be collected to attain top performances. In this work, we aim to overcome those limitations by leveraging upon the unique and useful characteristics of the extreme learning machine technique, which is based on a collection of randomly chosen hidden units and analytically defined output weights. Experiment evaluation has been conducted using the UK-DALE corpus. We find that the suggested approach achieves similar performances to recently proposed ANN-based methods and outperforms FHMMs. Besides, our solution generalises well to unseen houses.

The Greenland Ice Sheet is now the largest land ice contributor to global sea level rise, largely driven by increased surface meltwater runoff from the ablation zone, i.e. areas of the ice sheet where annual mass losses exceed gains. This small but critically important area of the ice sheet has expanded in size by ~50% since the early 1960s, and satellite remote sensing is a powerful tool for monitoring the physical processes that influence its surface mass balance. This review synthesizes key remote sensing methods and scientific findings from satellite remote sensing of the Greenland Ice Sheet ablation zone, covering progress in 1) radar altimetry, 2) laser (lidar) altimetry, 3) gravimetry, 4) multispectral optical imagery and, 5) microwave and thermal imagery. Physical characteristics and quantities examined include surface elevation change, gravimetric mass balance, reflectance, albedo, and mapping of surface melt extent and glaciological facies and zones. The review concludes that future progress will benefit most from methods that combine multi-sensor, multi-wavelength, and cross-platform datasets designed to discriminate the widely varying surface processes in the ablation zone. Specific examples include fusing laser altimetry, radar altimetry, and optical stereophotogrammetry to enhance spatial measurement density, cross-validate surface elevation change, and diagnose radar elevation bias; fusing optical imagery, radar imagery, and microwave scatterometry to discriminate between snow, liquid water, refrozen meltwater, and bare ice near the equilibrium line altitude; combining optical reflectance with laser altimetry to map supraglacial lake, stream, and crevasse bathymetry; and monitoring the inland migration of snowlines, surface melt extent, and supraglacial hydrologic features.

Depression is considered by WHO as the main contributor to global disability and it poses dangerous threats to approximately all aspects of human life, in particular public and private health. This mental disorder is usually characterized by considerable changes in feelings, routines, or thoughts. With respect to the fact that early diagnosis of this illness would be of critical importance ineffective treatment, some development has occurred in the purpose of depression detection. EEG signals reflect the working status of the human brain by which are considered the most proper tools for a depression diagnosis. Deep learning algorithms have the capacity of pattern discovery and extracting features from the raw data which is fed into them. Owing to this significant characteristic of deep learning, recently, these methods have intensely utilized in the diverse field of researches, specifically medicine and healthcare. Thereby, in this article, we aimed to review all papers concentrated on using deep learning to detect or predict depressive subjects with the help of EEG signals as input data. Regarding the adopted search method, we finally evaluated 22 articles between 2016 and 2021. This article which is organized according to the systematic literature review (SLR) method, provides complete summaries of all exploited studies and compares the noticeable aspects of them. Moreover, some statistical analysis performs to gain a depth perception of the general ideas of the latest researches in this area. A pattern of a five-step procedure was also established by which almost all reviewed articles fulfilled the goal of depression detection. Finally, open issues and challenges in this way of depression diagnosis or prediction and suggested works as the future directions discussed.

Traditional ways of validating satellite-derived sea surface temperature (SST) and sea surface salinity (SSS) products, using comparisons with buoy measurements, do not allow for evaluating the impact of mesoscale to submesoscale variability. Here we present the validation of remotely-sensed SST and SSS data against the unmanned surface vehicle (USV) – Saildrone – measurements from the Spring 2018 Baja deployment. More specifically, biases and root mean square differences (RMSD) were calculated between USV-derived SST and SSS values, and six satellite-derived SST (MUR, OSTIA, CMC, K10, REMSS, and DMI) and three SSS (JPLSMAP, RSS40, RSS70) products. Biases between the USV SST and OSTIA/CMC/DMI were approximately zero while MUR showed a bias of 0.2C. OSTIA showed the smallest RMSD of 0.36C while DMI had the largest RMSD of 0.5C. An RMSD of 0.4C between Saildrone SST and the satellite-derived products could be explained by the daily variability in USV SST which currently cannot be resolved by remote sensing measurements. For SSS, values from the JPLSMAP product showed saltier biases of 0.2 PSU, while RSS40 and RSS70 showed fresh biases of 0.3 PSU. An RMSD of 0.4 PSU could not be explained solely by the daily variability of the USV-derived SSS. Coherences were significant at the longer wavelengths, with a local maximum at 100 km that is most likely associated with the mesoscale turbulence in the California Current System.

Recent progress in deep learning has led to accurate and efficient generic object detection networks. Training of highly reliable models depends on large datasets with highly textured and rich images. However, in real-world scenarios, the performance of the generic object detection system decreases when (i) occlusions hide the objects, (ii) objects are present in low-light images, or (iii) they are merged with background information. In this paper, we refer to all these situations as challenging environments. With the recent rapid development in generic object detection algorithms, notable progress has been observed in the field of object detection in challenging environments. However, there is no consolidated reference to cover state-of-the-art in this domain. To the best of our knowledge, this paper presents the first comprehensive overview, covering recent approaches that have tackled the problem of object detection in challenging environments. Furthermore, we present the quantitative and qualitative performance analysis of these approaches and discuss the currently available challenging datasets. Moreover, this paper investigates the performance of current state-of-the-art generic object detection algorithms by benchmarking results on the three well-known challenging datasets. Finally, we highlight several current shortcomings and outline future directions.

Salmon farming has been blamed for the collapse of the sea trout (Salmo trutta) fishery in Loch Maree on Scotland’s west coast despite the absence of any direct evidence. Stocks of west coast demersal marine fish, especially around the Clyde Estuary have also declined over a similar time span. The decline of these marine fish stocks can be attributed to the removal of the “three-mile fishing limit” in 1984 by UK Government legislation. Sea trout inhabit the same inshore waters as targeted demersal fish and can be caught as by-catch. Comparisons of the decline of demersal species and the sea trout from Loch Maree and the west coast show a high degree of correlation. Stocks of whiting (Merlangius merlangus) from inshore waters have found to consist of small fish which mirrors the stock makeup of the Loch Maree sea trout stock.

(1) Background: Evidence-based policymaking requires data about the local population's socioeconomic status (SES) at detailed geographical level, however, such information is often not available, or is too expensive to acquire. Researchers have proposed solutions to estimate SES indicators by analyzing Google Street View images, however, these methods are also resource-intensive, since they require large volumes of manually labeled training data. (2) Methods: We propose a methodology for automatically computing surrogate variables of SES indicators using street images of parked cars and deep multiple instance learning. Our approach does not require any manually created labels, apart from data already available by statistical authorities, while the entire pipeline for image acquisition, parked car detection, car classification, and surrogate variable computation is fully automated. The proposed surrogate variables are then used in linear regression models to estimate the target SES indicators. (3) Results: We implement and evaluate a model based on the proposed surrogate variable at 30 municipalities of varying SES in Greece. Our model has $R^2=0.76$ and a correlation coefficient of $0.874$ with the true unemployment rate, while it achieves a mean absolute percentage error of $0.089$ and mean absolute error of $1.87$ on a held-out test set. Similar results are also obtained for other socioeconomic indicators, related to education level and occupational prestige. (4) Conclusions: The proposed methodology can be used to estimate SES indicators at the local level automatically, using images of parked cars detected via Google Street View, without the need for any manual labeling effort.

Deep learning models are part of the family of artificial neural networks and, as such, it suffers of catastrophic interference when they learn sequentially. In addition, most of these models have a rigid architecture which prevents the incremental learning of new classes. To overcome these drawbacks, in this article we propose the Self-Improving Generative Artificial Neural Network (SIGANN), a type of end-to-end Deep Neural Network system which is able to ease the catastrophic forgetting problem when leaning new classes. In this method, we introduce a novelty detection model to automatically detect samples of new classes, moreover an adversarial auto-encoder is used to produce samples of previous classes. This system consists of three main modules: a classifier module implemented using a Deep Convolutional Neural Network, a generator module based on an adversarial autoencoder; and a novelty detection module, implemented using an OpenMax activation function. Using the EMNIST data set, the model was trained incrementally, starting with a small set of classes. The results of the simulation show that SIGANN is able to retain previous knowledge with a gradual forgetfulness for each learning sequence. Moreover, SIGANN can detect new classes that are hidden in the data and, therefore, proceed with incremental class learning.

Plant geneticists and breeders have used marker technology since the 1980s in quantitative trait locus (QTL) identification. Marker-assisted selection is effective for large-effect QTL but has been challenging to use with quantitative traits controlled by multiple minor effect alleles. Therefore, genomic selection (GS) was proposed to estimate all markers simultaneously, thereby capturing all their effects. However, breeding programs are still struggling to identify the best strategy to implement it into their programs. Traditional breeding programs need to be optimized to implement GS effectively. This review explores the optimization of breeding programs for variety release based on aspects of the breeder’s equation. Optimizations include reorganizing field designs, training populations, increasing the number of lines evaluated, and leveraging the large amount of genomic and phenotypic data collected across different growing seasons and environments to increase heritability estimates, selection intensity, and selection accuracy. Breeding programs can leverage their phenotypic and genotypic data to maximize genetic gain and selection accuracy through GS methods utilizing multi-trait and, multi-environment models, high-throughput phenotyping, and deep learning approaches. Overall, this review describes various methods that plant breeders can utilize to increase genetic gains and effectively implement GS in breeding .

We propose a deep-learning approach for the joint MIMO detection and channel decoding problem. Conventional MIMO receivers adopt a model-based approach for MIMO detection and channel decoding in linear or iterative manners. However, due to the complex MIMO signal model, the optimal solution to the joint MIMO detection and channel decoding problem (i.e., the maximum likelihood decoding of the transmitted codewords from the received MIMO signals) is computationally infeasible. As a practical measure, the current model-based MIMO receivers all use suboptimal MIMO decoding methods with affordable computational complexities. This work applies the latest advances in deep learning for the design of MIMO receivers. In particular, we leverage deep neural networks (DNN) with supervised training to solve the joint MIMO detection and channel decoding problem. We show that DNN can be trained to give much better decoding performance than conventional MIMO receivers do. Our simulations show that a DNN implementation consisting of seven hidden layers can outperform conventional model-based linear or iterative receivers. This performance improvement points to a new direction for future MIMO receiver design.

The Mediterranean Sea is one of the most impacted basin in terms of microplastics pollution. Land-based activities are the major sources of plastic litter to the ocean, with harbors probably representing significant hotspots. In the framework of the SPlasH! project (Stop alle Plastiche in H2O, Interreg Marittimo project), microplastics were sampled in three north-western Mediterranean harbors during summer and winter. In this study, the areal concentrations of microplastics ranged from 5,576 to 379,965 items.km-2. A decreasing gradient was observed from the inner to the outer zones of the studied harbors, pointing out these enclosed systems as hotspots regarding microplastic pollution. During the summer, because of an enhancement of port activities, the areal concentrations of microplastics were higher than in winter. The investigation microplastics size classes distribution in the surface waters revealed that microplastic within a size range between 300 µm and 500 µm were depleted. During this study, we assessed trace metal partitioning (Pb, Fe, Cu, V, Cd and As) between the dissolved phase and biofilm, thus highlighting concentrations within the biofilm two and six orders higher than those in the dissolved phase. This result strongly suggest trace metal bioaccumulation within the biofilm. When trace metal concentrations are normalized over the corresponding surface of microplastics and microplastics, higher values were obtained for microplastics evidencing their enhanced capacities to bioaccumulate contaminants with respect to macroplastics.

The medial septum (MS), as part of the basal forebrain, supports many physiological functions, from sensorimotor integration to cognition. With often reciprocal connections with a broad set of peers at all major divisions of the brain, the MS orchestrates oscillatory neuronal activities throughout the brain. These oscillations are critical in generating sensory and emotional salience, locomotion, maintaining mood, supporting innate anxiety, and governing learning and memory. Accumulating evidence points out that the physiological oscillations under septal influence are frequently disrupted or altered in pathological conditions. Therefore, the MS may be a potential target for treating neurological and psychiatric disorders with abnormal oscillations (oscillopathies) to restore healthy patterns or erase undesired ones. Recent studies have revealed that the patterned stimulation of the MS alleviates symptoms of epilepsy. We discuss here that stimulus timing is a critical determinant of treatment efficacy on multiple time scales. On-demand stimulation may dramatically reduce side effects by not interfering with normal physiological functions. A precise pattern-matched stimulation through adaptive timing governed by the ongoing oscillations is essential to effectively terminate pathological oscillations. The time-targeted strategy for the MS stimulation may provide an effective way of treating multiple disorders including Alzheimer’s disease, anxiety/fear, schizophrenia, and depression, as well as pain.

The Greenland ice sheet is a major contributor to sea level rise, adding an estimated 0.47 +/− 0.23 mm/yr to global mean sea level between 1991 and 2015 (van den Broeke et al., 2016). Making sea level rise projections for the future and understanding the processes controlling current observed rates of sea level rise are crucially dependent on understanding the present-day state of the ice sheet. Here, we provide an overview of the current state of the mass budget of Greenland based on satellite gravimetry and remote sensing observations of surface elevation change, ice sheet velocity and calving front positions. We also combine these essential climate variables with a regional climate model (RCM) output from an ice sheet model (ISM) to gain insight into poorly understood ice sheet dynamical and surface mass processes. On average from 1992 to 2017 the ice sheet in some locations has lost up −2.65 m/yr in elevation based on ESA Radar altimetry analysis. Calving fronts have retreated all around Greenland since the 1990s and in only two out of 28 study locations have they remained stable. The locations of grounding lines at 5 key glaciers with floating ice tongues have remained stable over the observation period. However a detailed case study at Petermann glacier with an ice fracture model shows the sensitivity of these floating ice shelves to future climate change. GRACE gravimetric mass balance (GMB) data allows us to tie together disparate lines of evidence showing that Greenland has lost about 265 +/− 25 Gt/yr of ice over the period 2002 to 2015. RCM and ISM simulations show that surface mass processes dominate the overall Greenland ice sheet mass budget except for areas of fast ice sheet flow but marked differences between models and between models and observations indicate that not all processes are captured accurately, indicating areas of greater uncertainty and directions of future research for future sea level rise projections.

In the remote sensing domain, it is crucial to complete semantic segmentation on the raster images, e.g., river, building, forest, etc, on raster images. A deep convolutional encoder--decoder (DCED) network is the state-of-the-art semantic segmentation method for remotely sensed images. However, the accuracy is still limited, since the network is not designed for remotely sensed images and the training data in this domain is deficient. In this paper, we aim to propose a novel CNN for semantic segmentation particularly for remote sensing corpora with three main contributions. First, we propose applying a recent CNN called a global convolutional network (GCN), since it can capture different resolutions by extracting multi-scale features from different stages of the network. Additionally, we further enhance the network by improving its backbone using larger numbers of layers, which is suitable for medium resolution remotely sensed images. Second, "channel attention'' is presented in our network in order to select the most discriminative filters (features). Third, "domain-specific transfer learning'' is introduced to alleviate the scarcity issue by utilizing other remotely sensed corpora with different resolutions as pre-trained data. The experiment was then conducted on two given datasets: (i) medium resolution data collected from Landsat-8 satellite and (ii) very high resolution data called the ISPRS Vaihingen Challenge Dataset. The results show that our networks outperformed DCED in terms of $F1$ for 17.48% and 2.49% on medium and very high resolution corpora, respectively.

The detection of seismic events at regional and teleseismic distances is critical to Nuclear Treaty Monitoring. Traditionally, detecting regional and teleseismic events has required the use of an expensive multi-instrument seismic array; however in this work, we present DeepPick, a novel seismic detection algorithm capable of array-like performance from a single trace. We achieve this directly, by training our single-trace detector against labeled events from an array catalog, and by utilizing a deep temporal convolutional neural network. The training data consists of all arrivals in the International Seismological Centre Catalog for seven seismic arrays over a five year window from 1 Jan 2010 to 1 Jan 2015, yielding a total training set of 608,362 detections. The test set consists of the same seven arrays over a one year window from 1 Jan 2015 to 1 Jan 2016. We report our results by training the algorithm on six of the arrays and testing it on the seventh, so as to demonstrate the transportability and generalization of the technique to new stations. Detection performance against this test set is outstanding. Fixing a type-I error rate of 1%, the algorithm achieves an overall recall rate of 73% on the 141,095 array beam picks in the test set, yielding 102,394 correct detections. This is more than 4 times the 23,259 detections found in the analyst-reviewed single-trace catalogs over the same period, and represents an 8dB improvement in detector sensitivity over current methods. These results demonstrate the potential of our algorithm to significantly enhance the effectiveness of the global treaty monitoring network.