ARTICLE | doi:10.20944/preprints202006.0297.v1
Online: 24 June 2020 (18:02:03 CEST)
Breast Cancer diagnosis is one of the most studied problems in the medical domain. In the medical domain, cancer diagnosis has been studied extensively which instantiates the need of early prediction of cancer disease. For obtaining advance prediction, health records are exploited and given as input to an automated system. This paper focuses on constructing an automated system by employing deep learning based recurrent neural network models. A stacked GRU-LSTM-BRNN is proposed in this paper that accepts health records of a patient for determining possibility of being affected by breast cancer. Proposed model is compared against other baseline classifiers such as stacked Simple-RNN model, stacked LSTM-RNN model, stacked GRU-RNN model. Comparative results obtained in this study indicate that stacked GRU-LSTM-BRNN yield better classification performance for predictions related to breast cancer disease.
ARTICLE | doi:10.20944/preprints202105.0177.v1
Subject: Keywords: Overweight, obesity, deep learning, Convolutional layer, GRU, COVID-19, lifestyle.
Online: 10 May 2021 (11:22:56 CEST)
Obesity and overweight is a foremost concern around the globe for each group of age. This can be accelerated by the current imposed lockdown. However, excessive weight gain may result in other chronic diseases. This study has been considering the age group of 25 to 55 years as the sample populations and monitoring them from July, 2020 to November, 2020. The lifestyle of this population, food habit, mental health conditions are explored using deep learning based framework. All these parameters need to be monitored as these have close relation with currently imposed constraints due to COVID-19. A predictive model is constructed using deep learning techniques to predict the risk of gaining weight. The predictive model hybridizes the convolutional layer and gated recurrent neural networks as a unified entity for achieving the objective of early weight gain prediction. The result obtained by this model exhibits an encouraging predictive efficiency of 93.7%.
ARTICLE | doi:10.20944/preprints202009.0323.v1
Subject: Medicine & Pharmacology, Nursing & Health Studies Keywords: COVID-19; lockdown; CNN; DLNN; GRU; mental anxiety; hybrid approach
Online: 15 September 2020 (02:56:33 CEST)
COVID-19 and new concept, lockdown, change social life of all classes of humans. Children partially feel the changes of daily life and this situation has been children’s free mind. Children are under a new type of restriction imposed on them by their parents. Normally they prefer play with their their friends than study and always waiting for holidays. They heard a new jargon i.e. lockdown where everything stands still. Very often they see peoples in the roads and few vehicles are moving in the roads. However, a peculiar thing happens now that they sit in front of computer to hear the virtual classes that are taken by the teachers. This also happens when there is no lockdown since COVID-19 still affects people. The environment is totally changed and they do not find any proper answers from the parents about the scenario.This study has been made an attempt to carry out the mental affairs of children in West Bengal, India. Several families are surveyed for collecting responses mostly from rural areas as well as urban areas for the time-period from April, 2020 to July, 2020. An effort has been given in this paper to predict the stress, depression and anxiety faced by children during the COVID-19. A Deep Learning Neural Network (DLNN) based method is applied to understand the stress level, depression level and anxiety level amongst the children. A hybrid DLNN has been presented in this research that combines both Convolutional Layer and Gated-Recurrent Unit (GRU) for obtaining the prediction of the mental health of children. The model obtains an accuracy of 89.57% for defeminizing mental anxiety of children.
ARTICLE | doi:10.20944/preprints202207.0265.v1
Subject: Earth Sciences, Geoinformatics Keywords: GOES-R; GRU; Deep Learning; Wildfires; Active Fires; Early Detection; Monitoring
Online: 18 July 2022 (10:28:06 CEST)
Early detection of wildfires has been limited using the sun-synchronous orbit satellites due to their low temporal resolution and wildfires’ fast spread in the early stage. NOAA’s geostationary weather satellites GOES-R can acquire images every 15 minutes at 2km spatial resolution, and have been used for early fire detection. However, advanced processing algorithms are needed to provide timely and reliable detection of wildfires. In this research, a deep learning framework, based on Gated Recurrent Units (GRU), is proposed to detect wildfires at early stage using GOES-R dense time series data. GRU model maintains good performance on temporal modelling while keep a simple architecture, makes it suitable to efficiently process time-series data. 36 different wildfires in North and South America under the coverage of GOES-R satellites are selected to assess the effectiveness of the GRU method. The detection times based on GOES-R are compared with VIIRS active fire products at 375m resolution in NASA’s Fire Information for Resource Management System (FIRMS). The results show that GRU-based GOES-R detections of the wildfires are earlier than that of the VIIRS active fire products in most of the study areas. Also, results from proposed method offer more precise location on the active fire at early stage than GOES-R Active Fire Product in mid-latitude and low-latitude regions.
Subject: Mathematics & Computer Science, Algebra & Number Theory Keywords: motion capture; neural networks; reconstruction; gap filling; FFNN; LSTM; BILSTM; GRU
Online: 3 August 2021 (11:52:46 CEST)
Optical motion capture is a mature contemporary technique for the acquisition of motion data, alas it is non-error-free. Due to technical limitations and occlusions of markers, gaps might occur in such recordings. The article reviews various neural network architectures applied for gap filling problem in motion capture sequences within FBM framework providing the representation for body kinematic structure. The results are compared with interpolation and matrix completion methods. We found out, that for longer sequences simple linear feedforward neural networks can outperform the other, sophisticated architectures. We were also able to identify, that acceleration and monotonicity of input sequence are the parameters that have a notable impact on the obtained results.
ARTICLE | doi:10.20944/preprints202007.0101.v1
Subject: Keywords: Term deposit subscription; Neural network; GRU; Convolutional layers; DT; MLP; k-NN
Online: 6 July 2020 (09:13:34 CEST)
Banks are normally offered two kinds of deposit accounts. It consists of deposits like current/saving account and term deposits like fixed or recurring deposits. For enhancing the maximized profit from bank as well as customer perspective, term deposit can accelerate uplifting of finance fields. This paper focuses on likelihood of term deposit subscription taken by the customers. Bank campaign efforts and customer detail analysis can influence term deposit subscription chances. An automated system is approached in this paper that works towards prediction of term deposit investment possibilities in advance. This paper proposes deep learning based hybrid model that stacks Convolutional layers and Recurrent Neural Network (RNN) layers as predictive model. For RNN, Gated Recurrent Unit (GRU) is employed. The proposed predictive model is later compared with other benchmark classifiers such as k-Nearest Neighbor (k-NN), Decision tree classifier (DT), and Multi-layer perceptron classifier (MLP). Experimental study concludes that proposed model attains an accuracy of 89.59% and MSE of 0.1041 which outperform well other baseline models.
ARTICLE | doi:10.20944/preprints201911.0113.v1
Subject: Mathematics & Computer Science, Other Keywords: software defined networking; random forest; gain ratio; gru-lstm; anova f-rfe; open flow controller; machine learning
Online: 10 November 2019 (14:27:32 CET)
Recent advancements in Software Defined Networking (SDN) makes it possible to overcome the management challenges of traditional network by logically centralizing control plane and decoupling it from forwarding plane. Through centralized controllers, SDN can prevent security breach, but it also brings in new threats and vulnerabilities. Central controller can be a single point of failure. Hence, flow-based anomaly detection system in OpenFlow Controller can secure SDN to a great extent. In this paper, we investigated two different approaches of flow-based intrusion detection system in OpenFlow Controller. The first of which is based on machine-learning algorithm where NSL-KDD dataset with feature selection ensures the accuracy of 82% with Random Forest classifier using Gain Ratio feature selection evaluator. In the later phase, the second approach is combined with Gated Recurrent Unit Long Short-Term Memory based intrusion detection model based on Deep Neural Network (DNN) where we applied an appropriate ANOVA F-Test and Recursive Feature Elimination feature selection method to improve the classifier performance and achieved an accuracy of 88%. Substantial experiments with comparative analysis clearly show that, deep learning would be a better choice for intrusion detection in OpenFlow Controller.
ARTICLE | doi:10.20944/preprints202009.0491.v1
Subject: Mathematics & Computer Science, Artificial Intelligence & Robotics Keywords: Short term load forecasting; STLF; deep learning; RNN; LSTM; GRU; machine learning; SVR; random forest; KNN; energy consumption; energy-intensive manufacturing; time series prediction; industry
Online: 21 September 2020 (04:19:45 CEST)
To minimise environmental impact, avoid regulatory penalties, and improve competitiveness, energy-intensive manufacturing firms require accurate forecasts of their energy consumption so that precautionary and mitigation measures can be taken. Deep learning is widely touted as a superior analytical technique to traditional artificial neural networks, machine learning, and other classical time series models due to its high dimensionality and problem solving capabilities. Despite this, research on its application in demand-side energy forecasting is limited. We compare two benchmarks (Autoregressive Integrated Moving Average (ARIMA), and an existing manual technique used at the case site) against three deep learning models (simple Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU)) and three machine learning models (Support Vector Regression (SVM), Random Forest, and K-Nearest Neighbors (KNN)) for short term load forecasting (STLF) using data from a Brazilian thermoplastic resin manufacturing plant. We use the grid search method to identify the best configurations for each model, and then use Diebold-Mariano testing to confirm the results. Results suggests that the legacy approach used at the case site is the worst performing, and that the GRU model outperformed all other models tested.
ARTICLE | doi:10.20944/preprints202201.0107.v1
Subject: Engineering, Energy & Fuel Technology Keywords: Very short term load forecasting; VSTLF; Short term load forecasting; STLF; deep learning; RNN; LSTM; GRU; machine learning; SVR; random forest; extreme gradient boosting, energy consumption; ARIMA; time series prediction.
Online: 10 January 2022 (12:17:35 CET)
Commercial buildings are a significant consumer of energy worldwide. Logistics facilities, and specifically warehouses, are a common building type yet under-researched in the demand-side energy forecasting literature. Warehouses have an idiosyncratic profile when compared to other commercial and industrial buildings with a significant reliance on a small number of energy systems. As such, warehouse owners and operators are increasingly entering in to energy performance contracts with energy service companies (ESCOs) to minimise environmental impact, reduce costs, and improve competitiveness. ESCOs and warehouse owners and operators require accurate forecasts of their energy consumption so that precautionary and mitigation measures can be taken. This paper explores the performance of three machine learning models (Support Vector Regression (SVR), Random Forest, and Extreme Gradient Boosting (XGBoost)), three deep learning models (Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU)), and a classical time series model, Autoregressive Integrated Moving Average (ARIMA) for predicting daily energy consumption. The dataset comprises 8,040 records generated over an 11-month period from January to November 2020 from a non-refrigerated logistics facility located in Ireland. The grid search method was used to identify the best configurations for each model. The proposed XGBoost models outperform other models for both very short load forecasting (VSTLF) and short term load forecasting (STLF); the ARIMA model performed the worst.
ARTICLE | doi:10.20944/preprints202208.0345.v1
Subject: Mathematics & Computer Science, Artificial Intelligence & Robotics Keywords: Deep learning; solar radiation forecasting; model prediction; solar energy; multi climates data; generalizability; sustainability; Long Short-Term Memory (LSTM); Gated Recurrent Unit (GRU); Convolutional Neural Network (CNN); Hybrid CNN-Bidirectional LSTM; LSTM Autoencoder
Online: 18 August 2022 (10:59:18 CEST)
The sustainability of the planet and its inhabitants is in dire danger and is among the highest priorities on global agendas such as the Sustainable Development Goals (SDGs) of the United Nations (UN). Solar energy -- among other clean, renewable, and sustainable energies -- is seen as essential for environmental, social, and economic sustainability. Predicting solar energy accurately is critical to increasing reliability and stability, and reducing the risks and costs of the energy systems and markets. Researchers have come a long way in developing cutting-edge solar energy forecasting methods. However, these methods are far from optimal in terms of their accuracies, generalizability, benchmarking, and other requirements. Particularly, no single method performs well across all climates and weathers due to the large variations in meteorological data. This paper proposes SENERGY (an acronym for Sustainable Energy), a novel deep learning-based auto-selective approach and tool that, instead of generalising a specific model for all climates, predicts the best performing deep learning model for GHI forecasting in terms of forecasting error. The approach is based on carefully devised deep learning methods and feature sets through an extensive analysis of deep learning forecasting and classification methods using ten meteorological datasets from three continents. We analyse the tool in great detail through a range of metrics and methods for performance analysis, visualization, and comparison of solar forecasting methods. SENERGY outperforms existing methods in all performance metrics including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Forecast Skills (FS), Relative Forecasting Error, and the normalised versions of these metrics. The proposed auto-selective approach can be extended to other research problems such as wind energy forecasting and predict forecasting models based on different criteria (in addition to the minimum forecasting error used in this paper) such as the energy required or speed of model execution, different input features, different optimisations of the same models, or other user preferences.