Hospital readmission and length of stay prediction provide info to manage hospitals’ bed capacity and the number of required staff, especially during pandemics. We present a hybrid deep model called Genetic Algorithm-Optimized Convolutional Neural Network (GAOCNN) with a unique preprocessing method to predict hospital readmission and the length of stay in patients having various conditions. GAOCNN uses one-dimensional convolutional layers to predict hospital readmission and length of stay. The parameters of the layers are optimized using a genetic algorithm. To show the performance of the proposed model in patients with various conditions, we evaluate the model under three healthcare datasets; the Diabetes 130-US hospitals dataset, the COVID-19 dataset, and the MIMIC-III dataset. The diabetes 130-US hospitals dataset has information on both readmission and the length of stay, while COVID-19 and MIMIC-III datasets just include information on the length of stay. Experimental results show that the proposed model’s accuracy for hospital readmission is 97.2% for diabetic patients. Also, the accuracy of the length of stay prediction is 89%, 99.4%, and 94.1% for diabetic, COVID-19, and ICU patients, respectively. These results confirm the superiority of the proposed model compared to existing methods. Our findings offer a platform for managing healthcare funds and resources for patients with various diseases.

Working memory (WM) is a brain system for short-term storage and manipulation of information and plays an important role in complex cognitive tasks. In the synaptic theory of WM memorized elements are stored in the form of short-term potentiated connections in a sample population of neurons. In this paper, we show that such populations can be formed due to the mechanisms of spike-timing-dependent plasticity (STDP) – the phase dependence associated with the ratio of the pulse times of the interacting neurons. We propose a WM model considering two types of plasticity: short-term plasticity and STDP. We have shown formation of neuronal clusters encoding items in the WM model, that can be formed by external stimulation of a group of neurons due to the mechanisms of STDP and hold and reactivated by short-term plasticity mechanisms. The dynamic formation of neuronal clusters instead of pre-formed clusters gives additional flexibility to the model.

This article explores the crucial task of estimating State of Charge (SOC) in Hybrid Electric Vehicles (HEVs) and examines the applicability of various regression models for this purpose. We delve into the strengths and limitations of Linear Regression, Support Vector Regression (SVR), and Neural Network Regression (NNR) in the context of SOC estimation. Linear regression provides a simple and interpretable baseline, SVR extends this to nonlinear relationships, while NNR emerges as a powerful tool with adaptive capabilities. The choice of model depends on factors such as data characteristics, interpretability, and computational resources. As the field evolves, the article advocates for a nuanced approach, possibly incorporating hybrid models, to achieve robust and accurate SOC estimation, contributing to the ongoing enhancement of HEV efficiency and sustainability.

High-rise building machines (HBMs) play a critical role in the successful construction of super-high skyscrapers, providing essential support and ensuring safety. The HBM’s climbing system relies on a jacking mechanism consisting of several independent jacking cylinders. A reliable control system is imperative to maintain a smooth posture of the construction steel platform (SP) under the action of the jacking mechanism. This research introduces three multivariate time series neural network models—namely, Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Temporal Convolutional Network (TCN)—to predict the posture of HBM. The models take pressure and stroke measurements from the jacking cylinders as inputs, and their outputs determine the levelness of the SP and the posture of the HBM at various climbing stages. The development and training of these neural networks are based on historical on-site data, with the predictions subjected to thorough comparative analysis. All proposed neural network models exhibit the capability to dynamically predict the posture of the HBM during the climbing process, using data from sensors. Notably, the GRU model shows better predictive performance.

This article presents a study on brain tumor detection using the VGG-16 model, a convolutional neural network known for its performance in computer vision tasks. The aim of the study is to classify magnetic resonance imaging (MRI) images and accurately identify the presence of brain tumors. The dataset used consists of brain tumor MRI images, categorized into two classes: "NO" (no tumor) and "YES" (tumor). The methodology involves setting up the environment, importing and preprocessing the data, building the VGG-16 model, and evaluating its performance using metrics such as accuracy, precision, and recall. The results demonstrate an accuracy of approximately 88% on the validation set and 80% on the test set, indicating the potential of the VGG-16 model in supporting healthcare professionals in diagnosing brain tumors. The study contributes to the field of medical image analysis and offers insights into the application of deep learning for brain tumor detection.

In cold-climate regions, road salt is used as a de-icer for winter road maintenance. The applied road salt melts ice and snow on roads, being washed off through storm sewer systems into nearby urban streams, harming the freshwater ecosystem. Addressing the gap in the knowledge regarding the use of deep learning approaches for urban stream water quality forecasting, the present work discusses our implementation of a “Graph Neural Network” - “Sample and Aggregate” (GNN-SAGE) model for forecasting chloride concentrations in the Credit River in Ontario, Canada. The proposed GNN-SAGE is compared to other models, including a Deep Neural Network based transformer (DNN-Transformer) and a benchmarking persistence model for 6 hours forecasting horizon. Ac-cording to the results, the GNN-SAGE model surpasses other models in providing accurate predic-tions of chloride concentrations within the assessed prediction window. Also, a SHAP analysis provides insight into the variables that influence the model’s forecasting, showing the impact of the spatiotemporal neighbouring data from the network and the seasonality variables on the model’s result. The GNN-SAGE model shows potential for use in real-time forecasting of water quality in urban streams, aiding in the development of regulatory policies to protect the vulnerable freshwater ecosystems in urban areas.

Diabetic retinopathy (DR) is the primary factor leading to vision impairment and blindness in diabetic people. Uncontrolled diabetes can damage the retinal blood vessels. Initial detection and prompt medical intervention are vital in preventing progressive vision impairment. Today's growing medical field poses more significant workload and diagnostic demands on medical professionals. In the proposed study, a convolutional neural network (CNN) is employed to detect the stages of DR. This research is crucial for studying DR because of its innovative methodology incorporating two different public datasets. This strategy enhances the model's capacity to generalize unseen DR images, as each dataset encompasses unique demographics and clinical circumstances. The network can learn and capture complicated hierarchical image features with asymmetric weights. Each image undergoes preprocessing using contrast-limited adaptive histogram equalization (CLAHE) and the discrete wavelet transform (DWT). The model is trained and validated using the combined datasets of Dataset for Diabetic Retinopathy (DDR) and the Asia Pacific Tele-Ophthalmology Society (APTOS). The CNN model is tuned with different learning rates and optimizers. The CNN model with Adam optimizer achieved 70% accuracy and an area under curve (AUC) score of 0.82. The recommended study results may reduce diabetes-related vision impairment by early DR severity identification.

Electricity demand prediction is vital for energy production management and proper exploitation of the present resources. Recently, several novel machine learning (ML) models have been employed for electricity demand prediction to estimate the future prospects of the energy requirements. The main objective of this study is to review the various ML models applied for electricity demand prediction. Through a novel search and taxonomy, the most relevant original research articles in the field are identified and further classified according to the ML modeling technique, perdition type, and the application area. A comprehensive review of the literature identifies the major ML models, their applications and a discussion on the evaluation of their performance. This paper further makes a discussion on the trend and the performance of the ML models. As the result, this research reports an outstanding rise in the accuracy, robustness, precision and the generalization ability of the prediction models using the hybrid and ensemble ML algorithms.

Environmental monitoring systems play a crucial role in assessing environmental quality, detecting limits exceedances, and predicting potential ecological episodes. These systems rely on the measurement of various variables at specific locations and time intervals over an extended period. The concept of environmental monitoring encompasses the assessment of health and safety issues for public and environmental health purposes. Pollution of the atmosphere and water, climate change, and natural disasters are among the consequences of continuous industrial and municipal development and human interference in natural ecosystems. To address these challenges and to protect human lives and the environment, with a special concern on mitigating the ecological effects of industrial development, advanced technical solutions, including the technologies associated with artificial intelligence (artificial neural networks ANNs, machine learning ML) have been developed. These technologies offer powerful tools for analysing the vast amount of data collected by monitoring systems and extracting valuable insights. By applying ANNs and machine learning algorithms, environmental monitoring systems can effectively process and interpret the measured variables to assess environmental quality. Despite challenges and limitations, such as data quality and interpretability of AI models, ongoing research and interdisciplinary collaboration are paving the way for the successful implementation of AI in environmental monitoring, ultimately supporting informed decision-making and sustainable resource management.While several review papers have explored the theory of artificial intelligence (AI), here I aim to review the application of ANNs and ML, in environmental aspects, specifically in automotive and industrial emissions toxicity measurements, as well as atmospheric pollution prevention. By examining the potential of AI in these domains, the paper contributes to understanding the role of advanced technologies in environmental monitoring and protection.

This paper explores the application of machine learning (ML) algorithms in predicting trends in the fixed bond market, where traditional analytical methods have proven inadequate. Focusing on various ML techniques such as supervised and unsupervised learning, neural networks, and deep learning, the study evaluates their effectiveness in forecasting market movements. It details a series of experiments in which different ML models are rigorously trained and tested against historical bond market data. The findings reveal that models employing time series analysis and advanced deep learning show marked potential in accurately predicting bond market trends. Additionally, the paper delves into the challenges and limitations inherent in these ML approaches, including data requirements and the risk of model overfitting. Finally, it proposes directions for future research, emphasizing the integration of ML into broader financial market analysis.

Although the statistical methods of downscaling climate data have progressed significantly, the development of high-resolution precipitation products continues to be a challenge. This is especially true when interest centres on downscaling value over several study sites. In this paper , we report a new downscaling method termed the multi-site Climate Generative Adversarial Network (MSCliGAN), which can simulate annual maximum precipitation to the regional scale during the 1950-2010 period in different cities in Canada by using different AOGCM's from the Coupled Model Inter-Comparison Project 6 (CMIP6) as input. Auxiliary information provided to the downscaling model included topography and land-cover. The downscaling framework uses a convolution encoder-decoder U-net network to create a generative network and a convolution encoder network to create a critic network. An adversarial training strategy is used to train the model. The critic/discriminator used Wasserstein distance as a loss measure and on the other hand the generator is optimized using a summation of content loss on Nash-Shutcliff Model Efficiency (NS), structural loss on structural similarity index (SSIM), and adversarial loss Wasserstein distance. Downscaling results show that downscaling AOGCMs by incorporating topography and land-use/land-cover can produce spatially coherent fields close to observation over multiple-sites. We believe the model has sufficient downscaling potential in data sparse regions where climate change information is often urgently needed.

Accurate estimations of actual evapotranspiration (ETa) are fundamental for various environmental issues. Artificial Intelligence-based models are considered a promising alternative to the most common direct ETa estimation techniques and indirect methods by remote sensing (RS)-based surface energy balance models. Artificial Neural Networks (ANN) are proven to be suitable for predicting reference evapotranspiration and ETa based on RS data. The aim of this study is to develop a methodology based on ANNs for estimating daily ETa values using NDVI and land surface temperature, coupled with limited site-specific climatic variables at a large irrigation catchment. Two scenarios were implemented by the ANN model. Data from only the 38 days of satellite overpass dates was selected in Scenario-I, while the 769-day data included the satellite overpass dates and other days located between two satellite overpass acquisitions in Scenario-II. An irrigation scheme in the Mediterranean region of Turkiye was selected, and a total of 38 Landsat images, and local climatic data were used in 2021 and 2022. Results showed that R2 values in Scenario-I and II were acknowledgeably high for training (0.79 and 0.86), testing (0.75 and 0.81), and the entire dataset (0.76 and 0.84), respectively. Results of the new model in two scenarios showed acceptable agreement with ETa-METRIC values. The proposed ANN model demonstrated the potential of obtaining daily ETa using limited climatic data and RS imagery.

Quantitative structure-activity relationship (QSAR) model is adopted to study the relationship between the chemical and physical properties of various substances and the structure. Through QSAR studies, the internal relationship between the invisible structure and the activity can be obtained. In this paper, a novel chaos-enhanced accelerate particle swarm algorithm (CAPSO) is proposed, which is used to molecular descriptors screening and optimization of the weights of back propagation artificial neural network (BP ANN). Then, the QSAR model based on CAPSO and BP ANN is put forward, hereinafter referred to as CAPSO BP ANN model. The prediction experiment showed that the CAPSO algorithm is a reliable method for screening molecular descriptors and the five molecular descriptors obtained by CAPSO algorithm could well characterize the molecular structure of each compound in pKa prediction. The experimental results also showed the CAPSO BP ANN model has a good performance in predicting the pKa values of various compounds, the absolute mean relative error, root mean square error, and square correlation coefficient are respectively 0.5364, 0.0632, and 0.9438, indicating the higher prediction accuracy and correlation. The proposed hybrid intelligent model can be applied in all kinds of engineering design, prediction of physical and chemical properties and intelligent calculation.

We investigate the power of time series analysis based on a variety of information-theoretic approaches from statistics (AIC, BIC) and machine learning (Minimum Message Length) - and we then compare their efficacy with traditional time series model and with hybrids involving deep learning. More specifically, we develop AIC, BIC and Minimum Message Length (MML) ARMA (autoregressive moving average) time series models - with this Bayesian information-theoretic MML ARMA modelling already being new work. We then study deep learning based algorithms in time series forecasting, using Long Short Term Memory (LSTM), and we then combine this with the ARMA modelling to produce a hybrid ARMA-LSTM prediction. Part of the purpose of the use of LSTM is to seek capture any hidden information in the residuals left from the traditional ARMA model. We show that MML not only outperforms earlier statistical approaches to ARMA modelling, but we further show that the hybrid MML ARMA-LSTM models outperform both ARMA models and LSTM models.

Cooperative non-orthogonal multi access communication is a promising paradigm for the future wireless networks because of its advantages in terms of energy efficiency, wider coverage and interference mitigating. In this paper, we study the secrecy performance of a downlink cooperative non-orthogonal multi access (NOMA) communication system under the presence of an eavesdropper node. Smart node selection based on feed forward neural networks (FFNN) is proposed in order to improve the physical layer security (PLS) of a cooperative NOMA network. The selected cooperative relay node is employed to enhance the channel capacity of the legal users, where the selected cooperative jammer is employed to degrade the capacity of the wiretapped channel. Simulations of the secrecy performance metric namely the secrecy capacity ($C_S$) are presented and compared with the conventional technique based on fuzzy logic node selection technique. Based on our simulations and discussions the proposed technique outperforms the existing technique in term the of secrecy performance.

Byers Peninsula (62°34’-62°40’S-60°54’61°13’W), 60 km2 in size, is considered one of the largest ice-free areas in Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes, limnology and microbiology, live cycles, but not albedo. Surface albedo is one of the key physical parameters in the surface energy budget of polar regions. Most of Antarctica is covered by ice sheets; only about 0.44% of the area is permanently ice-free. However, in maritime Antarctica, the ice-free areas, corresponding to small islands, peninsulas, and coastal beaches, account for about 3% of the territory. To incorporate the contribution of these areas into global albedo models, it is necessary to relate the soil properties of the ice-free areas to the surface albedo response. Also, mapping soil properties and albedo have and special interest in these ice-free areas. Image classification using machine learning methods trained with georeferenced soil data could be useful for mapping soil properties and albedo in multispectral optical satellite images. A shallow neural network implemented using the Keras Python module was used to define and train models of soil properties using 15 explanatory variables corresponding to bands and spectral indices of a Sentinel image and a population of 49 soil samples taken from the top 5 centimeters of the soil profile. The soil samples were analyzed in the laboratory and a spectral library in the Vis-Nir range (350-2500 nm) was created. The albedo of the samples was integrated from the ADS spectra. At the same time, a linear regression model of albedo using the soil properties as explanatory variables was performed. The R2 fit of this new model was about 0.82 and the error of estimation was 4.1. The model was extended to the entire Byers Peninsula using the ML soil property models as explanatory variables. The RMSE of the extended models increased up to 8.2. We think that the main cause of this increase (2.6 points) is related to the error propagation, phenomenon due to the use of models as explanatory variables. However, another important part of the error increase could be due, among other reasons, to the use of an image that, although corrected, is not completely free of clouds.

Intelligent fault diagnosis techniques have replaced the time-consuming and unreliable human analysis, increasing the efficiency of fault diagnosis. Deep learning model can improve the accuracy of intelligent fault diagnosis with the help of its multilayer nonlinear mapping ability. This paper has proposed a novel method named Deep Convolutional Neural Networks with Wide First-layer Kernels (WDCNN). The proposed method uses raw vibration signals as input (data augmentation is used to generate more inputs), and uses the wide kernels in first convolutional layer for extracting feature and suppressing high frequency noise. Small convolutional kernels in the preceding layers are used for multilayer nonlinear mapping. AdaBN is implemented to improve the domain adaptation ability of the model. The proposed model addresses the problem that currently, the accuracy of CNN applied to fault diagnosis is not very high. WDCNN can not only achieve 100% classification accuracy on normal signals, but also outperform state of the art DNN model which is based on frequency features under different working load and noisy environment.

Advanced machine learning algorithms, have the potential to be successfully applied to many areas of system modelling. In the present study the capability of ten machine learning algorithms in predicting the structural damage of an 8-storey reinforced concrete frame building subjected to single and successive ground motions is examined. From this point of view, the initial damage state of the structural system, as well as 16 well known ground motion intensity measures are adopted as the features of the machine-learning algorithms that aim to predict the structural damage after each seismic event. The structural analyses are performed considering both real and artificial mainshock–aftershock sequences, while the structural damage is expressed in terms of two overall damage indices. The comparative study results in the most efficient damage index, as well as the most promising machine learning algorithm in predicting the structural response of a reinforced concrete building under single or multiple seismic events. Finally, the configured methodology deployed in a user-friendly web-application.

The question of molecular similarity is core in cheminformatics, and is usually assessed via a pairwise comparison based on vectors of properties or molecular fingerprints. We recently exploited variational autoencoders to embed 6M molecules in a chemical space, such that their (Euclidean) distance within the latent space so formed could be assessed within the framework of the entire molecular set. However, the standard objective function used did not seek to manipulate the latent space so as to cluster the molecules based on any perceived similarity. Using a set of some 160,000 molecules of biological relevance, we here bring together three modern elements of deep learning to create a novel and disentangled latent space, viz transformers, contrastive learning, and an embedded autoencoder. The effective dimensionality of the latent space was varied such that clear separation of individual types of molecules could be observed within individual dimensions of the latent space. The capacity of the network was such that many dimensions were not populated at all. As before, we assessed the utility of the representation by comparing clozapine with its near neighbours, and did the same for various antibiotics related to flucloxacillin. Transformers, especially when as here coupled with contrastive learning, effectively provide one-shot learning, and lead to a successful and disentangled representation of molecular latent spaces that at once uses the entire training set in their construction while allowing ‘similar’ molecules to cluster together in an effective and interpretable way.

Age estimation in dental radiographs Orthopantomography (OPG) is a medical imaging technique that physicians and pathologists utilise for disease identification and legal matters. For example, for estimating post-mortem interval, detecting child abuse, drug trafficking, and identifying an unknown body. Recent development in automated image processing models improved the age estimation's limited precision to an approximate range of +/- one year. While this estimation is often accepted as accurate measurement, age estimation should be as precise as possible in most serious matters, such as homicide. Current age estimation techniques are highly dependent on manual and time-consuming image processing. Age estimation is often a time-sensitive matter in which the image processing time is vital. Recent development in Machine learning-based data processing methods has decreased the imaging time processing; however, the accuracy of these techniques remains to be further improved. We proposed an ensemble method of image classifiers and transfer learning techniques to enhance the accuracy of age estimation using OPGs from one year to a couple of months (1-3-6). This hybrid model is based on convolutional neural networks (CNN) and K nearest neighbours (KNN). The hybrid (HCNN-KNN) model was used to investigate 1,922 panoramic dental radiographs of patients aged 15 to 23. These OPGs were obtained from the various teaching institutes and private dental clinics in Malaysia. To minimise the chance of overfitting in our model, we used the principal component analysis (PCA) algorithm and eliminated the features with high correlation. To further enhance the performance of our hybrid model, we performed systematic image pre-processing. We applied a series of classifications to train our model. We have successfully demonstrated that combining these innovative approaches has improved the classification and segmentation and thus the age-estimation outcome of the model. Our findings suggest that our innovative model, for the first time, to the best of our knowledge, successfully estimated the age in classified studies of one year old, six months, three months and one-month-old cases with accuracies of 99.98, 99.96, 99.87, and 98.78 respectively.

The fault diagnosis of wind farms has been proven to be a challenging task and motivates the research activities carried out through this work. Therefore, this paper deals with the fault diagnosis of a wind park benchmark model, and it considers viable solutions to the problem of earlier fault detection and isolation. The design of the fault indicator involves data-driven approaches, as they can represent effective tools for coping with poor analytical knowledge of the system dynamics, noise, uncertainty and disturbances. In particular, the proposed data-driven solutions rely on fuzzy models and neural networks that are used to describe the strongly nonlinear relationships between measurement and faults. The chosen architectures rely on nonlinear autoregressive with exogenous input models, as they can represent the dynamic evolution of the system along time. The developed fault diagnosis schemes are tested by means of a high-fidelity benchmark model, that simulates the normal and the faulty behaviour of a wind farm installation. The achieved performances are also compared with those of a model-based approach relying on nonlinear differential geometry tools. Finally, a Monte-Carlo analysis validates the robustness and the reliability of the proposed solutions against typical parameter uncertainties and disturbances.

Solar energy is a renewable resources of energy which is broadly utilized and have the least pollution impact between the available alternatives of fossil fuels. In this investigation, machine leaening approaches of neural networks (NN), neuro-fuzzy and least squares support vector machine (LSSVM) are used to build the models for prediction of the thermal performance of a photovoltaic-thermal solar collector (PV/T) by estimating its efficiency as an output of the model while inlet temperature, flow rate, heat, solar radiation, and heat of sun are input of the designed model. Experimental measurements was prepared by designing a solar collector system and 100 data extracted. Different analyses are also performed to examine the credibility of the introduced approaches revealing great performance. The suggested LSSVM model represented the best performance regarding the mean squared error (MSE) of 0.003 and correlation coefficient (R²) value of 0.99, respectively.

Satellite Image Time Series (SITS) is a data set which includes satellite images across several years with a high acquisition rate. Radiometric normalization is a fundamental and important preprocessing method for remote sensing applications using SITS due to the radiometric distortion caused by noise between images. Normalizing the subject image based on the reference image is a general strategy when using traditional radiometric normalization methods to normalize multi-temporal imagery (usually two scenes or three scenes in different time phases). However, these methods are not suitable for calibrating SITS because they cannot minimize the radiometric distortion between any pair of images in SITS. The existing relative radiometric normalization methods for SITS are based on linear assumptions which cannot effectively reduce nonlinear radiometric distortion caused by continuously changing noise in SITS. To overcome this problem and obtain a more accurate SITS, this study proposed a Nonlinear Radiometric Normalization Model (named NMAG) for SITS based on Artificial Neural Networks (ANN) and Greedy Algroithm (GA) . In this method, GA was used to determine the correction order of SITS and calculate the error between the image to be corrected and normalized images, which avoided the selection of a single reference image. ANN was used to obtain the optimal solution of error function, which minimized the radiometric distortion between different images in SITS. SITS composed of 21 Landsat-8 images in Tianjin City from October 2017 to January 2019 were selected to test the method. We compared NMAG with other two contrasting method (refered as CM1 and CM2), and found that the average of root mean square error $(\mu_{RMSE})$ of NMAG $(497.22)$ was significantly smaller than those of CM1 $(641.39)$ and CM2 $(543.47)$, and the accuracy of normalized SITS obtained by using NMAG has increased by 22.4\% and 8.5\% toward CM1 and CM2, respectively. These experimental results confirmed the effectiveness of NMAG in the reduction of radiometric distortion caused by continuously changing noise between images in SITS.

Chinese calligraphy, revered globally for its therapeutic and mindfulness benefits, encompasses styles such as Regular (Kai Shu), Running (Xing Shu), Official (Li Shu), and Cursive (Cao Shu) scripts. Beginners often start with Regular script, advancing to more intricate styles like Cursive. Each style, marked by unique historical calligraphers' contributions, requires learners to discern distinct nuances. The integration of AI in calligraphy analysis, collection, recognition, and classification are pivotal. This study introduces an innovative Convolutional Neural Network (CNN) architecture, pioneering the application of CNN in the classification of Chinese calligraphy. Focusing on the four principal calligraphers' styles from the Tang dynasty (690-907 A.D), this research spotlights the era when the traditional regular script font (Kai Shu) was refined. A comprehensive dataset of 8282 samples from these calligraphers, representing the zenith of regular style, was compiled for CNN training and testing. The model distinguishes personal styles for classification, showing superior performance over existing networks. Achieving 89.5-96.2% accuracy in calligraphy classification, our approach underscores the significance of CNN in both font and artistic style categorization. This research paves the way for advanced studies in Chinese calligraphy and its cultural implications.

Climate change has become the greatest threat to the survival of world and its ecosystem. With the irreversible impact on the ecosystem, problems like rise in sea level, food-insecurity, natural resources scarcity, seasonal disorders have increased over the past few years. Among these problems, the issue of water scarcity due to the lack of water resources and global warming has plagued several nations. Owing to the rising concerns over water scarcity United Nations (UN) has acknowledged water as a primary resource to the development of societies under the ‘Water Goal’ of the sustainable development goals. As the changing climate and intermittent availability of water resources pose major challenges to forecast demand, especially in countries like the United Arab Emirates (UAE) which has one of the highest per capita residential water consumption rates in the world. Therefore, the aim of this study is to propose an accurate water demand forecasting technique that incorporates all significant factors to predict the future water demands of the UAE. The forecasting model used is the Long Short Term Memory (LSTM), with the factors considered are mean temperature, mean rainfall, relative humidity, Gross Domestic Product (GDP), Consumer Price Index (CPI) and population growth. The LSTM model predicts the water demand forecasting in the UAE showing that the future demand will decrease from 1821 million m3 in 2018 to 1809.9 million m3 in 2027.

Abstract: The surge of diabetes poses a significant global health challenge, particularly in Oman and the Middle East. Early detection of diabetes is crucial for proactive intervention and improved patient outcomes. This research leverages the power of machine learning, specifically, Convolutional Neural Networks (CNNs), to develop an innovative 4D CNN model dedicated to early diabetes prediction. A region-specific dataset from Oman is utilized to enhance health outcomes for individuals at risk of developing diabetes. The proposed model showcases remarkable accuracy, achieving an average accuracy of 98.49% to 99.17% across various epochs. Additionally, it demonstrates excellent F1 score, recall, and sensitivity, highlighting its ability to identify true positive cases. The findings contribute to the ongoing effort to combat diabetes and pave the way for future research in using deep learning for early disease detection and proactive healthcare.

Imaging systems mounted to ground vehicles are used to image fruit tree canopies for estimation of fruit load, but frequently need correction for fruit occluded by branches, foliage or other fruits. This can be achieved using an orchard ‘occlusion factor’, estimated from a manual count of fruit load on a sample of trees (referred to as the reference method). It was hypothesised that canopy images could hold information related to the number of occluded fruit. Five approaches to correct for occluded fruit based on canopy images were compared using data of three mango orchards in two seasons. However, no attribute correlates to the number of hidden fruit were identified. Several image features obtained through segmentation of fruit and canopy areas, such as the proportion of fruit that were partly occluded, were used in training Random forest and multi-layered perceptron (MLP) models for estimation of a correction factor per tree. In another approach, deep learning convolutional neural networks (CNNs) were directly trained against harvest fruit count on trees. The supervised machine learning methods for direct estimation of fruit load per tree delivered an improved prediction outcome over the reference method for data of the season/orchard from which training data was acquired. For a set of 2017 season tree images (n=98 trees), a R2 of 0.98 was achieved for the correlation of the number of fruits predicted by a Random forest model and the ground truth fruit count on the trees, compared to a R2 of 0.68 for the reference method. The best prediction of whole orchard (n = 880 trees) fruit load, in the season of the training data, was achieved by the MLP model, with an error to packhouse count of 1.6% compared to the reference method error of 13.6%. However, the performance of these models on new season data (test set images) was at best equivalent and generally poorer than the reference method. This result indicates that training on one season of data was insufficient for the development of a robust model. This outcome was attributed to variability in tree architecture and foliage density between seasons and between orchards, such that the characters of the canopy visible from the interrow that relate to the proportion of hidden fruit are not consistent. Training of these models across several seasons and orchards is recommended.

Lithium-ion batteries serve as the primary sources of power for electric vehicles (EVs) and hybrid electric vehicles (HEVs). For vehicle applications, battery management systems (BMSs) are nec-essary to protect lithium-ion batteries from overheating and to ensure optimum vehicle perfor-mance. Our approach to developing a BMS was based on recent advances in the application of phase field models for lithium-ion batteries. In particular, our reduced-order model (ROM) uti-lized a dataset generated from the COMSOL® Multiphysics simulation of the Cahn–Hilliard equation for a single particle of a lithium iron phosphate (LiFePO4) cathode: an example of using a reduced-order model (ROM) based on a single-particle model (SPM). The main innovation of our ROM is that the SPM is fully coupled to a heat transfer model at the battery cell level. We utilized principal component analysis to identify a lower-order model that could reproduce the battery’s voltage and temperature response for ambient temperatures ranging from 253 to 298 K and for discharge rates ranging from 1 C to 20.5 C. The reduced-order dataset was then fitted to the ex-perimental data for an A123 Systems 26650 2.3 Ah cylindrical battery using deep neural network (DNN) regression.

The current neural networks for tomato leaf disease recognition have problems such as large model parameters, long training time, and low model accuracy. To solve these problems, a lightweight convolutional neural network LBFNet is proposed in this paper.First, a lightweight convolutional neural network LBFNet is established as the base model. Secondly, a three-channel attention mechanism module is introduced to learn the disease features in tomato leaf disease images and reduce the interference of redundant features. Finally, a cascade module is introduced to increase the depth of the model, solve the gradient descent problem, and reduce the loss caused by increasing the depth of the model. The quantized pruning technique is also used to further compress the model parameters and optimize the model performance. The results show that the LBFNet model achieves 99.06% accuracy on the LBFtomato dataset, with a training time of 996s and a single classification accuracy of over 94%. Further training using the saved weight file after quantized pruning makes the model accuracy reach 97.66%. Compared with the base model, the model accuracy was improved by 28%, and the model parameters were reduced by 96.7% compared with the traditional Resnet50. It was found that LBFNet can quickly and accurately identify tomato leaf diseases in complex environments, providing effective assistance to agricultural producers.

An abdominal aortic aneurysm (AAA) is usually asymptomatic until rupture, which is associated with extremely high mortality. Consequently, early detection of AAAs is of paramount importance in reducing mortality; however, most AAAs are detected by medical imaging incidentally. The aim of this study was to investigate the feasibility of machine learning-based pulse wave (PW) analysis for the early detection of AAAs using a database of in silico PWs. PWs in the large systemic arteries were simulated using one-dimensional blood flow modelling. A database of in silico PWs representative of subjects (aged 55, 65 and 75 years) with different AAA sizes was created by varying the AAA-related parameters with major impacts on PWs – identified by parameter sensitivity analysis – in an existing database of in silico PWs representative of subjects without AAA. Then, a machine learning architecture for early detection of AAAs was proposed, which was trained and tested using the new in silico PW database. The parameter sensitivity analysis revealed that the AAA maximum diameter and stiffness of the large systemic arteries were the dominant AAA-related biophysical properties that significantly influence the PW. The simulated PW indexes extracted from the database showed that the PW was not only influenced by the presence of an AAA but was also significantly affected by multiple cardiovascular parameters that compromised the detection of AAAs by using individual PW indexes. Alternatively, the trained machine learning model performed well in classifying normal and AAA conditions using digital photoplethysmogram PWs from the database. These findings suggest that machine learning-based PW analysis is a promising approach for AAA screening using PW signals acquired by wearable devices.

Novel applications of artificial intelligence for tuning the parameters of industrial machines for optimal performance are emerging at a fast pace. Tuning the combine harvesters and improving the machine performance can dramatically minimize the wastes during harvesting, and it is also beneficial to machine maintenance. Literature includes several soft computing, machine learning and optimization methods that had been used to model the function of harvesters of various crops. Due to the complexity of the problem, machine learning methods had been recently proposed to predict the optimal performance with promising results. In this paper, through proposing a novel hybrid machine learning model based on artificial neural networks integrated with particle swarm optimization (ANN-PSO), the performance analysis of a common combine harvester is presented. The hybridization of machine learning methods with soft computing techniques has recently shown promising results to improve the performance of the combine harvesters. This research aims at improving the results further by providing more stable models with higher accuracy.

This paper realizes early bearing fault warning through bearing fault time series prediction, and proposes a bearing fault time series prediction model based on optimized maximum correlation kurtosis deconvolution (MCKD) and long short-term memory (LSTM) recurrent neural network to ensure bearings operation reliability. The model is based on lifecycle vibration signal of the bearing, to begin, the cuckoo search (CS) is utilized to optimize the parameter filter length L and deconvolution period T of MCKD, taking into account the influence and periodicity of the bearing time series, the fault impact component of the optimized MCKD deconvolution time series is improved. Then select the LSTM learning rate α depending on deconvolution time series. Finally, the dataset obtained through various preprocessing approaches are used to train and predict the LSTM model. The average prediction accuracy of the optimized MCKD-LSTM model is 26 percent higher than that of the original time series, proving the efficiency of this method, and the prediction results track the real fault data well, according to the XI'AN JIAOTONG University XJTU-SY bearing dataset.

Prediction models in mobility and transportation maintenance systems have been dramatically improved through using machine learning methods. This paper proposes novel machine learning models for an intelligent road inspection. The traditional road inspection systems based on the pavement condition index (PCI) are often associated with the critical safety, energy and cost issues. Alternatively, the proposed models utilize surface deflection data from falling weight deflectometer (FWD) tests to predict the PCI. Machine learning methods are the single multi-layer perceptron (MLP) and radial basis function (RBF) neural networks as well their hybrids, i.e., Levenberg-Marquardt (MLP-LM), scaled conjugate gradient (MLP-SCG), imperialist competitive (RBF-ICA), and genetic algorithms (RBF-GA). Furthermore, the committee machine intelligent systems (CMIS) method was adopted to combine the results and improve the accuracy of the modeling. The results of the analysis have been verified through using four criteria of average percent relative error (APRE), average absolute percent relative error (AAPRE), root mean square error (RMSE), and standard error (SD). The CMIS model outperforms other models with the promising results of APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.

Accurate forecasts of ocean waves energy can not only reduce costs for investment but it is also essential for management and operation of electrical power. This paper presents an innovative approach based on the Long Short Term Memory (LSTM) to predict the power generation of an economical wave energy converter named “Searaser”. The data for analyzing is provided by collecting the experimental data from another study and the exerted data from numerical simulation of searaser. The simulation is done with Flow-3D software which has high capability in analyzing the fluid solid interactions. The lack of relation between wind speed and output power in previous studies needs to be investigated in this field. Therefore, in this study the wind speed and output power are related with a LSTM method. Moreover, it can be inferred that the LSTM Network is able to predict power in terms of height more accurately and faster than the numerical solution in a field of predicting. The network output figures show a great agreement and the root mean square is 0.49 in the mean value related to the accuracy of LSTM method. Furthermore, the mathematical relation between the generated power and wave height was introduced by curve fitting of the power function to the result of LSTM method.

Recently natural gas (NG) global market attracted much attention in case it is cleaner than oil, and simultaneously in most regions is cheaper than renewable energy sources. However, price fluctuations, environmental concerns, technological development, emerging unconventional resources, energy security challenges, and shipment are some of the forces that made the NG market more dynamic and complex. From a policy-making perspective, it is vital to uncover demand-side future trends. This paper proposed an intelligent forecasting model to forecast NG global demand, however investigating a multi-dimensional purified input vector. The model starts with a data mining (DM) step to purify input features, identify the best time lags, and to pre-process selected input vector. Then a hybrid artificial neural network (ANN) which equipped with genetic optimizer is applied to set up ANN’s characteristics. Among 13 available input features, six features (e.g. Alternative and Nuclear Energy, CO2 Emissions, GDP per Capita, Urban Population, Natural Gas Production, Oil Consumption) selected as the most critical feature via the DM step. Then, the hybrid prediction model is designed to extrapolate the consumption of future trends. The proposed model overcomes competitive models refer to different error based evaluation statistics. Besides, as the model proposed the best input feature set, results compared to the model which used the raw input set, with no DM purification process.

This study aims to evaluate a new approach in modeling gully erosion susceptibility based on deep learning neural network (DLNN) model, ensemble Particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN) and comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shiran watershed, Iran. For this purpose, 13 independent variables affecting gully erosion susceptibility in the study area, including altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from river, land use, soil, lithology, rainfall, , stream power index (SPI), topographic wetness index (TWI), were prepared. Also, 132 gully erosion locations were identified during field visits. Data for modeling were divided into two categories of training (70%) and testing (30%). Receiver operating characteristic (ROC) parameters including sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and area under curve (AUC) were used to evaluate the performance of the models. The results showed that, the AUC values from ROC with considering testing datasets of PSO-DLNN is 0.89 and which is associated with superb accuracy. Rest of the models also associated with optimal accuracy and near about PSO-DLNN model; the AUC values from ROC of DLNN, SVM and ANN for testing datasets are 0.87, 0.85 and 0.84 respectively. The PSO algorithm has updated and optimized the weights of DLNN model, and as a result, the efficiency of this model in predicting gully erosion susceptibility has increased. Therefore, it can be concluded that the use of DLNN model and its ensemble with PSO algorithm can be used as a novel and practical method in predicting the susceptibility of gully erosion that helps planners and managers in managing and reducing the risk of this phenomenon.

Downward short-wave (SW) solar radiation is the only essential energy source powering the atmospheric dynamics, ocean dynamics, biochemical processes, etc. on our planet. Clouds are the main factor limiting the SW flux over the land and the Ocean. For the accurate meteorological measurements of the SW flux one needs expensive equipment - pyranometers. For some cases where one does not need golden-standard quality of measurements, we propose estimating incoming SW radiation flux using all-sky optical RGB imagery which is assumed to incapsulate the whole information about the SW flux. We used DASIO all-sky imagery dataset with corresponding SW downward radiation flux measurements registered by an accurate pyranometer. The dataset has been collected in various regions of the World Ocean during several marine campaigns from 2014 to 2022, and it will be updated. We demonstrate the capabilities of several machine learning models in this problem, which are multilinear regression, Random Forests, Gradient Boosting and convolutional neural networks (CNN). We also applied the inverse target frequency (ITF) re-weighting of the training subset and the approach of pre-classification in order to raise the SW flux approximation quality. We found that the CNN is capable of approximating downward SW solar radiation with higher accuracy compared to existing empiric parameterizations. We also found that the ITF reweighting of the training subset increases the approximation quality substantially. The estimates of the SW radiation flux using all-sky imagery may be of particular use in case of the need for the fast radiative budgets assessment of a site.

A correct system design can be systematically obtained from a specification model of a real-time system that integrates hybrid measurements in a realistic industrial environment, this has been carried out through complete Matlab / Simulink / Stateflow models. However, there is a widespread interest in carrying out that modeling by resorting to Machine Learning models, which can be understood as Automated Machine Learning for Real-time systems that present some degree of hybridization. An induction motor controller which must be able to maintain a constant air flow through a filter is one of these systems and it is discussed in the paper as a study case of closed-loop control system. The article discusses a practical application of ML methods that demonstrates how to replace such closed loop in industrial control systems with a Simulink block generated from neural networks to show how the proposed procedure can be applied to derive complete hybrid system designs with artificial neural networks (ANN). In the proposed ANN-based method to design a real-time hybrid system with continuous and discrete components, we use a typical design of a neural network, in which we define the usual phases: training, validation, and testing. The generated output of the model is made up of reference variables values of the cyber-physical system, which represent the functional and dynamic aspects of model. They are used to feed Simulink/Stateflow blocks in the real target system.

Object recognition is an essential element of machine intelligence tasks. However, one model cannot practically be trained to identify all the possible objects it encounters. An ensemble of models may be needed to cater to a broader range of objects. Building a mathematical understanding of the relationship between various objects that share comparable outlined features is envisaged as an effective method of improving the model ensemble through a pre-processing stage, where these objects' features are grouped under a broader classification umbrella. This paper proposes a mechanism to train an ensemble of recognition models coupled with a model selection scheme to scale-up object recognition in a multi-model system. An algorithmic relationship between the learnt parameters of a trained classification model and the features of input images is presented in the paper for the system to learn the model selection scheme. The multiple models are built with a CNN structure, whereas the image features are extracted using a CNN/VGG16 architecture. Based on the models' excitation weights, a neural network model selection algorithm, which links a new object with the models and decides how close the features of the object are to the trained models for selecting a particular model for object recognition is developed and tested on a five-model neural network platform. The experiment results show the proposed model selection scheme is highly effective and accurate in selecting an appropriate model for a network of multiple models.

Seeds can maintain their quality for a limited time; after that, they will lose their germination ability and vigor. Some physiological and physicochemical changes in the structure of the seeds during storage can decrease the quality of the seeds which is known as aging. Therefore, detection of the strong young seeds from the old ones is a vital issue in the modern agriculture. Conventional methods of detection of the seed viability and germination are destructive, time-consuming and costly. In this research, two peanut cultivars, namely North Carolina 2 (NC-2) and Florispan were selected and three artificial aging levels were induced to them. Hyperspectral images (HSI) of the samples were acquired and the seed viability was evaluated using two pre-trained convolutional neural network (CNN) image processing models, AlexNet and VGGNet. The noise of the reflection spectra of the samples was relatively resolved and modified by combining Preprocessing techniques of moving average (MA) and standard normal variate (SNV). Using principal component analysis (PCA), the dimensions were declined and three principal components (PC) were extracted. These PCs were then used as variables in the classification of support vector machine (SVM) and linear discriminant analysis (LDA). The results showed the high capability of CNN architectures such as AlexNet and VGGNet in detection of the seed viability based on the HIS with no pre-processing and feature extraction. The mentioned architectures reached the accuracy of 0.985 and 0.986, respectively. The combination of feature extraction method of PCA with LDA and SVM classifiers showed that the use of a limited number of PCs instead of all wavelengths can decrease the complexity of modeling, while enhancing the efficiency of the models such that LDA and SVM classifiers achieved the accuracy of 0.983 and 0.986 in classification of peanut sees, respectively.

SQL injection attacks are one of the most common types of attacks on web applications. These attacks exploit vulnerabilities in the application’s database access mechanisms, allowing attackers to execute unauthorized SQL queries. In this study, we propose an architecture for detecting SQL injection attacks using a recurrent neural network (RNN) autoencoder. The proposed architecture was trained on a publicly available dataset of SQL injection attacks. Then compared with several other machine learning models, including ANN, CNN, Decision Tree, Naïve Bayes, SVM, Random Forest, and Logistic Regression. The experimental result showed that the proposed approach achieved an accuracy of 94% and an F1 score of 92%, which demonstrate its effectiveness in detecting QL injection attacks with high accuracy in comparison with other models covered in the study.

Requirements Engineering (RE) is an important step in the whole software development lifecycle. The problem in RE is to determine the class of the software requirements as functional and non-functional. Proper and early identification of these requirements is vital for the entire development cycle. On the other hand, manual government of requirement classes is a timewasting task, and it needs intensive effort. Automatic requirement classification techniques through advanced Machine Learning (ML) strategies are started to be developed to address this problem. Basically, software requirements are generated as natural language explanations and therefore requirement classification may be handled as a particular Natural Language Processing (NLP) problem. From ML point of view, classification strategies require dataset to be used in the training/learning phase. For this goal, we generated a unique Turkish dataset having collected the requiremenst from real-world software projects with 4600 samples. Of these requirements, 3000 and 1600 were labeled as functional and non-functional, respectively. The data set has been evaluated using (i) traditional machine learning algorithms, (ii) deep learning algorithms, and (iii) transformer models respectively. As a result BERTurk was found to be the most successful algorithm to discriminate functional and non-functional requirements in terms of 95% f-score metric.

This paper proposes a radiation pattern synthesis of the almost periodic antenna arrays including mutual coupling effects (that extracted by the Floquet analysis according to our previous work), which principally has a high directivity and large bandwidth. For modeling the given structures, the moment method combined with the Generalized Equivalent Circuit (MoM-GEC) is proposed. The artificial neural network (ANN) as a powerful computational model has been successfully applied to the antenna array pattern synthesis. The results showed that the multilayer feedforward neural networks are rugged and can successfully and efficiently resolve various distinctive complex almost periodic antenna patterns (with different source amplitudes) (in particular, both periodic and randomly aperiodic structures are taken into account). However, the artificial neural network (ANN) is capable of quickly producing the synthesis results using generalization with the early stopping (ES) method. A significant time gain and memory consumption are achieved by using this given method to improve the generalization (called early stopping). To justify this work, several examples are developed and discussed.

The importance of this study may be defined by using the smart techniques to earned value indicators of residential buildings projects in Republic of Iraq, only one development intelligent forecasting model was presented to predict Schedule Performance Index (SPI), Cost Performance Index (CPI), and To Complete Cost Performance Indicator (TCPI) are defined as the dependent. The approach is principally influenced by the determining numerous factors which effect on the earned value management, that involves Iraqi historical data. In addition, six independent variables (F1: BAC, Budget at Completion., F2: AC, Actual Cost., F3, A%, Actual Percentage., F4: EV, Earned Value. F5: P%, Planning Percentage., and F6: PV, Planning Value) were arbitrarily designated and satisfactorily described for per construction project. It was found that ANN has the capability to envisage the dust storm with a great accuracy. The correlation coefficient (R) has been 90.00%, and typical accuracy percentage has been 89.00%.

Early-season crop-type data are required for a variety of agricultural monitoring and decision-making applications. The early season in this study referred to the prophase and middle of a growth season. Early-season detection of crop types remains challenging because of limited discriminative features, especially for landscapes that are characterized by complex cropping patterns. In fact, different remote-sensing satellites can increase the frequency of data acquisition, which can provide more information in the early season. Moreover, optical and radar sensors have different degrees of sensitivity to crop parameters. Therefore, the integration and application of two types of multitemporal data are of great significance to improve the accuracy and timeliness of crop type detection.In deep learning (DL), convolutional neural network (CNN) and recurrent neural network (RNN) models have great potential for temporal feature extraction. Compared with RNNs, CNNs usually have fewer parameters and are more conducive to determining early-season detection dates of different crop types, which requires a lot of training because of the need to model on different dates. Nevertheless, revisit dates and temporal intervals of different satellites are usually different, resulting in different data acquisition time series; these data cannot be directly used as input for the same convolutional layer. To address this challenge, a Dual-1DCNN was bulit based on the CNN model in this study. Moreover, an incremental training method was used to attain the network on each data acquisition date and obtained the best detection date for each crop type in the early season. A case study for Hengshui City in China was conducted using time series of Sentinel-1A (S1A) and Sentinel-2 (S2). To verify this method, classical methods support vector machine (SVM) and random forest (RF) were implemented. The results demonstrated the following: (1) the Dual-1DCNN extracted discriminative features from S1A and S2 time series at the early season by producing the highest overall accuracy (OA: 87.23%); (2) for summer maize, cotton, and common yam rhizome, the Dual-1DCNN achieved F1 values of 92.39%, 87.71%, and 84.38%, respectively, at the early season (moreover, the early seasons were almost 40, 70, and 80 days before the end of the growth seasons, respectively). These findings suggested that the Dual-1DCNN is promising for the accurate and timely detection of crop types.

Bipolar disorder is a severe mood disorder and is one of the top 20 reasons of disability in the world. It causes a huge burden on society. In this study, the prediction models of bipolar disorder were constructed based on the concept of knowledge distillation. The input data consisted of patients of bipolar disorder and matched controls, all of which were selected from the open database MIMIC. The method of kernel density estimation (KDE) was exploited to generate probability density functions (PDF) which identify distributions of input data. The PDF values referred to as the soft labels were combined with the input data to construct the prediction models of bipolar disorder using decision tree and artificial neural network respectively. According to the evaluation results, indicators for identifying positive samples of bipolar disorder were improved. Meanwhile, the indicators for identifying negative samples have also been advanced. In addition, the branching attributes selected by the decision trees can be mapped back to specific disease diagnoses, which are all associated with bipolar disorder. In conclusion, using KDE to generate the soft label information of the input data can make knowledge distillation work and has improved the performances of prediction models for bipolar disorder.

Machine learning (ML) has found increasing use in research on energy conversion and storage technologies, in particular, so-called sustainable technologies. While often ML is used to directly optimize the parameters or phenomena of interest in the space of features, in this perspective, we focus on using ML to construct objects and methods that help in or enable the modeling of the underlying phenomena. We highlight the need for machine learning from very sparse and unevenly distributed numeric data in multidimensional spaces in these applications. After a brief introduction of some common regression-type machine learning techniques, we will focus on more advanced ML techniques which use these known methods as building blocks of more complex schemes and thereby allow working with extremely sparse data and also allow generating insight. Specifically, we will highlight the utility of using representations with sub-dimensional functions by combining the high-dimensional model representation ansatz with machine learning methods like neural networks or Gaussian process regressions in applications ranging from heterogeneous catalysis to nuclear energy.

Fault detection is an important step for subsurface interpretation and reservoir characterization from 3D seismic images. Due to the numerous and complicated faulting structures of seismic images, manual seismic interpretation is time taking and need intensive work. To overcome this problem, geoscientists are coming up with productive computer-aided techniques for assisting in interpreter science for many years. However, in this paper, we used a pre-trained CNN model to predict faults from the 3D seismic volume of the Poseidon field of Browse Basin, Australia. Basically, this field is highly structured with complex normal faulting throughout the targeted Plover Formations. So, our motivation for this work in this field is to compare machine learning-based fault prediction to user interpreted faults identification with supported by seismic variance attribute. We found very satisfying result using DL with having an improved fault probability volume that outperform variance technology. Therefore, we propose that this workflow could reduce time and able to predict fault quite accurately in any field area.

Artificial intelligence algorithms have gained widespread adoption in the field of air conditioning load prediction. However, their prediction accuracy is substantially influenced by the quality of training samples. Training samples that lack relevance to the predicted moments can introduce interference into the neural network's learning process, potentially leading to a state of local convergence during its iterative process. This, in turn, diminishes the robustness and generalization capabilities of the prediction model. To enhance the prediction accuracy of air conditioning load prediction models based on artificial intelligence algorithms, this study presents an artificial intelligence algorithm prediction model based on the method of sample similarity sample screening. Initially, the comprehensive similarity coefficient between samples is computed using the gray correlation analysis method, enriched with enhancements in information entropy. Subsequently, a subset of closely related samples is extracted from the original dataset and employed as the training dataset for the artificial intelligence prediction model. Finally, the trained artificial intelligence algorithm prediction model is deployed for air conditioning load prediction. The results illustrate that the method of screening training samples based on sample similarity effectively improves the prediction accuracy of BP neural network (BPNN) and extreme learning machine (ELM) prediction models. However, it is important to note that this approach may not be suitable for genetic algorithm BPNN (GABPNN) and support vector regression (SVR) models.

In this research, a model is presented to detect and monitor the rotor bar’s condition of large motors. This proposed model uses two diagnostic methods MCSA and ZCT, to extract the fault components. The input of the proposed model is only the motor current at two levels of 80% and 100% of the nominal motor load, which by using the two methods MCSA and ZCT and making changes in how to use them can be the disadvantages of other methods such as incorrect detection of rotor bars in Large motors with variable load, the harmonical stator voltage (or the presence of the drives) and asymmetric conditions. The extracted components are classified using neural network, instead of experimental and human resources constraints. Using this classification algorithm is high accuracy and the ability to implement in conventional processors. The proposed model has been trained andtested using currents of real large motor data and 96.87% accuracy using neural network to detect faults and monitor the online status of the rotor bars. On the other hand, the proposed model has been implemented in the industrial environment (FiroozkoohCement Factory) and has been able to correctly determine the rotor bars of 4 large suspicious motors announced by the factory technicians.

It is very difficult to accurately divide farmland and woodland in Gaofen 2 (GF-2) remote sensing image, because their single plant coverage is very small, and their spectra are very similar. The ratio of spatial resolution and one plant’s coverage area must be fully taken into account when designing the Convolutional Neural Network structure for extracting them from GF-2 image. We establish a Convolutional Encode Neural Networks model (CENN), The first layer has two sets of convolution kernels to learn the characteristics of farmland and woodland respectively, while the second layer is the encoder to encode the characteristics by transfer function, which can map the results to the corresponding category number. In the training stage, samples of farmland, woodland, and other categories are categorically used to train CENN, as soon as training is accomplished, CENN would acquire enough ability to accurately extract farmland and woodland from remote sensing images. The final extraction result is obtained by implementing per-pixel segmentation of images used to train the CENN. CENN is compared and analyzed with others such as Deep Belief Network (DBN), Full Convolutional Network (FCN), Deeplab Model. The results of experiments show that CENN can more accurately mine the characteristics of farmland and woodland, and it achieves its goal of extracting farmland and woodland with high precision from GF-2 images.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

Keywords: Аrtificial neural network, electric drive system, database, stability, training algorithm, technological mechanisms.

One of the most effective image processing techniques is the use of convolutional neural networks, where we combine intensity values at grid points in the vicinity of each point. To speed up computations, researchers have developed a dilated version of this technique, in which only some points are processed. It turns out that the most efficient case is when we select points from a sub-grid. In this paper, we explain this empirical efficiency proving that the sub-grid is indeed optimal – in some reasonable sense. To be more precise, we prove that all reasonable optimality criteria, the optimal subset of the original grid is either a sub-grid, or a sub-grid-like set.

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a new approach to ONNs based on integrated Kerr micro-combs that is programmable, highly scalable and capable of reaching ultra-high speeds, demonstrating the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths to achieve a single-unit throughput of 11.9 Giga-OPS at 8 bits per OP, or 95.2 Gbps. We test the perceptron on handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. By scaling the perceptron to a deep learning network using off-the-shelf telecom technology we can achieve high throughput operation for matrix multiplication for real-time massive data processing.

The informational synthesis of neural structures, processes, parameters and characteristics that allow a unified description and modeling as neural machines of natural and artificial neural systems is presented. The general informational parameters as the global quantitative measure of the neural systems computing potential as absolute and relative neural power were proposed. Neural information organizing and processing follows the way in which nature manages neural information by developing functions, functionalities and circuits related to different internal or peripheral components and also to the whole system through a non-deterministic memorization, fragmentation and aggregation of afferent and efferent information, deep neural information processing representing multiple alternations of fragmentation and aggregation stages. The relevant neural characteristics were integrated into a neural machine type model that incorporates unitary also peripheral or interface components as the central ones. The proposed approach allows overcoming the technical constraints in artificial computational implementations of neural information processes and also provides a more relevant description of natural ones.

The intracranial pressure (ICP) signal, as monitored on patients in intensive care units, contains pulses of cardiac origin where P1 and P2 subpeaks can often be observed. When calculable, the ratio of their relative amplitudes is an indicator of the patient’s cerebral compliance. This characterization is particularly informative on the overall state of the cerebrospinal system. We developed a recurrent neural network-based framework for P2/P1 ratio computation that only takes a raw ICP signal as an input. Two tasks are performed, namely pulse classification and subpeak designation. Pulse classification was achieved with an area under the curve of 0.90 on a 4,344-pulse testing dataset, while the peak designation algorithm identified pulses with a P2/P1 ratio > 1 with a 97.3% accuracy. Although it still needs to be evaluated on a larger number of labeled recordings, our automated P2/P1 ratio calculation framework appears to be a promising tool for improving bedside monitoring devices.

The coronavirus disease 2019 (COVID-19) is the fastest transmittable virus caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The detection of COVID-19 using artificial intelligence techniques and especially deep learning will help to detect this virus in early stages which will reflect in increasing the opportunities of fast recovery of patients worldwide. This will lead to release the pressure off the healthcare system around the world. In this research, classical data augmentation techniques along with CGAN based on a deep transfer learning model for COVID-19 detection in chest CT scan images will be presented. The limited benchmark datasets for covid-19 especially in chest CT images is the main motivation of this research. The main idea is to collect all the possible images for covid-19 that exists until the very writing of this research and use the classical data augmentations along with CGAN to generate more images to help in the detection of the COVID-19. In this study, five different deep convolutional neural network-based models (AlexNet, VGGNet16, VGGNet19, GoogleNet, and ResNet50) have been selected for the investigation to detect the coronavirus infected patient using chest CT radiographs digital images. The classical data augmentations along with CGAN improve the performance of classification in all selected deep transfer models. The Outcomes show that ResNet50 is the most appropriate deep learning model to detect the COVID-19 from limited chest CT dataset using the classical data augmentation with testing accuracy of 82.91%.

The coronavirus (covid-19) pandemic is putting healthcare systems across the world under unprecedented and increasing pressure according to the World Health Organization (WHO). With the advances in computer algorithms and especially Artificial Intelligence, the detection of this type of virus in the early stages will help in fast recovery and help in releasing the pressure off healthcare systems. In this paper, a GAN with deep transfer learning for coronavirus detection in chest x-ray images is presented. The lack of benchmark datasets for covid-19 especially in chest x-rays images is the main motivation of this research. The main idea is to collect all the possible images for covid-19 that exists until the writing of this research and use the GAN network to generate more images to help in the detection of the virus from the available x-rays images with the highest accuracy possible. The dataset used in this research was collected from different sources and it is available for researchers to download and use it. The number of images in the collected dataset is 307 images for four different types of classes. The classes are the covid-19, normal, pneumonia bacterial, and pneumonia virus. The dataset is divided into 90% for the GAN and the training and the validation phase, while 10% used in the testing phase. The GAN helps in generating more images from the original dataset to be 30 times larger than the originally collected dataset. The GAN also help in overcoming the overfitting problem and made the proposed model more robust. Three deep transfer models are selected in this research for investigation. The models are the Alexnet, Googlenet, and Restnet18. Those models are selected based on their small number of layers on their architectures, which will reflect in reducing the complexity of the models and the consumed memory and time. Using a combination of GAN and deep transfer models prove it is efficiency according to validation, testing accuracy, and performance measurements such as precision, recall, and F1 score. Three case scenarios are tested through the paper, the first scenario which includes 4 classes from the dataset, while the second scenario includes 3 classes and the third scenario includes 2 classes. All the scenarios include the covid-19 class as it is the main target of this research to be detected. In the first scenario, the Googlenet is selected to be the main deep transfer model as it achieves 80.6% in testing accuracy. In the second scenario, the Alexnet is selected to be the main deep transfer model as it achieves 85.2% in testing accuracy, while in the third scenario which includes 2 classes(covid-19, and normal), Googlenet is selected to be the main deep transfer model as it achieves 100% in testing accuracy and 99.9% in the validation accuracy. All the performance measurement strengthen the obtained results through the research. Finally, this research may be considered one of the first trails to use GAN and deep transfer models together to help in detecting coronaviruses (covid-19) within the absence of a benchmark dataset around the world, especially in x-rays chest images.

Microarray gene expression-based detection and classification of medical conditions have been prominent in research studies over the past few decades. However, extracting relevant data from the high-volume microarray gene expression with inherent nonlinearity and inseparable noise components raises significant challenges during data classification and disease detection. So, this paper proposes a two-level strategy involving feature extraction and selection methods before the classification step. The feature extraction step utilizes Short Term Fourier Transform (STFT), and the feature selection step employs Particle Swarm Optimization (PSO) and Harmonic Search (HS) metaheuristic methods. The classifiers employed are Non-Linear Regression, Gaussian Mixture Model, Softmax Discriminant, Naive Bayes, SVM (Linear), SVM (Polynomial), and SVM (RBF). The two-level extracted relevant features are compared with raw data classification results, including Convolutional Neural Network (CNN) Methodology. Among the methods, STFT with PSO feature selection and SVM (RBF) classifier produced the highest accuracy of 94.47%.

In this article, the research team has systematically developed a method to model the kinematics and dynamics of a 3-wheeled robot subjected to external disturbances and sideways wheel sliding. These models will be used to design control laws that compensate for wheel slippage, model uncertainties, and external disturbances. These are control algorithms developed based on Dynamic Surface Control (DSC). Adaptive trajectory tracking DSC algorithm using fuzzy logic system (AFDSC) and radial neural network (RBFNN) with fuzzy logic system to overcome the disadvantages of DSC and expand the application domain for wheeled Mobile Robots (WMR). However, this Adaptive Fuzzy Neural Network Dynamic Surface Control (AFNNDSC) adaptive controller ensures the closed system is stable and follows the preset trajectory in the presence of wheel slippage model uncertainty and is affected by significant amplitude disturbances. The stability and convergence of the closed-loop system are guaranteed based on the Lyapunov analysis. The AFNNDSC adaptive controller is evaluated by simulation on MATLAB/Simulink software and in a steady state. The maximum position error on the right wheel and left wheel is 0.000572 (m) and 0.000523 (m), and the angular velocity tracking error in the right and left wheels of the control method is 0.000394 (rad/s). The experimental results show the correctness of the theoretical analysis, the effectiveness of the proposed controller, and the possibility of practical application.

The temporo-spatial theory of consciousness postulates that the brain implements its own inner time and space for conscious processing of outside world. In line with this hypothesis, I present a mechanistic model of mutually connected processes that encode the inner space and time. The model is used to elaborate the binding mechanism between two sets of processes representing the inner space and time, respectively. Further, a stochastic version of the model is developed to investigate the interplay between the binding strength and noise. The spectral entropy is used to characterize the noise effects on the systems of processes when the binding strength is varied. The stochastic modeling results reveal that the spectral entropy values for strongly bound systems have similar entropy values for weakly bound or even decoupled systems. Thus, the analysis performed in this study allows to conclude that the binding mechanism is noise-resilient.

Malaysian healthcare institutions still use ineffective paper-based vaccination systems to manage childhood immunization schedules. This may lead to missed appointments, incomplete vaccinations, and outbreaks of preventable diseases among infants. To address this issue, we proposed a text messaging vaccination reminder and recall system named Virtual Health Connect (VHC) to simplify and accelerate the immunization administration for nurses that may result in improving the completion and timeliness of immunizations among infants. Considering the narrow research about the acceptance of these systems in the healthcare sector, we examined factors influencing nurses’ attitude and intention to use VHC using the extended technology acceptance model (TAM). The novelty of the conceptual model is proposing new predictors of attitude, namely, perceived compatibility and perceived privacy and security issues. We conducted a survey among 121 nurses in Malaysian government hospitals and clinics to test the model. We analyzed the collected data using partial least squares-structural equation modeling (PLS-SEM) to examine the significant factors influencing nurses’ attitude and intention to use VHC. Moreover, we applied artificial neural network (ANN) to determine the most significant factors of acceptance with higher accuracy. Therefore, we could offer more accurate insights to decision-makers in the healthcare sector for the advancement of health services. Our results highlighted that the compatibility of VHC with the current work setting of nurses developed their positive perspectives toward the system. Moreover, the nurses felt optimistic about the system when considering it to be useful and easy to use in the workplace. Finally, their attitude toward using VHC played a pivotal role in raising their intention. Based on the ANN models, we also found that perceived compatibility was the most significant factor influencing nurses' attitude towards using VHC, followed by perceived ease of use and perceived usefulness.

An earthquake is a natural event by its general definition. This natural event is a disaster that causes significant damage, loss of life, and other economic effects that will damage the state. The possibility of predicting a natural event such as an earthquake will minimize the reasons mentioned. Data collection, data processing, and data evaluation were carried out in this study. Earthquake forecasting was performed using the data and the RNN (Recurrent Neural Network) method. The study was carried out on seismic data with a magnitude of 3.0 and above belonging to Düzce Province between 1990 and 2022. In order to increase the learning potential of the method, the b and d values of the earthquake were calculated and included in the data set, except for the earthquake magnitude. The determination of earthquakes in a specific time interval in regions of Turkey, the classification of earthquake-related seismic data using artificial neural networks, and the production of predictions for the future reveal the importance of this study.

This paper investigates the dynamic properties of artificial neural networks using differential equations and explores the influence of parameters on stability and neural oscillations. By analyzing the equilibrium point of the differential equations, we identify conditions for asymptotic stability and criteria for oscillation in artificial neural networks. Furthermore, we demonstrate how adjusting synaptic weights between neurons can effectively control stability and oscillation. The proposed model offers potential insights into the malfunctioning mechanisms of biological neural networks implicated in neurological disorders like Parkinson's disease tremors and epilepsy seizures, which are characterized by abnormal oscillations.

Multiply-accumulate calculations using a memristor crossbar array is an important method to realize neuromorphic computing. However, the memristor array fabrication technology is still immature, and it is difficult to fabricate large-scale arrays with high-yield, which restricts the development of memristor-based neuromorphic computing technology. Therefore, cascading small-scale arrays to achieve the neuromorphic computational ability that can be achieved by large-scale arrays, which is of great significance for promoting the application of memristor-based neuromorphic computing. To address this issue, we present a memristor-based cascaded framework with some basic computation units, several neural network processing units can be cascaded by this means to improve the processing capability of the dataset. Besides, we introduce a split method to reduce pressure of input terminal. Compared with VGGNet and GoogLeNet, the proposed cascaded framework can achieve 93.54% Fashion-MNIST accuracy under the 4.15M parameters. Extensive experiments with Ti/AlOx/TaOx/Pt we fabricated are conducted to show that the circuit simulation results can still provide a high recognition accuracy, and the recognition accuracy loss after circuit simulation can be controlled at around 0.26%.

Tumorigenesis is a complex biological phenomenon that includes extensive genetic and phenotypic heterogeneities and complicated regulatory mechanisms. In the recent few years, our studies demonstrate that tumor-initiating cells are similar to neural stem/progenitor cells in regulatory networks, tumorigenicity and pluripotent differentiation potential. In the review, I will make further discussion on these observations and propose a rule of cell biology by integrating these findings with evidence from developmental biology, tumor biology and evolution, which suggests that neural stemness underlies two coupled cell properties, tumorigenicity and pluripotent differentiation potential. Tumorigenicity and phenotypic heterogeneity in tumor is a result of acquirement of neural stemness in cells. The neural stemness property of tumor-initiating cells can hopefully integrate different concepts/hypotheses underlying tumorigenesis. Neural stem cells/neural progenitors and tumor-initiating cells share regulatory networks; both exhibit neural stemness, tumorigenicity and differentiation potential; both are dependent on expression or activation of ancestral genes (the atavistic effect); both rely primarily on aerobic glycolytic metabolism; both can differentiate into various cells or tissues that are derived from three germ layers, resembling severely disorganized or more severely degenerated process of embryonic development; both are enriched in long genes with more splice variants that provide more plastic scaffolds for cell differentiation, etc. The property of neural stemness might be a key point to understand tumorigenesis and pluripotent differentiation potential, and possibly explain certain pathological observations in tumors that have been inexplicable. Therefore, behind the complexity of tumorigenesis might be a general rule of cell biology, i.e., neural stemness represents the ground state of cell tumorigenicity and pluripotent differentiation potential.

A chronically stable electrode material with low impedance for recording neural activity and high charge-injection capacity for functional electro-stimulation is desirable for the fabrication of implantable microelectrode arrays that aims to restore impaired or lost neurological functions in humans. For this purpose, we have investigated the electrochemical properties of sputtered ruthenium oxide (RuOx) electrode coatings, deposited on planar microelectrode arrays, using an inorganic model of interstitial fluid (model-ISF) at 37o C as the electrolyte. Through a combination of cyclic voltammetry (CV) and electrochemical impedance spectroscopy (EIS) modelling study we have established the contribution of faradaic reaction as the major charge-injection contributor within the safe neural stimulation potential window of 0.6 V vs Ag|AgCl. We have also established the reversibility of the charge-injection process for sputtered RuOx film by applying constant charge-per-phase current stimulations at different pulse widths and by comparing the magnitudes of leading and trailing access voltages during voltage transient measurements. Finally, the impedance of the sputtered RuOx film was found to be reasonably comparable in both its oxidized and reduced states, although electronic contribution from capacitive double-layer was found to be slightly higher for the completely oxidized film around 0.6 V than its reduced counterpart around -0.6V.

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-OPS (TOPS - operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

Neural stem cell (NSC) based therapies are at the forefront of regenerative medicine strategies to combat illness and injury of the central nervous system (CNS). In addition to their ability to produce new cells, NSCs secrete a variety of products, known as the NSC secretome, that have been shown to ameliorate CNS disease pathology and promote recovery. As pre-clinical and clinical research to harness the NSC secretome for therapeutic purposes advances, a more thorough understanding of the endogenous NSC secretome can provide useful insight into the functional capabilities of NSCs. In this review, we focus on research investigating the autocrine and paracrine functions of the endogenous NSC secretome across life. We also compare the NSC secretome across species, finding signs of conserved parallels between rodent, human and zebrafish NSC secretomes. Throughout development and adulthood, we find evidence that the NSC secretome is a critical component of how endogenous NSCs regulate themselves and their niche. We also find gaps in current literature, most notably in the clinically relevant domain of endogenous NSC paracrine function in the injured CNS. Future investigations to further define the endogenous NSC secretome and its role in CNS tissue regulation are necessary to bolster our understanding of NSC-niche interactions and to aid in the generation of safe and effective NSC-based therapies.

Biological neural network (BNN) is the core brain for creature to accomplish its intelligent behaviors through unique network structure and mechanisms. It also inspires controlling human-designed autonomous agents including robots to generate more advanced intelligent behaviors by mimicking the neural control mechanism of creatures at a deeper and more interactive level. Here, we constructed a whole-brain neural network model of Caenorhabditis elegans (C. elegans), which characterizes the electrochemical processes at the level of cellular synapse. The neural network simulation integrates computational programming and visualization of neurons and synapse connections of C. elegans, containing the specific controllable circuits summarization with their dynamic characteristics within the whole network. To illustrate its particular intelligent control capability in terms of robotics, we introduce the first innovative methodology for applying the BNN model to a 12-legged robot’s movement control based on the established numerical simulation platforms. We accomplished and designed two methods and corresponding encoding processes, one involving orientation control and the other involving locomotion generation, to demonstrate the intelligent control performance of BNN. Both simulation and experiment results indicate that the robot exhibits stronger autonomy and more intelligent moving performance under the control of BNN. We then summarized the contributions for digitalizing the C. elegans’ whole-brain neural network in real-time and utilizing it to control robot in a closed loop to validate its advanced intelligence control ability in terms of a scientific robot.

Speech recognition, or automatic speech recognition (ASR), is a technology designed to convert spoken language into text using software. However, conventional ASR methods involve several distinct components, including language, acoustic, and pronunciation models with dictionaries. This modular approach can be time-consuming and may influence performance. In this study, we propose a method that streamlines the speech recognition process by incorporating a unified recurrent neural network (RNN) architecture. Our architecture integrates a convolutional neural network (CNN) with an RNN and employs a connectionist temporal classification (CTC) loss function. Key experiments were carried out using a dataset comprising 576,656 valid sentences, using erosion techniques. Evaluation of the model performance, measured by the word error rate (WER) metric, demonstrated remarkable results, achieving a WER of 2%. This approach has significant implications for the realm of speech recognition, as it alleviates the need for labor-intensive dictionary creation, enhancing the efficiency and accuracy of ASR systems, and making them more applicable to real-world scenarios. For future enhancements, we recommend the inclusion of dialectal and spontaneous data in the dataset to broaden the model's adaptability. Additionally, fine-tuning the model for specific tasks can optimize its performance for targeted objectives or domains, further enhancing its effectiveness in those areas.

Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) have been utilised to forecast the foreign exchange market (Forex). However, such models usually exhibit unstable behaviour, as data perturbations often downgrade the functionality of the entire network due to their monolithic architecture. Hence, this study proposes a novel neuroscience-informed modular network applied to the closing prices and the sentiments retrieved from Yahoo Finance and Twitter APIs, aiming to anticipate better price fluctuations in Euro to British Pound Sterling (EUR/GBP) rather than monolithic methods. The proposed model is based on a new modular CNN, replacing pooling layers with orthogonal kernel initialisation RNNs coupled with Monte Carlo Dropout (MCD), namely MCoRNNMCD. It combines two modules: i) a convolutional simple RNN and ii) a convolutional Gated Recurrent Unit (GRU), where orthogonality and MCD are added to reduce the overfitting, assessing each module's uncertainty. These parallel feature extraction modules concatenate their outputs to a final three-layer Artificial Neural Network (ANN) decision-making module. A comprehensive comparison viewing objective evaluation metrics such as the Mean Square Error (MSE) proved that the proposed MCoRNNMCD-ANN outperformed single CNN, LSTM, GRU, and the state-of-the-art hybrid BiCuDNNLSTM, CLSTM, CNN-LSTM, and LSTM-GRU in forecasting hourly EUR/GBP closing price fluctuations.

In recent years, Neural networks are increasingly deployed in various fields to learn complex patterns and make accurate predictions. However, designing an effective neural network model is a challenging task that requires careful consideration of various factors, including architecture, optimization method, and regularization technique. This paper aims to comprehensively overview the state-of-the-art artificial neural network (ANN) generation and highlight key challenges and opportunities in machine learning applications. It provides a critical analysis of current neural network model design methodologies, focusing on the strengths and weaknesses of different approaches. Also, it explores the use of different learning approaches, including convolutional neural networks (CNN), deep neural networks (DNN), and recurrent neural networks (RNN) in image recognition, natural language processing, and time series analysis. Besides, it discusses the benefits of choosing the ideal values for the different components of ANN, such as the number of Input/output layers, hidden layers number, activation function type, epochs number, and model type selection, which help improve the model performance and generalization. Furthermore, it identifies some common pitfalls and limitations of existing design methodologies, such as overfitting, lack of interpretability, and computational complexity. Finally, it proposes some directions for future research, such as developing more efficient and interpretable neural network architectures, improving the scalability of training algorithms, and exploring the potential of new paradigms, such as Spiking Neural Networks, quantum neural networks, and neuromorphic computing.

Computer-aided image diagnostics (CAD) have been used in many fields of diagnostic medicine. It relies heavily on classical computer vision and artificial intelligence. Quantum neural network (QNN) has been introduced by many researchers around the world and presented recently by research corporations such as Microsoft, Google, and IBM. In this paper, the investigation of the validity of using the QNN algorithm for machine-based breast cancer detection was performed. To validate the learnability of the QNN, a series of learnability tests were performed alongside with classical convolutional neural network (CCNN). QNN is built using the Cirq library to perform the assimilation of quantum computation on classical computers. Series of investigations were performed to study the learnability characteristics of QNN and CCNN under the same computational conditions. The comparison was performed for real Mammogram data sets. The investigations showed success in terms of recognizing the data and training. Our work shows better performance of QNN in terms of successfully training and producing a valid model for smaller data set compared to CCNN.

This study investigates the factors influencing the choice of online and offline shopping trips and their impacts on urban transportation, environment, and economy in Tehran, Iran. A questionnaire survey was conducted to collect data from 1,000 active e-commerce users who made successful orders in both online and offline services in the last 20 days of 2021 in areas 2 and 5 of Tehran. A deep neural network model was developed to estimate the type of shopping trip based on 10 indicators, such as age, gender, car ownership, delivery cost, product price, etc. The performance of the model was compared with three other algorithms: MLP, decision tree, and KNN. The results showed that the deep neural network model had the highest accuracy of 95.63%. The most important factors affecting the choice of shopping trips were delivery cost, delivery time, and product price. This study provides insights for transportation planners, e-commerce managers, and policymakers to design effective strategies for reducing transportation costs, pollutant emissions, urban traffic, and increasing user satisfaction and sustainable development.

Optical artificial neural networks (ONNs) — analog computing hardware tailored for machine learning [1,2] — have significant potential for ultra-high computing speed and energy efficiency [3]. We propose a new approach to architectures for ONNs based on integrated Kerr micro-comb sources [4] that is programmable, highly scalable and capable of reaching ultra-high speeds. We experimentally demonstrate the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths of a micro-comb to achieve a high single-unit throughput of 11.9 Giga-FLOPS at 8 bits per FLOP, corresponding to 95.2 Gbps. We test the perceptron on simple standard benchmark datasets — handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. This performance is a direct result of the record small wavelength spacing (49GHz) for a coherent integrated microcomb source, which results in an unprecedented number of wavelengths for neuromorphic optics. Finally, we propose an approach to scaling the perceptron to a deep learning network using the same single micro-comb device and standard off-the-shelf telecommunications technology, for high-throughput operation involving full matrix multiplication for applications such as real-time massive data processing for unmanned vehicle and aircraft tracking.

This article presents a detailed examination of the methodology and modeling tools utilized to analyze gas flow in pipelines, rooted in the fundamental principles of gas dynamics. The methodology integrates numerical simulations with modern neural network techniques, particularly focusing on the Physics-Informed Neural Network (PINN) method. This innovative approach combines artificial neural networks (ANNs) with physical equations, offering a more efficient and accurate way to model various complex processes and phenomena. The proposed mathematical model, based on the Euler equation, has been meticulously implemented using the Python language. Verification with analytical solutions ensures the accuracy and reliability of the computations. In the research, a comprehensive comparative analysis was conducted between results obtained using the PINN method and those from conventional Computational Fluid Dynamics (CFD) approaches. The analysis highlighted the advantages of the PINN method, which produced smoother pressure and velocity fluctuation profiles while reducing computation time, demonstrating its potential as a transformative modeling tool. The data derived from this study are of paramount importance for ensuring ongoing energy supply reliability and can also be used to create predictive models related to gas behavior in pipelines. The application of modeling techniques for gas flow simulation has the potential to revolutionize the integrity of our energy infrastructure and utilization of gas resources. However, it is crucial to emphasize that the effectiveness of such models relies on continuous monitoring and frequent updates to ensure alignment with real-world conditions. This research not only contributes to a deeper understanding of compressible gas flows but also underscores the crucial role of advanced modeling methodologies in the sustainable management of gas resources for both current and future generations.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

Dynamic neural networks (DNN) are types of artificial neural networks (ANN) that are designed to work with sequential data where context in time is important. In contrast to traditional static neural networks that process data in a fixed order, dynamic neural networks use information about past inputs, which is important if dynamic of a certain process is emphasized. They are widely used in natural language processing, speech recognition and time series prediction. In industrial processes, their use is interesting for the prediction of difficult-to-measure process variables. In an industrial process of isomerization, it is crucial to measure the quality attributes affecting the octane number of gasoline. Process analyzers that are commonly used for this purpose are expensive and subject to failures, therefore, in order to achieve continuous production in case of malfunction, mathematical models for estimating the product quality attributes are imposed as a solution. In this paper, mathematical models were developed using dynamic recurrent neural networks (RNN), i.e., their subtype of a long short-term memory (LSTM) architecture. The results of the developed models were compared with the results of several types of other data-driven models developed for an isomerization process, such as multilayer perceptron (MLP) artificial neural networks, support vector machines (SVM) and dynamic polynomial models. The obtained results are satisfactory, which suggests a good possibility of application.

This study aimed at exploring what role artificial intelligence techniques could play in the futural numerical analysis. In this paper, a convolutional neural network techniques based on modified loss function is proposed as a surrogate of finite element method(FEM). Several surrogate-based physics-informed neural networks(PINNs) are developed to solve representative boundary value problems based on elliptic partial differential equations (PDEs). Results from the proposed surrogate-based approach are in good agreement with ones from conventional FEM. It is found that modification of the loss function could improve the prediction accuracy of the neural network. It is indicated that to some extent the artificial intelligence technique could replace conventional numerical analysis as a great surrogate model.

Forest fire identification is important for forest resource protection. Effective monitoring of forest fires requires the deployment of multiple monitors with different viewpoints, while most traditional recognition models can only recognize images from a single source. By ignoring the information from images with different viewpoints, these models produce high rates of missed and false alarms. In this paper, we propose a graph neural network model based on the similarity of dynamic features of multi-view images to improve the accuracy of forest fire recognition. The input features of the nodes on the graph are converted into relational features of different gallery pairs by establishing pairs (nodes) representing different viewpoint images and gallery images. The new feature library relationship is used to update the image gallery with dynamic features in order to achieve the estimation of similarity between images and improve the image recognition rate of the model. In addition, to reduce the complexity of image pre-processing process and extract key features in images effectively, this paper also proposes a dynamic feature extraction method for fire regions based on image segment ability. By setting the threshold value of HSV color space, the fire region is segmented from the image, and the dynamic features of successive frames of the fire region are extracted. The experimental results show that, compared with the baseline method Resnet, this paper's method is more effective in identifying forest fires, and its recognition accuracy is improved by 2%. And the scheme of this paper can adapt to different forest fire scenes, with better generalization ability and anti-interference ability.

Characterization of cancer cells and neural stem cells indicates that tumorigenicity and pluripotency are coupled cell properties determined by neural stemness, and tumorigenesis represents a process of progressive loss of original cell identity and gain of neural stemness. This reminds of a most fundamental process required for the development of the nervous system and body axis during embryogenesis, i.e., embryonic neural induction. Neural induction is that, in response to extracellular signals that are secreted by the Spemann-Mangold organizer in amphibians or the node in mammals and inhibit epidermal fate in ectoderm, the ectodermal cells lose their epidermal fate and assume the neural default fate and consequently, turn into neuroectodermal cells. They further differentiate into the nervous system and also some non-neural cells via interaction with adjacent tissues. Failure in neural induction leads to failure of embryogenesis, and ectopic neural induction due to ectopic organizer or node activity or activation of embryonic neural genes causes a formation of secondary body axis or a conjoined twin. During tumorigenesis, cells progressively lose their original cell identity and gain of neural stemness, and consequently, gain of tumorigenicity and pluripotency, due to various intra-/extracellular insults in cells of a postnatal animal. Tumorigenic cells can be induced to differentiation into normal cells and integrate into normal embryonic development within an embryo. However, they form tumors and cannot integrate into animal tissues/organs in a postnatal animal because of lack of embryonic inducing signals. Combination of studies of developmental and cancer biology indicates that neural induction drives embryogenesis in gastrulating embryos but a similar process drives tumorigenesis in a postnatal animal. Tumorigenicity is the manifestation of aberrant occurrence of pluripotent state in a postnatal animal. Pluripotency and tumorigenicity are both but different manifestations of neural stemness in pre- and postnatal stage, respectively, of animal life. The unique property of neural stemness is derived from the evolutionary advantage of neural genes and the neural-biased state of the last common unicellular ancestors of metazoan. Based on these findings, I discuss about some confusion in cancer research, propose to distinguish the causality and associations and discriminate causal and supporting factors involved in tumorigenesis, and suggest revisiting the focus of cancer research.

This paper introduces a novel architecture—bidirectional optical neural network (BONN)—for providing backward connections alongside forward connections in artificial neural networks (ANNs). BONN incorporates laser diodes and photodiodes and exploits the properties of Köhler illumination to establish optical channels for backward directions. Thus, it has bidirectional functionality that is crucial for algorithms such as the backpropagation algorithm. BONN has a scaling limit of 96 × 96 for input and output arrays, and a throughput of 8.5 × 1015 MAC/s. While BONN's throughput may rise with additional layers for continuous input, limitations emerge in the backpropagation algorithm as its throughput doesn't scale with layer count. Successful BONN-based implementation of the backpropagation algorithm requires the development of fast spatial light modulator to accommodate frequent data flow changes. A two-mirror-like BONN and its cascaded extension are alternatives for multilayer emulation, and they help save hardware space and increase the parallel throughput for inference. An investigation into the application of the clustering technique to BONN revealed its potential to help overcome scaling limits and to provide full interconnections for backward directions between doubled input and output ports. BONN's bidirectional nature holds promise for enhancing supervised learning in ANNs and increasing hardware compactness.

Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare system and patients’ information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD), and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays AI grants the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI challenges the role of the physician’s experience in PAD treatment.

Partial differential equations (PDEs) are used to describe a wide range of phenomena, such as heat transfer, fluid dynamics, and quantum mechanics. By solving PDEs, we can ob- tain insights into the behavior of the system and make predictions about its future evolution. Conventional numerical methods for obtaining the approximate solutions of PDEs may re- quire extensive computational resources and time, especially for complex PDEs and large- scale problems. The recently developed physics-informed neural network (PINN) has shown promise in a variety of scientific and engineering fields by incorporating physical laws into the loss functions of the neural network (NN). In addition, the training of PINN does not require ground truth data, but it has poor generalization ability to unseen domains. On the other hand, a convolutional neural network (CNN) has fast inference and better generalization ability, but it requires a large amount of training data. Taking the advantages of PINN and CNN by using Legendre multiwavelets (LMWs) as basis functions, we introduce a new method to approach the PDEs in this paper, namely Physics-Informed Legendre Multiwavelets CNN (PiLMWs-CNN), in order to continuously approximate a grid-based state representation that can be handled by a CNN. PiLMWs-CNN enable us to train our models using only physics-informed loss functions without any pre- computed training data, simultaneously providing fast and continuous solutions that gener- alize to previously unknown domains. In particular, the LMWs can simultaneously possess compact support, orthogonality, symmetry, high smoothness, and high approximation order. Compared to orthonormal polynomial (OP) bases, the approximation accuracy can be greatly increased and computation costs can be significantly reduced by using LMWs. We applied PiLMWs-CNN to approximate the damped wave equation, incompressible Navier-Stokes (N- S) equation, and two-dimensional heat conduction equation. The experimental results show that this method provides more accurate, efficient, and fast convergence with better stability when approximating the solution of PDEs.

Human activity recognition (HAR) using wearable sensors is gaining popularity in the healthcare domain, enabling continuous monitoring and timely interventions. The conventional HAR systems are centralised and need data sharing with a server for processing and model training. However, this data sharing leads to various challenges, such as privacy concerns, increased communication and storage costs, inefficient computational algorithms, data scarcity due to unwillingness to share, and difficulty achieving high accuracy and personalised models simultaneously. To overcome these challenges, this paper introduces a privacy and energy-aware federated learning (FL) framework for model training without data sharing. The proposed scheme incorporates spiking neural networks (SNNs), which are particularly suited for resource-constrained devices due to their event-driven information processing. The key idea is to synergise the strengths of SNNs and long short-term memory (LSTM) to create a hybrid model for robust HAR. The proposed hybrid spiking LSTM (S-LSTM) model uses the LSTM as an input layer to capture temporal dependencies efficiently, followed by spiking layers that replace the typical activation using leaky integrate-and-fire neurons. We employ the combination of surrogate gradient learning and backpropagation through time (BPTT) to update the weights of SNN layers in a supervised manner. The performance of the proposed model is evaluated using two publicly available datasets for both indoor and outdoor scenarios. The results show that the proposed S-LSTM performs much better than spike convolutional neural networks (S-CNN) and simple CNN, achieving the accuracy of 97% and 87% for indoor and outdoor datasets, respectively. Personalisation, also known as fine-tuning the global model using local data, is crucial in HAR. It allows the model to adapt to individual behaviour and preferences, making predictions more accurate. The results also show that personalisation improves the performance of participants up to 9% on average. Additionally, analysis with 50% random client participation reduces communication costs by 50% with minimal impact on accuracy.

A scalable optical convolutional neural network (SOCNN) based on free-space optics and Koehler illumination was proposed to address the limitations of the previous 4f correlator system. Unlike Abbe illumination, Koehler illumination provides more uniform illumination and reduces crosstalk. SOCNN allows for scaling up of the input array and the use of incoherent light sources. Hence, the problems associated with 4f correlator systems can be avoided. We analyzed the limitations in scaling the kernel size and parallel throughput and found that SOCNN can offer a multilayer convolutional neural network with massive optical parallelism.

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-FLOPS (floating point operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

Speech recognition, also known as automatic speech recognition (ASR), is a technology that enables software to transcribe spoken language into text. However, existing Amharic ASR methods require multiple separate blocks, such as language, acoustic, and pronunciation models with dictionaries, which can be time-consuming and influence performance. This study proposes an approach that replaces much of the speech pipeline with a single recurrent neural network (RNN) architecture. Our proposed architecture is based on a hybrid approach that combines a convolutional neural network (CNN) with a recurrent neural network (RNN) and a connectionist temporal classification (CTC) loss function. We conducted several experiments with noisy audio data that contain 20,000 valid sentences. The model was evaluated using the word error rate (WER) metric, achieving impressive results of 7% WER on noisy data. This approach has significant implications for the field of speech recognition, as it reduces the human effort required to create dictionaries and improves the efficiency and accuracy of ASR systems, making them more practical for real-world applications.

Creating self-learning algorithms, developing deep neural networks and improving other methods that "learn" for various areas of human activity is the main goal of the theory of machine learning. It helps to replace the human with a machine, aiming to increase the quality of production. The theory of artificial neural networks, which already have replaced the humans in problems of detection of moving objects, recognition of images or sounds, time series prediction, big data analysis and numerical methods remains the most dispersed branch of the theory of machine learning. Certainly, for each area of human activity it is necessary to select appropriate neural network architectures, methods of data processing and some novel tools from applied mathematics. But the universal problem for all these neural networks with specific data is the achieving the highest accuracy in short time. Such problem can be resolved by increasing sizes of architectures and improving data preprocessing, where the accuracy rises with the training time. But there is a possibility to increase the accuracy without time growing, applying optimization methods. In this survey we demonstrate existing optimization algorithms of all types, which can be used in neural networks. There are presented modifications of basic optimization algorithms, such as stochastic gradient descent, adaptive moment estimation, Newton and quasi-Newton optimization methods. But the most recent optimization algorithms are related to information geometry, for Fisher-Rao and Bregman metrics. This approach in optimization extended the theory of classic neural networks to quantum and complex-valued neural networks, due to geometric and probabilistic tools. There are provided applications of all introduced optimization algorithms, what delighted many kinds of neural networks, which can be improved by including any advanced approaches in minimization of the loss function. Afterwards, we demonstrated ways of developing optimization algorithms in further researches, engaging neural networks with progressive architectures. Classical gradient based optimizers can be replaced by fractional order, bilevel and, even, gradient free optimization methods. There is a possibility to add such analogues in graph, spiking, complex-valued, quantum and wavelet neural networks. Besides the usual problems of image recognition, time series prediction, object detection, there are many are other tasks for modern theory of machine learning, such as solving problem of quantum computations, partial differential and integro-differential equations, stochastic processes and Brownian motion, making decisions and computer algebra.

In the pursuit of energy efficiency and reduced environmental impact, adequate ventilation in enclosed spaces is essential. This study presents a hybrid neural network model designed for real-time monitoring and prediction of environmental variables. The system comprises two phases: An IoT hardware-software platform for data acquisition and decision-making, and a hybrid model combining short-term memory and convolutional recurrent structures. The results are promising and hold potential for integration into parallel processing AI architectures.

In computer vision and image analysis, Convolutional Neural Networks (CNNs) and other deep learning models are at the forefront of research and development. These advanced models have proven to be highly effective in tasks related to computer vision. One technique that has gained prominence in recent years is the construction of ensembles using Deep CNNs. These ensembles typically involve combining multiple pre-trained CNNs to create a more powerful and robust network. The purpose of this study is to evaluate the effectiveness of building CNN ensembles by combining several advanced techniques. Tested here are CNN ensembles constructed by replacing ReLU layers with different activation functions, employing various data augmentation techniques, and utilizing several algorithms, including some novel ones, that perturb network weights. Experimental results performed across many data sets representing different tasks demonstrate that our proposed methods for building deep ensembles produces superior results. All the resources required to replicate our experiments are available at https://github.com/LorisNanni.

We present a simplified computational rule for the back-propagation formulas for artificial neural networks. In this work, we provide a generic two-step rule for the back-propagation algorithm in matrix notation. Moreover, this rule incorporates both the forward and backward phases of the computations involved in the learning process. Specifically, this recursively computing rule permits the propagation of the changes to all synaptic weights in the network, layer by layer, efficiently. In particular, we use this rule to compute both the up and down partial derivatives of the cost function of all the connections feeding into the output layer.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

Background: Disruption of alternative splicing (AS) is frequently observed in cancer and it might represent an important signature for tumor progression and therapy. Exon skipping (ES) represents one of the most frequent AS events and in non-small cell lung cancer (NSCLC) MET exon 14 skipping was shown to be targetable. Methods: We constructed a neural network (NN) specifically designed to detect MET exon 14 skipping events using RNAseq data. Furthermore, for discovery purpose we also developed a sparsely connected autoencoder to identify uncharacterized MET isoforms. Results: The NN had 100% Met exon 14 skipping detection rate, when tested on a manually curated set of 690 TCGA bronchus and lung samples. When globally applied to 2605 TCGA samples, we observed that the majority of false positives was characterized by a blurry coverage of exon 14, but interesting they share a common coverage peak in the second intron and we speculate that this event could be the transcription signature of a LINE1-MET fusion. Conclusions: Taken together our results indicate that neural networks can be an effective tool to provide a quick classification of pathological transcription events and sparsely connected autoencoders could represent the basis for the development of an effective discovery tool.

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a novel approach to ONNs that uses integrated Kerr optical micro-combs. This approach is programmable and scalable and is capable of reaching ultra-high speeds. We demonstrate the basic building block ONNs — a single neuron perceptron — by mapping synapses onto 49 wavelengths to achieve an operating speed of 11.9 x 10⁹ operations per second, or Giga-OPS, at 8 bits per operation, which equates to 95.2 gigabits/s (Gbps). We test the perceptron on handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. By scaling the perceptron to a deep learning network using off-the-shelf telecom technology we can achieve high throughput operation for matrix multiplication for real-time massive data processing.

Real-world time series data sets contain a combination of linear and nonlinear patterns, making the time series forecasting problem more challenging. In this paper, a new hybrid methodology is introduced for forecasting univariate time series data sets using a multiplicative error modeling approach. An autoregressive integrated moving average (ARIMA) model is combined with an autoregressive neural network (ARNN) for improving the predictions of individual forecast models. The proposed multiplicative ARIMA-ARNN model glorifies the chances of capturing the different combinations of linear and nonlinear patterns in time series. The model shows outstanding performance on six standard time-series data sets compared to other widely used single and hybrid forecasting models.

Using smartphone especially android platform has already got eighty percent market shares, due to aforementioned report, it becomes attacker’s primary goal. There is a growing number of private data onto smart phones and low safety defense measure, attackers can use multiple way to launch and to attack user’s smartphones.(e.g. Using different coding style to confuse the software of detecting malware). Existing android malware detection methods use multiple features, like safety sensor API, system call, control flow structure and data information flow, then using machine learning to check whether its malware or not. These feature provide app’s unique property and limitation, that is to say, from some perspectives it might suit for some specific attack, but wouldn’t suit for others. Nowadays most malware detection methods use only one aforementioned feature, and these methods mostly analysis to detect code, but facing the influence of malware’s code confusion and zero-day attack, aforementioned feature extraction method may cause wrong judge. So, it’s necessary to design an effective technique analysis to prevent malware. In this paper, we use the importance of word from apk, because of code confusion, some malware attackers only rename variables, if using general static analysis wouldn’t judge correctly, then use these importance value to go through our proposed method to generate picture, finally using convolutional neural network to see whether the apk file is malware or not.

Deep learning is emerging in many industrial sectors in hand with big data analytics to streamline production. In the biomanufacturing sector, big data infrastructure is lagging comparatively to other industries. A promising approach is to combine Deep Neural Networks (DNN) with prior knowledge in Hybrid Neural Network (HNN) workflows that are less dependent on the quality and quantity of data. This paper reviews published articles over the past 30 years on the topic of HNN applications to bioprocesses. It revealed that HNNs were applied to various bioprocesses, including microbial cultures, animal cells cultures, mixed microbial cultures, and enzyme biocatalysis. HNNs were mainly applied for process analysis, process monitoring, development of software sensors, open- and closed-loop control, batch-to-batch control, model predictive control, intensified design of experiments, quality-by-design, and recently for the development of digital twins. Most previous HNN studies combined shallow Feedforward Neural Networks (FFNNs) with physical laws, such as macroscopic material balance equations, following the semiparametric design principle. Only recently, deep HNNs based on deep FFNNs, Convolution Neural Networks (CNN), Long Short-Term Memory (LSTM) networks and Physics Informed Neural Networks (PINNs) have been reported. The biopharma sector is currently a major driver but applications to biologics quality attributes, new modalities, and downstream processing are significant research gaps.