This paper presents a novel approach for indoor acoustic source localization using microphone arrays and based on a Convolutional Neural Network (CNN). The proposed solution is, to the best of our knowledge, the first published work in which the CNN is designed to directly estimate the three dimensional position of an acoustic source, using the raw audio signal as the input information avoiding the use of hand crafted audio features. Given the limited amount of available localization data, we propose in this paper a training strategy based on two steps. We first train our network using semi-synthetic data, generated from close talk speech recordings, and where we simulate the time delays and distortion suffered in the signal that propagates from the source to the array of microphones. We then fine tune this network using a small amount of real data. Our experimental results show that this strategy is able to produce networks that significantly improve existing localization methods based on SRP-PHAT strategies. In addition, our experiments show that our CNN method exhibits better resistance against varying gender of the speaker and different window sizes compared with the other methods.

Intelligent fault diagnosis techniques have replaced the time-consuming and unreliable human analysis, increasing the efficiency of fault diagnosis. Deep learning model can improve the accuracy of intelligent fault diagnosis with the help of its multilayer nonlinear mapping ability. This paper has proposed a novel method named Deep Convolutional Neural Networks with Wide First-layer Kernels (WDCNN). The proposed method uses raw vibration signals as input (data augmentation is used to generate more inputs), and uses the wide kernels in first convolutional layer for extracting feature and suppressing high frequency noise. Small convolutional kernels in the preceding layers are used for multilayer nonlinear mapping. AdaBN is implemented to improve the domain adaptation ability of the model. The proposed model addresses the problem that currently, the accuracy of CNN applied to fault diagnosis is not very high. WDCNN can not only achieve 100% classification accuracy on normal signals, but also outperform state of the art DNN model which is based on frequency features under different working load and noisy environment.

An effective process monitoring strategy is a requirement for meeting the challenges posed by increasingly complex products and manufacturing processes. To address these needs, this study investigates a comprehensive scheme based on classical machine learning methods, deep learning algorithms, and feature extraction and selection techniques. In a first step, a novel deep learning architecture based on convolutional neural networks (CNN) and gated recurrent units (GRU) is introduced to predict the local weld quality based on mid-wave infrared (MWIR) and near-infrared (NIR) image data. The developed technology is used to discover critical welding defects including lack of fusion (false friends), sagging and lack of penetration, and geometric deviations of the weld seam. Additional work is conducted to investigate the significance of various geometrical, statistical, and spatio-temporal features extracted from the keyhole and weld pool regions. Furthermore, the performance of the proposed deep learning architecture is compared to that of classical supervised machine learning algorithms, such as multi-layer perceptron (MLP), logistic regression (LogReg), support vector machines (SVM), decision trees (DT), random forest (RF) and k-Nearest Neighbors (kNN). Optimal hyperparameters for each algorithm are determined by an extensive grid search. Ultimately, the three best classification models are combined into an ensemble classifier that yields the highest detection rates and achieves the most robust estimation of welding defects among all classifiers studied, which is validated on previously unknown welding trials.

The volume of fluid (VOF) method is a popular technique for the direct numerical simulations of flows involving immiscible fluids. A discrete volume fraction field evolving in time represents the interface, in particular, to compute its geometric properties. The height function method (HF) is based on the volume fraction field, and its estimate of the interface curvature converges with second-order accuracy with grid refinement. Data-driven methods have been recently proposed as an alternative to computing the curvature, with particular consideration for a well-balanced input data set generation and symmetry preservation. In the present work, a two-layer feed-forward neural network is trained on an input data set generated from the height function data instead of the volume fraction field. The symmetries for rotations, reflections, and the anti-symmetry for the phase swapping have been considered to reduce the number of input parameters. The neural network, establishing a correlation between curvature and height function values, can efficiently predict the local interface curvature. We compare the trained neural network to the standard Height Function method to assess its performance and robustness.

Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 × 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

Deep underground laboratories offer advantages for conducting high-precision observations of weak geophysical signals, benefitting from a low background noise level. It is both valuable and feasible to enhance strong, noisy ground electromagnetic (EM) field data using synchronously recorded underground EM signals, which typically exhibit a high signal-to-noise ratio. In this study, we propose an EM field reconstruction method employing a Long Short-Term Memory (LSTM) recurrent neural network with referenced deep underground EM observations. Initially, a deep learning model was developed to capture the time-varying features of underground multi-component EM fields using the LSTM recurrent neural network. Subsequently, this model was applied to process synchronously observed strong, noisy data from other conventional observation systems, such as those at surface, to achieve noise suppression through signal reconstructions. Both theoretical analysis and practical observational data suggest that the proposed method effectively suppresses noise and reconstructs clean EM signals. This method is efficient and time-saving, representing an effective approach to fully utilizing the advantages of deep underground observation data. Furthermore, this method could be extended to the processing and analysis of other geophysical data.

Artificial intelligence (AI) is a current trend in computer science, which extends itself its amazing capacities to other technologies such as mechatronics and robotics. Going beyond technological applications, the philosophy behind AI is that there is a vague and potential convergence of artificial manufacture and natural world although the limiting approach may be still very far away, but why? The implicit problem is that Darwin theory of evolution focuses on natural world where breeding conservation is the cornerstone of the existence of creature world but there is no similar concept of breeding conservation in artificial world whose things are created by human. However, after developing for a long time until now, AI issues an interesting concept of generation in which artifacts created by computer science can derive their new generations inheriting their aspects / characteristics. Such generated artifacts make us look back on offsprings by the process of breeding conservation in natural world. Therefore, it is possible to think that AI generation, which is a recent subject of AI, is a significant development in computer science as well as high-tech domain. AI generation does not help us to reach near biological evolution even in the case that AI can combine with biological technology but, AI generation can help us to extend our viewpoint about Darwin theory of evolution as well as there may exist some uncertain relationship between man-made world and natural world. Anyhow AI generation is a current important subject in AI and there are two main generative models in computer science: 1) generative model that applies large language model into generating natural language texts understandable by human and 2) generative model that applies deep neural network into generating digital content such as sound, image, and video. This technical report focuses on deep generative model (DGM) for digital content generation, which is a short summary of approaches to implement DGMs. Researchers can read this work as an introduction to DGM with easily understandable explanations.

With the advancement of technology, signal modulation types are becoming increasingly diverse and complex. The phenomenon of signal time-frequency overlap during transmission poses significant challenges for the classification and recognition of mixed signals, including poor recognition capabilities and low generality. This paper presents a recognition model for fine-grained analysis of mixed signal characteristics, proposing a Geometry Coordinate attention mechanism and introducing a low-rank bilinear pooling module to more effectively extract signal features for classification. The model employs a residual neural network as its backbone architecture and utilizes the Geometry Coordinate attention mechanism for time-frequency weighted analysis based on information geometry theory. This analysis targets multiple-scale features within the architecture, producing time-frequency weighted features of the signal. These weighted features are further analyzed through a low-rank bilinear pooling module, combined with the backbone features, to achieve fine-grained feature fusion. This results in a fused feature vector for mixed signal classification. Experiments were conducted on a simulated dataset comprising 39,600 mixed signal time-frequency plots. The model was benchmarked against a baseline using a residual neural network. The experimental outcomes demonstrated an improvement of 9% in the exact match ratio and 5% in the Hamming score. These results indicate that the proposed model significantly enhances the recognition capability and generalizability of mixed signal classification.

Partial Differential Equations (PDEs) constitute a fundamental framework for modeling various physical phenomena across diverse fields such as physics, engineering, and finance. Solving PDEs accurately and efficiently remains a significant challenge, particularly when dealing with complex systems or high-dimensional data. In this paper, we present a novel approach based on deep learning techniques to investigate the effective factors in solving PDEs. Our methodology leverages the expressive power of deep neural networks to learn and represent the underlying relationships between input parameters and the solutions of PDEs. By incorporating domain knowledge into the network architecture and training process, our approach aims to provide insights into the key factors influencing the solution of PDEs. We demonstrate the effectiveness of our method through numerical experiments on various PDEs, showcasing its capability to identify important features and improve predictive accuracy. Our findings suggest that deep learning techniques offer a promising avenue for understanding and analyzing the complex dynamics inherent in PDEs, paving the way for enhanced computational methods in scientific and engineering applications.

Tunicate orthologs in the human genome comprise just 84 genes of the 19,872 protein-coding genes, yet they stand at the base of the Olfactores clade - which radiated to generate thousands of tunicate and vertebrate species. What were the powerful drivers among the 84 that enabled this process? Many of these orthologs are present in gene families. We discuss the biological role of each family and the orthologs’ quantitative contribution to the family. Most important was the evolution of a second type of cadherin. This, a Type II cadherin, had the property of detaching the cell containing that cadherin from cells that expressed the Type I class. The set of such Type II cadherins could now detach and move away from their Type I neighbours, a process which would eventually evolve into the formation of the neural crest, “ the fourth germ layer”, providing a wide range of possibilities for further evolutionary invention. A second important contribution were key additions to the broad development of the muscle and nerve protein and visual perception tool-kits. These developments in mobility and vision provided the basis for the development of the efficient predatory capabilities of the Vertebrata.

COVID-19, caused by the SARS-CoV-2 virus, has spread around the world and killed around 6.9 million people. Rapid and accurate diagnosis is essential for preventing and controlling the disease, reducing transmission and consequently saving lives. RT-PCR is the gold standard test used to detect the disease. However, the test is expensive and the result is time-consuming, which makes mass testing difficult, especially in countries with limited resources. In addition, the test has high analytical specificity and low diagnostic sensitivity, which leads to false-negative results. Several studies in the literature report the presence of hematological and biochemical alterations in infected patients and use these alterations with machine learning algorithms to help diagnose the disease. Therefore, this article presents the results obtained by different neural network architectures based on Adaptive Resonance Theory (ART) for the diagnosis of COVID-19. The study was conducted in two distinct stages: the first consisted of selecting the best ART network among several, using three open-access datasets and comparing the results with the literature. In the second stage, the chosen model was tested on a dataset containing patients from various hospitals in four countries. In addition, the model was subjected to external validation, including data from a country not present during the training and adjustment of the model, in order to validate the robustness and generalization capacity of the model. The results obtained by the ART networks in this study are promising, outperforming not only classical models, but also the deep learning models often used in the literature. Validation on data from different countries strengthens the model’s reliability and effectiveness.

This paper presents a novel approach to sentiment analysis specifically customized for predicting stock market movements, bypassing the need for external dictionaries which are often unavailable for many languages. Our methodology directly analyzes textual data, with a particular focus on context-specific sentiment words within neural network models. This specificity ensures our sentiment analysis is both relevant and accurate in identifying trends in the stock market. We employ sophisticated mathematical modeling techniques to enhance both the precision and interpretability of our models. Through meticulous data handling and advanced machine learning methods, we leverage large datasets from Twitter and financial markets to examine the impact of social media sentiment on financial trends. We achieved an accuracy exceeding 75%, highlighting the effectiveness of our modeling approach, which we further refined into a convolutional neural network model. This achievement contributes valuable insights into sentiment analysis within the financial domain, thereby improving the overall clarity of forecasting in this field.

In this essay, I revisit Neural Networks (NNs) through the lens of evolutionary dynamics. From the two most important features of NNs, I recover the two most general equations of evolutionary dynamics. These two equations may thus serve as a connection between NNs and a body of knowledge that has been built over multiple centuries and has found application across a vast range of disciplines. This connection may therefore also help explain why NNs with the two features in question are applicable across a much broader range of domains than initially envisioned.

End-to-end learned image compression codecs have notably emerged in recent years. These codecs have demonstrated superiority over conventional methods, showcasing remarkable flexibility and adaptability across diverse data domains while supporting new distortion losses. Despite challenges such as computational complexity, learned image compression methods inherently align with learning-based data processing and analytic pipelines due to their well-suited internal representations. The concept of Video Coding for Machines has garnered significant attention from both academic researchers and industry practitioners. This concept reflects the growing need to integrate data compression with computer vision applications. In light of these developments, we present a comprehensive survey and review of lossy image compression methods. Additionally, we provide a concise overview of two prominent international standards, MPEG Video Coding for Machines and JPEG AI. These standards are designed to bridge the gap between data compression and computer vision, catering to practical industry use cases.

Quantum computing (QC) has opened the door to advancements in machine learning (ML) tasks that are currently implemented in the classical domain. Convolutional neural networks (CNNs) are classical ML architectures that exploit data locality and possess a simpler structure than fully-connected multi-layer perceptrons (MLPs) without compromising the accuracy of classification. However, the concept of preserving data locality is usually overlooked in the existing quantum counterparts of CNNs, particularly for extracting multi-features in multidimensional data. In this paper, we present a multidimensional quantum convolutional classifier (MQCC) that performs multidimensional and multi-feature quantum convolution with average and Euclidean pooling and thus adapting the CNN structure to a variational quantum algorithm (VQA). Average pooling is based on the quantum Haar transform (QHT) and Euclidean pooling is based on partial quantum measurement. The experimental work was conducted using multidimensional data to validate the correctness and demonstrate the scalability of the proposed method utilizing both noisy and noise-free quantum simulations. We evaluated the MQCC model with reference to reported work on state-of-the-art quantum simulators from IBM Quantum and Xanadu using a variety of standard ML datasets. The experimental results showed favorable characteristics of our proposed techniques compared to existing work with respect to a number of quantitative metrics such as the number of training parameters, cross-entropy loss, classification accuracy, circuit depth, and quantum gate count.

Ensuring optimal performance and reliability in rotor-bearing systems is crucial for industrial applications. Imbalance and shaft bow in these systems can lead to decreased efficiency and increased vibrations. Early detection and mitigation of a rotor’s faults are essential, and model-based fault identification has gained much attention in the manufacturing industry for years. Over the past two decades, however, the development of fault diagnosis rules with data-driven and artificial intelligence (AI) has become a trend, and in the foreseeable future, AI combined with big data will become mainstream. Nevertheless, the critical role of rotating machinery in manufacturing introduces a challenge, as the availability of fault data is often insufficient. This limitation renders the establishment of diagnostic rules using data-driven methods and AI technologies impractical. In light of these challenges, this study proposes a novel hybrid approach, that combines a physical model with machine learning (ML) techniques for the diagnosis of multi-faults (imbalance and shaft-bow demonstrated) in a Jeffcott rotor. To overcome the lack of real-world faulted, labeled datasets, a physics-based Jeffcott rotor model is first derived and then used to generate abundant fault datasets for ML. Subsequently, simulated data are employed for the training of an artificial neural network (ANN), enabling the network to learn from and analyze the vast array of generated data. The results prove that a well-trained feed-forward neural network (FNN) can accurately isolate and diagnose the imbalance and shaft-bow faults using the simulated data and the real data from the Jeffcott rotor experiment. These physics-based and ML approaches prove effective particularly for multi-fault, offering new possibilities for advanced rotor system monitoring and maintenance strategies in industrial applications.

This paper proposed an optimal tracking control scheme through adaptive dynamic programming(ADP) for a class of partially unknown discrete-time nonlinear systems based on radial basis function neural network(RBF-NN). In order to acquire the unknown system dynamics, we use two RBF-NNs, the one is used to construct the identifier, and the another is used to directly approximate the steady-state control input, where a novel adaptive law is proposed to update neural network weights. While the optimal feedback control and the cost function are derived via feedforward neural networks approximating, it is proposed to regulate the tracking error, the critic network and the actor network are then trained online to obtain the solution of the associated Hamilton–Jacobi–Bellman (HJB) equation being built under the ADP framework. Simulations verify the effectiveness of the optimal tracking control technique using the neural networks.

When dealing with limited sample sizes or missing values in time series data, achieving high accuracy in forecasting becomes challenging. This challenge is particularly common in wind energy forecasting, where many wind farms lack complete data. In this paper, we employ the widely-used ARIMA (Autoregressive Integrated Moving Average) model for time series forecasting. To address the difficulties posed by limited sample sizes and missing values, we adopt a unique approach by utilizing multiple ARIMA models for different datasets. A key distinction from other multiple models methods for time series forecasting lies in each model within our approach using its own dataset, making the fusion process more intricate. To overcome this, we incorporate neural networks and two techniques for model fusion: direct fusion with a learning mechanism and compensation for missing data through training. For each ARIMA model, we introduce a noise estimation method to circumvent the white noise assumptions inherent in ARIMA models. Finally, we apply these methods to wind energy prediction, and our experimental results showcase a significant enhancement in forecasting accuracy.

The speed-density or flow-density relationship is a fundamental aspect of traffic flow theory. Single-regime models often face challenges in consistently fitting empirical data under diverse traffic conditions. This paper addresses the inaccuracies of single-regime models, attributing them not only to their functional forms but also to data dispersion and sample selection bias. To mitigate these issues, the data is segmented into day and night periods, leading to the creation of separate models for each. Calibration results, conducted on data from two freeways, Tehran-Karaj and Tehran-Qom, reveal distinct challenges, with the former exhibiting high dispersion and the latter showing low dispersion. Surprisingly, single-regime models demonstrate notable effectiveness when applied to distinct day and night data. Further analysis, categorizing data into day and night, results in reduced errors (20-60% improvement in R-Square), emphasizing the potential for enhanced accuracy by considering distinct regimes. Overall, the study underscores the significance of regime-specific considerations for accurate traffic flow modeling. Upon thorough evaluation, the study highlights the superiority of the neural network Multi-layer Perceptron (MLP) over traditional models. The research discusses the implications of incorporating day and night parameters into the models, emphasizing their potential for accuracy enhancement.

Considering that cryptocurrencies are now present in practically every financial transaction because they are widely accepted as an alternate means of making payments and exchanging currencies, academics and economists have more opportunities to study cryptocurrency prices. Over the years, investors, traders and investment banks have found it difficult to predict the closing daily price of Ethereum due to its rapid price fluctuation. The daily closing price of cryptocurrency is essential to consider when trading or investing in Ethereum. This report focuses on carrying out a comparative study of the predictive capabilities of deep machine learning algorithms with a stacking ensemble modelling framework using daily historical observations of the price of Ethereum obtained from Coindesk, tweets extracted from Twitter ranging from the 1st of August 2022 to the 8th of August 2022 and other five covariates (closing price lag1, closing price lag2, noltrend, daytype and month) engineered from the closing price of Ethereum. Seven models are used to compute the forecasts for the daily closing price of Ethereum; these are the recurrent neural network, ensemble stacked recurrent neural network, gradient boosting machine, generalized linear model, distributed random forest, deep neural networks and stacked ensemble for gradient boosting machine, generalized linear model, distributed random forest and deep neural networks. The main evaluation metric used is the mean absolute error. According to MAE, RNN forecasts outperform the other model’s forecasts in this study, producing an MAE of 0.0309.

Red mud (RM), a bauxite residue, contains hazardous radioactive wastes and alkaline material and poses severe surface water and groundwater contamination risks, necessitating recycling. Pretreated RM can be used to make adsorbents for water treatment. However, its performance is affected by many factors, resulting in a nonlinear correlation and coupling relationship. This study aimed to identify the best formula for an RM adsorbent using a mathematical model that examines the relationship between 11 formulation types (e.g., pore-assisting agent, component modifier, and external binder) and nine properties (e.g., specific surface area, wetting angle, and Zeta potential, among others). This model was built using a back-propagation neural networks(BP) based on single-factor experimental data and orthogonal test data. The model trained and predicted the established network structure to obtain the optimal adsorbent formula. The RM particle adsorbents had a pH of 10.16, specific surface area(BET) of 48.92 m2·g−1, pore volume of 2.10 cm3·g−1, compressive strength(ST)) of 1.12 KPa, and 24-h immersion pulverization rate(η_m) of 3.72%. In the removal of total phosphorus in flotation tailings backwater, it exhibited a good adsorption capacity (Q)and total phosphorous removal rate(η) of 48.63 mg·g−1 and 95.13%, respectively.

The implementation of neural networks (NN) on edge devices enables local processing of wireless data but faces challenges such as high computational complexity and memory requirements when deep neural networks (DNN) are used. Shallow neural networks customized for specific problems are more efficient, requiring fewer resources, and resulting in a lower latency solution. An additional benefit of the smaller network size is that it is suitable for real-time processing on edge devices. The main concern with shallow neural networks is their accuracy performance compared to DNNs. In this paper, we demonstrate that a customized adaptive activation function (AAF) can meet the accuracy of a DNN. We designed an efficient FPGA implementation for a customized segmented spline curve neural network (SSCNN) structure to replace the traditional fixed activation function with an AAF. We compared our SSCNN with different neural network structures such as real-valued time delay neural network (RVTDNN), augmented real-valued time delay neural network (ARVTDNN), and deep neural networks with different parameters. Our proposed SSCNN implementation uses 40% fewer hardware resources and no Block RAMS compared to the DNN with similar accuracy. We experimentally validate this computationally efficient and memory-saving FPGA implementation of SSCNN for digital predistortion of RF power amplifiers using the AMD/Xilinx RFSoC ZCU111. The implemented solution uses less than 3% of the available resources. The solution also enables an increase of the clock frequency to 221.12 MHz, allowing the transmission of wide bandwidth signals.

With the recent advances in Machine Learning (ML), several models have been successfully applied to financial and accounting data to predict the likelihood of companies’ bankruptcy. However, time series have received little attention in literature with a lack of studies on the application of Deep Learning sequence models as Recurrent Neural Networks (RNN) and the recent Attention-based models in general. In this research work, we investigated the application of Long Short Term Memory (LSTM) networks to exploit time series of accounting data for bankruptcy prediction. The main contributions of our work are the following: a) we have proposed a Multi-head LSTM that models each financial variable in a time window independently and compared it with a single-input LSTM and other traditional ML models. The Multi-head LSTM outperforms all the other models; b) We identify the optimal time series length for bankruptcy prediction to be equal to 4 years of accounting data; c) We made public the dataset we used for the experiments that include data from 8262 different public companies in the American stock market generated in the period between 1999-2018. Furthermore, we prove the efficacy of the Multi-head LSTM models in terms of lower false positives and better division of the two classes.

This paper presents a customized adaptive cascaded deep learning (ACDL) model for the design and performance prediction of metasurface absorbers. A multi-resonant metasurface absorber structure is introduced, with 10 target-driven design parameters. The proposed deep learning model takes advantage of cascading several sub-deep neural network (DNN) layers with forward noise mitigation capability. The inherent appearance of sparse data is completely dealt with in this work by proposing a trained adaptive selection technique. On the basis of the findings, the prediction response is quite fast and accurate enough to retrieve the design parameters of the studied metasurface absorber and with two sized patches of 4000 and 7000 datasets. The training loss taken form the second DNN of our proposed model shows logarithmic mean squared errors of 0.039 and 0.033 when using Keras and the adaptive method, respectively, with a dataset split of 4000. On the contrary, for a dataset split of 7000, the errors are 0.049 with Keras and 0.045 with the adaptive method. On the other hand, the validation loss is evaluated using the mean square error method, which results in a loss with 4000 datasets split with the Keras method of 0.044, while it is 0.020 with the adaptive method. When extending the dataset to 7000, the validation loss with the keras splitting method is 0.0073, while it is improved, reaching 0.006 with the proposed adaptive method, and achieving a prediction accuracy of 94%. This proposed deep learning model can be deployed in the design process and synthesis of multi-resonant metasurface absorber structures. The proposed model shows its advantages of making the design process more efficient in sparse dataset handling, efficient approach in multi-resonance metasurface data pre-processing, less time consuming, and computationally valuable.

Seawater density is an important physical property in oceanography that affects the accuracy of calculations such as gravity fields and tidal potentials, and the calibration of acoustic and optical oceanographic sensors. In related studies, constant density values are frequently used, which can introduce significant errors. Therefore, this study employs a basic convolutional neural network model to construct a comprehensive model showing the seawater density distribution across the globe. The model takes into account depth, latitude, longitude, and month as inputs. Numerous real seawater datasets were used to train the model, and it has been shown that the model has an absolute mean error and root mean square error of less than 2 kg/m3 in 99% of the test set samples. The model effectively demonstrates the influence of input parameters on the distribution of seawater density. In this paper, we present a newly developed global model for distributing seawater density which is both comprehensive and accurate, surpassing previous models. The utilization of the model presented in this paper for estimating seawater density can minimize errors in theoretical ocean models and serve as a foundation for designing and analyzing ocean exploration systems.

Photovoltaic systems and wind energy systems are generally used in distributed system. However, zero-sequence and harmonic currents occur due to photovoltaic systems, and positive-sequence harmonic currents occur due to wind turbines. Thus, the sheath current in high voltage cables increases due to these currents and poor power quality in distributed generation plants. Metal parts of the cable are grounded to prevent the negative effects of sheath currents. When long high voltage cable lines are grounded with the method in the literature, high sheath current and voltage occur on the cable sheath. Therefore, the SSBLR method is designed as a new method for the distributed generation system. The SSBLR method has been optimized with prediction methods and multi-objective optimization methods to prevent negative effects of the sheath current. Pareto optimal method is used as multi-objective optimization method, and artificial neural network, hybrid artificial neural network and regression methods are used as prediction method. The most dominant result is searched using different estimation and optimization methods in pareto optimal method. When the artificial neural network-genetic algorithm hybrid method is used as a prediction method, and genetic algorithm used as optimization method, significant decreases are observed in sheath current and voltage.

In this study, tree selection/plantation DSS (Decision Support Systems) were reviewed and assessed based on essential objectives in the available literature. We reviewed existing DSS using multiple data sources and available online resources such as web interfaces. We compared the existing DSS, focusing primarily on five primary objectives in this study, which DSS may address when it comes to the tree selection, including a) Climate resilience, b) Infrastructure/Space Optimization, c) Agroforestry, d) Ecosystem services, e) Urban sustainability. Climate resilience of tree species and urban sustainability is addressed relatively less in existing systems, which can be holistically internalized in future DSS tools Based on this review, DNN (Deep Neural Networks) is recommended to address achieving trade-offs between complex objectives such as maximizing ecosystem services, climate resilience of tree species, maintaining Agroforestry, and other benefits.

This proposed research explores a novel approach to image classification by deploying a complex-valued neural network (CVNN) on a field-programmable gate array (FPGA), specifically for classifying 2D images transformed into polar form. The aim of this research is to address the limitations of existing neural network models in terms of energy and resource efficiency, by exploring the potential of FPGA-based hardware acceleration in conjunction with advanced neural network architectures like CVNNs. The methodological innovation of this research lies in the Cartesian to polar transformation of 2D images, effectively reducing the input data volume required for neural network processing. Subsequent efforts focused on constructing a CVNN model optimized for FPGA implementation, emphasizing the enhancement of computational efficiency and overall performance. The experimental findings provide empirical evidence supporting the efficacy of the image classification system developed in this study. One of the developed models, CVNN_128, achieves an accuracy of 88.3% with an inference time of just 1.6ms and a power consumption of 4.66mW for the classification of the MNIST test dataset consists of 10,000 frames. While there is a slight concession in accuracy compared to recent FPGA implementations that achieve 94.43%, our model significantly excels in classification speed and power efficiency—surpassing existing models by more than a factor of 100. In conclusion, the paper demonstrates the substantial advantages of FPGA-implementation of CVNNs for image classification tasks, particularly in scenarios where speed, resource, and power consumption are critical. The study’s reproducible results and corresponding code are available on GitHub at the following link: https://github.com/mahmad2005/CVNNonFPGA

Seismic velocity inversion is one of the most critical issues in the field of seismic exploration and has long been the focus of numerous experts and scholars. In recent years, the advancement of machine learning technologies has infused new vitality into the research of seismic velocity inversion and yielded a wealth of research outcomes. Typically, seismic velocity inversion based on machine learning lacks control over physical processes and interpretability. Starting from wave theory and the physical processes of seismic data acquisition, this paper proposes a method for seismic velocity model inversion based on Physical Embedding Recurrent Neural Networks. Firstly, the wave equation is a mathematical representation of the physical process of acoustic waves propagating through a medium, and the finite difference method is an effective approach to solving the wave equation. With this in mind, we introduce the architecture of recurrent neural networks to describe the finite difference solution of the wave equation, realizing the embedding of physical processes into machine learning. Secondly, in seismic data acquisition, the propagation of acoustic waves from multiple sources through the medium represents a high-dimensional causal time series (wavefield snapshots), where the influential variable is the velocity model, and the received signals are the observations of the wavefield. This forms a forward modeling process as the forward simulation of the wavefield equation, and the use of error back-propagation between observations and calculations as the velocity inversion process. Through time-lapse inversion and incorporating the causal information of wavefield propagation, the non-uniqueness issue in velocity inversion is mitigated. Through mathematical derivations and theoretical model analyses, the effectiveness and rationality of the method are demonstrated. In conjunction with simulation results for complex models, the method proposed in this paper can achieve velocity inversion in complex geological structures.

Against the backdrop of the current carbon peaking and carbon neutrality policies, higher requirements have been put forward for the upgrading and construction of smart grids. Non-intrusive load monitoring (NILM) technology is a key technology for advanced measurement systems at the end of the power grid. It obtains detailed power information of the load, without the need for traditional hardware deployment. The key step to solve this problem is load decomposition and identification. This paper first utilized Long Short Term Memory-Denoising Autoencoder(LSTM-DAE) to decompose the mixed current signal on the household busbar and obtain the current signals of multiple independent loads that constituted the mixed current. Then, the obtained independent current signals were combined with voltage signals to generate multi-cycle colored Voltage-Current(VI) trajectories, which were color-coded according to the background. These colored VI trajectories with background colors formed a feature library. When the CNN network was used for load recognition, considering the influence of hyperparameters on recognition results, the BOA algorithm was used for optimization, and the optimized CNN network was employed for VI trajectory recognition. Finally, the proposed method was validated using the PLAID dataset. Experimental results showed that the proposed method exhibited better performance in load decomposition and identification.

The power system has rapidly grown and expanded over the past decades and has been experiencing major changes and challenges. The increase in energy demand and the modern advancements in the smart grid, such as solar and wind energies and electric vehicles, have led to complexity and complications for utilities. A further layer of complexity and difficulty was added by the rapid expansion of behind-the-meter (BTM) photovoltaic (PV) systems with various designs and characteristic features. The rapid increase and the invisible solar power (BTM) have led to fluctuations in power grid stability and reliability and to inefficiency. Accurate forecasting of load generation will help to assure optimal planning, minimize the negative effects of the PV systems, and minimize the operational and maintenance costs. The authors propose a solution that uses combinations of K-means clustering with neural network machine learning models, AMI real-world PV load generation, and weather data to forecast the generation load at customer locations to achieve a 2.49% error between actual and predicted generation load.

The study aims to analyze the characteristic parameters of rooftop photovoltaic (PV) power generation on industrial plant buildings in the Ningxia region of China, in order to evaluate the impact of passive design characteristic parameters on the benefits of PV power generation and determine the degree of impact of different passive design characteristic parameters. The methodology involves analyzing the characteristics of existing industrial plant buildings in Ningxia, China, and conducting a series of regional studies on the parameters of plant PV power generation influencing factors. The simulation results revealed that five features, including roof form, PV panel laying pattern, PV panel laying area, azimuth angle, and PV module material, have a significant impact on PV power generation benefits of industrial plant buildings.The study further uses MATLAB 2022b to build a backpropagation neural network model with 5 neurons in the implicit layer to predict the PV power generation benefits. The model calculates the whole-life cycle power generation benefits and the whole-life cycle reduction of carbon emissions as output data. Finally, the Mean Impact Value (MIV) method is employed to select the feature parameter values one by one within their range, and the passive design feature parameters that have the greatest influence on the prediction results are identified as the PV panel laying method, the PV panel tilt angle, and the PV material parameters, respectively.

Applications of gradient method for nonlinear optimization in development of Gradient Neural Network (GNN) and Zhang Neural Network (ZNN) are investigated. Particularly, the solution of the matrix equation AXB=D which changes over time is studied using the novel GNN model, termed as GGNN(A,B,D). The GGNN model is developed applying GNN dynamics on the gradient of the error matrix used in the development of the GNN model. The convergence analysis shows that the neural state matrix of the GGNN(A,B,D) design converges asymptotically to the solution of the matrix equation AXB=D, for any initial state matrix. It is also shown that the convergence result is the least square solution which is defined depending on the selected initial matrix. A hybridization of GGNN with analogous modification GZNN of the ZNN dynamics is considered. The Simulink implementation of presented GGNN models is carried out on the set of real matrices.

We aim to map the ESG patterns of emerging-market companies from 2018 to 2021 in order to determine whether the COVID-19 pandemic exerted any influence on sustainable corporate behavior. Thus, the ESG performances were assessed by applying the Kohonen neural network for clustering purposes at three main levels: i) ESG overall, including country and sectoral perspectives; ii) ESG thematic; and iii) ESG four-folded (stakeholder, perspective, management level, and focus strategic views). Our results show that emerging-market companies focus their ESG efforts on social and governance issues rather than on environmental. However, environmental, and social behavior differ more acutely than governance behavior across clusters. The ESG pillars country-level and eleven market-based economic sectors analysis corroborate the geographic and sector dependence of ESG performance. The thematic-level analysis indicate that operational activities and community issues received more attention, which suggests that emerging-market companies address distinct ESG topics according to their particularities and competitiveness. Furthermore, our empirical findings provide evidence that the ESG behavior of companies has changed over the course of the COVID-19 pandemic. Thus, our findings are relevant to policymakers involved in regulating ESG disclosure practices, investors focused on enhancing their sustainable investment strategies, and firms engaged in improving their ESG involvement.

This paper presents a novel approach for the recognition of multiple sclerosis (MS) using wavelet entropy and a Particle Swarm Optimization (PSO)-based neural network. MS is a complex neurological disorder with diverse clinical manifestations, often challenging to diagnose accurately. In this study, we leverage wavelet entropy (WE) as a feature extraction method to capture intricate patterns within brain imaging data. These extracted features are then employed to train a neural network model optimized through PSO to enhance classification accuracy. Experimental results on a dataset comprising MS and healthy control subjects demonstrate the effectiveness of our proposed approach, viz., WE-PSONN, which achieves a sensitivity of 91.95±1.15, a specificity of 92.36±0.88, a precision of 92.28±0.88, an accuracy of 92.16±0.90. The combination of advanced signal processing techniques and machine learning optimization holds promise for improving the early diagnosis and management of MS, offering potential benefits to both patients and healthcare providers.

In this research, we present a comprehensive methodology to categorize perfumes based on their fragrance profiles and subsequently aid in creating innovative odoriferous molecules using advanced neural networks. Drawing from data on Parfumo and the Good Scents Company webpage (Parfumo, 2008; The Good Scents Company, 2021), the study employs sophisticated web scraping techniques to gather diverse perfume attributes. Following this, a k-means algorithm is applied for perfume clustering, paving the way for recommending similar scents to consumers. The process then bridges customer preferences to molecular design by incorporating their feedback into generating new molecules via graph neural networks (GNNs). Through converting the Simple Molecular Input Line Entry System (SMILES) representation into graph structures, the GNN facilitates the creation of new molecular designs attuned to consumer desires. The proposed approach offers promising avenues for consumers to pinpoint similar perfume choices, incorporating feedback, and for manufacturers to conceptualize new fragrant molecules with a high likelihood of market resonance.

During the 1950s, the Gros Michel species of bananas were nearly wiped out by the incurable Fusarium Wilt, also known as Panama Disease. Originating in Southeast Asia, Fusarium Wilt is a banana pandemic that has been threatening the multi-billion-dollar banana industry worldwide. The disease is caused by a fungus that spreads rapidly throughout the soil and into the roots of banana plants. Currently, the only way to stop the spread of this disease is for farmers to manually inspect and remove infected plants as quickly as possible, whereas it is a time-consuming process. The main purpose of this study is to build a deep Convolutional Neural Network (CNN) using a transfer learning approach to rapidly identify fusarium wilt infections on banana crop leaves. We chose to use the ResNet50 architecture as the base CNN model for our transfer learning approach owing to its remarkable performance in image classification, which was demonstrated through its victory in the ImageNet competition. After its initial training and fine-tuning on a data set consisting of 300 healthy and diseased images, the CNN model achieved near-perfect accuracy of 0.99 and was fine-tuned to adapt the ResNet base model. ResNet50’s distinctive residual block structure could be the reason behind these results. To evaluate this CNN model, 500 test images, consisting of 250 diseased and healthy banana leaf images, were classified by the model. The deep CNN model was able to achieve an accuracy of 0.98 and an F-1 score of 0.98 by correctly identifying the class of 492 of the 500 images. These results show that this DCNN model outperforms existing models such as Sangeetha et al., 2023’s deep CNN model by at least 0.07 in accuracy and is a viable option for identifying Fusarium Wilt in banana crops.

The cities of the future are places of sustainable mobility and a continuous reduction in the amount of harmful substances entering the surrounding environment. Current emission models are mainly dedicated to fully combustion vehicles and do not fully reflect the actual emissions of vehicles in the fleet, which is becoming increasingly diverse. The increasing share of hybrid and electric vehicles is generating the need to measure emissions and energy consumption from these vehicles and to develop new emission models that are accurate. This problem mainly concerns low-emission zones in cities, where mobility planning should be based on simulation models that are based on a continuously updated database. This work concerns the proposal of a two-dimensional model of emissions from hybrid vehicles using artificial neural networks for low-emission zones. The results can be used to further develop such emission models.

Landslide is one of the most common geological disasters in China, which is characterized by suddenness and uncertainty, and it is difficult to realize accurate identification, early warning and forecasting of landslide disaster by conventional means. With the development of high-resolution remote sensing satellites and InSAR surface deformation monitoring technology, the traditional means of landslide monitoring data sources are limited, and there is a lack of effective methods to excavate the characteristics of the spatial distribution of landslide hazards and their triggering factors and other issues. In this paper, the area extending 10 km outside the VII isobar of the Gengma earthquake is taken as the study area, and 13 evaluation factors are screened out by integrating the factors of InSAR surface deformation, topography and geological environment, and the Bayesian Optimized Convolutional Neural Network (BO-CNN) is used for the evaluation of landslide susceptibility, and the BO-RF and PSO-SVM models are selected for the comparative analysis. The model accuracy evaluation was carried out by three indexes: ROC curve, AUC value and FR value, in which the ROC curves of PSO-SVM, BO-RF and BO-CNN were all close to the upper-left corner of the corner, and the AUC values were 0.9388, 0.9529, and 0.9535, respectively, and the FR value of landslide in the high susceptibility area of BO-CNN was as high as 14.9, and was higher than that of PSO-SVM and BO-RF, respectively. SVM and BO-RF model is 4.55 and 3.69 higher, the experimental results show that the BO-CNN model used in this paper has a better effect in landslide susceptibility evaluation, and the research results of the local government's disaster prevention and mitigation measures are of great significance.

Recently, deep learning models have been widely applied to modulation recognition, which have become a hot topic due to their excellent end-to-end learning capabilities. However, current methods are mostly based on uni-modal inputs, which suffer from incomplete information and local optimization. To complement the advantages of different modalities, we focus on the multi-modal fusion method. Therefore, we introduce an iterative dual-scale attentional fusion (iDAF) method to integrate multimodal data. Firstly, two feature maps with different receptive field sizes are constructed using local and global embedding layers. Secondly, the feature inputs are iterated into the Iterative Dual Scale Attention Module (iDCAM), where the two branches capture the details of high-level features and the global weights of each modal channel, respectively. The iDAF not only extracts the recognition characteristics of each specific domains, but also complements the strengths of different modalities to obtain a fruitful view. Our iDAF achieves a recognition accuracy of 93.5\% at 10dB and 0.6232 at full SNR. The comparative experiments and ablation studies effectively demonstrate the effectiveness and superiority of the iDAF.

In order to assess the degradation state of rolling bearings and accurately grasp the remaining life information of rolling bearings, a bearing remaining life prediction method based on the grey wolf optimization algorithm to improve the BP neural network model is proposed. The method consists of two steps, firstly, using the craggy value and root mean square value to determine the first failure time of rolling bearings so as to approximate the input features, and secondly, using the Grey Wolf optimization algorithm to optimize the BP neural network to construct the degradation model of the bearings through machine learning. The method reduces the prediction error compared with conventional techniques, indicating that the method can effectively simulate the bearing degradation process and predict the remaining useful life (RUL) of the bearing.

In this research, the application of the Physics-Informed Neural Network (PINN) model is explored to solve transport equation-based Partial Differential Equations (PDEs). The primary objective is to analyze the impact of different activation functions incorporated within the PINN model on its predictive performance, specifically assessing the Mean Squared Error (MSE) and Mean Absolute Error (MAE). The dataset used in the study consists of a varied set of input parameters related to strut diameter, unit cell size, and the corresponding yield stress values. Through this investigation, the aim is to understand the effectiveness of the PINN model and the significance of choosing appropriate activation functions for solving complex PDEs in real-world applications. The outcomes suggest that the choice of activation function may have minimal influence on the model's predictive accuracy for this particular problem. The PINN model showcases exceptional generalization capabilities, indicating its capacity to avoid overfitting with the provided dataset. The research underscores the importance of striking a balance between performance and computational efficiency while selecting an activation function for specific real-world applications. These valuable findings contribute to advancing the understanding and potential adoption of PINN as an effective tool for solving challenging PDEs in diverse scientific and engineering domains.

In urban Vehicular Ad Hoc Network (VANET) environments, buildings play a crucial role as they can act as obstacles that attenuate the transmission signal between vehicles. Quantifying the impact of buildings on the transmission quality is essential, especially in critical scenarios involving emergency vehicles, where reliable communication is of utmost importance. In this research, we propose a supervised learning approach based on artificial neural networks (ANNs) to develop a predictive model capable of estimating the level of signal degradation, represented by the bit error rate (BER), based on the obstacles perceived by moving emergency vehicles. By establishing a relationship between the level of signal degradation and the encountered obstacles, our proposed mechanism enables efficient routing decisions to be made prior to the transmission process. Consequently, data packets are routed through paths that exhibit the lowest BER. To gather the necessary training data, we employed SUMO and NS-3 simulations. The simulation results demonstrate that our developed model successfully learns and accurately estimates the BER for new data instances. Overall, our research contributes to enhancing the performance and reliability of communication in urban VANET environments, especially in critical scenarios involving emergency vehicles, by leveraging supervised learning and artificial neural networks to predict signal degradation levels and optimize routing decisions accordingly.

The mutton sheep breeding industry has transformed significantly in recent years, from traditional grassland free-range farming to a more intelligent approach. As a result, automated sheep face recognition systems have become vital to modern breeding practices and have gradually replaced ear tagging and other manual tracking techniques. Although sheep face datasets have been introduced in previous studies, they have often involved pose or background restrictions (e.g., fixing of the subject’s head, cleaning of the face), which restrict data collection and have limited the size of available sample sets. As a result, a comprehensive benchmark designed exclusively for the evaluation of individual sheep recognition algorithms is lacking. To address this issue, this study develops a large-scale benchmark dataset, Sheepface-107, comprised of 5,350 images acquired from 107 different subjects. Images were collected from each sheep at multiple angles, including front and back views, in a diverse collection that provides a more comprehensive representation of facial features. In addition to the dataset, an assessment protocol is developed by applying multiple evaluation metrics to the results produced by three different deep learning models: VGG16, GoogLeNet, and ResNet50, which achieved F1-scores of 83.79%, 89.11%, and 93.44%, respectively. A statistical analysis of each algorithm suggested that accuracy and the number of parameters were the most informative metrics for use in evaluating recognition performance.

To digital grade the color fastness of fabrics after rubbing, an automatic grading method based on spectral reconstruction technology and BP neural network was proposed. Firstly, the modeling samples are prepared by rubbing the fabrics according to the ISO standard of 105-X12. Then, to comply with visual rating standards for color fastness, the modeling samples are professionally graded to obtain the visual rating result. After that, a digital camera is used to capture digital images of the modeling samples inside a closed and uniform lighting box, and the color data values of the modeling samples are obtained through spectral reconstruction technology. Finally, the color fastness prediction model for rubbing was constructed using the modeling samples data and BP neural network. The color fastness level of the testing samples was predicted using the prediction model, and the prediction results were compared with the existing color difference conversion method and curve fitting method. Experimental show that the prediction model of fabric color fastness can be better constructed using the BP neural network, where the root-mean-square error of the prediction for the training sample is 0.30, and the root-mean-square error of the prediction for the test sample is 0.25. The overall performance of the method is slightly better than the color difference conversion method, and it is significantly outperforming the curve fitting method. It can be seen that the digital rating method of fabric color fastness to rubbing based on spectral reconstruction and BP neural network has a high consistency with the visual evaluation, which will help for the automatic color fastness grading.

The most frequent, noticeable, and frequent natural calamity in the karakoram region is landslides. Extreme landslides have occurred frequently along Karakoram highway, particularly during the monsoon, causing a major loss of life and property. Therefore, it was necessary to look for a solution to increase growth and vigilance in order to lessen losses related to landslides caused by natural disasters. By utilizing contemporary technologies, an early warning system might be developed. Artificial neural networks (ANNs) are widely used nowadays across many industries. This paper's major goal is to provide new integrative models for assessing landslide susceptibility in a prone area of north of Pakistan. To do this, the training of an artificial neural network (ANN) is supervised using metaheuristic and Bayesian techniques: particle swarm optimization algorithm (PSO), Genetic algorithm (GA), Bayesian optimization Gaussian process (BO_GP), and Bayesian optimization Gaussian process (BO_TPE). 304 previous landslides and the eight most prevalent conditioning elements combine to form a geographical database. The models are hyper-parameter optimized, and the best ones are employed to generate the susceptibility maps. The area under the receiving operating characteristic curve (AUROC) accuracy index found demonstrated that the maps produced by both Bayesian and metaheuristic algorithms are highly accurate. The effectiveness and efficiency of applying artificial neural networks (ANNs) for landslide mapping, susceptibility analysis, and forecasting are studied in this research it’s observed from experimentation that the performance differences for GA, BO_GP, and PSO compared to BO_TPE are relatively small, ranging from 0.3166% to 1.8399%. This suggests that these techniques achieved comparable performance to BO_TPE in terms of AUC. However, it's important to note that the significance of these differences can vary depending on the specific context and requirements of the ML task. Additionally in this study, we explore eight feature selection algorithms to determine the geospatial variable importance for landslide susceptibility mapping along the KKH. The algorithms considered include Information Gain, Gain Ratio, OneR Classifier, Subset Evaluators, Principal Components, Relief Attribute Evaluator, Correlation, and Symmetrical Uncertainty. These algorithms enable us to evaluate the relevance and significance of different geospatial variables in predicting landslide susceptibility. By applying these feature selection algorithms, we aim to identify the most influential geospatial variables that contribute to landslide occurrences along the KKH. The algorithms encompass a diverse range of techniques, such as measuring entropy reduction, accounting for attribute bias, generating single rules, evaluating feature subsets, reducing dimensionality, and assessing correlation and information sharing. The findings of this study will provide valuable insights into the critical geospatial variables associated with landslide susceptibility along the KKH. These insights can aid in the development of effective landslide mitigation strategies, infrastructure planning, and targeted hazard management efforts. Additionally, the study contributes to the field of geospatial analysis by showcasing the applicability and effectiveness of various feature selection algorithms in the context of landslide susceptibility mapping.

Deep learning is improving by leaps and bounds in remote sensing images (RSIs) analysis, pre-trained convolutional neural networks (CNNs) have shown remarkable performance in remote sensing image scene classification (RSISC). Nonetheless, pre-trained CNNs require massive annotated data as samples for data training. When labeled samples are not sufficient, the most common solution is to the pre-trained CNNs using a great deal of natural image dataset (e.g. ImageNet). However, these pre-trained CNNs require a large quantity of labelled data for training, which is often not feasible in RSISC, especially when the target RSIs have different imaging mechanisms from RGB natural images. In this paper, we proposed an improved hybrid classical-quantum transfer learning CNNs composed of classical and quantum elements to classify open-source RSI dataset. The classical part of the model is made up of a ResNet network which extracts useful features from RSI datasets. To further refine the network performance, a tensor quantum circuit is subsequently employed by tuning parameters on near-term quantum processors. We tested our models on open-source RSI dataset. In our comparative study, we have concluded that the hybrid classical-quantum transferring CNN has achieved better performance than other pre-trained CNNs based RSISC methods with small training samples. Moreover, it has been proved that the proposed algorithm improves the classification accuracy while greatly decreasing sum of model parameters and sum of training data.

This study addresses the challenge of assessing the carcinogenic potential of hazardous chemical mixtures, such as PFAS, which are known to contribute significantly to cancer development. Here, we propose a novel framework called HNNMixCancer that utilizes a Hybrid Neural Network (HNN) integrated into a machine-learning framework. This framework incorporates a mathematical model to simulate chemical mixtures and enables the creation of classification models for binary and multiclass classification and regression. Through extensive experimentation, we demonstrate that our HNN model outperforms other methodologies, including Random Forest, Bootstrap Aggregating, Adaptive Boosting, Support Vector Regressor, Gradient Boosting, Kernel Ridge, Decision Tree with AdaBoost, and KNeighbors, achieving a superior accuracy of 92.7% in binary classification. To address the limited availability of experimental data and enrich the training data, we generate an assumption-based virtual library of chemical mixtures using a known carcinogenic and non-carcinogenic single chemical for all the classification models. Remarkably, in this case, all methods achieve accuracies exceeding 98% for binary classification. In external validation tests, our HNN method achieves the highest accuracy of 80.5%. Furthermore, in multiclass classification, the HNN demonstrates an overall accuracy of 96.3%, outperforming RF, Bagging, and AdaBoost, which achieved 91.4%, 91.7%, and 80.2%, respectively. In regression models, HNN, RF, SVR, GB, KR, DT with AdaBoost, and KN achieve average R2 values of 0.96, 0.90, 0.77, 0.94, 0.96, 0.96, and 0.97, respectively, showcasing their effectiveness in predicting the concentration at which a chemical mixture becomes carcinogenic. Our method exhibits exceptional predictive power in prioritizing carcinogenic chemical mixtures, even when relying on assumption-based mixtures. This capability is particularly valuable for toxicology studies that lack experimental data on the carcinogenicity and toxicity of chemical mixtures. To our knowledge, this study introduces the first method for predicting the carcinogenic potential of chemical mixtures. The HNNMixCancer framework offers a novel alternative for dose-dependent carcinogen prediction. Ongoing efforts involve implementing the HNN method to predict mixture toxicity and expanding the application of HNNMixCancer to include multi-mixtures.

Epilepsy is a neurological disorder that affects approximately 1% of the world's population. To diagnose and estimate the occurrence of epilepsy, the analysis of recorded brain activity is performed by a neurologist, which is not only time-consuming and tedious but also occasionally accompanied by human error. Therefore, in recent decades, researchers have aimed to unravel an approach for designing and building an automated method for diagnosing and estimating the occurrence of epilepsy. Accordingly, the present study proposed two new-fangled ways based on brain signals and a convolutional neural network (CNN). Moreover, this research implements a CNN with a sequential three-layer structure. Numerous experiments were performed, and the accuracy of estimating epilepsy using the developed methods was achieved at 95% without feedback and 97% with feedback. The proposed methods were proven to be more accurate than the previous techniques and can be employed as a physician's assistant once entering the field of operation.

Drowsiness detection is an important task in road safety and other areas that require sustained attention. In this article, an approach to detect drowsiness in drivers is presented, focusing on the eye region, since eye fatigue is one of the first symptoms of drowsiness. The method used for the extraction of the eye region is Mediapipe, chosen for its high accuracy and robustness. Three neural networks were analyzed based on: InceptionV3, VGG16 and ResNet50V2 that implement deep learning. The database used is NITYMED, which contains videos of drivers with different levels of drowsiness. The three networks were evaluated in terms of accuracy, precision and recall in detecting drowsiness in the eye region. The results of the study show that all three convolutional neural networks have high accuracy in detecting drowsiness in the eye region. In particular, the Resnet50V2 network achieved the highest accuracy, with a rate of 99.71% on average. For better visualization of the data, the Grad-CAM technique is used, with which we get a better understanding of the performance of the algorithms in the classification process.

Accurately estimating a person's age is crucial for identity verification at all critical checkpoints, including airports, land borders, and seaports. Human gait may be used as a biometric identifier and indicator of age, among other things. This study aims to develop methods for estimating a person's age by observing their walk. In this paper, a novel technique for preprocessing the proposed gait dataset has been used by utilizing a combination of the gait energy image (GEI), the accumulated frame difference energy image (AFDEI), and the invariant moment of the image. The proposed technique outperformed state-of-the-art methods in terms of accuracy. The proposed method was tested and evaluated using a convolutional neural network (CNN), and it achieved an average accuracy of 90.35% across 14 different view angles within 5 K-Fold, the proposed method resulted in 94.68% and 94.54% in 30º and 75º view degree respectively. concluding that the approach is effective and promising for estimating age using human gait.

Early detection of breast cancer, one of the most common cancers in women worldwide, raises survival rates and lowers the cost of treatment. Although breast cancer detection and classification (CAD) tools have improved, some issues and restrictions still require further research. The creation of breast cancer CAD systems, particularly with deep learning models, was significantly impacted by recent advancements in machine learning and image processing techniques. The current deep learning-based CAD system to identify and categorize masses in mammography is presented in a structured manner in this survey. The survey provides the most popular breast cancer CAD system evaluation metrics, publicly available mammographic datasets, and current image modalities. The survey examines the available literature, emphasizing its strengths and limitations. The survey also emphasizes the difficulties and drawbacks of the current methods for classifying and detecting breast cancer. We point out research gaps and make suggestions for further study. This systematic review may be beneficial for clinicians using CAD systems to diagnose breast cancer early on and for researchers looking for knowledge gaps and making more contributions to the field.

Over the last several decades, large wildfires are increasingly common across the United States causing disproportionate impact on forest health and function, human well-being, and economy. Here, we examine the severity of large wildfires across the Contiguous United States over the past decade (2011-2020) using a wide array of meteorological, vegetational, and topographical features in the Deep Neural Network model. A total of 4,538 wildfire incidents were used in the analysis covering 87,305 square miles of burned area. We observed the highest number of large wildfires in California, Texas, and Idaho, with lightning causing 43 % of these incidents. Importantly, results indicate that the severity of wildfire occurrences is highly correlated with the climatological forcings, land cover, location, and elevation of the ecosystem. Overall, results may serve useful guide in managing landscapes under changing climate and disturbance regimes.

The core of eLoran ground-based timing navigation system is the accurate measurement of groundwave propagation delay. However, meteorological changes will disturb the conductive characteristic factors along the groundwave propagation path, especially for complex terrestrial propagation environment, and may even lead to microsecond-level propagation delay fluctuation, seriously affecting the timing accuracy of the system. Aiming at this problem, this paper proposes a propagation delay prediction model based on Back-Propagation neural network (BPNN) for complex meteorological environment, which realizes the function of directly mapping propaga-tion delay fluctuation through meteorological factors. Firstly, the theoretical influence of meteoro-logical factors on each component of propagation delay is analyzed based on calculation parame-ters. Then, through the correlation analysis of the measured data, the complex relationship be-tween the seven main meteorological factors and the propagation delay, as well as their regional differences are demonstrated. Finally, a BPNN prediction model considering regional changes of multiple meteorological factors is proposed, and the validity of the model is verified by long-term collected data. Experimental results show that the proposed model can effectively predict the propagation delay fluctuation in the next few days, and its overall performance is significantly improved compared with the existing linear model and simple neural network model. eLoran; meteorological factor; propagation delay prediction model; Back-Propagation neural network;

This paper presents a concise mathematical framework for investigating both feed-forward and backward process, during the training to learn model weights, of an artificial neural network (ANN). Inspired from the idea of the two-step rule for backpropagation, we define a notion of F_adjoint which is aimed at a better description of the backpropagation algorithm. In particular, by introducing the notions of F-propagation and F-adjoint through a deep neural network architecture, the backpropagation associated to a cost/loss function is proven to be completely characterized by the F-adjoint of the corresponding F-propagation relatively to the partial derivative, with respect to the inputs, of the cost function.

While the field of personality neuroscience has extensively focused on humans and, in a few cases, primates and rodents, a wide range of research on fish personality has emerged in the last decades. This research is focused mainly on the ecological and evolutionary causes of individual differences, but also aimed less extensively at proximal mechanisms (e.g., neurochemistry or genetics). We argue that, if consistent and intentional work is made to solve some of the meta-theoretical issues of personality research both on fish and mammals, fish personality research can lead to important advances in personality neuroscience as a whole. The five dimensions of personality in fish (shyness-boldness, exploration-avoidance, activity, aggressiveness, and sociability) need to be translated into models that explicitly recognize the impacts of personality in psychopathology, synergizing research on fish as model organisms in experimental psychopathology, personality neuroscience, and ecological-ethological approaches to the evolutionary underpinnings of personality to produce a powerful framework to understand individual differences.

For W-band long-range mm-wave wireless transmission systems, nonlinearity issues resulting from photoelectric devices, optical fiber, and wireless power amplifiers can be handled by deep learning equalization algorithms. Besides, the PS technique is considered an effective measure to further increase the capacity of the modulation-constraint channel. However, since the proba-bilistic distribution of m-QAM varies with the amplitude, there have been difficulties in learning valuable information from the minority class. This limits the gain of nonlinear equalization. To overcome the imbalanced machine learning problem, we propose a novel two-lane DNN (TLD) equalizer with the random over-sampling (ROS) technique in this paper. The combination of PS at the transmitter and ROS at the receiver improves the overall performance of the W-band wireless transmission system, and our 4.6-km ROF delivery experiment verifies its effectiveness for the W-band mm-wave PS-16QAM system. Based on our proposed equalization scheme, we realize single-channel 10-Gbaud W-band PS-16QAM wireless transmission over 100 m optical fiber link and 4.6-km wireless air-free distance. The results show that compared with the typical TLD without ROS, the TLD-ROS can improve the receiver sensitivity by 1dB. Furthermore, a reduction of 45.6% in complexity is realized, and training samples can be reduced by 15.5%. Considering the actual wireless physical layer with its requirements, there is much to be gained from the joint use of deep learning and balanced data pre-processing techniques.

Time series data having low signal-to-noise ratio, non-stationarity and non-linearity are commonly seen in high-frequency stock trading, where the objective is to increase the likelihood of profit by taking advantage of tiny discrepancies in prices and trading on them quickly and in huge quantities. For this purpose, it is essential to apply a trading method that is capable of fast and accurate prediction from such time series data. In this paper, we develop an online time series forecasting method for high-frequency trading (HFT) by integrating three neural network deep learning models, i.e., Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) and Transformer; and we abbreviate the new method to online LGT or O-LGT. The key innovation underlying our method is its efficient storage management, which enables super-fast computing. Specifically, when computing the forecast for the immediate future time, we use only the output calculated from the previous trading data (rather than the previous trading data themselves) together with the current trading data. Thus, the computing involves updating only the current data into the process. We evaluate the performance of O-LGT by analyzing the high-frequency Limit Order Book (LOB) data from the China market. It shows that our model in most cases achieves similar speed with much higher accuracy than the conventional fast supervised learning models for HFT. However, with a slight sacrifice in accuracy, O-LGT is approximately 40 times faster than the existing high-accuracy neural network models for the LOB data in China market.

Structure–function relationships in proteins have been one of the crucial scientific topics. Heme proteins have diverse and pivotal biological functions. Therefore, clarifying their structure–function correlation is significant to understand their functional mechanism and is informative for various fields of science. In this study, we constructed convolutional neural network models for predicting protein functions from the tertiary structures of heme-binding sites (active sites) of heme proteins to examine the structure–function correlation. As a result, we succeeded in the classification of oxygen-binding protein (OB), oxidoreductase (OR), proteins with both functions (OB–OR), and electron transport protein (ET) with high accuracy. Although the misclassification rate for OR and ET was high, the rates between OB and ET and between OB and OR were almost zero, indicating that the prediction model works well between protein groups with very different functions. However, predicting the function of proteins modified with amino acid mutation(s) remains a challenge. Our findings indicate a structure–function correlation in the active site of heme proteins. This study is expected to be applied to the prediction of more detailed protein functions such as catalytic reactions.

Ultrasound (US) is commonly used for the diagnosis of liver masses. Ensemble learning has been widely used for image classification, but its methods have not been fully optimized. This study was performed to investigate the usefulness of ensemble learning and compare a number of ensemble learning techniques using multiple convolutional neural network (CNN)-trained models for image classification of liver masses in US images. The US imaging data set was classified into four categories: benign liver tumor (BLT, 6320 images), liver cyst (LCY, 2320 images), metastatic liver cancer (MLC, 9720 images), and primary liver cancer (PLC, 7840 images). In this study, 250 test images were randomly selected for each class, for a total of 1000 images, and the remaining images were used for training. Sixteen different CNNs were used for to train and test the US images. All four types of ensemble learning—soft voting (SV), stacking (ST), weighted average voting (WAV), and weighted hard voting (WHV)—showed greater accuracy than the single CNN. All four types also showed significantly better deep learning performance than ResNeXt101 alone. For image classification of liver masses using US images, ensemble learning improved the performance of deep learning over a single CNN.

The poor success rate of preclinical drugs which target the nervous system is related to the highly complex nature of brain physiology and pathophysiology. For in vitro drug screening in this field, the two-dimensional (2D) approach - where cells are incubated in a monolayer - is not physiologically relevant. In contrast, in vivo rodent models are very low throughput and expensive. As such, improved, well-characterised three dimensional (3D) in vitro models should be employed to bridge the gap between 2D in vitro primary screening and rodent models by incorporating aspects of the in vivo brain environment. These key features include the extracellular matrix (ECM) and a multidimensional relationship of supporting cells. In this study, a neural progenitor cell line was differentiated into the main types of cells found in brain, including neurons and astrocytes. This model was designed in a 3D extracellular matrix replacement in a minimalised manner. Different culture formats using multi-well plates were explored and a high-throughput cellular imaging platform was applied. Next, we applied this model to assess neural toxicity of a newly synthesised dual-specificity tyrosine-regulated kinase 1 (DYRK1) inhibitor derived from natural compounds, which is structurally related to a natural DYRK1A inhibitor harmine, K04179. Chemical studies have already shown that K04179 has higher specificity to DYRK1A compared with previously reported DYRK1 inhibitors, such as INDY. We have produced the first report of the biological effects of this new compound on the new 3D minimalised mid-brain model with quantification of both neuronal and astrocyte populations in tandem, revealing differential toxic effects of DYRK1 inhibitor compounds K04179 and INDY on neurons and glia.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

Brain stem cells (neural stem cells or NSCs) and neurons of a chosen kind reprogramming is a potential technique for cell therapy. It is possible to reprogram non-neuronal cells, for example, by using a predetermined group of factors, nuclear transfer, and the induced transcriptional factors (TFs) expression in a related lineage of cells, and non-coding microRNAs (miRNAs). Researchers have additionally been attempting to improve reprogramming methods, whether it is by employing unique sets of biomolecules and particular TFs or by delivering relevant miRNA and Biomolecules. The technique of miRNA mediated is intriguing for its capability to quickly create a range of biologically desirable cell types for therapy from different lineages of cells. Current findings have made significant advancements towards changing the somatic cells to diverse particular neuronal subgroups with greater efficiency, using reprogramming of miRNA-mediated neural cells, despite the fact that the precise processes need to be discovered. To further understand how miRNAs might direct somatic cells to become neural, we need to look at the latest research on their function in neural reprogramming over the differentiated cells. Recent findings on the role of miRNAs in the initiation of cell reprogramming and the determination of the neuronal subtype's destiny are the primary focus of this comprehensive overview. Furthermore, we cover the far more latest results concerning certain miRNAs' activity in controlling different phases of neuronal differentiation, which contributes in comprehending the interaction network of miRNAs and their receptors.

This article introduces new method using ANN to control SVC in order to correct the source power factor of low voltage network. Two ANN approaches are investigated to design accurate and fast power factor correction (PFC) controller. First approach uses simple ANN (SANNA). Second approach uses cascaded ANN (CANNA). ANN regression, performance and the calculated error for both approaches are investigated to select between the two approaches. CANNA is selected as a better solution and it used to build the ANN PFFC controller using database, generated by MATLAB-Simulink, for standard three low voltage levels (240V, 220V and 110V). Nine test cases are carried out to validate the performance of proposed ANN PFC controller with a network has variable loads and low power factor (0.6 approximately). In order to extend the use of the controller to other voltage levels not included in the training process of the cascaded ANN, only the SVC is resized. Another nine cases are carried out with the same loads using the same ANN controller, as it is, to test its performance with the extended voltage level range (415V, 230V and 120V). The results show accurate and fast response in all test cases.

Computer network attacks are evolving in parallel with the evolution of hardware and neural network architecture. Despite major advancements in Network Intrusion Detection System (NIDS) technology, most implementations still depend on signature-based intrusion detection systems, which can’t identify unknown attacks. Deep learning can help NIDS to detect novel threats since it has a strong generalization ability. The deep neural network’s architecture has a significant impact on the model’s results. We propose a genetic algorithm based model to find the optimal number of hidden layers and the number of neurons in each layer of the deep neural network (DNN) architecture for the network intrusion detection binary classification problem. Experimental results demonstrate that the proposed DNN architecture shows better performance than classical machine learning algorithms at a lower computational cost.

Our health requires continual protein synthesis for maintaining and repairing tissues. For protein synthesis to function, all the essential (indispensable) amino acids (IAA) that must be available in the diet, along with those AAs that the cells can synthesize, the dispensable amino acids. Here we review studies that have shown the location of the detector for IAA deficiency in the brain, specifically for recognition of IAA deficient diets (IAAD diets) in the anterior piriform cortex (APC), with subsequent responses in downstream brain areas. The APC is highly excitable, uniquely suited to serve as an alarm for reductions in IAAs. With a balanced diet, these neurons are kept from over-excitation by GABAergic inhibitory neurons. Because several transporters and receptors on the GABAergic neurons have rapid turnover times, they rely on intact protein synthesis to function. When an IAA is missing, its unique tRNA cannot be charged. This activates the enzyme General Control Nonderepressible 2 (GCN2) that is important in the initiation phase of protein synthesis. Without the inhibitory control supplied by GABAergic neurons, excitation in the circuitry is free to signal an urgent alarm. Studies in rodents have shown rapid recognition of IAA deficiency by quick rejection of the IAAD diet.

Defect detection and identification from fruits and vegetables are particularly challenging for Indian agriculture. Defect Detection is a process to identify the defects or damages in vegetables and fruits, based on the shapes, colors and textures. The local market finds it difficult to cope with the defects and other infections in fruits and vegetables as quality evaluations and classification of vegetables and fruits have become tedious process. Recently, several approaches based on Image processing, Machine Learning and Artificial Intelligence methods have been proposed for the purpose of defect detection. On the basis of classifying the types of defects, related pathogens, and physical and morphological characteristics descriptors, we review the different approaches based on a corpus of 57 articles between 2016 and 2021. In the process of describing the defect analysis, steps from the target articles, algorithms, and methods including qualitative and quantitative evaluation are mainly summarized. The aim of this current review work is to present-day novel images and collects recent defective area calculation methods to detect surface defects of fruits and vegetables using RGB images and to classify whether the fruit is defected or fresh. A rigorous evaluation of many new algorithms provided for quality assurance by researcher’s probes of vegetables and fruits have been conducted in this work. This review work conveys that using the recent identification features will help to decrease the disadvantages in fruit storeroom owing to storage of the affected vegetables and fruits, ie. Preventing the spread of defects and other infections from the infected fruits and vegetables to the fresh ones.

Experimental test facilities are generally characterised using linear transfer functions to relate the wavemaker forcing amplitude to wave elevation at a probe located in the wavetank. Second and third order correction methods are becoming available but are limited to certain ranges of waves in their applicability. Artificial intelligence has been shown to be a suitable tool to find even highly nonlinear functional relationships. This paper reports on a numerical wavetank implemented using the OpenFOAM software package which is characterised using artificial intelligence. The aim of the research is to train neural networks to represent non-linear transfer functions mapping a desired surface-elevation time-trace at a probe to the wavemaker input required to create it. These first results already demonstrate the viability of the approach and the suitability of a single setup to find solutions over a wide range of sea states and wave characteristics.

Since its advent in the mid-twentieth century, the field of artificial intelligence (AI) has been heavily influenced by biology. From the structure of the brain to evolution by natural selection, core biological concepts underpin many of the fundamental breakthroughs in modern AI. Here, focusing specifically on artificial neural networks (ANNs) that have become commonplace in machine learning, we show the numerous connections between theories based on coevolution, multi-level selection, modularity and competition and related developments in ANNs. Our aim is to illuminate the valuable but often overlooked inspiration biologists have provided AI research and to spark future contributions at this intersection of biology and computer science. Although recent advances in AI have been swift, many significant challenges remain requiring innovative solutions. Thankfully, biology in all its forms still has a lot to teach us, especially when trying to create truly intelligent machines.

The diffusion of molecules in aqueous solutions in the domain of membrane technology is very critical in the efficiency of chemical engineering and purification processes. In this study, the diffusion in high and low concentration regions is simulated with finite difference method (FDM), and then the results of numerical computations are coupled with adaptive network-based fuzzy inference system (ANFIS) and bilayered neural network method (BNNM). Machine learning approach can individually predict diffusion phenomena across the domain based on understanding of the machine instead of the discretization of an ordinary differential equation (ODE). The findings of the machine learning method are in good agreement with those of FDM at different times of the simulation. In addition to numerical computation, the error of the system is computed for different iterations. The results show that by increasing the number of iterations and training datasets, all errors reduce significantly for both training and testing. BNN method is also used to train the prediction process of diffusion for a more accurate comparison. This technique is similar to ANFIS method in terms of prediction capability. According to the findings, ANFIS approach predicts diffusion slightly better than BNN method. In this regard, ANFIS technique produces R>0.99 while BNN method produces R around 0.98. Both machine learning methods are accurate enough to predict diffusion throughout the domain for different time steps. The computational time for both algorithms is less than that of FDM method to predict low and high concentrations in the domain. Besides, based on the results, artificial intelligence (AI) can find the relationship between inputs and outputs and determine which input has the main influence on the output in this study to optimize the process. As such, future studies can be focused on AI and other methods for faster prediction and optimization processes.

Any effort to combat corruption can benefit from an examination of past and projected worldwide trends. In this paper, we forecast the level of corruption in countries by integrating an artificial neural network modeling and time series analysis. The data were obtained from 113 countries from 2007 to 2017. The study is carried out at two levels: (a) global level where all countries are considered as a monolithic group; and (b) cluster level, where countries are placed into groups based on their development-related attributes. For each cluster, we use the findings from our previous study on the cluster analysis of global corruption using machine learning methods that identified the four most influential corruption factors, and we use those as independent variables. Then, using the identified influential factors, we forecast the level of corruption in each cluster using a nonlinear autoregressive recurrent neural network with exogenous inputs (NARX), an artificial neural network technique. The NARX models were developed for each cluster, with the objective function in terms of the Corruption Perceptions Index (CPI). For each model, the optimal neural network is determined by finetuning the hyperparameters. The analysis was repeated for all countries as a single group. The accuracy of the models is assessed by comparing the mean square errors (MSE) of the time series models. The results suggest that the NARX artificial neural network technique yields reliable future values of CPI globally or for each cluster of countries. This can assist policymakers and organizations in assessing the expected efficacies of their current or future corruption control policies from a global perspective as well as for groups of countries.

Optical motion capture is a mature contemporary technique for the acquisition of motion data, alas it is non-error-free. Due to technical limitations and occlusions of markers, gaps might occur in such recordings. The article reviews various neural network architectures applied for gap filling problem in motion capture sequences within FBM framework providing the representation for body kinematic structure. The results are compared with interpolation and matrix completion methods. We found out, that for longer sequences simple linear feedforward neural networks can outperform the other, sophisticated architectures. We were also able to identify, that acceleration and monotonicity of input sequence are the parameters that have a notable impact on the obtained results.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial & temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

Evidence on adult mammalian neurogenesis and scarce studies with human brains led to the idea that adult human neurogenesis occurs in the subgranular zone (SGZ) of the dentate gyrus and in the subventricular zone (SVZ). However, findings published from 2018 rekindled controversies on adult human SGZ neurogenesis. We systematically reviewed studies published during the first decade of characterization of adult human neurogenesis (1994–2004) – when the two-neurogenic-niche concept in humans was consolidated – and compared with further studies. The synthesis of both periods is that adult human neurogenesis occurs in an intensity ranging from practically zero to a level comparable to adult mammalian neurogenesis in general, which is the prevailing conclusion. Nonetheless, Bernier and colleagues showed in 2000 intriguing indications of adult human neurogenesis in a broad area including the limbic system. Likewise, we later showed evidence that limbic and hypothalamic structures surrounding the circumventricular organs form a continuous zone expressing neurogenesis markers encompassing the SGZ and SVZ. The conclusion is that publications from 2018 on adult human neurogenesis did not bring novel findings on location of neurogenic niches. Rather, we expect that the search of neurogenesis beyond the canonical adult mammalian neurogenic niches will confirm our indications that adult human neurogenesis is orchestrated in a broad brain area. We predict that this approach may, for example, clarify that human hippocampal neurogenesis occurs mostly in the CA1-subiculum zone and that the previously identified human rostral migratory stream arising from the SVZ is indeed the column of the fornix expressing neurogenesis markers.

This paper attempts to compare two different approaches to solve the problem of accident rates prediction based on human factors for industrial workers. One of the methods has already been done using Fuzzy c-Means Clustering and proved to be working with decent results. The second method which will be covered in this paper is using Artificial Neural Networks. The primary goal of this work is to insure that ANN will work efficiently in such prediction problem. The second goal is to reveal the fact that which one of the two selected methodologies is better at defining the estimation of accident rates among people who work in different industrial fields. The purpose has been achieved when the outcome of the ANN was obtained and compared accordingly with the output of the research previously carried out with Fuzzy c-means clustering method. Comparing the outcomes of these two different methods gave an immense insight on which features are more important than others when it comes to laborers properties with completely different background such as varying levels of health, knowledge, experience, training and physical properties. At the end of the research, it becomes clear that accident rates estimation for laborers with properly trained Artificial Neural Network gives better results when it is compared with Fuzzy c-Means Clustering method. Standard deviation method was used to calculate the validity of ANN technique. The result was compared with Fuzzy c-mean clustering technique. Impressive improvement of 8.8% in the accident rate prediction was achieved using Tailored-Made-ANN.

Predicting trip purpose from comprehensive and continuous smart card data is beneficial for transport and city planners in investigating travel behaviours and urban mobility. Here we propose a framework, ActivityNET, using machine learning (ML) algorithms to predict passengers’ trip purpose from smart card data and Points-of-Interest (POIs) data. The feasibility of the framework is demonstrated in two phases. Phase I focuses on extracting activities from individuals’ daily travel patterns from smart card data and combining them with POIs using the proposed ‘activity-POIs consolidation algorithm’. Phase II feeds the extracted features into an artificial neural network (ANN) with multiple scenarios and predicts trip purpose under primary activities (home and work) and secondary activities (entertainment, eating, shopping, child drop-offs/pick-ups and part-time work) with high accuracy. As a case study, the proposed ActivityNET framework is applied in Greater London and illustrates a robust competence to predict trip purpose. The promising outcomes demonstrate that the cost-effective framework offers high predictive accuracy and valuable insights into transport planning.

Computer systems are involved in many critical human applications today, so that a small error can lead to serious and dangerous problems. These errors can be from an error in the incorrect design of the user interface to an error in the program code. The success of a software product depends on several factors. Given that different organizations and institutions use software products, the need to have a quality and desirable Software according to the goals and needs of the organization makes measuring the quality of software products. an important issue for most organizations and institutions, To be sure of having the right software. It is necessary to use a standard quality model to examine the features and sub-features for a detailed and principled study in the quality discussion. In this study, the quality of Word software was measured by Adaptive Neural Fuzzy Inference System. In recent years, powerful systems called fuzzy inference systems on The basis of adaptive neural network (ANFIS) has been used in various sciences. Using the power of neural network training and the linguistic advantage of fuzzy systems, these types of systems have been able to realize the advantages of the two in terms of analyzing very powerful complex processes. Considering the importance of software quality and to have a good and usable software in terms of quality and measuring the quality of software during the study. It was applied at different levels to make the result of measuring the quality of Word software more accurate and closer to reality. In this research, the quality of the software product is measured based on the adaptive neural-fuzzy inference system in ISO standard. According to the results obtained in this study, it is understood that quality is a continuous and hierarchical concept and the quality of each part of the software at any stage of production can lead to high quality products.

Missing observations constitute one of the most important issues in data analysis in applied research studies. The magnitude and their structure impact parameters estimation in the modeling with important consequences for decision-making. This study aims to evaluate the efficiency of imputation methods combined with the backpropagation algorithm in a nonlinear regression context. The evaluation is conducted through a simulation study including sample sizes (50, 100, 200, 300 and 400) with different missing data rates (10, 20, 30 40 and 50%) and three missingness mechanisms (MCAR, MAR and MNAR). Four imputation methods (Last Observation Carried Forward, Random Forest, Amelia and MICE) were used to impute datasets before making prediction with backpropagation. 3-MLP model was used by varying the activation functions (Logistic-Linear, Logistic-Exponential, TanH-Linear and TanH-Exponentiel), the number of nodes in the hidden layer (3 - 15) and the learning rate (20 - 70%). Analysis of the performance criteria (R2, r and RMSE) of the network revealed good performances when it is trained with TanH-Linear functions, 11 nodes in the hidden layer and a learning rate of 50%. MICE and Random Forest were the most appropriate for data imputation. These methods can support up to 50% of missing rate with an optimal sample size of 200.

Timely diagnosis of Alzheimer's diseases(AD) is crucial to obtain more practical treatments. In this paper, a novel approach Based on Multi-Level Fuzzy Neural Networks (MLFNN) for early detection of AD is proposed. The focus of study was on the problem of diagnosing AD and MCI patients from healthy people using MLFNN and selecting the best feature(s) and most compatible classification algorithm. In this way, we achieve an excellent performance using only a single feature i.e. MMSE score, by fitting the optimum algorithm to the best area using optimum possible feature(s) namely one feature for a real life problem. It can be said, the proposed method is a discovery that help patients and healthy people get rid of painful and time consuming experiments. Experiments shows the effectiveness of proposed method in current research for diagnosis of AD with one of the highest performance (accuracy rates of 96.6%), ever reported in the literature.

We consider the problem of coordinating the charging of an entire fleet of electric vehicles (EV), using a model-free approach, i.e. purely data-driven reinforcement learning (RL). The objective of the RL-based control is to optimize charging actions, while fulfilling all EV charging constraints (e.g. timely completion of the charging). In particular, we focus on batch-mode learning and adopt fitted Q-iteration (FQI). A core component in FQI is approximating the Q-function using a regression technique, from which the policy is derived. Recently, a dueling neural networks architecture was proposed and shown to lead to better policy evaluation in the presence of many similar-valued actions, as applied in a computer game context. The main research contributions of the current paper are that (i)we develop a dueling neural networks approach for the setting of joint coordination of an entire EV fleet, and (ii)we evaluate its performance and compare it to an all-knowing benchmark and an FQI approach using EXTRA trees regression technique, a popular approach currently discussed in EV related works. We present a case study where RL agents are trained with an epsilon-greedy approach for different objectives, (a)cost minimization, and (b)maximization of self-consumption of local renewable energy sources. Our results indicate that RL agents achieve significant cost reductions (70--80%) compared to a business-as-usual scenario without smart charging. Comparing the dueling neural networks regression to EXTRA trees indicates that for our case study's EV fleet parameters and training scenario, the EXTRA trees-based agents achieve higher performance in terms of both lower costs (or higher self-consumption) and stronger robustness, i.e. less variation among trained agents. This suggests that adopting dueling neural networks in this EV setting is not particularly beneficial as opposed to the Atari game context from where this idea originated.

Great Malang region is developing rapidly with the population increase and inhabitant`s activity, like migration and urbanization. Other activities like agricultural expansion as well as an uncontrolled residential development need to be monitored to avoid any negative impact in the future. The availability of free and open-source software, spatial high-resolution satellite imagery datasets, and powerful algorithms open the possibilities to map, monitor, and predict the future trend of land use land cover (LULC) changes. However, the accuracy and precision of this model is still in doubt, especially in the Great Malang region. Research is needed to provide a foundational basis and documentation on how the changes occur, where did the changes occur, and the accuracy of the predicted model. This study tries to answer those questions using the high spatial resolution of Sentinel-2 imageries. Combination of the fuzzy algorithm, artificial neural network, and cellular automata was utilized to process the datasets. We analysed four different scenarios of simulation and the result then compared. The different number of hidden layers and iteration was used and evaluated to understand the effect of different parameters in the prediction result. The best scenario was then used to predict future land use changes. This study has successfully produced the future LULC model of Great Malang region with high accuracy level (87%). The study also found that the land use transformation from agriculture to urban built-up area is relatively low, where changes of the built-up area over three periods of analysis are below than 5%. This is due to the physical condition of Great Malang region where mountainous areas are dominated.

Adult neurogenesis is an evolutionary conserved process occurring in all vertebrates. However, striking differences are observed between the taxa, considering the number of neurogenic niches, the neural stem cell (NSC) identity and brain plasticity under constitutive and injury-induced conditions. Zebrafish has become a popular model for the investigation of the molecular and cellular mechanisms involved in adult neurogenesis. Compared to mammals, the adult zebrafish displays a high number of neurogenic niches distributed throughout the brain. Furthermore, it exhibits a strong regenerative capacity without scar formation or any obvious disabilities. In this review, we will first discuss the similarities and differences regarding (i) the distribution of neurogenic niches in the brain of adult zebrafish and mammals (mainly mouse) and (ii) the nature of the neural stem cells within the main telencephalic niches. In the second part, we will describe the cascade of cellular events occurring after telencephalic injury in zebrafish and mouse. Our study clearly shows that most early events happening right after the brain injury are shared between zebrafish and mouse including cell death, microglia and oligodendrocyte recruitment, as well as injury-induced neurogenesis. In mammals one of the consequences following an injury is the formation of a glial scar that is persistent. This is not the case in zebrafish, which may be one of the main reasons that zebrafish display a higher regenerative capacity.

In recent years, intelligent fault diagnosis algorithms using deep learning method have achieved much success. However, the signals collected by sensors contain a lot of noise, which will have a great impact on the accuracy of the diagnostic model. To address this problem, we propose a one-dimensional convolutional neural network with multi-scale kernels (MSK-1DCNN) and apply this method to bearing fault diagnosis. We use a multi-scale convolution structure to extract different fault features in the original signal, and use the ELU activation function instead of the ReLU function in the multi-scale convolution structure to improve the anti-noise ability of MSK-1DCNN; then we use the training set with pepper noise to train the network to suppress overfitting. We use the Western Reserve University bearing data to verify the effectiveness of the algorithm and compare it with other fault diagnosis algorithms. Experimental results show that the improvements we proposed have effectively improved the diagnosis performers of MSK-1DCNN under strong noise and the diagnosis accuracy is higher than other comparison algorithms.

Deep learning has achieved lots of successes in many fields, but when trainable sample are extremely limited, deep learning often under or overfitting to few samples. Meta-learning was proposed to solve difficulties in few-shot learning and fast adaptive areas. Meta-learner learns to remember some common knowledge by training on large scale tasks sampled from a certain data distribution to equip generalization when facing unseen new tasks. Due to the limitation of samples, most approaches only use shallow neural network to avoid overfitting and reduce the difficulty of training process, that causes the waste of many extra information when adapting to unseen tasks. Euclidean space-based gradient descent also make meta-learner's update inaccurate. These issues cause many meta-learning model hard to extract feature from samples and update network parameters. In this paper, we propose a novel method by using multi-stage joint training approach to post the bottleneck during adapting process. To accelerate adapt procedure, we also constraint network to Stiefel manifold, thus meta-learner could perform more stable gradient descent in limited steps. Experiment on mini-ImageNet shows that our method reaches better accuracy under 5-way 1-shot and 5-way 5-shot conditions.

Unmanned Aerial Vehicles (UAVs) are being increasingly viewed as valuable tools to aid the management of farms. This kind of technology can be particularly useful in the context of extensive cattle farming, as production areas tend to be expansive and animals tend to be more loosely monitored. With the advent of deep learning, and Convolutional Neural Networks (CNNs) in particular, extracting relevant information from aerial images has become more effective. Despite the technological advancements in drone, imaging and machine learning technologies, the application of UAVs for cattle monitoring is far from being thoroughly studied, with many research gaps still remaining. In this context, the objectives of this study were threefold: 1) to determine the highest possible accuracy that could be achieved in the detection of animals of the Canchim breed, which is visually similar to the Nelore breed (\textit{Bos taurus indicus}); 2) to determine the ideal Ground Sample Distance (GSD) for animal detection; 3) to determine the most accurate CNN architecture for this specific problem. The experiments involved 1,853 images containing 8,629 samples of animals, and 15 different CNN architectures were tested. A total of 900 models were trained (15 CNN architectures * 3 spacial resolutions * 2 datasets * 10-fold cross validation), allowing for a deep analysis of the several aspects that impact the detection of cattle using aerial images captured using UAVs. Results revealed that many CNN architectures are robust enough to reliably detect animals in aerial images even under far from ideal conditions, indicating the viability of using UAVs for cattle monitoring.

Many scientific and technological problems are studied with the help of computer codes that simulate the phenomena of interest rather than via traditional laboratory experiments. Such models play an important role in neuroscience where they are used to mimic brain function from the sub-cellular to the macroscopic level. Exploration with computer models carries with it a number of statistical challenges: where to sample the input space for the simulator, how to make sense of the data that is generated, how to estimate unknown parameters in the model, how to validate a model. The simulator setting also has some unique problems and possibilities. This review paper describes statistical research on these issues and how that work might be applied to neural simulations.

Various empirical models are available to evaluate the temperature effects on relative permeability of the different rock and fluid systems. However, the implementation of limited experimental data points may hinder the applicability of such models to other systems. This study aims to develop new predictive models for k_ro estimation based on multilayer perceptron artificial neural network (MLP-ANN), adaptive neuro-fuzzy inference system (ANFIS), and least squares support vector machine (LSSVM) approaches. A database comprising of 626 data points applied to the model development. The independent variables are temperature, oil viscosity, water viscosity, water saturation ( ), and the absolute permeability. Each variable covers a wide range of variations which increases models’ potential to be applied in various systems with different characteristics. The doubtful experimental data points excluded using a leverage value approach and a sensitivity analysis carried out to determine the quantitative impact of every individual independent variable on the k_ro. Statistical error analyses demonstrated the coefficient of determination (R²) values of 0.985, 0.975, and 0.999 for MLP-ANN, ANFIS, and LSSVM, respectively. The comparative study indicated that the LSSVM had the best performance regarding both graphical and statistical error analyses among the newly proposed models and previously reported models in the literature.

An article's tone and framing not only influence an audience's perception of a story but may also reveal attributes of author identity and bias. Building upon prior media, psychological, and machine learning research, this neural network-based system detects those writing characteristics in ten news agencies' reporting, discovering patterns that, intentional or not, may reveal an agency's topical perspectives or common contextualization patterns. Specifically, learning linguistic markers of different organizations through a newly released open database, this probabilistic classifier predicts an article's publishing agency with 74% hidden test set accuracy given only a short snippet of text. The resulting model demonstrates how unintentional 'filter bubbles' can emerge in machine learning systems and, by comparing agencies' patterns and highlighting outlets' prototypical articles through an open source exemplar search engine, this paper offers new insight into news media bias.

In this paper, PEN3 electronic nose was used to detect and recognize fresh and moldy apples (inoculated with Penicillium expansum and Aspergillusniger) taken Golden Delicious apples as model subject. Firstly, the apples were divided into two groups: apples only inoculated with different molds (Group A) and mixed apples of inoculated apples with fresh apples (Group B). Then the characteristic gas sensors of the PEN3 electronic nose that were most closely correlated with the flavor information of the moldy apples were optimized and determined, which can simplify the analysis process and improve the accuracy of results. Four pattern recognition methods, including linear discriminant analysis (LDA), backpropagation neural network (BPNN), support vector machines (SVM) and radial basis function neural network (RBFNN), were then applied to analyze the data obtained from the characteristic sensors, respectively, aiming at establishing the prediction model of flavor information and fresh/moldy apples. The results showed that only the gas sensors of W1S, W2S, W5S, W1W and W2W in the PEN3 electronic nose exhibited strong signal response to the flavor information, indicating were most closely correlated with the characteristic flavor of apples and thus the data obtained from these characteristic sensors was used for modeling. The results of the four pattern recognition methods showed that BPNN presented the best prediction performance for the training and validation sets for both the Group A and Group B, with prediction accuracies of 96.29% and 90.00% (Group A), 77.70% and 72.00% (Group B), respectively. Therefore, it first demonstrated that PEN3 electronic nose can not only effectively detect and recognize the fresh and moldy apples, but also can distinguish apples inoculated with different molds.

Localizing the source of a signal is often as important as deciphering the signal’s message. Localization mechanisms must cope with the challenges of representing the spatial information of weak, noisy signals. Comparing these strategies across modalities and model systems allows a broader understanding of the general principles shaping spatial processing. In this review we focus on the electrosensory system of knifefish and provide an overview of our current understanding of spatial processing in this system, in particular, localization of conspecific signals. We argue that many mechanisms observed in other sensory systems, such as the visual or auditory systems, have comparable implementations in the electrosensory system. Our review therefore describes a field of research with unique opportunities to provide new insights into the principles underlying spatial processing.

Multi-floor environments are usually ignored while designing an autonomous robot for indoor cleaning applications. However, for efficient operation in such environments, the ability of a robotic platform to traverse staircases is crucial. Staircase detection and localization is highly important for planning the traversal on staircases. This paper describes a deep learning approach using Convolutional Neural Networks (CNNs) based Robot Operation System (ROS) to staircase detection and localization. We use an object detection network to detect staircases in images. We also localize these staircases using a contour detection algorithm to detect the target point, a point close to the center of the first step, and the angle of approach to the target point. Experiments are performed with data obtained from images captured on different types of staircases at different view points/angles. Results show that the approach is very accurate in identifying the presence of the staircase in the working environment and is also able to locate the target point with good accuracy.

A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through "factors" that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a data-set of nouns. We provide an estimate of the number of concepts that can be stored and retrieved by a large-scale cortical network, the Potts network, which is perhaps approximately 10⁷ with human cortical parameters. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.

Accurate estimates of daily rainfall are essential for understanding and modeling the physical processes involved in the interaction between the land surface and the atmosphere. In this study, daily satellite soil moisture observations from the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) generated by implementing the standard NASA- algorithm are employed for estimating rainfall, firstly, through the use of recently developed approach, SM2RAIN (Brocca et al., 2013) and, secondly, the nonlinear autoregressive network with exogenous inputs (NARX) neural modelling at five climate stations in the Karkheh river basin (KRB), located in southwest Iran. In the SM2RAIN method, the period 1 January 2003 to 31 December 2005 is used for the calibration of algorithm and the remaining 9 months from 1 January 2006 to 30 September 2006 is used for the validation of the rainfall estimates. In the NARX model, the full study period is split into a training (1 January 2003 to 31 September 2005) and a testing (1 September 2005 to 30 September 2006) stage. For the prediction of the rainfall as the desired target (output), relative soil moisture changes from AMSR-E and measured air temperature time series are chosen as exogenous (external) inputs in NARX. The quality of the estimated rainfall data is evaluated by comparing it with observed rainfall data at the five rain gauges in terms of the correlation coefficient R, the RMSE and the statistical bias. For the SM2RAIN method, R ranges between 0.44 and 0.9 for all stations, whereas for the NARX- model the values are generally slightly lower. Moreover, the values of the bias for each station indicate that although SM2RAIN is likely to underestimate large rainfall intensities, due to the known effect of soil moisture saturation, its biases are somewhat lower than those of NARX. In conclusion, the results of the present study show that with the use of AMSR-E soil moisture products in the physically based SM2RAIN- algorithm as well as in the NARX neural network, rainfall for poorly gauged regions can be fairly predicted.

Maximum hardness and hardened depth are the responses of interest in relation to the laser hardening process. These values define heat treatment quality and have a direct impact on mechanical performance. This paper aims to develop models capable of predicting the shape of the hardness profile depending on laser process parameters for controlling laser hardening quality (LHQ), or rather the response values. An experimental study was conducted to highlight hardened profile sensitivity to process input parameters such as laser power (P_L), beam scanning speed (V_S) and initial hardness in the core (H_C). LHQ modeling was conducted by modeling attributes extracted from the hardness profile curve using two effective techniques based on the punctual and geometrical approaches. The process parameters with the most influence on the responses were laser power, beam velocity and initial hardness in the core. The obtained results demonstrate that the geometrical approach is more accurate and credible than the punctual approach according to performance assessment criteria.

Recent advances in recording and real-time analysis of surface electromyographic signals (sEMG) have fostered the use of sEMG human-machine interfaces for controlling personal computers, prostheses of upper limbs, and exoskeletons among others. Despite a relatively high mean performance, sEMG-interfaces still exhibit strong variance in the fidelity of gesture recognition among different users. Here we systematically study the latent factors determining the performance of sEMG-interfaces in synthetic tests and in an arcade game. We show that the degree of muscle cooperation and the amount of the body fatty tissue are the decisive factors in synthetic tests. Our data suggest that these factors can only be adjusted by a long-term training, which promotes fine-tuning of low-level neural circuits driving the muscles. A short-term training has no effect on synthetic tests, but significantly increases the game scoring. This implies that it works at a higher decision-making level, not relevant for synthetic gestures. We propose a procedure that enables quantification of the gestures’ fidelity in a dynamic gaming environment. For each individual subject the approach allows identifying “problematic” gestures that decrease gaming performance. This information can be used for optimizing the training strategy and for adapting the signal processing algorithms to individual users, which could be a way for a qualitative leap in the development of future sEMG-interfaces.

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

Emergency control load-shedding is a key solution to prevent blackouts in the power system. This paper proposed a new model of emergency controls load shedding based on the fast identification of the unstable state of the power system. K-means clustering algorithm divided the instability mode into the clusters. The results of analysis of this cluster were used as the basis for classification control. Building load shedding strategies is consisted of the pre-designed rules based on AHP algorithm. When the recognition of the power system “instability” is detected, the signal of load shedding control is triggered immediately, therefore the decision time is greatly shortened comparing to the traditional methods. The effectiveness of the proposed method was tested on the IEEE 39-bus to overcome the limitations of the last traditional methods.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

We introduce NodeFlow, a flexible framework for probabilistic regression on tabular data that combines Neural Oblivious Decision Ensemble (NODE) and Conditional Continuous Normalizing Flows (CNF). It offers improved modeling capabilities for arbitrary probabilistic distributions, addressing the limitations of traditional parametric approaches. In NodeFlow, the NODE captures complex relationships in tabular data through a tree-like structure, while the conditional CNF utilizes the NODE’s output space as a conditioning factor. The training process of NodeFlow employs standard gradient-based learning, facilitating end-to-end optimization of the NODEs and CNF-based density estimation. This approach ensures outstanding performance, ease of implementation, and scalability, making NodeFlow an appealing choice for practitioners and researchers. Comprehensive assessments on benchmark datasets underscore NodeFlow’s efficacy, revealing its achievement of state-of-the-art outcomes in multivariate probabilistic regression setup and its strong performance in univariate regression tasks. Furthermore, ablation studies are conducted to justify the design choices of NodeFlow. In conclusion, NodeFlow’s end-to-end training process and strong performance make it a compelling solution for practitioners and researchers. Additionally, it opens new avenues for research and application in the field of probabilistic regression on tabular data.

Securing the structural safety of blades has become crucial, owing to the increasing size and weight of blades resulting from the recent development of large wind turbines. Composites are primarily used for blade manufacturing because of their high specific strength and specific stiff-ness. However, in composite blades, joints may experience fractures from the loads generated during wind turbine operation, leading to deformation caused by changes in the structural stiff-ness. In this study, 7,132 debonding damage data, classified by damage type, position, and size, are selected to predict debonding damage based on natural frequency. The change in the natural frequency caused by debonding damage is acquired through finite element (FE) modeling and modal analysis. Synchronization between the FE analysis model and manufactured blades is achieved through modal testing and data analysis. Finally, the relationship between the debond-ing damage and the change in natural frequency is examined using artificial neural network techniques