Biological neural network (BNN) is the core brain for creature to accomplish its intelligent behaviors through unique network structure and mechanisms. It also inspires controlling human-designed autonomous agents including robots to generate more advanced intelligent behaviors by mimicking the neural control mechanism of creatures at a deeper and more interactive level. Here, we constructed a whole-brain neural network model of Caenorhabditis elegans (C. elegans), which characterizes the electrochemical processes at the level of cellular synapse. The neural network simulation integrates computational programming and visualization of neurons and synapse connections of C. elegans, containing the specific controllable circuits summarization with their dynamic characteristics within the whole network. To illustrate its particular intelligent control capability in terms of robotics, we introduce the first innovative methodology for applying the BNN model to a 12-legged robot’s movement control based on the established numerical simulation platforms. We accomplished and designed two methods and corresponding encoding processes, one involving orientation control and the other involving locomotion generation, to demonstrate the intelligent control performance of BNN. Both simulation and experiment results indicate that the robot exhibits stronger autonomy and more intelligent moving performance under the control of BNN. We then summarized the contributions for digitalizing the C. elegans’ whole-brain neural network in real-time and utilizing it to control robot in a closed loop to validate its advanced intelligence control ability in terms of a scientific robot.

Mechanical equipment is composed of several parts, the interaction between the parts exists throughout whole life cycle leads to the widespread phenomenon of fault coupling and the diagnosis of independent faults cannot meet the requirements of the health management of mechanical equipment under actual working conditions. In this paper, the topological structure of graph neural network is used to describe the correlation of coupling faults and multiple fault types are regarded as network nodes respectively. The fault features are fused and extracted by graph convolution to achieve the classification of coupling faults. In this paper, dynamic vertexes are defined in data topology and the parameters of DIGNN classification model are optimized by changing the fault type of dynamic vertexes during training stage. The data is loaded into dynamic vertexes for classification and analysis during testing stage. The one-dimensional vibration data is converted into two-dimensional time-frequency domain data by wavelet transform making the input features of the model interpretable to reduce the uncertainty of model training. The data topology is then fed into DIGNN for fault classification, and GCN's node aggregation gives interpretability to each layer of network data processing. The method proposed in this paper can realize accurate diagnosis of independent faults on the data set, and can effectively judge the coupling mode of coupling faults, which is suitable for coupling fault analysis of mechanical equipment.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

This research proposes a near-infrared hyperspectral imaging/two-branch convolutional neural network (NIR-HSI/2B-CNN) algorithmic scheme to detect mango anthracnose of the species Colletotrichum asianum at the early stages of disease development. In the algorithmic model development, root mean square propagation was used as the solver to train the neural network, given 150 epochs. In addition, spectral raw data was preprocessed to transform it into an understandable and efficient format. The optimal classification model was the 2B-CNN model with 1st-derivative preprocessing, achieving an accuracy of 0.94 for the calibration set and 0.71 for the prediction set. The proposed NIR-HSI/2B-CNN scheme could detect anthracnose mangoes since the the first day of inoculation of the spore suspension (i.e., day 0) through to day 3, achieving a moderate classification accuracy. Meanwhile, the accuracy of conventional convolutional neural networks (CNN) were within a range of 0.66-0.67 for the calibration set and 0.55-0.57 for the prediction set. The results indicated that incorporating spatial features in the 2B-CNN modeling enhanced the prediction performance of the algorithm. The proposed NIR-HSI/2B-CNN algorithmic scheme needs refinements to be able to reliably sort mango fruits into those suitable for premium fresh consumption and export without anthracnose and those for domestic consumption or processing. The novelty of this research lies in the use of NIR-HSI and 2B-CNN algorithm to detect plant pathogens at the early stages of disease development. In addition, the new method of natural simulation to deposit the fungal spores onto the mango surface by spraying spore suspension onto the mango surface where the conidia penetrated unaided into the underneath of the mango peel is proposed.

The informational synthesis of neural structures, processes, parameters and characteristics that allow a unified description and modeling as neural machines of natural and artificial neural systems is presented. The general informational parameters as the global quantitative measure of the neural systems computing potential as absolute and relative neural power were proposed. Neural information organizing and processing follows the way in which nature manages neural information by developing functions, functionalities and circuits related to different internal or peripheral components and also to the whole system through a non-deterministic memorization, fragmentation and aggregation of afferent and efferent information, deep neural information processing representing multiple alternations of fragmentation and aggregation stages. The relevant neural characteristics were integrated into a neural machine type model that incorporates unitary also peripheral or interface components as the central ones. The proposed approach allows overcoming the technical constraints in artificial computational implementations of neural information processes and also provides a more relevant description of natural ones.

Graph Neural Networks (GNNs) are powerful models capable of managing intricate connections in non-Euclidean data, such as social networks, physical systems, chemical structures, and communication networks. Despite their effectiveness, the large-scale and complex nature of graph data demands substantial computational resources and high performance during both training and inference stages, presenting significant challenges, particularly in the context of embedded systems. Recent studies on GNNs have investigated both software and hardware solutions to enhance computational efficiency. Earlier studies on Deep Neural Networks (DNNs) have indicated that methods like reconfigurable hardware and quantization are beneficial in addressing these issues. Unlike DNN research, studies on efficient computational methods for GNNs are less developed and require more exploration. This survey reviews the latest developments in quantization and FPGA-based acceleration for GNNs, showcasing the capabilities of reconfigurable systems (often FPGAs) to offer customized solutions in environments marked by significant sparsity and the necessity for dynamic load management. It also emphasizes the role of quantization in reducing both computational and memory demands through the use of fixed-point arithmetic and streamlined vector formats. This paper concentrates on low-power, resource-limited devices over general hardware accelerators and reviews research applicable to embedded systems. Additionally, it provides a detailed discussion of potential research gaps, foundational knowledge, obstacles, and prospective future directions.

Resonance inductive coupling is widely used for wireless power transfer (WPT) in medical applications. In this paper, we analyze the LCL-compensated WPT structure and propose a novel constant voltage transmission system based on gain estimation, without any extra feedback from the receiver. The system is capable for implant neural stimulation where the load impedance and the coupling coefficient are both variable. Compared to existing methods for constant voltage transmission, our approach offers advantages in compact size and the compatibility with the industrial, scientific and medical (ISM) band. We validate the load-independent resonant characteristic and the feasibility of constant voltage transmission using an experimental prototype working at 6.78MHz. Finally, we discuss the structure of the implant stimulator and methods of applying the proposed WPT system.

This study innovatively assesses the Mun River flow components in Thailand, integrating Artificial Neural Networks (ANN) and Isotopic (18O) End-Member Mixing Analysis (IEMMA). It quantifies the contributions of the Upper Mun River (UMR) and Chi River (CR) to the overall flow, revealing a discrepancy in their estimated contributions. ANN predicts the UMR and CR contribute approximately 70.1% and 29.5% respectively, while IEMMA indicates a more pronounced disparity with 84% from UMR and 16% from CR. This divergence highlights the distinct perspectives of ANN, focusing on hydrological data patterns, and IEMMA, emphasizing isotopic signatures. Despite discrepancies, both methods validate UMR as a significant contributor to the overall flow, highlighting their utility in hydrological research. The findings underscore the complexity of river systems and advocate for an integrated approach of river flow analysis for a comprehensive understanding, crucial for effective water resource management and planning.

Geopolymers, made from aluminosilicate raw materials, offer significant environmental advantages over conventional concrete (CC) mixes. This study explores the compressive strength, setting time, and durability of geopolymer concrete (GPC) cylinders, some of which include an additional ordinary portland cement (OPC) mix. Consistent material composition and testing methods are emphasized to achieve reliable results. MATLAB was utilized to develop and assess a neural network model predicting the compressive strength of GPC based on key variables. The model was validated using 16 experimental samples and 1047 samples from various studies. The performance plot displayed the Mean Squared Error (MSE) over iterations, identifying the best training performance at epoch 658 with an MSE of 5.3408. The Error Histogram highlighted distribution errors between predicted and actual compressive strength values, with the highest range from -1.015 to 0.3587, meaning that the predicted values were mostly within a small margin of error from the actual values. This narrow error range indicates that the ANN model has high accuracy in its predictions, as most errors are small and clustered around zero, demonstrating reliable performance in estimating compressive strength. Regression analysis showed varying correlation coefficients (training set R=0.98373, test set R=0.88164, and whole set R=0.96982), indicating adequate predictive accuracy. The results demonstrate that properly trained neural networks can effectively predict the compressive strength of GPC, highlighting its potential as a sustainable construction material.

In the recent years, tissue engineering researchers have exploited a variety of biomaterials that can potentially mimic extracellular matrix (ECM) for tissue regeneration. Natural cellulose, mainly obtained from bacterial (BC) and plant-based (PC) sources, can serve as a high potential scaffold material for different regenerative purposes. Natural cellulose has drawn the attention of researchers due to its advantage over synthetic cellulose in terms of availability, cost-effectiveness, perfusablility, biocompatibility, negligible toxicity, mild immune response and due to imitating native tissues. In this article, we will review the recent in vivo and in vitro studies aimed to assess the potentials of natural cellulose for the purpose of soft (skin, heart, veins, nerve, among others) and hard (bone and tooth) tissue engineering.

Throughout the evolution of machine learning, the size of models has steadily increased as researchers strive for higher accuracy by adding more layers. This escalation in model complexity necessitates enhanced hardware capabilities. Today, state-of-the-art machine learning models have become so large that effectively training them requires substantial hardware resources, which may be readily available to large companies but not to students or independent researchers. To make the research on machine learning models more accessible, this study introduces a size reduction technique that leverages stages in Pyramid Training and Similarity Comparison. Our results demonstrate that pyramid training can reduce model complexity while maintaining accuracy of conventional full-sized models, offering a scalable and resource-efficient solution for researchers and practitioners in hardware-constrained environments.

This paper introduces an innovative approach that enables automated and precise prediction of the steel's chemical composition based on the desired Jominy curve. The microstructure, and in fact the presence of martensite, is decisive for the hardness of the steel, so the study considered the occurrence of this phase at particular distances from the quenched-end of the Jominy sample. Steels for quenching and tempering and case hardening were investigated. With representative collected dataset of hardness values from quenched-end of Jominy specimen, microstructure and chemical composition of steels, the complex regression model was made using supervised artificial neural networks. The balance between cost and required hardenability can be achieved through optimizing the chemical composition of steel. This model of designing steel with required hardenability can be of great benefit in the mechanical engineering and manufacturing industry. The model is verified experimentally.

The speed-density or flow-density relationship is a fundamental aspect of traffic flow theory. Single-regime models often face challenges in consistently fitting empirical data under diverse traffic conditions. This paper addresses the inaccuracies of single-regime models, attributing them not only to their functional forms but also to data dispersion and sample selection bias. To mitigate these issues, the data is segmented into day and night periods, leading to the creation of separate models for each. Calibration results, conducted on data from two freeways, Tehran-Karaj and Tehran-Qom, reveal distinct challenges, with the former exhibiting high dispersion and the latter showing low dispersion. Surprisingly, single-regime models demonstrate notable effectiveness when applied to distinct day and night data. Further analysis, categorizing data into day and night, results in reduced errors (20-60% improvement in R-Square), emphasizing the potential for enhanced accuracy by considering distinct regimes. Overall, the study underscores the significance of regime-specific considerations for accurate traffic flow modeling. Upon thorough evaluation, the study highlights the superiority of the neural network Multi-layer Perceptron (MLP) over traditional models. The research discusses the implications of incorporating day and night parameters into the models, emphasizing their potential for accuracy enhancement.

Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 × 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

Currently, foam mixers are predominantly categorized into two types: low-pressure and high-pressure. Low-pressure mixers primarily use agitator rotation to mix materials. However, they face challenges such as difficulty in cleaning and complex structures. High-pressure mixers, widely adopted for their structural simplicity and lack of need for cleaning devices, effectively mitigate issues associated with low-pressure mixers. Nonetheless, they encounter problems with uneven mixing when processing high-viscosity materials. Historically, the primary solution to this issue was increasing the working pressure. However, the capacity to increase pressure is finite, and higher pressure demands higher quality materials for the mixers. To address the issues high-pressure mixers face when dealing with high-viscosity materials, this study focuses on the polyimide high-pressure mixer. After reviewing previous studies, four design variables were selected: the mixer's impingement angle, inlet diameter, outlet diameter, and impingement pressure. Using a Full Factorial Design of Experiments (DOE), the significance of the impact exerted by these four variables on Mixing Unevenness was analyzed, determining the extent of their influence. Optimal Latin Hypercube Sampling generated several random sample points, followed by the establishment of both a Back Propagation (BP) Neural Network approximation model and a Kriging approximation model. A Genetic Algorithm was then applied to optimize these two approximation models, resulting in the optimal combination of design variables. The research findings indicate that the BP Neural Network exhibits higher predictive accuracy compared to the Kriging prediction model. The optimal combination of parameters, optimized through the Genetic Algorithm (GA), reduced the Mixing Unevenness by 69.1%, effectively decreasing the Mixing Unevenness of the mixer head.

In recent years, extensive research has been conducted on the IoT, one of its challenges has been the field security and penetration in these networks. security solutions it Require more planning and awareness to ensure system security and privacy protection.it has also been shown that adjusting the weights of neural networks can help improve the accuracy of detection to what extent. the challenge in the attack detection field is to increase the accuracy of attack detection by machine learning methods, in this paper, a new method is presented to adjust weights of the random neural network for attack detection. Evaluations of the proposed method show that compared to random neural network methods, nearest neighbor, and support vector machine, the accuracy of attack detection improves up to 99.49 percent, and the random neural network method has been able to improve by 99.01 percent, placing the best methods together in these experiments in the form of a multi-learning model showed that the results also had an increase in accuracy up to 99.56 percent, while the training time in the proposed model is less compared to the random neural network method.

With the urgent need of precise positioning faced by internet of things (IoT) applications, the universality and cost of indoor positioning devices become key factors. Since the 5G network has been widely deployed, new opportunity is brought by tightly fusing the traditional low-cost sensors, i.e., the magnetometer. In this study, using 5G channel state information (CSI) and geomagnetic data, a multi-input convolutional neural network (CNN) localization system was proposed. First, to generate a data tensor that is easy for CNN processing, the raw data was reconstructed individually. Then, to comprehensively incorporate the features of 5G CSI and geomagnetic strength data, the ReLU function was chosen as the activation function of the convolutional layer. After that, a multi-input CNN was trained using the incorporated geomagnetic strength and CSI amplitude in the off-line side, and the trained CNN was recorded as a location fingerprint, which can be used for the user position prediction. Finally, in the online side and using a multi-input CNN, the 2-D coordinates are estimated and tested indoors in a typical conference room scenario. The results showed that longer sampling time of fingerprint data result in better uniqueness of the reference point, while the data collection time of locating points does not need to be long. Taking the positioning efficiency and accuracy into consideration, a sampling time of 3s at the reference point and 0.2s at the locating point are recommended. The positioning accuracy using the proposed method was 1.41 m, with an improvement of 22.9% compared with the 5G positioning, and an improvement of 18.0% compared with the 5G and geomagnetic fusing positioning using single CNN.

Making sustainable business models, especially in manufacturing, is a key approach for organizations to adopt in order to create more sustainable processes. New technologies are needed to implement new policies that can minimize the economic, environmental, and social consequences of industrial activity. Sustainable maintenance is decisive to guarantee the availability, reliability, and safety of assets, surpassing traditional maintenance policies and embracing the principles of the circular economy. The main objective of Maintenance 4.0 is to increase the lifespan and availability of the equipment by preventing unplanned downtime, reducing planned shutdowns, and improving safety. This research focuses on the integration of advanced Industry 4.0 tools with conventional monitoring and control techniques in process industries. The article suggests that while complex neural networks might provide good predictions, simpler solutions can generalize well and have lower prediction errors because they can capture the underlying relationships between variables in a specific asset better. The combination of maintenance function, Industry 4.0 tools, and advanced statistical solutions to obtain sustainable processes can facilitate organizational change and aid decision-making in equipment management. These solutions seek to reduce interruptions and expenses through the unnecessary utilization of labor and spare parts. All these considerations improve communication and data processing, resulting in improved maintenance of a hydrogen compressor in the petrochemical industry.

Quantum computing (QC) has opened the door to advancements in machine learning (ML) tasks that are currently implemented in the classical domain. Convolutional neural networks (CNNs) are classical ML architectures that exploit data locality and possess a simpler structure than fully-connected multi-layer perceptrons (MLPs) without compromising the accuracy of classification. However, the concept of preserving data locality is usually overlooked in the existing quantum counterparts of CNNs, particularly for extracting multi-features in multidimensional data. In this paper, we present a multidimensional quantum convolutional classifier (MQCC) that performs multidimensional and multi-feature quantum convolution with average and Euclidean pooling and thus adapting the CNN structure to a variational quantum algorithm (VQA). Average pooling is based on the quantum Haar transform (QHT) and Euclidean pooling is based on partial quantum measurement. The experimental work was conducted using multidimensional data to validate the correctness and demonstrate the scalability of the proposed method utilizing both noisy and noise-free quantum simulations. We evaluated the MQCC model with reference to reported work on state-of-the-art quantum simulators from IBM Quantum and Xanadu using a variety of standard ML datasets. The experimental results showed favorable characteristics of our proposed techniques compared to existing work with respect to a number of quantitative metrics such as the number of training parameters, cross-entropy loss, classification accuracy, circuit depth, and quantum gate count.

Reasonable allocation of production plans and saving the overall electricity cost are crucial for large manufacturing conglomerates, which is an effective way for conglomerates to realize open-source and cost-saving. This paper develops an optimization model of off-site industrial production scheduling for enterprises in response to the problems of high electricity costs due to the irrational allocation of production schedules on the demand side of China's electric power and the difficulty of promoting industrial and commercial distributed photovoltaic (PV) projects in China. The model makes full use of the conditions of different PV resources and different electricity prices in different places to optimize the scheduling of industrial production in different places. The model is embedded with two sub-models of the electricity price prediction model and distributed photovoltaic kWh cost model to complete the model parameters, in which the electricity price prediction model utilizes the LSTM neural network. The integrated model is then solved by the particle swarm algorithm. To verify the effectiveness of the model in solving the problem of off-site production scheduling on the demand side of electricity, the research team researched two off-site pharmaceutical factories belonging to the same large pharmaceutical company. Finally, the research data were substituted into the model for solving, and it was concluded that the optimization model could significantly reduce the cost of electricity consumption of the enterprise by about 7.9 %.

In response to the burgeoning global demand for premium agricultural products, particularly within the competitive nut market, this paper introduces an innovative methodology aimed at enhancing the grading process for almonds and their shells. Leveraging state-of-the-art Deep Convolutional Neural Networks (CNNs), specifically the AlmondNet-20 architecture, our study achieves exceptional accuracy exceeding 99%, facilitated by the utilization of a 20-layer CNN model. To bolster robustness in differentiating between almonds and shells, data augmentation techniques are employed, ensuring the reliability and accuracy of our classification system. Our model, meticulously trained over 1000 epochs, demonstrates remarkable performance, boasting an accuracy rate of 99% alongside a minimal loss function of 0.0567. Rigorous evaluation through test datasets further validates the efficacy of our approach, revealing impeccable precision, recall, and F1-score metrics for almond detection. Beyond its technical prowess, this advanced classification system offers tangible benefits to both industry experts and non-specialists alike, ensuring globally reliable almond classification. The application of deep learning algorithms, as showcased in our study, not only enhances grading accuracy but also presents opportunities for product patents, thereby contributing to the economic value of our nation. Through the adoption of cutting-edge technologies such as the AlmondNet-20 model, we pave the way for future advancements in agricultural product classification, ultimately enriching global trade and economic prosperity.

COVID-19, caused by the SARS-CoV-2 virus, has spread around the world and killed around 6.9 million people. Rapid and accurate diagnosis is essential for preventing and controlling the disease, reducing transmission and consequently saving lives. RT-PCR is the gold standard test used to detect the disease. However, the test is expensive and the result is time-consuming, which makes mass testing difficult, especially in countries with limited resources. In addition, the test has high analytical specificity and low diagnostic sensitivity, which leads to false-negative results. Several studies in the literature report the presence of hematological and biochemical alterations in infected patients and use these alterations with machine learning algorithms to help diagnose the disease. Therefore, this article presents the results obtained by different neural network architectures based on Adaptive Resonance Theory (ART) for the diagnosis of COVID-19. The study was conducted in two distinct stages: the first consisted of selecting the best ART network among several, using three open-access datasets and comparing the results with the literature. In the second stage, the chosen model was tested on a dataset containing patients from various hospitals in four countries. In addition, the model was subjected to external validation, including data from a country not present during the training and adjustment of the model, in order to validate the robustness and generalization capacity of the model. The results obtained by the ART networks in this study are promising, outperforming not only classical models, but also the deep learning models often used in the literature. Validation on data from different countries strengthens the model’s reliability and effectiveness.

This paper analyses the application of deep learning techniques for predicting wave overtopping events in port environments using sea state and weather forecasts as inputs. The study was conducted in the outer port of Punta Langosteira, A Coruña, Spain. A video recording infrastructure was installed to monitor overtopping events from 2015 to 2022, identifying 3709 overtopping events. The data collected was merged with actual and predicted data for the sea state and weather conditions during the overtopping events, creating three datasets. We used these datasets to create several machine learning models to predict whether an overtopping event would occur based on sea state and weather conditions. The final models achieved a high accuracy level during the training and testing stages: 0.81, 0.73, and 0.84 average accuracy during training and 0.67, 0.48, and 0.86 average accuracy during testing, respectively. The results of this study have significant implications for port safety and efficiency, as wave overtopping events can cause disruptions and potential damage. Using deep learning techniques for overtopping prediction can help port managers take preventative measures and optimize operations, ultimately improving safety and helping to minimize the economic impact that overtopping events have on the port's activities.

Short-circuit blowing is an important technical means to ensure the rapid surfacing of submersible. In order to study the impact of seven multiple manipulation factors of three levels on blowing, a proportional short-circuit blowing model test bench had been built and L18(37) orthogonal experiments were carried out; then, using Back propagation neural network and Pearson correlation analysis, the experimental data were trained and predicted, correlation between individual factor and blowing was further studied as supplement of orthogonal experiments. It had been proved that both multi-factor combination and individual including blowing duration, sea tank back pressure, the gas blowing pressure of the cylinder group, and sea valve flowing area had larger influence, whose correlation coefficients were 0.6535, 0.8105, 0.5569, 0.5373, of which the F-ratio of blowing duration is over critical value 3.24. And statistical evaluation indicators of Back propagation neural network were between 10e-2 and 10e-13, relative error was less than 3%, and prediction error accuracy was 100%. Based on the results above, a reasonable prediction method for submersible short-circuit blowing had been formed and suggestions on engineering design and operations were proposed, including advantage of short-circuit blowing method, initial condition settings and manipulation strategy.

Aiming at solving difficulties related to aero-engine classification and identification, the infrared spectra of aero-engine hot jets are measured by telemetry Fourier transform infrared spectrometer, and a six types aero-engine hot jet spectrum data set is generated. The spectrum data set were randomly sampled at a ratio of 8:1:1 to generate training set, validation set and prediction set. In this paper, a Peak Finding Siamese Convolutional Neural Network (PF-SCNN) is designed to match and classify spectrum data. In the first place, the matching pairs of training set and validation set are made independently with the labels of positive and negative samples creating. The spectrum feature extraction and distance similarity calculation are carried out by the Siamese convolutional neural network (SCNN). When entering the prediction phase, the prediction set and training set are integrated to predict in the trained model. The prediction set labels are ultimately determined by matching them with the training set labels having the highest similarities to ensure accurate predictions. To improve the operation efficiency of the SCNN, a peak finding method is introduced to extract the spectrum peaks. Peak positions of high frequency are counted, while the peak data are extracted. The peak data are used to take the place of the original data for training and prediction. The performance measures are defined as Accuracy, Precision, Recall, Confusion matrix and F1-score, and the prediction accuracy was up to 99%. The experimental results indicate that the proposed PF-SCNN is suitable for our spectral dataset and can complete the task of infrared spectrum classification of aero-engine hot jets.

Accurate measurement of pedaling kinetics and kinematics is vital for optimizing rehabilitation, exercise training, and understanding musculoskeletal biomechanics. Pedal reaction force, the main external force in cycling, is essential for musculoskeletal modeling and closely correlates with lower limb muscle activity and joint reaction forces. However, sensor instrumentation like 3-axis pedal force sensors is costly and requires extensive post-processing. Recent advancements in machine learning (ML), particularly neural network (NN) models, provide promising solutions for kinetic analyses. In this study, an NN model was developed to predict radial and mediolateral forces, providing a low-cost solution to study pedaling biomechanics with stationary cycling ergometers. Fifteen healthy individuals performed a 2-minute pedaling task at two different self-selected (58±5 rpm) and higher (72±7 rpm) cadences. Pedal forces were recorded using a 3-axis force system. The dataset included pedal force, crank angle, cadence, power, and participants' weight and height. The NN model achieved an inter-subject normalized root mean square error (nRMSE) of 0.15±0.02 and 0.26±0.05 for radial and mediolateral forces at high cadence, respectively, and 0.20±0.04 and 0.22±0.04 at self-selected cadence. The NN model's low computational time suits real-time pedal force predictions, matching the accuracy of previous ML algorithms for estimating ground reaction forces in gait.

Breast cancer remains a global health problem requiring effective diagnostic methods for early detection in order to achieve WHO’s ultimate goal of breast self-examination (BSE). A literature review indicates the urgency of improving diagnostic methods and identifies thermography as a promising, cost-effective, and non-invasive and adjunctive and complementary detection method. This research explores the potential of using machine learning (ML) techniques, specifically Bayesian Networks (BN) combined with Convolutional Neural Networks (CNN) to improve breast cancer diagnosis at early stages. Explainable artificial intelligence (XAI) aims to clarify the reasoning behind any output of artificial neural networks based models. The proposed integration adds interpretability of the diagnosis, which is particularly significant for a medical diagnosis. We have constructed two diagnostic expert models. In research model A, combining thermal images after XAI process together with medical records, an accuracy of 84.07% has been achieved, while model B, that includes also CNN prediction, achieved an accuracy of 90.93%. These results demonstrate the potential of XAI to transform breast cancer diagnosis, increasing accuracy and reducing the risk of misdiagnosis.

End-to-end learned image compression codecs have notably emerged in recent years. These codecs have demonstrated superiority over conventional methods, showcasing remarkable flexibility and adaptability across diverse data domains while supporting new distortion losses. Despite challenges such as computational complexity, learned image compression methods inherently align with learning-based data processing and analytic pipelines due to their well-suited internal representations. The concept of Video Coding for Machines has garnered significant attention from both academic researchers and industry practitioners. This concept reflects the growing need to integrate data compression with computer vision applications. In light of these developments, we present a comprehensive survey and review of lossy image compression methods. Additionally, we provide a concise overview of two prominent international standards, MPEG Video Coding for Machines and JPEG AI. These standards are designed to bridge the gap between data compression and computer vision, catering to practical industry use cases.

Reconstructing 3D indoor scenes from 2D images has always been an important task in computer vision and graphics applications. For indoor scenes, traditional 3D reconstruction methods suffer from the lack of surface details, poor reconstruction of large flat surface textures and areas with uneven lighting, and many falsely reconstructed floating debris noises in the reconstructed models. We add adaptive normal priors to the neural implicit reconstruction process to optimize the network, and improve the accuracy of volume density prediction by adding regularization terms to the neural radiation field to constrain the volume density obtained by weight distribution, and learn a smooth SDF surface from the network to obtain an explicit mesh model. Experiments show that the method proposed in this paper outperforms the state-of-the-art methods on ScanNet, Hypersim, and Replica datasets.

Ensuring optimal performance and reliability in rotor-bearing systems is crucial for industrial applications. Imbalance and shaft bow in these systems can lead to decreased efficiency and increased vibrations. Early detection and mitigation of a rotor’s faults are essential, and model-based fault identification has gained much attention in the manufacturing industry for years. Over the past two decades, however, the development of fault diagnosis rules with data-driven and artificial intelligence (AI) has become a trend, and in the foreseeable future, AI combined with big data will become mainstream. Nevertheless, the critical role of rotating machinery in manufacturing introduces a challenge, as the availability of fault data is often insufficient. This limitation renders the establishment of diagnostic rules using data-driven methods and AI technologies impractical. In light of these challenges, this study proposes a novel hybrid approach, that combines a physical model with machine learning (ML) techniques for the diagnosis of multi-faults (imbalance and shaft-bow demonstrated) in a Jeffcott rotor. To overcome the lack of real-world faulted, labeled datasets, a physics-based Jeffcott rotor model is first derived and then used to generate abundant fault datasets for ML. Subsequently, simulated data are employed for the training of an artificial neural network (ANN), enabling the network to learn from and analyze the vast array of generated data. The results prove that a well-trained feed-forward neural network (FNN) can accurately isolate and diagnose the imbalance and shaft-bow faults using the simulated data and the real data from the Jeffcott rotor experiment. These physics-based and ML approaches prove effective particularly for multi-fault, offering new possibilities for advanced rotor system monitoring and maintenance strategies in industrial applications.

Human Pose Estimation (HPE) is a critical technology in computer vision with diverse applications ranging from healthcare to sports analysis. This project presents a method for detecting the 2D stance of multiple persons in an image using a nonparametric representation known as Part Affinity Fields (PAFs). By leveraging the first 10 layers of the VGG-19 convolutional neural network and training on the COCO dataset, our model effectively identifies and associates key points of the human body.The architecture employs a two-branch system that jointly learns part locations and their associations through sequential prediction. This enables the model to maintain real-time performance while achieving high accuracy, regardless of the number of persons in the image. To enhance accessibility, we developed a mobile application using Flutter and TensorFlow Lite, allowing real-time pose estimation via a mobile device’s front camera. The app provides immediate feedback on physical exercises and yoga poses, making it an invaluable tool for fitness enthusiasts and healthcare professionals. Visual outputs such as heatmaps and PAFs confirm the model’s capability to accurately localize and connect key points. Despite potential challenges such as data quality and hyperparameter tuning, the results indicate that our approach is both reliable and practical for real-world deployment. This project not only advances the state-of-the-art in HPE but also opens up possibilities for future enhancements, including integrating 3D pose estimation and applying the technology in augmented and virtual reality applications.

Adult neurogenesis involves generation of functional neurons from neural progenitor cells, which have the potential to complement and restore damaged neurons and neural circuits. Therefore, the development of drugs that stimulate neurogenesis represents a promising strategy in stem cell therapy and neural regeneration, greatly facilitating the reconstruction of neural circuits in cases of neurodegeneration and brain injury. Our study reveals that compound A5, previously designed and synthesized by our team, exhibits remarkable neuritogenic activities, effectively inducing neurogenesis in neural stem/progenitor cells (NSPCs). Subsequently, transcriptome analysis using high-throughput Illumina RNA-seq technology was performed to further elucidate the underlying molecular mechanisms by which compound A5 promotes neurogenesis. Notably, comparative transcriptome analysis showed that the up-regulated genes were mainly associated with neurogenesis and the down-regulated genes were mainly concerned with cell cycle progression. Furthermore, we confirmed that compound A5 significantly affected the expression of transcription factors related to neurogenesis and cell cycle regulatory proteins. Collectively, these findings identify a new compound with neurogenic activity and may provide insights into drug discovery for neural repair and regeneration.

The exceptional performance advantages of the fiber optic gyroscope (FOG) position it as a dominant player in middle and high-end inertial navigation systems. To prevent the loss of sensor precision caused by algorithm design and simplify the complex modeling strategy in traditional methods. We gradually demonstrate the significant role of Convolutional Neural Network (CNN) in the navigation system based on FOG, and utilize the particle swarm optimization algorithm (PSO) to expedite the convergence of the network. The experimental results demonstrate that the initial alignment method based on deep learning is more accurate than the traditional method. The attitude angle error is reduced by 81.25%, 92.54% and 36.53% respectively. The research provides support for the future application of deep learning in optical navigation systems.

Glaucoma, a global leading cause of blindness, necessitates accurate segmentation of the optic disc (OD) and optic cup (OC) for effective screening. However, existing segmentation methods based on convolutional neural networks (CNNs) suffer from high computational complexity and long inference times. In this paper, we propose an end-to-end segmentation method for the OD and OC using a lightweight MobileNetv3 as the feature extraction network. Our approach incorporates boundary branches and an adversarial learning network to achieve multi-label segmentation of the OD and OC. We evaluate the proposed method on three publicly available datasets: Drishti-GS, RIM-ONE-r3, and REFUGE. The experimental results demonstrate segmentation accuracies of 0.974/0.900, 0.966/0.875, and 0.962/0.880 for the OD and OC on the respective datasets, while significantly reducing inference time.

As modern systems are becoming more complex their control strategy cannot longer relay only on measurement information that usually comes from probes but also from mathematical models. Those systems models can lead to unbearable computation times due to their own complexity, turning the control process non-viable, which leads to the implementation of surrogate models that enable to achieve estimates within acceptable time to take decisions. A control trained with Deep Reinforcement Learning algorithm, using a Physics-Informed Neural Network to obtain the temperature map on the following time step, replaces the need of running Direct Numerical Simulations. On this work we considered an 1D heat conduction problem, which temperature distribution feeds a control system to activate a heat source aiming to obtain a constant, previously defined, temperature value. With this approach, control training becomes much faster without the need of performing numerical simulations or laboratory measurements, as well the control is taken based on Neural Network enabling its implementation on simple processors to edge computing.

Electric vehicles are in focus and growing, with new adoptions every day. Its wide use represents a new scenario and challenge for the electrical power system due to the high charge storage requirements. Predicting these loads using artificial neural networks proves to be a very efficient tool for solving time series. This work uses a multilayer perceptron network through supervised backpropagation training with Bayesian regularization to improve generalization, reducing overfit- ting errors. In this research, the aggregation of the actual consumption of 200 homes and 348 plug-in electric vehicles is used in the training and forecasting process, and to validate the method developed, MAPE was used. Short-term forecasts were made considering the year’s four seasons, predicting the next 24 hours of total aggregate demand from homes and vehicles. The methodology presented significant and relevant results using hybrid training for the problem, with the potential to be applied in the real world.

The success of near-infrared spectroscopy (NIRS) analysis hinges on the precision and robustness of the calibration model. Shallow learning (SL) algorithms like partial least squares discriminant analysis (PLS-DA) often fall short in capturing interrelationships between adjacent spectral variables, and the analysis results are easily affected by spectral noise, which dramatically limits the breadth and depth application of NIRS. Deep learning (DL) methods, with their capacity to discern intricate features from limited samples, are progressively integrated into NIRS. In this paper, two discriminant analysis problems including wheat kernels and Yali pears were used as examples, and several representative calibration models to research the robustness and effectiveness of the model. Additionally, this article proposed a near-infrared calibration model, which is based on gramian angular difference field and coordinate attention convolutional neural networks (G-CACNN). The research results show that, compared with SL, spectral preprocessing has a smaller impact on the analysis accuracy of consensus learning (CL) and DL, and the latter has the highest analysis accuracy in the modeling results of using the original spectrum. The accuracy of G-CACNN in two discrimination tasks is 98.48% and 99.39%, respectively. Finally, This research compared the performance of various models under noise to evaluate the robustness and noise resistance of the proposed method.

Accurately predicting drug-drug interactions (DDIs) is crucial for preventing adverse drug events in clinical settings. However, existing methodologies often rely on complex models built from diverse data sources, posing challenges in computational drug discovery. To address the need for precise computational methods in predicting unknown DDIs, this study introduces a novel Deep Neural Network (DNN)-based approach. By leveraging a wide range of drug-related information, including substructure, targets, side effects, pathways, and indications, our method calculates multiple drug similarities. These similarities are then synthesized using a nonlinear fusion method to extract high-level features. Subsequently, a tailored neural network is deployed for interaction prediction. Comparative evaluation against three prominent machine learning classifiers—Extreme Gradient Boosting (XGBoost), Adaptive Gradient Boosting (AdaBoost), and Light Gradient-Boosting Machine (LGBM)—using three benchmark datasets demonstrates the superior performance of DNN. It achieves outstanding accuracy, precision, recall, and F1-score metrics, all reaching 94.6% in cross-validation. Additionally, case studies involving numerous drug pairs confirm the reliability of DNN in accurately predicting unknown DDIs. These findings underscore DNN as a potent and reliable method for DDI prediction, with promising implications for drug discovery and healthcare applications.

Amid the swift progression of the global automobile industry, the aspiration for lightweight vehicle design has surfaced as a crucial approach to boost fuel efficiency and curtail environmental impact. The objective of this study revolves around achieving holistic optimization of vehicle structure via detailed scrutiny of vehicle process characteristics, amalgamated with a Back Propagation neural network (BPNN) optimized by a genetic algorithm (GA) and a topology optimization (TO) method.The process initiates with an examination of the vehicle's technical characteristics, succeeded by an optimization protocol that couples GA with BPNN. This exhaustive optimization procedure derives the best-fit values of design parameters and identifies the globally optimal lightweight design approach. Subsequently, a comprehensive structural optimization is actualized by modifying the topological distribution of the structure.A simulation experiment of the conceptual car body beam skeleton is conducted as a conclusive step, and the anti-collision capacity of the car body beam skeleton is assessed by measuring deformation intrusion. The findings reveal that in the vehicle topology optimization, a comparative analysis of pre and post-optimization results indicates an improved topological density across diverse sections. The topological density of the vehicle's frontal structure escalates from 0.75 to 0.8. Following optimization, the stiffness assessment records a marginal increase (within the range of 0.02–0.05), implying that the lightweight design does not compromise the general rigidity of the structure.The optimized body structure manifests superior crashworthiness in the crash test: the deformation intrusion diminishes by 27% in front-end collisions. In side impacts, the deformation and intrusion at critical points are reduced by 13.15% to 10% respectively. The comprehensive method proposed herein proves to be an efficient strategy to actualize the lightweight design of vehicles.

A novel approach to optimizing turbomachinery performance is presented in this chapter, which integrates Computational Fluid Dynamics (CFD) simulations, an artificial neural network (ANN) with a modified Non-dominated Sorting Genetic Algorithm II (NSGA-II). Using this enhanced algorithm, substantial performance improvements can be achieved through geometric optimization. The effectiveness of this method is demonstrated in two case studies: an inducer for a centrifugal pump and a Savonius wind turbine. The inducer is designed to maximize head coefficient, hydraulic efficiency, and net positive suction head by optimizing factors such as inlet and outlet blade angles. The optimization process employs the Group Method of Data Handling (GMDH) for objective function modeling, followed by Pareto front plotting and TOPSIS for identifying trade-off optimal points. Results indicate significant improvements in head coefficient, hydraulic efficiency, and NPSHR by 14.3%, 0.3%, and 30.2%, respectively. Twist angle, aspect ratio, and overlap ratio are also optimized for wind turbine blades. The power coefficient is enhanced by 5.32%, the torque coefficient by 13.74%, and the rotational speed by 0.071% through multi-objective optimization. As a result of this approach, efficiency improves, and valuable insights into the optimal design principles for turbomachinery components are also gained.

Link prediction is a fundamental problem in graphs. Currently, SubGraph Representation Learning (SGRL) methods provide state-of-the-art solutions for link prediction by transforming the task into a graph classification problem. However, existing SGRL solutions suffer from high computational costs and lack scalability. In this paper, we propose a novel SGRL framework called Augmented Feature Diffusion on Sparsely Sampled Subgraph (AFD3S). The AFD3S first uses a conditional variational autoencoder to augment the local features of the input graph, effectively improving the expressive ability of downstream Graph Neural Networks. Then, based on a random walk strategy, sparsely sampled subgraphs are obtained from the target node pairs, reducing computational and storage overhead. Graph diffusion is then performed on the sampled subgraph to achieve specific weighting. Finally, the diffusion matrix of the subgraph and its augmented feature matrix are used for feature diffusion to obtain operator-level node representations as inputs for the SGRL-based link prediction. Feature diffusion effectively simulates the message-passing process, simplifying subgraph representation learning, thus accelerating the training and inference speed of subgraph learning. Our proposed AFD3S achieves optimal prediction performance on several benchmark datasets, with significantly reduced storage and computational costs.

Deep Neural Network (DNN) inference demands substantial computing power, resulting in significant energy consumption. A large number of negative output activations in convolution layers are rendered zero due to the invocation of the ReLU activation function. This results in a substantial number of unnecessary computations that consume significant amounts of energy. This paper presents ECHO: Energy-efficient Computation Harnessing Onilne Arithmetic - A MSDF-based accelerator for DNN inference, designed for computation pruning, utilizing an unconventional arithmetic paradigm known as online/ most-significant digit first (MSDF) arithmetic which performs computations in a digit-serial manner. The MSDF digital serial computation of online arithmetic enables overlapped computation of successive operations leading to substantial performance improvements. The online arithmetic, coupled with a negative output detection scheme, facilitates early and precise recognition of negative outputs. This, in turn, allows for the timely termination of unnecessary computations, resulting in a reduction of energy consumption. The implemented design has been realized on the Xilinx Virtex-7 VU3P FPGA and subjected to a comprehensive evaluation through a rigorous comparative analysis involving widely used performance metrics. Experimental results demonstrate promising power and throughput improvements compared to contemporary methods. In particular, the proposed design achieved an average improvement in power consumption of up to 81%, 82.9%, and 40.6% for VGG-16, ResNet-18, and ResNet-50 workloads compared to the conventional bit-serial design, respectively. Furthermore, significant average speedups of 2.39×, 2.6×, and 2.42 were observed when comparing the proposed design to conventional bit-serial designs for VGG-16, ResNet-18, and ResNet-50 models respectively.

With the advancement of technology, signal modulation types are becoming increasingly diverse and complex. The phenomenon of signal time-frequency overlap during transmission poses significant challenges for the classification and recognition of mixed signals, including poor recognition capabilities and low generality. This paper presents a recognition model for fine-grained analysis of mixed signal characteristics, proposing a Geometry Coordinate attention mechanism and introducing a low-rank bilinear pooling module to more effectively extract signal features for classification. The model employs a residual neural network as its backbone architecture and utilizes the Geometry Coordinate attention mechanism for time-frequency weighted analysis based on information geometry theory. This analysis targets multiple-scale features within the architecture, producing time-frequency weighted features of the signal. These weighted features are further analyzed through a low-rank bilinear pooling module, combined with the backbone features, to achieve fine-grained feature fusion. This results in a fused feature vector for mixed signal classification. Experiments were conducted on a simulated dataset comprising 39,600 mixed signal time-frequency plots. The model was benchmarked against a baseline using a residual neural network. The experimental outcomes demonstrated an improvement of 9% in the exact match ratio and 5% in the Hamming score. These results indicate that the proposed model significantly enhances the recognition capability and generalizability of mixed signal classification.

Securing the structural safety of blades has become crucial, owing to the increasing size and weight of blades resulting from the recent development of large wind turbines. Composites are primarily used for blade manufacturing because of their high specific strength and specific stiff-ness. However, in composite blades, joints may experience fractures from the loads generated during wind turbine operation, leading to deformation caused by changes in the structural stiff-ness. In this study, 7,132 debonding damage data, classified by damage type, position, and size, are selected to predict debonding damage based on natural frequency. The change in the natural frequency caused by debonding damage is acquired through finite element (FE) modeling and modal analysis. Synchronization between the FE analysis model and manufactured blades is achieved through modal testing and data analysis. Finally, the relationship between the debond-ing damage and the change in natural frequency is examined using artificial neural network techniques

This study demonstrates the efficacy of structured pruning and architectural fine-tuning on the YOLOv7-tiny model for eye state detection, emphasizing optimization for real-time applications. Structured pruning significantly reduced the model's complexity and storage size while maintaining high detection accuracy, as evidenced by stable precision, recall, and mAP@.5 metrics across iterations. Further fine-tuning adjusted the model's width and depth, optimizing efficiency and processing speed without compromising performance. These optimizations yielded YOLOv7-tiny variants that are both computationally efficient and accurate, suitable for resource-constrained environments. The findings highlight the critical role of model optimization in deploying effective neural networks for specific detection tasks in real-time scenarios.

Interaction between multiple phases especially liquid-gas is one of the most common phenomena in industrial systems. Computer Vision enables modern systems to derive an automated and robust image-processing technique to address this issue. However, diverse experimental conditions still make it a challenging task to overcome. In Deep Learning, instance segmentation has created a niche in various computer vision applications as it aims to provide different instance IDs to objects belonging to the same class. In this paper, we propose a novel approach employing the YOLO (You Look Only Once) an end-to-end deep learning architecture for the detection and segmentation of bubbles in fluid flows. YOLOv5 offers significant improvements in both speed and accuracy compared to its predecessors like YOLOv3. Therefore, we train the YOLOv5 network on a dataset consisting of annotated images representing instances of bubbles across varied fluid flow environments. This paper provides both qualitative and quantitative evaluation of three YOLOv5 networks (small, medium, and extra-large) in detecting and segmenting bubbles with high accuracy and efficiency. Based on the metrics all three YOLOv5 models achieved high precision above 0.98 for bounding box detection and 0.97 for segmentation mask, and high recall value greater than 0.97 for box and 0.96 for mask quality was achieved. The achieved results indicate that the models accurately localize bubbles within the image frame, and distinguish bubble pixels from the background. Also, mean average precision (mAP50-95) consistently exceeds 0.84 across all models for the bounding box and 0.73 for the segmentation mask. The ascertained results emphasize the potential of YOLOv5 architecture as a powerful tool for automated bubble analysis in real-world applications. Our research contributes to advancing the field of deep neural networks in fluid systems and provides a fresh approach for future developments in automated bubble analysis.

The paper describes the new method for image compression based on coordinated group signal transformation. The algorithm is a type of difference coding. Coordinated processing significantly simplifies the difference signal conversion scheme using a single group codec for all signals. The described method considers color channels as correlated signals of a multi-channel communication system. The specifics of the processed data required modification of the coordinated group processing algorithm. First, we changed how to calculate the difference signals to prevent data loss. Secondly, the group codec was supplemented with a neural network to improve the quality of reconstructed images. We considered the following types of neural networks: fully connected, recurrent, convolution, and convolution in the Fourier space. Based on the simulation results, it is best to use fully connected neural networks if the goal is to minimize processing delay time. These networks have a response time of 13 ms. On the other hand, if the priority is to improve quality in cases where delays are not critical, then convolution neural networks in the Fourier space should be used. These networks have a response time of 140 ms and are of significant interest.

There are several challenges on how to attain energy efficiency while maintaining balance among factors affecting energy consumption such as power rating and temperature setpoints of cooling units, room temperature and humidity, and indoor air quality (IAQ). A real-time energy and IAQ monitoring system were installed in an educational building to profile the operational power consumption of inverter-based air condition unit (ACU) installed in each room. Polynomial curve and neural fitting regression analysis were applied to the real-time power consumption, indoor temperature and humidity, and carbon dioxide (CO2) level data. The derived models were able to provide the stabilizing indoor thermal and air conditions of the room to reach steady state ACU power consumption. These collected data and calculated parameters can be used to define rules in automating control of cooling appliances for an efficient energy utilization. The regression approaches, using real-time data, have determined the influence of indoor heat conditions and carbon dioxide levels on ACU power consumption. These parameters were utilized to establish consistent values for temperature, humidity, and carbon dioxide levels under stable settings of inverter-based air conditioning units.

The volume of fluid (VOF) method is a popular technique for the direct numerical simulations of flows involving immiscible fluids. A discrete volume fraction field evolving in time represents the interface, in particular, to compute its geometric properties. The height function method (HF) is based on the volume fraction field, and its estimate of the interface curvature converges with second-order accuracy with grid refinement. Data-driven methods have been recently proposed as an alternative to computing the curvature, with particular consideration for a well-balanced input data set generation and symmetry preservation. In the present work, a two-layer feed-forward neural network is trained on an input data set generated from the height function data instead of the volume fraction field. The symmetries for rotations, reflections, and the anti-symmetry for the phase swapping have been considered to reduce the number of input parameters. The neural network, establishing a correlation between curvature and height function values, can efficiently predict the local interface curvature. We compare the trained neural network to the standard Height Function method to assess its performance and robustness.

Taekwondo has evolved from a traditional martial art into an official Olympic sport. This study introduces a novel action recognition model tailored for Taekwondo unit actions, utilizing joint motion data acquired via wearable inertial measurement unit (IMU) sensors. The utilization of IMU sensor-measured motion data facilitates the capture of the intricate and rapid movements characteristic of Taekwondo techniques. The model, underpinned by a conventional convolutional neural network (CNN)-based image classification framework, synthesizes action images to represent individual Taekwondo unit actions. These action images are generated by mapping joint motion profiles onto the RGB color space, thus encapsulating the motion dynamics of a single unit action within a solitary image. To further refine the representation of rapid movements within these images, a time-warping technique was applied, adjusting motion profiles in relation to the velocity of the action. The effectiveness of the proposed model was assessed using a dataset compiled from 40 Taekwondo experts, yielding remarkable outcomes: an accuracy of 0.998, precision of 0.983, recall of 0.982, and an F1-score of 0.982. These results underscore the time-warping technique's contribution to enhancing feature representation, as well as the proposed method's scalability and effectiveness in recognizing Taekwondo unit actions.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

Digital twin technology is revolutionizing traditional manufacturing paradigms. In modern manufacturing systems, digital twin technology is fraught with challenges due to the scarcity of labeled data. Specifically, existing supervised machine learning algorithms, with their reliance on voluminous training data, find their applicability constrained in real-world production settings. This paper introduces an unsupervised 3D reconstruction approach tailored for industrial applications, aimed at bridging the data void in creating digital twin models. Our proposed model, by ingesting high-resolution 2D images, autonomously reconstructs precise 3D digital twin models without the need for manual annotations or prior knowledge. Through comparisons with multiple baseline models, we demonstrate the superiority of our method in terms of accuracy, speed, and generalization capabilities. This research not only offers an efficient approach to industrial 3D reconstruction but also paves the way for the widespread adoption of digital twin technology in manufacturing.

Photovoltaic modules should pass series of tests and examinations, verifying the electrical and thermal characteristics of the module, before being released to the market, examining the properties of the modules should undergo appropriate durability and efficiency tests under real outdoor conditions with exposure to climatic conditions and under laboratory conditions. The performance of photovoltaic cells depends on many factors, such as solar irradiance, module operating temperature, installation location, weather conditions and module shading. In this paper, three selected photovoltaic modules were examined using a large-scale steady-state solar simulator. The current-voltage (I-V) characteristics of the photovoltaic modules were experimentally tested and analyzed. The next step was to implement a three-layer artificial neural network model (MLP). The experimental data obtained in the previous step coupled with output data from MLP were then used in global sensitivity analysis (GSA). Experiments carried out on a large-scale stationary solar simulator showed differences between the values declared by the manufacturer and the values obtained from measurements of PV modules. The first module tested achieved the maximum power point greater than that specified by the manufacturer, while the other two showed power drops; it was 85-87% for the second module, and 95-98% for the third, respectively. The performed global sensitivity analysis (GSA) for the MLP model showed that the parameters: eff (22.9) and Voc/V (14.19) have the largest effect on the power-voltage relationship, while U (7.29) has the smallest effect. The usefulness of machine learning (ML) methods in the comparative analysis of PV modules has been proved.

The use of artificial intelligence algorithms (AI) has gained importance for dental applications in recent years. Analyzing using IA information from different sensor data such as images or X-ray radiographs can help to improve medical decisions and to achieve early diagnosis of different dental pathologies. In particular, the use of deep learning (DL) techniques based on convolutional neural networks (CNNs) has obtained promising results in dental applications based on images, in which approaches based on classification, detection, and segmentation are being studied with growing interest. However, there are still several challenges to be tackled, such as the data quality and quantity, the variability among categories, and the analysis of the possible bias and variance associated with each dataset distribution. In this work, we compare three different DL object detection models, which are Faster R-CNN, YOLO V2, and SSD. Each object detection architecture was trained, calibrated, validated, and tested with three different feature extraction CNNs which are ResNet-18, ResNet-50, and ResNet-101, which were the networks that best fit our dataset distribution. Based on such detection networks, we detect four different categories of angles in third molars using X-ray panoramic radiographs by using Winter's classification criterion. This criterion characterizes the third molar's position regarding the second molar's longitudinal axis. The detected categories for the third molars are distoangular, vertical, mesioangular, and horizontal. For training, we used a total of 644 panoramic X-ray images. The results obtained in the testing dataset reached up to 99% mean average accuracy performance, demonstrating the YOLOV2 obtained higher effectiveness in solving the third molar angle detection problem. These results demonstrate that the use of CNNs for object detection in panoramic X-rays represents a promising solution in dental applications.

Facial recognition systems are widely used systems around the globe. Their applications in real world scenarios like law enforcement, surveillance, ID card identification, information security, access control and many more has made them very important in today’s world. These systems have shown promising results and excellent performance; however, these systems need tremendous number of facial images for training before they are implemented in the real-world scenarios. The problem arises when we face lack of training images due to which the performance of such systems decreases exponentially. The problem becomes even worse when there is only one image per subject for training our facial recognition system, the probe image might contain variation like illumination, expression and disguise which are hard to be accurately recognized. Generative models have achieved great success for handling the lack of training data by generating synthetic data that resembles the original data. We have created a new method by fine tuning the basic Conditional Generative Adversarial Network (CGAN) to generate synthetic facial images provided only single image per subject. These synthetic facial images contain six variations that are smile, anger, stare, illumination and disguise. We increased the size of the dataset and then applied a convolutional neural network for facial recognition, which improved the accuracy of our system from 0.76 to 0.99.

Deep Learning (DL) oriented document processing is widely used in different fields for extraction, recognition, and classification processes from raw corpora of data. The article examines the application of deep learning approaches, based on different neural network methods, including Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and Convolutional Neural Networks (CNN). The compared models were combined with two different word embedding techniques, namely: Bidirectional Encoder Representations from Transformers BERT and Gensim Word2Vec. The models are designed to evaluate the performance of architectures based on neural network techniques for the classification of CVs of Moroccan engineering students at ENSAK(National School of Applied Sciences of Kenitra, Ibn Tofail University). The used dataset included resumes collected from engineering students at ENSAK in 2023 for a project on the employability of Moroccan engineers in which new approaches were applied, especially machine learning, deep learning, and big data. Accordingly, 867 resumes were collected from five specialties of study (Electrical Engineering, Networks and Systems Telecommunications, Computer Engineering, Automotive Mechatronics Engineering, Industrial Engineering). The results revealed good performance of the proposed models based on the BERT embedding approach compared to models based on the Gensim Word2Vec embedding approach. Accordingly, the CNN-GRU/Bert model achieved slightly better accuracy with 0.9251 compared to other hybrid models.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. In contemporary times, the transition from conventional electricity grids to Smart Grids constitutes an area where extensive research is conducted on a global scale. Among the research challenges, the investigation of Deep Transfer Learning (DTL) in the field of electricity load forecasting represents a fundamental effort that imparts generality to Artificial Intelligence applications, due to new capabilities, such as knowledge transfer and computational power reduction. In this paper a comprehensive study is conducted for day-ahead electricity load forecasting. For this purpose, three Sequence-to-Sequence (Seq2seq) Deep Learning (DL) models are used, namely the Multilayer Perceptron (MLP), the Convolutional Neural Network (CNN) and the Ensemble Learning Model (ELM), which is consisted of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL and emphasizing the way the datasets are trained and fine-tuning for higher forecasting accuracy. In order to implement the forecasting strategies using Deep Learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1-24 hours) for each month of the year for Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. After several trials, four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) contains the training of the DL models using Lesvos dataset, and the testing period performed directly on the Chios dataset without fine-tuning. The fourth strategy is a Multi-task Deep Learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. In this paper, we explore the performance of DTL and compare the results with those produced with MTDL. The results demonstrated that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, the two cases with fine-tuning (DTL Case 1 and 2) outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it has been concluded that the MLP model presents best monthly forecasts with a MAPE of 6.24% and 6.01% for the first two cases, the CNN model presents best monthly forecasts with a MAPE of 5.57% and 5.60% respectively and the ELM model achieves best monthly forecasts with a MAPE of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

This paper explores how smart cities can cope with land subsidence and liquefaction in the context of rapid urbanization in Japan. Since the 1960s, liquefaction has become an important topic in geotechnical engineering, and great efforts have been made to evaluate the resistance of soil to liquefaction. There is currently a lack of machine learning applications specifically for smart cities in areas such as geological hazards. This study uses two machine learning techniques, artificial neural networks and ensemble learning, to obtain a prediction model with high performance in predicting the bearing layer depth to improve the accuracy of geo-engineering surveys. The model was developed by analyzing actual survey data from 433 locations in Setegaya, Tokyo, by using artificial neural networks (ANNs) and bagging, respectively. The results show that machine learning has great advantages in predicting the bearing layer depth. In addition, compared with a single model such as artificial neural networks, the prediction performance of ensemble learning can be improved by about 20%. Both interdisciplinary approaches can help predict address risks and thus promote sustainable urban development, highlighting the potential of smart cities in the future.

A single paragraph of about 200 words maximum. For research articles, abstracts should give a pertinent overview of the work. We strongly encourage authors to use the following style of structured abstracts, but without headings: (1) Background: Place the question addressed in a broad context and highlight the purpose of the study; (2) Methods: briefly describe the main methods or treatments applied; (3) Results: summarize the article’s main findings; (4) Conclusions: indicate the main conclusions or interpretations. The abstract should be an objective representation of the article and it must not contain results that are not presented and substantiated in the main text and should not exaggerate the main conclusions.

In this study a novel approach of designing automatic control systems with the help of AI tools is proposed. Given plant dynamics, expected references, and expected disturbances, design of optimal neural-network based controller is done automatically. Several common reference types are studied including step, square, sine, sawtooth and trapezoid functions. Expected reference-disturbance pairs are used to train the system for finding optimal neural-network controller parameters. A separate test set is used to test the system for unexpected reference-disturbance pairs to show the generalization performance of the proposed system. Parameters of a real DC motor are used to test the proposed approach. Real DC motor’s parameters are estimated using particle swarm optimization (PSO) algorithm. Initially, a proportional-integral (PI) controller is designed using PSO algorithm for finding simple controller’s parameters optimally and automatically. Starting with neural-network equivalent of optimal PI controller, optimal neural-network controller is designed using PSO algorithm for training again. Simulations are conducted with estimated parameters for diverse set of training and test patterns. Results are compared with optimal PI controller’s performance and reported in the corresponding section. Encouraging results are obtained suggesting further research in the proposed direction.

In strawberry cultivation, precise disease management is crucial for maximizing yields and reducing unnecessary fungicide use. Traditional methods for measuring Leaf Wetness Duration (LWD), a critical factor in assessing the risk of fungal diseases such as botrytis fruit rot and anthracnose, have been reliant on sensors with known limitations in accuracy and reliability and difficulties with calibrating. To overcome these limitations, this study introduced an innovative algorithm for leaf wetness detection systems employing high-resolution imaging and deep learning technologies, including convolutional neural networks (CNNs). Implemented at the University of Florida's Plant Science Research and Education Unit (PSREU) in Citra, Florida, USA and expanded to three additional locations across Florida, USA, the system captured and analyzed images of a reference plate to accurately determine the wetness and, consequently, the LWD. The comparison of system outputs with manual observations across diverse environmental conditions demonstrated the enhanced accuracy and reliability of the artificial intelligence-driven approach. By integrating this system into the Strawberry Advisory System (SAS), this study provided an efficient solution to improve disease risk assessment and fungicide application strategies, promising significant economic benefits and sustainability advances in strawberry production.

Accurate forecasting of available energy portion that corresponds to the reservoir inflow of the month(s) ahead provides important decision support for the hydropower plants in energy pro-duction planning for revenue maximization, as well as for the environmental impact prevention, and flood control at the upstream and downstream of a basin. Therefore, a reliable forecasting tool or model is deemed necessary and crucial. Considering the fluctuation and nonlinearity of data which significantly influence the forecasting results, this study develops an effective hybrid model by integrating Artificial Neural Network (ANN) and Particle Swarm Optimization (PSO) called “PSO-ANN” model based on the hydrological and meteorological data pre-processed by cross-correlation function (CCF), autocorrelation function (AFC), and normalization techniques for predicting the available energy portion corresponding to the reservoir inflow mentioned above for a case study hydropower plant in Laos namely, Theun-Hinboun hydropower plant (THHP). The model was evaluated by using correlation coefficient (r), relative error (RE), root mean square error (RMSE), and Taylor diagram plots in comparison with the popular single algorithm approaches such as ANN, and NARX models. Results demonstrated the superiority of the proposed PSO-ANN approach over the other two models.

This paper proposes training improvement methods of artificial neural networks (ANN) trajectory predictors. First, a dynamic power system time-series trajectory is split into several different segments to simplify the original ANN training problem. Moreover, the time-derivative of the trajectory is included to obtain an augmented loss function. Compared to previous studies which mainly focused on increasing the prediction accuracy, the aim of these novel techniques is to reduce the computational burden where the ANN output performance is still acceptable. The effectiveness of the developed methods is validated based on the WSCC three-machine nine-bus and IEEE 39-bus system models. The mean absolute error (MAE) and trajectory prediction results are analyzed, in which the numbers of neurons, hidden layers, and training epochs are constrained during the ANN training process. Rotor-angle difference between generators and the system frequency are investigated as the dynamic trajectories of the power system models. It is revealed that when the ANN architecture and epochs are constrained, the MAE results can be reduced, and the ANN training results can better reflect the original trajectory using the improvement approaches.

The optimization of photovoltaic (PV) systems is vital for enhancing efficiency and economic viability, especially under Partial Shading Conditions (PSCs). This study focuses on the development and comparison of traditional and advanced algorithms, including Perturb and Observe (P&O), Incremental Conductance (IC), Fuzzy Logic Control (FLC), Grey Wolf Optimization (GWO), Particle Swarm Optimization (PSO), and Artificial Neural Networks (ANN), for efficient Maximum Power Point Tracking (MPPT). Simulations conducted in MATLAB/SIMULINK evaluated these algorithms’ performance under various shading scenarios. The results indicate that while traditional methods like P&O and IC are effective under uniform conditions, advanced techniques, particularly ANN-based MPPT, exhibit superior efficiency and faster convergence under PSCs. The study concludes that integrating AI and ML into MPPT algorithms significantly enhances the reliability and efficiency of PV systems, paving the way for broader adoption of solar energy technologies in diverse environmental conditions. These findings contribute to advancing renewable energy technology and support the green energy transition.

The article presents an innovative method for synthesizing radiation patterns efficiently by 1 combining the Taguchi method and neural networks, while validating the results on a 10-element 2 antenna array. The Taguchi method aims to minimize product and process variability, while neural 3 networks are used to model the relationship between antenna design parameters and radiation 4 pattern characteristics. This approach utilizes Taguchi parameters as inputs for the neural network, 5 which is then trained on a dataset generated by the Taguchi method. After training, the network is 6 validated using a real 10-element antenna array. Analytical results demonstrate that this method 7 enables efficient synthesis of radiation patterns with a significant reduction in computation time 8 compared to traditional approaches. Furthermore, validation on the antenna array confirms the 9 accuracy and robustness of the approach, showing a high correlation between predicted performances 10 by the neural network model and actual measurements on the antenna array.In summary, our article 11 highlights that the combined use of the Taguchi method and neural networks, with validation on a 12 real antenna array, offers a promising approach for efficient synthesis of antenna radiation patterns. 13 This approach combines speed, accuracy, and reliability in antenna system design.

Currently there are fewer depth models applied to pepper picking detection, while the existing generalized neural networks have problems such as large model parameters, long training time, and low model accuracy.In order to solve the above problems, this paper proposes a Yolo-chili target detection algorithm for chili pepper detection. First, the classical target detection algorithm yolov5 is used as a benchmark model, and an adaptive spatial feature pyramid structure combining the attention mechanism and the idea of multi-scale prediction is introduced to improve the model's detection effect on occluded peppers and small target peppers. Secondly, a three-channel attention mechanism module is introduced to improve the algorithm's long-distance recognition ability and reduce the interference of redundant testers. Finally, the quantized pruning method is used to reduce the model parameters and realize the lightweight processing of the model. Applying the method to the homemade chili pepper dataset, the AP value of chili pepper reaches 93.11%; the accuracy rate is 93.51% and the recall rate is 92.55%.The experimental results show that yolo-chili is able to achieve accurate and real-time pepper detection under complex orchards.

The main purpose of this article is to identify brain diseases such as Alzheimer's and Parkinson's in an intelligent way using Python software and processing the function of neurons in the neural network areas of the brain, which are classified into different components, and the data is based on the information obtained from FMRI images using algorithms artificial intelligence can intelligently diagnose the type of disease. Therefore, by using spatial clustering based on the deep learning method with noise algorithm (DBSCAN), fMRI brain image and fMRI brain surface complexity are classified, and then image preprocessing will be applied to fMRI images by using artificial intelligence neural networks (ANN) algorithm. became. Then, by using the ANN algorithm and Deep CNN topology of the brain neural network, the type of disease in the brain can be diagnosed by simulating the performance of an artificial neural network (ANN) in Python software. Deep machine learning-based methods, especially algorithms based on neural networks, have shown great success in medical image analysis for various tasks including brain tumor detection, segmentation, and classification, and Alzheimer's and epilepsy. In this research, we propose an integrated model based on a convolutional neural network for simultaneous recognition and classification of brain diseases for intelligent diagnosis of tumors and epilepsy. The average accuracy obtained from our proposed model is 97.89 percent accuracy and 91.66 percent specificity.

With prosperous development and successful application of deep learning technologies in the field of remote sensing, numerous deep-learning based methods have emerged for synthetic aperture radar (SAR) automatic target recognition (ATR) tasks over the past few years. Generally, most deep-learning based methods can achieve outstanding recognition performance in condition that an abundant of labeled samples are available to train the model. However, in real application scenarios, it is difficult and costly to acquire and to annotate abundant SAR images due to the imaging mechanism of SAR, which poses a big challenge to existing SAR ATR methods. Thereby, SAR target recognition under the situation of few-shot, where only a scarcely few of labeled samples are available, is a fundamental problem that needs to be solved. In this paper, we put forward a new method named enhanced prototypical network with customized region-aware convolution (CRCEPN) to specially tackle the few-shot SAR ATR tasks. To be specific, We first develop a feature extraction network based on a customized and region-aware convolution, which can adaptively adjust convolutional kernels and their receptive fields according to each SAR image’s own characteristics as well as the semantical similarity among spatial regions, thus augmenting its capability to extract more informative and discriminative features. To achieve accurate and robust target identity prediction under the few-shot condition, we then propose an enhanced prototypical network which can improve the representation ability of the class prototype by properly making use of training and test samples together, thus effectively raising the classification accuracy. Meanwhile, a new hybrid loss is designed to learn a feature space with both inter-class separability and intra-class tightness as much as possible, which can further upgrade the recognition performance of the proposed method. Experiments performed on the moving and stationary target acquisition and recognition (MSTAR) dataset and the OpenSARShip dataset demonstrate that the proposed method is competitive with some state-of-the-art methods for few-shot SAR ATR tasks.

Accurate estimations of actual evapotranspiration (ETa) are fundamental for various environmental issues. Artificial Intelligence-based models are considered a promising alternative to the most common direct ETa estimation techniques and indirect methods by remote sensing (RS)-based surface energy balance models. Artificial Neural Networks (ANN) are proven to be suitable for predicting reference evapotranspiration and ETa based on RS data. The aim of this study is to develop a methodology based on ANNs for estimating daily ETa values using NDVI and land surface temperature, coupled with limited site-specific climatic variables at a large irrigation catchment. Two scenarios were implemented by the ANN model. Data from only the 38 days of satellite overpass dates was selected in Scenario-I, while the 769-day data included the satellite overpass dates and other days located between two satellite overpass acquisitions in Scenario-II. An irrigation scheme in the Mediterranean region of Turkiye was selected, and a total of 38 Landsat images, and local climatic data were used in 2021 and 2022. Results showed that R2 values in Scenario-I and II were acknowledgeably high for training (0.79 and 0.86), testing (0.75 and 0.81), and the entire dataset (0.76 and 0.84), respectively. Results of the new model in two scenarios showed acceptable agreement with ETa-METRIC values. The proposed ANN model demonstrated the potential of obtaining daily ETa using limited climatic data and RS imagery.

This paper proposed emotion recognition methods for consecutive facial images, and implements the inference of neural network model on a field-programmable gate array (FPGA). The proposed emotion recognition methods are based on a neural network model architecture that combines convolution neural networks (CNNs), long short-term memory (LSTM), and fully connected neural networks (FCNNs), called CLDNN or ConvLSTM-FCN. This type of neural network mod-el can analyze the local feature sequences obtained through convolution of data, making it suita-ble for processing time-series data such as consecutive facial images. In this paper, sequences of facial images are sampled from videos corresponding to various emotional state of subjects. The sampled images are then pre-processed with the processes includes facial detection, greyscale conversion, resize, and data augmentation if necessary. The 2-D CNN in ConvLSTM-FCN is used for feature extraction for these pre-processed facial images. These sequences of facial im-age features are time sequences with dependent properties between the elements within them. The LSTM is then used to model these time sequences followed by fully connected neural net-works (FCNNs) for classification. The proposed consecutive facial emotion recognition method achieves an average recognition rate of 99.51% on RAVDESS dataset, 87.80% on BAUM-1s dataset and 96.82% on eNTERFACE’05 data set, using 10-fold cross-validation on the PC. Some com-parisons of recognition accuracies between the proposed method and the other existing related works are conducted in this paper. According to the comparisons, the proposed emotion recog-nition methods outperform the existing related researches. The proposed emotion recognition methods are then implemented on an FPGA chip using the neural network model inference algo-rithms in this paper, and the accuracies of the experiments conducted on the FPGA chip are iden-tical to those obtained on the PC. This verifies that the proposed neural network model imple-mented on the FPGA chip performs well.

With the rapid developments that have been made in computer vision and computer technology, semantic segmentation of high-resolution images has emerged as a mainstream and challenging task. The, segmentation of water areas remains a complex task due to the similar features between water areas or between water areas and other land objects. Meanwhile, since coastlines and riverbanks are typically presented in irregular shapes, it is difficult to obtain the categories of pixels at boundaries. This paper proposed the use of a Water-Land Boundary Attention Network (WLBANet) to improve the accuracy of pixels at boundaries between water and land. This network also reinforced the performance of contextual information extraction into distinguishing between water areas and other land objects. To prove the validity of this proposed network, WLBANet was performed on the Water Land Dataset (WLD), which is also by this paper, and which contains water areas and other land objects categories. The results demonstrates that the proposed method has significant effectiveness.

Diabetic retinopathy (DR) is the primary factor leading to vision impairment and blindness in diabetic people. Uncontrolled diabetes can damage the retinal blood vessels. Initial detection and prompt medical intervention are vital in preventing progressive vision impairment. Today's growing medical field poses more significant workload and diagnostic demands on medical professionals. In the proposed study, a convolutional neural network (CNN) is employed to detect the stages of DR. This research is crucial for studying DR because of its innovative methodology incorporating two different public datasets. This strategy enhances the model's capacity to generalize unseen DR images, as each dataset encompasses unique demographics and clinical circumstances. The network can learn and capture complicated hierarchical image features with asymmetric weights. Each image undergoes preprocessing using contrast-limited adaptive histogram equalization (CLAHE) and the discrete wavelet transform (DWT). The model is trained and validated using the combined datasets of Dataset for Diabetic Retinopathy (DDR) and the Asia Pacific Tele-Ophthalmology Society (APTOS). The CNN model is tuned with different learning rates and optimizers. The CNN model with Adam optimizer achieved 70% accuracy and an area under curve (AUC) score of 0.82. The recommended study results may reduce diabetes-related vision impairment by early DR severity identification.

In the ambitiously evolving construction industry of Kuwait, characterized by its vision 2035 and rapid technological integration, there exists a pressing need for advanced analytical frameworks. This research paper introduces a groundbreaking deep learning approach utilising an autoencoder neural network to analyse the complexities of the Kuwait Construction Market and identify data irregularities. The construction sector’s significant investment influx and project expansion make it an ideal candidate for deploying sophisticated analytical techniques to detect anomalous patterns indicating inefficiencies or unveiling potential opportunities. Our approach leverages the capabilities of autoencoder architectures to delve into and understand the prevalent patterns in market behaviours. This meticulous analysis allows for the detection of deviations that may lead to operational or financial consequences. We elucidate the mathematical foundations of autoencoders, highlighting their proficiency in managing the complex, multidimensional data typical of the construction industry. Through training on an extensive dataset—comprising variables like market sizes, investment distributions, and project completions—our model demonstrates its ability to pinpoint subtle yet significant anomalies. The outcomes of this study enhance our understanding of deep learning’s pivotal role in construction and building management. Additionally, our findings proactively sketch the future market trajectory and facilitate anomaly detection, thereby contributing substantially to the academic discussion on integrating machine learning into construction management. This research offers valuable insights for professionals within Kuwait, aiming to harness deep learning techniques to boost operational efficiency and strategic foresight in the construction sector.

This article focuses on generating an alternative in order to identify traffic officers during driving. This research employed the latest You Only Look Once (YOLO) model, using a six-phase methodology: data collection, data preparation involving resizing and labeling, implementation of various filters to avoid overfitting, model training, prediction evaluation, and result interpretation. The YOLO model was applied across three iterations using a dataset of 1862 images. To enhance training efficiency and detection speed, the graphics processing unit (GPU) acceleration was utilized, further enhancing the experimental process. The results of this study revealed that the YOLOv8x variant produced the most promising results. This proposed model attained a remarkable F1 score of 0.95, bolstered by a confidence score of 0.631, with the potential for an increase to 0.80 in confidence without significantly compromising the F1-score. These findings are poised to make a substantial contribution to the broader research landscape, particularly in advancing the effectiveness of detection models for traffic officers.

Underwater natural gas pipelines constitute critical infrastructure for energy transportation. Any damage or leakage in these pipelines poses serious security risks, directly threatening marine and lake ecosystems and potentially causing operational issues and economic losses in the energy supply chain. Due to the difficulty in detecting deterioration over time and regularly inspecting these submerged pipelines by divers, the use of unmanned underwater vehicles (UUVs) becomes crucial in this field. In this study, an underwater pipeline tracking experiment was carried out by providing autonomous features to a remote-controlled unmanned underwater vehicle. During the tracking of the underwater pipeline, damages were identified, and the locations of these damages were determined. The navigation information of the underwater vehicle, including orientation in the x, y, z axes (roll, pitch, yaw) from a gyroscope integrated with magnetic compass, speed and position information in the three axes from an accelerometer, and the distance to the water surface from a pressure sensor, was integrated into the vehicle. Pre-tests determined the necessary pulse width modulation values for the thrusters of the vehicle, enabling autonomous operation by providing these values as input to the thruster motors. In this study, the vehicle moves in 3D was achived by the vertical thruster of the vehicle was activated to maintain a specific depth, and applying equal force to the vehicle’s right and left thrusters forward movement, while differential force induced deviation angles. In pool experiments, the unmanned underwater vehicle autonomously tracked the pipeline as intended, identifying damages on the pipeline using images captured by the vehicle's camera. The images for damage assessment were processed using a convolution neural network (CNN) algorithm, which is a deep learning method. The position of the damage relative to the vehicle was estimated from the pixel dimensions of the identified damage. The location of the damage relative to its starting point was obtained by combining these two positional pieces of information from the vehicle's navigation system. The all study was performed within the Python environment.

Significant changes in Land Use and Land Cover (LULC) have widespread implications for the environment, economy, and society; influencing future sustainability and development of a region. This study aimed to assess LULC changes for a 30 year period (1990 – 2020) and project future LULC from 2030 to 2100 for the Irrawaddy Delta using remote sensing and simulations with the artificial neural networks-cellular automata method. The findings showed significant LULC changes in the Delta, particularly for the mangrove forests and cropland (rice paddies). Mangrove coverage was 1,471 km² in 1990 but decreased to 1,282 km² in 2020, and simulations predict a further reduction to 1,277 km² in 2100. Cropland areas increased from 10,550 km² to 10,618 km² in 2020, with simulations projecting a slight decrease to 10,586 km² by 2100. Human activities and cyclonic events, especially in the southern part of the region, have led to barren land and impervious areas replacing dense mangrove and forested areas. These changes threaten the ecological integrity of the Delta and impact local livelihoods and biodiversity. The study underscores the need for sustainable land management practices and policies to mitigate the adverse effects of LULC changes and ensure the resilience of the Irrawaddy Delta against ongoing environmental challenges.

Hybrid power plants have recently emerged as reliable and flexible electricity generation stations by combining multiple renewable energy sources, energy storage systems (ESS), and fossil-based output. However, the effective operation of the hybrid power plants to ensure continuous energy dispatch under challenging conditions is a complex task. This paper proposes a dispatch engine (DE) based on mixed-integer linear programming (MILP) for the planning and management of hybrid power plants. To maintain the committed electricity output, the dispatch engine will provide schedules for operation over extended time periods as well as monitor and reschedule the operation in real-time. Through precise prediction of the PV and wind power output, the proposed approach guarantees optimum scheduling. The precise prediction of the PV and wind power are achieved by employing a predictor of Feed-Forward Neural Network (FFNN) type. With such a dispatch engine, the operational cost of the hybrid power plants, and the use of diesel generators (DGs) are both minimized. A case study is carried out to assess the proposed dispatch engine feasibility. A real-time measurement data pertaining to load, wind, and PV power outputs is obtained from different locations in the Sultanate of Oman. The real-time data is utilized to predict the future output power from PV and the Wind farm over 24 hours. The predicted powers are then used in combination with a PV-Wind-DG-ESS-Grid hybrid plant to evaluate the performance of the proposed dispatch engine. The proposed approach is implemented and simulated using MATLAB. The results of the simulation reveal the proposed Feed-Forward Neural Network’s (FFNN) powerful forecasting abilities. In addition, the results demonstrate that adopting the proposed DE can minimize the use of DG units and reduce plant running expenses.

Vermicomposting is one of the most important waste management techniques in the process of vermiculture. In this study, a Neural Network-assisted novel paradigm is proposed to predict waste from vermicomposting. The proposed Neural Network Skeleton is based on a Gallium Arsenide Processing Schema, which is used to separate wastes. By comparing the proposed sys-tem with existing methods, it was found that the proposed approach had the highest average prediction ratio of 91.32%, outperforming other techniques like ERD, RNN, and Deep LSTM. The separation ratio analysis also demonstrated the effectiveness of the proposed method, with a range of 45-94%. Furthermore, the study emphasizes the importance of chemical equilibrium and the effectiveness of our proposed Gallium Arsenide Processing Schema in achieving high prediction and separation accuracies, showcasing its potential for practical application in waste management processes. Lastly, the prediction of the process evolution stages is detailed, indicating the efficiency of the proposed system in achieving various levels of waste separation. Overall, the study provides valuable insights into the potential of the proposed methods in op-timizing wastewater management processes, paving the way for more effective and sustainable vermicomposting practices.

Sparse training (ST) aims to ameliorate deep learning by replacing fully connected artificial neural networks (ANNs) with sparse or ultra-sparse ones, such as brain networks are, therefore it might benefit to borrow brain-inspired learning paradigms from complex network intelligence theory. Here, we launch the ultra-sparse advantage challenge, whose goal is to offer evidence on the extent to which ultra-sparse (around 1% connection retained) topologies can achieve any leaning advantage against fully connected. Epitopological learning is a field of network science and complex network intelligence that studies how to implement learning on complex networks by changing the shape of their connectivity structure (epitopological plasticity). One way to implement Epitopological (epi- means new) Learning is via link prediction: predicting the likelihood of non-observed links to appear in the network. Cannistraci-Hebb learning theory inspired the CH3-L3 network automata rule for link prediction which is effective for general-purpose link prediction. Here, starting from CH3-L3 we propose Epitopological Sparse Meta-deep Learning (ESML) to apply Epitopological Learning to sparse training. In empirical experiments, we find that ESML learns ANNs with ultra-sparse hyperbolic (epi-)topology in which emerges a community layer organization that is meta-deep (meaning that each layer also has an internal depth due to power-law node hierarchy). Furthermore, we discover that ESML can in many cases automatically sparse the neurons during training (arriving even to 30% neurons left in hidden layers), this process of node dynamic removal is called percolation. Starting from this network science evidence, we design Cannistraci-Hebb training (CHT), a 4-step training methodology that puts ESML at its heart. We conduct experiments on 7 datasets and 5 network structures comparing CHT to dynamic sparse training SOTA algorithms and the fully connected counterparts. The results indicate that, with a mere 1% of links retained during training, CHT surpasses fully connected networks on VGG16, GoogLeNet, ResNet50, and ResNet152. This key finding is an evidence for ultra-sparse advantage and signs a milestone in deep learning. CHT acts akin to a gradient-free oracle that adopts CH3-L3-based epitopological learning to guide the placement of new links in the ultra-sparse network topology to facilitate sparse-weight gradient learning, and this in turn reduces the convergence time of ultra-sparse training. Finally, CHT offers the first examples of parsimony dynamic sparse training because, in many datasets, it can retain network performance by percolating and significantly reducing the node network size. Our code is available at: https://github.com/biomedical-cybernetics/Cannistraci-Hebb-training.

Breast cancer stands as a predominant health concern for women globally. As mammography is the primary screening tool for breast cancer detection, improving the detection of breast cancer at screening could save more lives. This mammography re-view paper provides a systematic review of computer-aided techniques during a specific time frame for the segmentation and classification of microcalcification, evaluating image processing, machine learning, and deep learning techniques. The systematic review is meticulously carried out, adhering closely to the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This article focuses on mammographic breast cancer detection approaches based on automated systems, discussed chronologically from 1970 through 2023. This article encompasses the breadth of artificial intelligence-based methods from the most primitive to the most sophisticated models. Image processing and machine learning-based methods are compre-hensively reviewed. The evaluation of a deep learning architecture based on self-extracted features for classification tasks demonstrated outclass performance. Large-scale datasets required for a broader and in-depth analysis of novel methods for breast cancer detection are also discussed in this article. This research work is aligned with the United Nations' sustainability de-velopment goals.

Monitoring the integrity of aeronautical structures is fundamental for safety. Structural Health Monitoring Systems (SHMS) perform real-time monitoring functions, but their performances must be carefully assessed. In this work the damage detection performances of a strain-based SHMS, were evaluated on a composite helicopter rotor blade root. The SHMS monitored the bonding between the central core and the surrounding antitorsional layer. A damage detection algorithm was trained through Finite Element analyses performed on the component. The effects of the loads variability and of damages were decoupled by including a load recognition step in the algorithm. Load recognition was accomplished in different ways: version#1 adopted an Artificial Neural Network (ANN) trained on blades in pristine condition; version#2 was trained also on damaged blades; version#3 adopted a calibration matrix method. Anomaly detection, damage assessment, and localization were performed by using an ANN. Results showed a higher load identification and anomaly detection accuracy for version#1 and version#2 compared to version#3. Gaussian noise reduced anomaly detection and damage assessment performances, and reduced damage localization accuracy for bigger damages. The damage detection performance were obtained for a fibre optic based-SHMS, including the trade-off between probability of detection and false alarm rate for different damage sizes.

Deep learning neural networks require an immense amount of computation, especially in the training phase of the network when networks with multiple layers of intermediate neurons need to be built. In this paper, we will focus on the PSO algorithm with the aim of significantly accelerating the DLNN training phase by taking advantage of the GPGPU architecture and the Apache Spark analytics engine for large-scale data processing tasks. PSO is a bio-inspired stochastic optimization method whose goal is to iteratively improve the solution to a (usually complex) problem by attempting to approximate a given objective. However, parallelizing an efficient PSO is not a straightforward process due to the complexity of the computations performed on the swarm of particles and the iterative execution of the algorithm until a solution close to the objective with minimal error is achieved. In the present work, two parallelizations of the PSO algorithm have been implemented , both designed for a distributed execution environment. The synchronous parallel PSO implementation ensures consistency at the cost of potential idle time due to global synchronization, while the asynchronous parallel PSO approach improves execution time by reducing the need for global synchronization, making it more suitable for large datasets and distributed environments such as Apache Spark. Both variants of PSO have been implemented to distribute the computational load supported by this algorithm –due to the costly fitness evaluation and updating of particle positions– across the different Spark cluster executor nodes to effectively achieve coarse-grained parallelism, resulting in a significant performance increase over current sequential variants of PSO.

This study investigates anomaly detection of IoT device traffic using Convolutional Neural Networks (CNN) and Variational Autoencoders (VAE) to enhance the detection capability of security threats in IoT environments. A series of hardware configurations, software environments, and hyperparameters were utilized to optimize the training and testing processes of the models. The CNN model demonstrates robust classification performance, achieving an accuracy rate of 95.85% on the test dataset, effectively distinguishing between different types of IoT device traffic. Meanwhile, the VAE model exhibits proficient anomaly detection capabilities by effectively capturing abnormal patterns in the data using reconstruction loss and KL divergence. The combined use of CNN and VAE models offers a comprehensive solution to cybersecurity challenges in IoT environments. Future research directions include exploring diverse IoT traffic data, practical deployment for validation, and further optimization of model structures and parameters to improve performance and applicability.

A reinforcement learning algorithm is proposed to improve the accuracy of short-term load forecasting (STLF) in this article. The proposed model integrates radial basis function neural network (RBFNN), support vector regression (SVR), and adaptive annealing learning algorithm (AALA). In the proposed methodology, firstly, the initial structure of RBFNN is determined by using SVR. Then, an AALA with time-varying learning rates is used to optimize the initial parameters of SVR-RBFNN (AALA-SVR-RBFNN). In order to overcome the stagnation for searching optimal RBFNN, a particle swarm optimization (PSO) is applied to simultaneously find promising learning rates in AALA. Finally, the short-term load demands are predicted by using the optimal RBFNN. The performance of the proposed methodology is verified on the actual load dataset from Taiwan Power Company (TPC). Simulation results reveal that the proposed AALA-SVR-RBFNN can achieve a better load forecasting precision as compared to various RBFNNs.

Accurate and robust deep learning models for facial expression recognition are challenging to achieve, given the diversity of human faces and variations in images, including different facial poses and lighting conditions. In this work, we proposed a clock-driven convolutional Spiking Neural Network (SNN) and STDP fine-tune architecture, meticulously calibrated its hyperparameters, and experimented with various optimization methods. The best model resulted was trained and evaluated on the Fer2013 and FER+ database, obtaining an accuracy of 61.87% and 79.97% without requiring auxiliary training data or face registration. To our best knowledge, the proposed SNN achieved comparable accuracy to CNNs of similar depth and possessed the advantages of low energy consumption and high computational efficiency. The computational efficiency of the proposed SNN is approximately three times that of CNNs. Along with this, we introduced the very recent cumulative spike guided encoder visualization technique and revealed the strong encoding capability of the proposed SNN.

Photovoltaic (PV) systems, which are renewable energy sources, are increasingly being utilized in distributed generation. To maintain a stable energy balance, energy storage systems such as batteries (BAT) play a vital role. Electric vehicles (EVs) offer a promising solution with rechargeable battery systems for operation. The BATs must maintain their state of charge within design boundaries, despite intermittent PV and load power fluctuations, and advanced power control and management techniques are essential for their effective operation. The article evaluates an intelligent controller that uses a Sliding Mode Control adaptive deep learning algorithm Convolutional Neural Networks (SMC-CNN) and a unique Strategy for managing supervisory power. (SPMS) for photovoltaic systems with battery energy storage for better regulation of DC bus voltage. SMC-CNN offers exceptional resilience and seamless functionality, minimizing fluctuations in DC bus voltage in the control strategy design requirements. The primary goals are maintaining a consistent power supply and ensuring continuous service by preventing system components from exceeding capacity. This study aims to enhance the control of DC bus voltage in the PV and battery system, with the primary significance focusing on the following aspects. The advanced SPMS has been created, incorporating control system constraints to enhance SOC balancing speed and reduce fluctuations in DC bus voltage. Power flow management involves optimizing energy flow between the PV system, battery system, and load while minimizing battery capacity requirements. The proposed SMC-CNN and SPMS are demonstrated through real-time simulation using Matlab/Simulink, as demonstrated in comprehensive case studies.

Plant diseases not only cause economic losses, but they also pose a health risk. In this regard, aflatoxins are linked to the development of some type of liver cancer, especially the hepatocellular carcinoma. Aflatoxins are usually produced by the fungi Aspergillus flavus and Parsiticus in figs, and their identification is usually carried out using invasive and complex methods or by visual inspection at an advanced stage. Given that Spain is one of the main producers of figs and Extremadura is the leading region in the country, it is necessary to explore alternative ways of detecting the presence of aflatoxins in figs and preventing them from entering the food chain. The aim of this research is to address the early detection of Aspergillus flavus fungus using non-invasive techniques with the aid of hyperspectral imaging and the application of artificial intelligence techniques, in particular deep learning. The images were taken after inoculation of the microtoxin using 3 different concentrations, related to three different classes and healthy figs (healthy controls). The analysis of the hyperspectral images was performed at the pixel level. Firstly, a full connected neural network was used to analyse the spectral signature associated with each pixel; second, the wavelet transform was applied to each spectral signature. The resulting images are fed to a convolutional neural network. The hyperparameters of the proposed models were adjusted based on the parameter tuning process also performed. The results are promising, with 83% accuracy, 82.75% recall and 83.25% F1-measure for the single neural network, and 77.25% accuracy, recall and F1 for the convolution neural network.

One of the most effective image processing techniques is the use of convolutional neural networks, where we combine intensity values at grid points in the vicinity of each point. To speed up computations, researchers have developed a dilated version of this technique, in which only some points are processed. It turns out that the most efficient case is when we select points from a sub-grid. In this paper, we explain this empirical efficiency proving that the sub-grid is indeed optimal – in some reasonable sense. To be more precise, we prove that all reasonable optimality criteria, the optimal subset of the original grid is either a sub-grid, or a sub-grid-like set.

Optical artificial neural networks (ONNs) have significant potential for ultra-high computing speed and energy efficiency. We report a new approach to ONNs based on integrated Kerr micro-combs that is programmable, highly scalable and capable of reaching ultra-high speeds, demonstrating the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths to achieve a single-unit throughput of 11.9 Giga-OPS at 8 bits per OP, or 95.2 Gbps. We test the perceptron on handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. By scaling the perceptron to a deep learning network using off-the-shelf telecom technology we can achieve high throughput operation for matrix multiplication for real-time massive data processing.

Polarimetric Synthetic Aperture Radar (PolSAR) images encompass valuable information that can facilitate extensive land cover interpretation and generate diverse output products. Extracting meaningful features from PolSAR data poses challenges distinct from those encountered in optical imagery. Deep Learning (DL) methods offer effective solutions for overcoming these challenges in PolSAR feature extraction. Convolutional Neural Networks (CNNs) play a crucial role in capturing PolSAR image characteristics by leveraging kernel capabilities to consider local information and the complex-valued nature of PolSAR data. In this study, a novel three-branch fusion of complex-valued CNN named Shallow to Deep Feature Fusion Network (SDF2Net) is proposed for PolSAR image classification. To validate the performance of the proposed method, classification results are compared against multiple state-of-the-art approaches using the Airborne Synthetic Aperture Radar (AIRSAR) datasets of Flevoland, San Francisco, and ESAR Oberpfaffenhofen dataset. The results indicate that the proposed approach demonstrates improvements in OA, with 1.3% and 0.8% enhancement for the AIRSAR datasets and 0.5% improvement for the ESAR dataset. The analyses conducted on the Flevoland data underscore the effectiveness of the SDF2Net model, revealing a promising OA of 96.01% even with only 1% sampling ratio.

The intracranial pressure (ICP) signal, as monitored on patients in intensive care units, contains pulses of cardiac origin where P1 and P2 subpeaks can often be observed. When calculable, the ratio of their relative amplitudes is an indicator of the patient’s cerebral compliance. This characterization is particularly informative on the overall state of the cerebrospinal system. We developed a recurrent neural network-based framework for P2/P1 ratio computation that only takes a raw ICP signal as an input. Two tasks are performed, namely pulse classification and subpeak designation. Pulse classification was achieved with an area under the curve of 0.90 on a 4,344-pulse testing dataset, while the peak designation algorithm identified pulses with a P2/P1 ratio > 1 with a 97.3% accuracy. Although it still needs to be evaluated on a larger number of labeled recordings, our automated P2/P1 ratio calculation framework appears to be a promising tool for improving bedside monitoring devices.

Deep convolutional neural networks (CNNs) have revolutionised computer vision technology by automatically learning hierarchical representations of image data, leading to state-of-the-art performance in visual recognition tasks. This article presents a comprehensive review of deep CNNs, from their evolution and architectures to the current state-of-the-art research. The review also provides the core concepts and building blocks of CNNs and their concise mathematical representations. Furthermore, it explores applications of deep CNNs in three popular domains, including medical diagnosis, remote sensing, and facial recognition. This review will benefit researchers and practitioners in computer vision and artificial intelligence, as well as industry professionals seeking to leverage the latest advancements in deep learning technologies.

An earthquake is a natural event by its general definition. This natural event is a disaster that causes significant damage, loss of life, and other economic effects that will damage the state. The possibility of predicting a natural event such as an earthquake will minimize the reasons mentioned. Data collection, data processing, and data evaluation were carried out in this study. Earthquake forecasting was performed using the data and the RNN (Recurrent Neural Network) method. The study was carried out on seismic data with a magnitude of 3.0 and above belonging to Düzce Province between 1990 and 2022. In order to increase the learning potential of the method, the b and d values of the earthquake were calculated and included in the data set, except for the earthquake magnitude. The determination of earthquakes in a specific time interval in regions of Turkey, the classification of earthquake-related seismic data using artificial neural networks, and the production of predictions for the future reveal the importance of this study.

This paper investigates the dynamic properties of artificial neural networks using differential equations and explores the influence of parameters on stability and neural oscillations. By analyzing the equilibrium point of the differential equations, we identify conditions for asymptotic stability and criteria for oscillation in artificial neural networks. Furthermore, we demonstrate how adjusting synaptic weights between neurons can effectively control stability and oscillation. The proposed model offers potential insights into the malfunctioning mechanisms of biological neural networks implicated in neurological disorders like Parkinson's disease tremors and epilepsy seizures, which are characterized by abnormal oscillations.

Multiply-accumulate calculations using a memristor crossbar array is an important method to realize neuromorphic computing. However, the memristor array fabrication technology is still immature, and it is difficult to fabricate large-scale arrays with high-yield, which restricts the development of memristor-based neuromorphic computing technology. Therefore, cascading small-scale arrays to achieve the neuromorphic computational ability that can be achieved by large-scale arrays, which is of great significance for promoting the application of memristor-based neuromorphic computing. To address this issue, we present a memristor-based cascaded framework with some basic computation units, several neural network processing units can be cascaded by this means to improve the processing capability of the dataset. Besides, we introduce a split method to reduce pressure of input terminal. Compared with VGGNet and GoogLeNet, the proposed cascaded framework can achieve 93.54% Fashion-MNIST accuracy under the 4.15M parameters. Extensive experiments with Ti/AlOx/TaOx/Pt we fabricated are conducted to show that the circuit simulation results can still provide a high recognition accuracy, and the recognition accuracy loss after circuit simulation can be controlled at around 0.26%.

Tumorigenesis is a complex biological phenomenon that includes extensive genetic and phenotypic heterogeneities and complicated regulatory mechanisms. In the recent few years, our studies demonstrate that tumor-initiating cells are similar to neural stem/progenitor cells in regulatory networks, tumorigenicity and pluripotent differentiation potential. In the review, I will make further discussion on these observations and propose a rule of cell biology by integrating these findings with evidence from developmental biology, tumor biology and evolution, which suggests that neural stemness underlies two coupled cell properties, tumorigenicity and pluripotent differentiation potential. Tumorigenicity and phenotypic heterogeneity in tumor is a result of acquirement of neural stemness in cells. The neural stemness property of tumor-initiating cells can hopefully integrate different concepts/hypotheses underlying tumorigenesis. Neural stem cells/neural progenitors and tumor-initiating cells share regulatory networks; both exhibit neural stemness, tumorigenicity and differentiation potential; both are dependent on expression or activation of ancestral genes (the atavistic effect); both rely primarily on aerobic glycolytic metabolism; both can differentiate into various cells or tissues that are derived from three germ layers, resembling severely disorganized or more severely degenerated process of embryonic development; both are enriched in long genes with more splice variants that provide more plastic scaffolds for cell differentiation, etc. The property of neural stemness might be a key point to understand tumorigenesis and pluripotent differentiation potential, and possibly explain certain pathological observations in tumors that have been inexplicable. Therefore, behind the complexity of tumorigenesis might be a general rule of cell biology, i.e., neural stemness represents the ground state of cell tumorigenicity and pluripotent differentiation potential.

This research investigates the application of deep learning in sentiment analysis of Canadian maritime case law. It offers a framework for improving maritime law and legal analytics policy-making procedures. The automation of legal document extraction takes center stage, underscoring the vital role sentiment analysis plays at the document level. Therefore, this study introduces a novel strategy for sentiment analysis in Canadian maritime case law, combining sentiment case law approaches with state-of-the-art deep learning techniques. The overarching goal is to systematically unearth hidden biases within case law and investigate their impact on legal outcomes. Employing Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) based models, this research achieves a remarkable accuracy of 98.05% for categorizing instances. In contrast, Conventional Machine Learning techniques such as Support Vector Machines (SVM) yield an accuracy rate of 52.57%, Naive Bayes at 57.44 %, and Logistic Regression at 61.86%. The superior accuracy of the CNN and STM model combination underscores its usefulness in legal sentiment analysis, offering promising future applications in diverse fields like legal analytics and policy design. These findings mark a significant choice for AI-powered legal tools, presenting more sophisticated and sentiment-aware options for the legal profession.

Intrinsically Disordered Proteins (IDPs) play crucial roles in signal transduction, cell differentiation, and transcriptional regulation. Many disrupted genes associated with mental disorders are identified as IDPs, and emerging evidence suggests the functional role of IDPs in neuropsychiatric disorders. However, few studies comprehensively explore the functional association between protein disorder properties and different mental diseases. To address this gap, we collected disrupted gene sets for seven mental diseases (MDD, SCZ, BP, ID, AD, ADHD, ASD) and a control gene set from normal brains using DisGeNET and GeneCards databases. The state-of-the-art predictor IUPred2A was then utilized to calculate the disorder properties , followed by a thorough comparison between the disordered proteins in mental diseases and healthy controls. Functional enrichment analysis and protein-protein interaction networks were conducted to investigate the IDPs’ functional roles in psychiatric diseases. Additionally, we demonstrated the role of IDPs in protein binding formations through a case study of alpha-synuclein using protein docking. Our findings reveal that differentially expressed proteins in mental disorders, especially in ASD and ADHD, exhibit more IDPs than those in healthy controls. IDPs in psychiatric disorders are significantly enriched in neurodevelopmental pathways and play an important role in in gene expression regulation. Our results indicate distinct functional patterns of disorder proteins among mental diseases and healthy controls. When comparing the IDPs between ASD and ADHD, we observed that IDPs in ADHD are more likely linked to the synaptic signaling and regulation, while IDPs in ASD are more tendentiously related to diverse and complex biological processes. Our work offers valuable insights into the important functions of IDPs in psychiatric disorders, enhancing our understanding of the molecular mechanisms involved in psychiatric disorders.

A chronically stable electrode material with low impedance for recording neural activity and high charge-injection capacity for functional electro-stimulation is desirable for the fabrication of implantable microelectrode arrays that aims to restore impaired or lost neurological functions in humans. For this purpose, we have investigated the electrochemical properties of sputtered ruthenium oxide (RuOx) electrode coatings, deposited on planar microelectrode arrays, using an inorganic model of interstitial fluid (model-ISF) at 37o C as the electrolyte. Through a combination of cyclic voltammetry (CV) and electrochemical impedance spectroscopy (EIS) modelling study we have established the contribution of faradaic reaction as the major charge-injection contributor within the safe neural stimulation potential window of 0.6 V vs Ag|AgCl. We have also established the reversibility of the charge-injection process for sputtered RuOx film by applying constant charge-per-phase current stimulations at different pulse widths and by comparing the magnitudes of leading and trailing access voltages during voltage transient measurements. Finally, the impedance of the sputtered RuOx film was found to be reasonably comparable in both its oxidized and reduced states, although electronic contribution from capacitive double-layer was found to be slightly higher for the completely oxidized film around 0.6 V than its reduced counterpart around -0.6V.

Popular geo-computer vision works make use of aerial imager with sizes ranging from 64 × 64 to 1024 × 1024 pixels without any overlap, although the learning process of deep learning models can be affected by the reduced semantic context or the lack of information near image boundaries. In this work, the impact of three image sizes (256 × 256, 512 × 512, and 1024 × 1024 pixels) and two image overlap levels (no overlap and 12.5% overlap) on the performance of road classification models was statistically evaluated. For this, two convolutional neural networks used in various tasks of geospatial object extraction were trained (using the same hyperparameters) on a large dataset (containing aerial image data covering 8650 km² of the Spanish territory that was labelled with binary road information) under twelve different scenarios, each scenario featuring a different combination of tile size and overlap. To assess their generalisation capacity, the performance of all resulting models was evaluated on a data from novel areas covering approximately 825 km². The performance metrics obtained were analysed using appropriate descriptive and inferential statistical techniques to evaluate the impact of the performance at distinct levels of the fixed factors (tile size, tile overlap, neural network architecture). Statistical tests were applied to study the main and interaction effects of the fixed factors on the performance. A significance level of 0.05 was applied to all the null hypothesis tests. The results were highly significant for the main effects (p-values lower than 0.001), while the two-way and three-way interaction effects among them had different levels of significance. The results indicate that the training of road classification models on images with a higher tile size (more semantic context) and tile overlap (additional border context and continuity) significantly impacts their performance. The best model was trained on a dataset featuring tiles with a size of 1024 × 1024 pixels and a 12.5% overlap and achieved a loss value of 0.0984, an F1 score of 0.8728, and an ROC-AUC score of 0.9766, together with an error rate of 3.5% on the test set.