With the rapid development of technology and the advancement of Internet technology, various social networking platforms are gradually coming into people's view and occupying a higher and higher position. In the recommendation scenario, the user-item interaction naturally forms a bipartite heterogeneous graph structure and with the development of graph embedding and graph neural network technologies based on deep learning to process graph domain information, the combination of graph information and recommendation systems shows strong research potential and application prospects. The methodological improvement of the recommendation algorithm based on collaborative filtering takes advantage of the nature that user-items can form a bipartite graph in the recommendation scenario. The existing methods still have some shortcomings. The methods that only use weights or convolutional recurrent neural networks to implicitly model different historical behaviors lack explicit modeling of video switching relationships in serialized behaviors. The user's interest is changing all the time, so it is not possible to recommend based on the user's history, and it is necessary to consider both the long-term and short-term interest of the user according to the video content in order to achieve accurate recommendation of short videos. In this paper, we design a recommendation model based on graph neural network, which models users' long-term and short-term interests by two vector propagation methods, respectively.

In order to design effective protective coatings against corrosion, the polyvinyl alcohol (PVA) as compound and composite with silver nanoparticles (nAg/PVA) were electrodeposited on copper surface employing electrochemical techniques such as linear potentiometry and cyclic voltammetry. A new paradigm was used to distinguish the features of coatings, i.e., a Deep Convolutional Neural Network (CNN) was implemented to automatically and hierarchically extract the discriminative characteristics from the information given by optical microscopy images. The main arguments that invoke a CNN implementation in the surface science of materials are the following: artificial intelligence techniques can be successfully applied to learn differences between surface coatings; based on their popularity for image processing, CNN can model images related to the problem of coatings; deep learning is able to extract the features that are distinguishable between material surfaces. To provide an overview of the copper surface, CNN was applied on microscope slides (CNN@microscopy) and inherently learnt distinctive characteristics for each class of surface morphology. The material surface morphology controlled by CNN without the interference of the human factor was successfully conducted, in our study, to extract the similarities/differences between unprotected and protected surfaces to establish the PVA and nAg/PVA performance to retard the copper corrosion.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

: In the last years, materializations of neuromorphic circuits based on nanophotonic arrangements have been proposed, which contain complete optical circuits, laser, photodetectors, photonic crystals, optical fibers, flat waveguides, and other passive optical elements of nanostructured materials, which eliminate the time of simultaneous processing of big groups of data, taking advantage of the quantum perspective and thus highly increasing the potentials of contemporary intelligent computational systems. This article is an effort to record and study the research that has been conducted concerning the methods of development and materialization of neuromorphic circuits of Neural Networks of nanophotonic arrangements. In particular, an investigative study of the methods of developing nanophotonic neuromorphic processors, their originality in neuronic architectural structure, their training methods and their optimization has been realized along with the study of special issues such as optical activation functions and cost functions.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

Accurate electricity price forecasting has become a substantial requirement since the liberalization of the electricity markets. Due to the challenging nature of the electricity prices, which includes high volatility, sharp price spikes and seasonality, various types of electricity price forecasting models still compete and can not outperform each other consistently. Neural Networks have been successfully used in machine learning problems and Recurrent Neural Networks (RNNs) have been proposed to address time-dependent learning problems. In particular, Long Short Term Memory and Gated Recurrent Units (GRU) are tailor-made for time series price estimation. In this paper, we propose to use Gated Recurrent Units as a new technique for electricity price forecasting. We have trained a variety of algorithms with rolling 3-year window and compared the results with the RNNs. In our experiments, 3-layered GRUs outperformed all other neural network structures and state of the art statistical techniques in a statistically significant manner in the Turkish day-ahead market.

The problem of optimal scheduling in a system with parallel queues and a single server has been extensively studied in the queueing theory. However, such systems have mostly been studied by assuming homogeneous attributes of arrival and service processes, or in heterogeneous case a Markov random process was usually assumed. In this paper, we explore the possibility of combining simulation and neural network paradigms for optimal scheduling in a heterogeneous system with an arbitrary inter-arrival and service time distributions. The service of any queue by the server is exhaustive. Further routing of the server after the queue has been emptied is as instructed by the trained neural network. Any change in the queue that currently has a server is accompanied by a switching cost. The simulated annealing optimization algorithm which is used to optimize the parameters of the neural network was adapted for numerically evaluated average cost function. A Markov decision problem was formulated for the corresponding markovian queueing system to verify the results of solving the optimization problem. In addition to comparing the actual values of the average cost, the parameter values of the neural network trained on the optimal control policy of the Markov model are also used to determine the domains of parameters required for the simulated annealing defined on a finite discrete domain. Numerical analysis shows the effectiveness of this approach. Moreover, a comparison of the results for different distributions illustrates the insensitivity of the optimal control policy to the shape of the distributions for the same two first moments. Thus, the optimal control policy for an exponential model can be used as a suboptimal one for the general system.

The variation of aerosols, especially dust aerosol, in time and space plays an important role in climate forcing studies. Aerosols can effectively reduce land surface longwave emission and re-emit energy at a colder temperature, making estimation of downwelling surface longwave radiation (DSLR) with satellite data difficult. Using the latest atmospheric radiative transfer code (MODTRAN 5.0), we simulate the outgoing longwave radiation (OLR) and DSLR under different land surface and atmospheric profile conditions. The results show that dust aerosol has an obvious “warming” effect to longwave radiation compared with other aerosols, that aerosol longwave radiative forcing (ALRF) increased with increasing aerosol optical depth (AOD), and that the atmospheric water vapor content (WVC) is critical to the understanding of ALRF. A method is proposed to improve the accuracy of DSLR estimation from satellite data for the skies under heavy dust aerosols. The AOD and atmospheric WVC under cloud-free conditions with a relatively simple satellite-based radiation model that yields the high accurate DSLR under heavy dust aerosol are used explicitly as model input to reduce the effects of dust aerosol on the estimation of DSLR. Validations of the proposed model with satellites data and field measurements show that it estimates the DSLR accurately under heavy dust aerosol skies. The root mean square errors (RMSEs) are 20.4 W/M² and 24.2 W/M² for Terra and Aqua satellites, respectively, at the Yingke site, and the biases are 2.7 W/M² and 9.6 W/M², respectively. For the Arvaikheer site, the RMSEs are 23.2 W/M² and 19.8 W/M² for Terra and Aqua, respectively, and the biases are 7.8 W/M² and 10.5 W/M², respectively. The proposed method is especially applicable to acquire relatively high accurate DSLR under heavy dust aerosol using MODIS data with available WVC and AOD data.

This paper aims at presenting an energy management strategy (EMS) based upon optimal control theory for a battery-supercapacitor hybrid power system. The hybrid power system consists of a Lithium-ion battery and a supercapacitor with associated bidirectional DC/DC converters. The proposed EMS aims at computing adaptive gains using salp swarm algorithm and load following control technique to assign the power reference for both the supercapacitor and the battery while achieving optimal performance and stable voltage. The DC-DC converter model is derived utilizing the first-principles method and compute the required gains to achieve the desired power. The fact that the developed algorithm takes disturbances into account increases the power ele-ments’ life expectancies and supplies the power system with the required power

ABSTRACT Ethiopia is a developing country, where majority of the population lives in rural areas without access to electricity. 83% of the total population of the country use traditional biomass energy as a basic source of energy. In contrast, the country is endowed with sufficient renewable energy resources which can be used as a standalone electric energy supply system for electrifying remote areas of the country. These resources are mainly micro hydropower and wind which can be used individually or the best combination of one another. The application of hybrid renewable energy system has become an important alternative solution for rural electrification program. The Modeling and control of a hybrid PV-Wind-Hydro DG system is also addressed. Dynamic models for the major system components, namely, wind energy conversion system, PV energy conversion system, hydro, inverter, and overall fuzzy logic controller units are developed. Then, a simulation model for the proposed hybrid power system has been developed using MATLAB /Simulink environment. This is done by creating subsystem sets of the major dynamic component models and then assembling into a single aggregate model. The overall power management strategy for coordinating and/or controlling the different energy sources is also presented in the thesis work. Generally there are 800 households with total electric demand of 71.6KW.To satisfy this demand 52%, 35% and 13% is to be contributed from wind/hydro/solar respectively. To use the power economically fuzzy logic controller is used. The controller monitors the demand and the available sources and then switches to the appropriate power supply according to the written rules. Simulations have been carried out to verify the system dynamic performance using a practical load profile and weather data. The result shows that the overall power management strategy is effective and the load demand is balanced. To complete this work, a grid extension from the closest substation has been compared with hybrid system. Cost of the grid extension is estimated based on the data obtained from EEP office. This is done in order to compare the cost of the designed hybrid power system against the cost of grid extension. The result shows that breakeven grid extension distance to be 23.9km which indicates that grid extension is preferable.

Memristors are state-of-the-art, nano-sized, two-terminal, passive electronic elements with very good switching and memory characteristics. Owing to their very low power usage and a good compatibility to the existing CMOS ultra-high-density integrated circuits and chips, they are po-tentially applicable in artificial and spiking neural networks, memory arrays, and many other de-vices and circuits for artificial intelligence. In this paper, a complete electronic realization of ana-log circuit model of modified neural net with memristor-based synapses and transfer function with memristors and MOS transistors in LTSPICE is offered. Each synaptic weight is realized by only one memristor, providing enormously reduced circuit complexity. The summing and scaling implementation is founded on op-amps and memristors. The logarithmic-sigmoidal activation function is based on a simple scheme with MOS transistors and memristors. The functioning of the suggested memristor-based neural network for pulse input signals is evaluated both analytically in MATLAB-SIMULINK and in LTSPICE environment. The obtained results are compared one to another and are successfully verified. The realized memristor-based neural network is an im-portant step towards the forthcoming design of complex memristor-based neural networks for ar-tificial intelligence, for implementation in very high-density integrated circuits and chips.

Arctic sea ice prediction holds significant importance for facilitating Arctic route planning, optimizing fisheries management, and advancing the field of sea ice dynamics research. While various deep learning models have been developed for sea ice prediction, they predominantly operate at the seasonal or sub-seasonal scale, often focusing on localized areas, and few cater to full-region daily scale prediction. This study introduces the use of spatiotemporal sequence data prediction models, namely, the convolutional LSTM (ConvLSTM) and predictive recurrent neural network (PredRNN), for the prediction of sea ice concentration (SIC). Our analysis reveals that, when solely utilizing SIC historical data as the input, the ConvLSTM model outperforms the PredRNN model in SIC prediction. To enhance the model's capacity to capture spatiotemporal relationships between multiple variables, we expanded the range of input data types to form the ConvLSTM-multi and PredRNN-multi models. Experimental findings demonstrate that the ConvLSTM-multi model excels in assimilating the influence of reanalysis data on sea ice within the sea ice edge region, thus exhibiting superior performance in predicting daily Arctic SIC over the subsequent 10 days. Furthermore, sensitivity tests on various model parameters highlight the substantial impact of sea surface temperature and prediction date on the accuracy of daily sea ice prediction. Additionally, meteorological and oceanographic parameters primarily affect the prediction accuracy of the thin ice region at the edge of the sea ice.

The study aims to analyze the characteristic parameters of rooftop photovoltaic (PV) power generation on industrial plant buildings in the Ningxia region of China, in order to evaluate the impact of passive design characteristic parameters on the benefits of PV power generation and determine the degree of impact of different passive design characteristic parameters. The methodology involves analyzing the characteristics of existing industrial plant buildings in Ningxia, China, and conducting a series of regional studies on the parameters of plant PV power generation influencing factors. The simulation results revealed that five features, including roof form, PV panel laying pattern, PV panel laying area, azimuth angle, and PV module material, have a significant impact on PV power generation benefits of industrial plant buildings.The study further uses MATLAB 2022b to build a backpropagation neural network model with 5 neurons in the implicit layer to predict the PV power generation benefits. The model calculates the whole-life cycle power generation benefits and the whole-life cycle reduction of carbon emissions as output data. Finally, the Mean Impact Value (MIV) method is employed to select the feature parameter values one by one within their range, and the passive design feature parameters that have the greatest influence on the prediction results are identified as the PV panel laying method, the PV panel tilt angle, and the PV material parameters, respectively.

The core of eLoran ground-based timing navigation system is the accurate measurement of groundwave propagation delay. However, meteorological changes will disturb the conductive characteristic factors along the groundwave propagation path, especially for complex terrestrial propagation environment, and may even lead to microsecond-level propagation delay fluctuation, seriously affecting the timing accuracy of the system. Aiming at this problem, this paper proposes a propagation delay prediction model based on Back-Propagation neural network (BPNN) for complex meteorological environment, which realizes the function of directly mapping propaga-tion delay fluctuation through meteorological factors. Firstly, the theoretical influence of meteoro-logical factors on each component of propagation delay is analyzed based on calculation parame-ters. Then, through the correlation analysis of the measured data, the complex relationship be-tween the seven main meteorological factors and the propagation delay, as well as their regional differences are demonstrated. Finally, a BPNN prediction model considering regional changes of multiple meteorological factors is proposed, and the validity of the model is verified by long-term collected data. Experimental results show that the proposed model can effectively predict the propagation delay fluctuation in the next few days, and its overall performance is significantly improved compared with the existing linear model and simple neural network model. eLoran; meteorological factor; propagation delay prediction model; Back-Propagation neural network;

With the automotive industry moving towards automated driving, sensing is increasingly important in enabling technology. The virtual sensors allow data fusion from various vehicle sensors and provide a prediction for measurement that is hard or too expensive to measure in another way or in the case of demand on continuous detection. In this paper, virtual sensing is discussed for the case of vehicle suspension control, where information about the relative velocity of the unsprung mass for each vehicle corner is required. The corresponding goal can be identified as a regression task with multi-input sequence input. The hypothesis is that the state-of-art method of Bidirectional Long-Short Term Memory (BiLSMT) can solve it. In this paper, a virtual sensor has been proposed and developed by training a neural network model. The simulations have been performed using an experimentally validated full vehicle model in IPG Carmaker. Simulations provided the reference data which was used for Neural Network (NN) training. The extensive dataset covering 26 scenarios has been used to obtain training, validation and testing data. The Bayesian Search was used to select the best neural network structure using root mean square error as a metric. The best network is made of 167 BiLSTM, 256 fully connected hidden units and 4 output units. Error histograms and spectral analysis of the predicted signal compared to the reference signal are presented. The results demonstrate the good applicability of neural network-based virtual sensors to estimate vehicle unsprung mass relative velocity.

A novel adaptive neural network-based fault-tolerant control scheme is proposed for six-degree freedom nonlinear helicopter dynamic. The proposed approach can detect and mitigate sensors' faults in real-time. An adaptive observer-based on neural network (NN) and extended Kalman filter (EKF) is designed, which incorporates the helicopter's dynamic model to detect faults in the navigation sensors. Based on the detected faults, an active fault-tolerant controller, including three loops of dynamic inversion, is designed to compensate for the occurred faults in real-time. The simulation results showed that the proposed approach is able to detect and mitigate different types of faults on the helicopter navigation sensors, and the helicopter tracks the desired trajectory without any interruption.

This study addresses the prediction of recurring failures in water supply networks, a complex and costly task, but essential for the effective maintenance of these vital infrastructures. Using historical failure data provided by Companhia de Água e Esgotos da Paraíba (CAGEPA), the research focuses on predicting the time until the next failure at specific points in the network. The authors divided the failures into two categories: Occurrences of New Faults (ONF) and Recurrences of Faults (RF). To make the predictions, they used predictive models based on Machine Learning, more specifically on MLP (Multi Layer Perceptron) neural networks. The study revealed that, by analyzing data from past failures and considering factors such as altitude, number of failures on the same street and days between failures, it is possible to achieve an accuracy greater than 80% in predicting failures within a 90-day interval. This demonstrates the feasibility of using fault history to predict future water supply outages with significant accuracy. These forecasts allow water utilities to plan and optimize their maintenance, minimizing inconvenience and losses. The article contributes to the field of water infrastructure management by suggesting that the data-driven approach can be applied in other cities or in networks of different types, such as energy or communication networks. The conclusions highlight the importance of data collection and analysis in preventing failures and optimizing water utilities’ resources.

Advances in reconfigurable liquid-based reconfigurable antennas are enabling new possibilities to fulfil the requirements of more advanced wireless communication systems. In this review, a comparative analysis of various state-of-the-art concepts and techniques for designing reconfigurable antennas using liquid is presented. First, the electrical properties of different liquids at room temperature commonly used in reconfigurable antennas are identified. This is followed by a discussion of various liquid actuation techniques in enabling high frequency reconfigurability. Next, liquid-based reconfigurable antennas in literature used to achieve the different types of reconfiguration will be critically reviewed. These include frequency-, polarization-, radiation pattern- and compound reconfigurability. The current concepts of liquid-based reconfigurable antennas can be classified broadly into three basic approaches: altering the physical (and electrical) dimensions of antennas using liquid, applying liquid-based sections as reactive loads; and implementation of liquids as dielectric resonators. Each concept and their design approaches will be examined, outlining their benefits, limitations, and possible future improvements.

This paper numerically investigates a 3D mesh independency study of a straight blade horizontal axis tidal turbine modelled using Computational Fluid Dynamics (CFD). The solution was produced by employing two turbulence models, the standard k-ε model and Shear Stress Transport (SST) in ANSYS CFX. Three parameters were investigated: mesh resolution, turbulence model, and power coefficient in the initial CFD, analysis. It was found that the mesh resolution and the turbulence model affect the power coefficient results. The power coefficients obtained from the standard k-ε model are 15% to 20% lower than the accuracy of the SST model. It can also be demonstrated that the torque coefficient increases with the increasing Tip Speed Ratio (TSR), but drops drastically after TSR = 5 and k-ε model failing to capture the non-linearity in the torque coefficient with the increasing TSR.

With the integrated development of the Internet, wireless sensor technology, cloud computing, and mobile Internet, there has been a lot of attention given to research about and applications of the Internet of Things. A Wireless Sensor Network (WSN) is one of the important information technologies in the Internet of Things; it integrates multi-technology to detect and gather information in a network environment by mutual cooperation, using a variety of methods to process and analyze data, implement awareness, and perform tests. This paper mainly researches the localization algorithm of sensor nodes in a wireless sensor network. Firstly, a multi-granularity region partition is proposed to divide the location region. In the range-based method, the RSSI (Received Signal Strength indicator, RSSI) is used to estimate distance. The optimal RSSI value is computed by the Gaussian fitting method. Furthermore, a Voronoi diagram is characterized by the use of dividing region. Rach anchor node is regarded as the center of each region; the whole position region is divided into several regions and the sub-region of neighboring nodes is combined into triangles while the unknown node is locked in the ultimate area. Secondly, the multi-granularity regional division and Lagrange multiplier method are used to calculate the final coordinates. Because nodes are influenced by many factors in the practical application, two kinds of positioning methods are designed: the unknown node is in the positioning unit or not. When the unknown node is on the side of the positioning unit, we use the method of vector similarity. Moreover, we use the centroid algorithm to calculate the ultimate coordinates of unknown node. When the unknown node is not on the side of the positioning unit, we establish a Lagrange equation containing the constraint condition to calculate the first coordinates. Furthermore, we use the Taylor expansion formula to correct the coordinates of the unknown node. In addition, this localization method has been validated by establishing the real environment.

This study explores the use of Bayesian Neural Networks (BNNs) for estimating chlorophyll-a concentration ([CHL-a]) from remotely sensed data. The BNN model enables uncertainty quantification, offering additional layers of information compared to traditional ocean colour models. An extensive in situ bio-optical dataset is utilized, generated by merging 27 data sources across the world’s oceans. The BNN model demonstrates remarkable capability in capturing mesoscale features and ocean circulation patterns, providing comprehensive insights into spatial and temporal variations in [CHL-a] across diverse marine ecosystems. In comparison to established ocean colour algorithms, such as Ocean Colour 4 (OC4), the BNN shows comparable performance in terms of correlation coefficients, errors, and biases when compared with the in situ data. The BNN, however, further provides critical information about the distribution of [CHL-a], which can be used to assess uncertainties in the prediction. Moreover, the BNN model’s ability to provide more information for coastal waters, especially with higher spatial resolution imagery, offers valuable advantages for marine research and management. By quantifying uncertainty, the model builds confidence in [CHL-a] predictions, even in regions with limited data coverage. This is reflected by the spread in the model predictions, where the BNN can detect a range of uncertainty bounds that reflect confidence in the retrievals. Introducing BNNs as probabilistic ocean colour models represents a significant advancement, enabling more accurate and reliable predictions of [CHL-a] in the global oceans.

In this paper, carbon nanotubes modified screen-printed electrode (CNTs/SPE) was prepared and the CNTs/SPE was employed for the electrochemical determination of antioxidant substance Chlorogenic acids (CGAs). A pair of well-defined redox peak of CGA was observed at the CNTs/SPE in 0.10 mol∙L^-1 acetic acid-sodium acetate buffer (pH 6.2) and electrode process is adsorption-controlled. Cyclic voltammetry (CV) and differential pulse voltammetry (DPV) method for the determination of CGA were proposed based on the CNTs/SPE. Under the optimal conditions, the proposed method exhibited linear ranges from 4.73×10^-7 to 4.45×10^-5 mol∙L^-1, the linear regression equation was Ipa(µA) = 4.1993 C (mol∙L^-1)+1.1039 (r = 0.9976) and the detection limit for CGA could reach 3.25×10^-6 mol∙L^-1. The recovery of matrine was 94.74~106.65% (RSD = 2.92%) in coffe beans. The proposed method is quick, sensitive, reliable, and can be used for the determination of CGA.

The article presents an innovative method for synthesizing radiation patterns efficiently by 1 combining the Taguchi method and neural networks, while validating the results on a 10-element 2 antenna array. The Taguchi method aims to minimize product and process variability, while neural 3 networks are used to model the relationship between antenna design parameters and radiation 4 pattern characteristics. This approach utilizes Taguchi parameters as inputs for the neural network, 5 which is then trained on a dataset generated by the Taguchi method. After training, the network is 6 validated using a real 10-element antenna array. Analytical results demonstrate that this method 7 enables efficient synthesis of radiation patterns with a significant reduction in computation time 8 compared to traditional approaches. Furthermore, validation on the antenna array confirms the 9 accuracy and robustness of the approach, showing a high correlation between predicted performances 10 by the neural network model and actual measurements on the antenna array.In summary, our article 11 highlights that the combined use of the Taguchi method and neural networks, with validation on a 12 real antenna array, offers a promising approach for efficient synthesis of antenna radiation patterns. 13 This approach combines speed, accuracy, and reliability in antenna system design.

We describe a machine learning (ML) approach to process the signals collected from Covid-19 optical-based detector. Multilayer Perceptron (MLP) and Support Vector Machine (SVM) were used to process both raw data and feature engineering data, and high performances for qualitative detection of the SARS-CoV-2 virus with concentration down to 1 TCID50/ml has been achieved. Valid detection experiments contain 486 negative and 108 positive samples; and control experiments, in which biosensors without antibody functionalization were used to detect SARS-CoV-2, contains 36 negative samples and 732 positive samples. Data distribution patterns of the valid and control detection dataset, based on T-distributed Stochastic Neighbor Embedding (t-SNE), was used to study the distinguishability between positive and negative samples, and explain the ML prediction performances. This work demonstrates that ML can be a generalized effective approach to process signals and dataset of biosensors dependent on resonant modes as biosensing mechanism.

Intrahepatic cholangiocarcinoma (ICCA) is a malignant epithelial neoplasm characterized by biliary differentiation within the liver. ICCA is molecularly heterogeneous and exhibits a broad spectrum of histopathological features. It is a highly aggressive carcinoma with high mortality and poor survival rates. ICCAs are classified into two main subtypes: small duct type and large duct types. These two tumor types have different cell origins and clinicopathological features. ICCAs are characterized by numerous molecular alterations, including mutations in KRAS, TP53, IDH1/2, ARID1A, BAP1, BRAF, SAMD4, and EGFR, and FGFR2 fusion. Two main molecular subtypes–inflammation and proliferation–have been proposed. Recent advances in high-throughput assays using next-generation sequencing have improved our understanding of ICCA pathogenesis and molecular genetics. The diagnosis of ICCA poses a significant challenge for pathologists because of its varied morphologies and phenotypes. Accurate diagnosis of ICCA is essential for effective patient management and prognostic determination. This article provides an updated overview of ICCA pathology, focusing particularly on molecular features, histological subtypes, and diagnostic approaches.

In this paper, we examine two strategies for boosting the performance of ensembles of Siamese networks (SNNs) for image classification using two loss functions (Triplet and Binary Cross Entropy) and two methods for building the dissimilarity spaces (FULLY and DEEPER). With FULLY, the distance between a pattern and a prototype is calculated by comparing two images using the fully connected layer of the Siamese network. With DEEPER, each pattern is described using a deeper layer combined with dimensionality reduction. The basic design of the SNNs takes advantage of supervised k-means clustering for building the dissimilarity spaces that train a set of support vector machines, which are then combined by sum rule for a final decision. The robustness and versatility of this approach are demonstrated on several cross-domain image data sets, including a portrait data set, two bioimage and two animal vocalization data sets. Results show that the strategies employed in this work to increase the performance of dissimilarity image classification using SNN is closing the gap with standalone CNNs. Moreover, when our best system is combined with an ensemble of CNNs, the resulting performance is superior to an ensemble of CNNs, demonstrating that our new strategy is extracting additional information.

Background and Objectives: Knee osteoarthritis (KOA) is a degenerative disease that is targeting continuously people of different ages, but especially the elderly population, the number of which tends to increase continuously at the global level. Apart from age, excess weight can influence the evolution of the disease, with obesity being associated with a weak inflammation stage, and an imbalance between pro-inflammatory and anti-inflammatory cytokines. The present work aimed to identify specific biomarkers alike ACRP-30, IL-10, TNF-α, and IL-6 in synovial fluid and correlate them with patients’ clinical data. Materials and Methods: 24 subjects with KOA and over 50 years of age are involved in the present study. All patients performed a supine X-ray at the target knee. Ultrasound was performed using an ESAOTE MyLab Omega (ESAOTE Spa, Italy) ultrasound device and a 6-19 MHz linear array transducer. Results: The obtained results highlighted a significant correlation between age and adiponectin level (p=0.0451, r=-0.412). Also, the IL-10 values are lower in cases where the intensity of the pain is more pronounced (p=0.0405, r=-0.421). In addition, analyzing the data by gender, it was observed that in the case of males, stiffness is more related to age (p=0.0079, r=0.7993), compared to women (p=0.0203, r=0.6223). In the case of women, the progression of the disease tends to increase more intensively total WOMAC score’s values (p=0.00031, r=0.8342), compared with men (p=0.0289, r=7013). Regarding interleukins and BMI, significant correlations were observed only in the case of men. Conclusions: A significant correlation between age and adiponectin, and adiponectin and IL-6, suggests that advanced age may contribute to adiponectin reduction. Comparing men with women, it was observed that men's age is more related to rigidity, and IL-6 and IL-10 are directly correlated to BMI and women seem to be more sensitive to pain and stiffness.

In this paper, we propose and demonstrate a network analysis optical frequency domain reflectometer (NA-OFDR) for distributed temperature measurements at high spatial (down to 3 cm) and temperature resolution. The system makes use of a frequency-stepped, continuous-wave (cw) laser, whose output light is modulated using a vector network analyzer. The latter is also used to demodulate the amplitude of the beat signal obtained by coherently mixing the Rayleigh backscattered light with a local oscillator. The system is capable of high measurand resolution (50 mK at 3-cm spatial resolution), thanks to the high sensitivity of coherent Rayleigh scattering to temperature. Furthermore, compared to the conventional optical-frequency domain reflectometry (OFDR), the proposed system does not rely on the use of a tunable laser, therefore it is less prone to limitations related to the laser coherence or sweep nonlinearity. Two configurations are analyzed, both numerically and experimentally, based on either a double sideband or single sideband modulated probe light. The results confirm the validity of the proposed approach.

In contemporary construction, the prevalence of vibration serviceability issues in lightweight and slender structures has become increasingly common, owing to advancements in building materials and construction methods. While these structures often meet the criteria for ultimate limit states, they can still elicit complaints due to excessive vibrations induced by human activity. To address this challenge, the Integral Resonant Control (IRC) technique has emerged as a favored approach for actively damping vibrations in various systems. This study introduces a fresh perspective on implementing a multi-input multi-output (MIMO) IRC scheme for active vibration control (AVC) specifically tailored for pedestrian structures utilizing inertial mass actuators. Building upon a common framework and design methodology outlined in previous research, this work presents a novel application of MIMO IRC for AVC. The designed controller is rigorously tested and implemented on a laboratory floor structure to validate its efficacy.

This dossier is aimed at individuals involved in the development, implementation, and application of AI-supported systems in the field of education, particularly those who are dealing with metadata in this context. The insights and recommendations described in this dossier are based on interviews with five experts from the USA and UK, research on metadata standards, and our personal experiences in the context of the INVITE competition. This dossier provides an overview of the current development of learning metadata and existing standards. It shows the efforts and obstacles to introducing those metadata standards from an international perspective based on interviews with five experts in the field. Furthermore, this dossier shows the international experiences in selecting and using metadata standards and how these findings can inspire discussions in the German-speaking discourse regarding the use of metadata in education.

This paper explores the capability of various machine learning algorithms, including Random Forests and advanced gradient boosting techniques such as XGBoost, LightGBM, and CatBoost, to predict customer churn in the telecommunications sector. For this analysis, a dataset available to the public was employed. The performance of these algorithms was assessed using recognized metrics, including Accuracy, Precision, Recall, F1-score, and the Receiver Operating Characteristic Area Under Curve (ROC AUC). These metrics were evaluated at different phases: subsequent to data preprocessing and feature selection; following the application of SMOTE and ADASYN sampling methods; and after conducting hyperparameter tuning on the data that had been adjusted by SMOTE and ADASYN. The outcomes underscore the notable efficiency of upsampling techniques such as SMOTE and ADASYN in addressing the imbalance inherent in customer churn prediction. Notably, the application of random grid search for hyperparameter optimization did not significantly alter the results, which remained comparatively unchanged. The algorithms' performance post- ADASYN application marginally surpassed that observed after SMOTE application. Remarkably, LightGBM achieved an exceptional F1-score of 89% and an ROC AUC of 95% subsequent to the ADASYN sampling technique. This underlines the effectiveness of advanced boosting algorithms and upsampling methods like SMOTE and ADASYN in navigating the complexities of imbalanced datasets and intricate feature interdependencies.

Nowadays, the Internet of Things (IoT) devices and applications have rapidly expanded worldwide due to their benefits in improving the business environment, industrial environment, and people's daily lives. However, the IoT devices are not immune to malicious network traffic, which causes potential negative consequences and sabotages IoT operating devices. Therefore, developing a method for screening network traffic is necessary to detect and classify malicious activity to mitigate its negative impacts. Therefore, this research proposes a predictive machine learning model to detect and classify network activity in an IoT system. Specifically, our model distinguishes between normal and anomaly network activity. Furthermore, it classifies network traffic into five categories, normal, Mirai attack, denial of service (DoS) attack, Scan attack, and man-in-the-middle (MITM) attack. Five supervised learning models were implemented to characterize their performance in detecting and classifying network activities for IoT systems. This includes models shallow neural networks (SNN), decision trees (DT), bagging trees (BT), support vector machine (SVM), and k-nearest neighbor (kNN). The learning models were evaluated on a new and broad dataset for IoT attacks, the IoTID20 dataset. Besides, a deep feature engineering process was applied to the dataset to improve the accuracy of the learning models. Our experimental evaluation exhibited an accuracy of 100% recorded for the detection using all implemented models and an accuracy of 99.4%-99.9% recorded for the classification process.

Coconut is an important multipurpose crop wherein different stages of its maturity are used for different products. Traditional approach of its classification use sound formed by tapping the fruit, and the tapper will base its judgment through the sound he heard. The procedure was highly subjective and attempts had been made by other researchers to automate and classify the adulthood of the coconut objectively. Nowadays, deep learning techniques are being utilized to solve classification problems. One such method is Convolutional Neural Network (CNN) that takes raw pixel data, learns to extract features, and ultimately classifies the input. In this study, a portable device was developed that takes audio signals generated from tapping the fruit mechanically. This audio clip was converted to spectrogram and was used as input to a LeNet CNN architecture. We argue that CNN classifier has improved accuracy compared to the non-deep learning system. Our evaluation confirmed that the use of CNN had improved the accuracy of classifying coconut by about 15%.

In recent years, Neural networks are increasingly deployed in various fields to learn complex patterns and make accurate predictions. However, designing an effective neural network model is a challenging task that requires careful consideration of various factors, including architecture, optimization method, and regularization technique. This paper aims to comprehensively overview the state-of-the-art artificial neural network (ANN) generation and highlight key challenges and opportunities in machine learning applications. It provides a critical analysis of current neural network model design methodologies, focusing on the strengths and weaknesses of different approaches. Also, it explores the use of different learning approaches, including convolutional neural networks (CNN), deep neural networks (DNN), and recurrent neural networks (RNN) in image recognition, natural language processing, and time series analysis. Besides, it discusses the benefits of choosing the ideal values for the different components of ANN, such as the number of Input/output layers, hidden layers number, activation function type, epochs number, and model type selection, which help improve the model performance and generalization. Furthermore, it identifies some common pitfalls and limitations of existing design methodologies, such as overfitting, lack of interpretability, and computational complexity. Finally, it proposes some directions for future research, such as developing more efficient and interpretable neural network architectures, improving the scalability of training algorithms, and exploring the potential of new paradigms, such as Spiking Neural Networks, quantum neural networks, and neuromorphic computing.

Microgrids (MGs) have evolved as critical components of modern energy distribution networks, providing increased dependability, efficiency, and sustainability. Effective control strategies are essential for optimising MG operation and maintaining stability in the face of changing environmental and load conditions. Traditional rule-based control systems are extensively used due to their interpretability and simplicity. However, these strategies frequently lack the flexibility for complex and changing system dynamics. This paper provides a novel method called hybrid intelligent control for adaptive MG that integrates basic rule-based-control and deep learning techniques, including gated recurrent units (GRU), basic recurrent neural network (RNN) and long short-term memory (LSTM). The main target of this hybrid approach is to improve MG management performance by combining the strengths of basic rule-based systems and deep learning techniques. These deep learning techniques readily enhance and adapt control decisions based on historical data and domain-specific rules, leading to increasing system efficiency, stability, and resilience in adaptive MG. Our results show that the proposed method optimises MG operation, especially under demanding conditions such as variable renewable energy supply and unanticipated load fluctuations. This study investigates special RNN architectures and hyper-parameter optimization techniques with the aim of predicting power consumption and generation within the adaptive MG system. Our promising results show the highest-performing models indicating high accuracy and efficiency in power prediction. The finest-performing model accomplishes an R2 value close to 1, representing a strong correlation between predicted and actual power values.

In the realm of computer vision, semantic segmentation is the task of recognizing objects in images at the pixel level. This is done by performing a classification of each pixel. The task is complex and requires sophisticated skills and knowledge about the context to identify objects’ boundaries. The importance of semantic segmentation in many domains is undisputed. In medical diagnostics, it simplifies the early detection of pathologies, thus mitigating the possible consequences. In this work, we provide a review of the literature on deep ensemble learning models for polyp segmentation and we develop new ensembles based on convolutional neural networks and transformers. The development of an effective ensemble entails ensuring diversity between its components. To this end, we combine different models (HarDNet-MSEG, Polyp-PVT, and HSNet) trained with different data augmentation techniques, optimization methods, and learning rates, which we experimentally demonstrate to be useful to form a better ensemble. Most importantly, we introduce a new method to obtain the segmentation mask which is more suitable for combining transformers in an ensemble. In our extensive experimental evaluation, the proposed ensembles exhibit state-of-the-art performance.

We demonstrate a photonic RF integrator based on an integrated soliton crystal micro-comb source. By multicasting and progressively delaying the input RF signal using a transversal structure, the input RF signal is integrated discretely. Up to 81 wavelengths are provided by the microcomb source, which enable a large integration time window of ~6.8 ns, together with a time resolution as fast as ~84 ps. We perform signal integration of a diverse range of input RF signals including Gaussian pulses with varying time widths, dual pulses with varying time intervals and a square waveform. The experimental results show good agreement with theory. These results verify our microcomb-based integrator as a competitive approach for RF signal integration with high performance and potentially lower cost and footprint.

Pedestrian object detection plays a significant role in intelligent systems such as intelligent traffic and monitoring. Traditional machine learning methods on pedestrian detection have shown various drawbacks, \eg{} low accuracy, slow speed, \etc The Convolutional Neural Network (CNN) based object detection algorithms have demonstrated remarkable advantages in the field of pedestrian detection. However, the mainstream CNNs still face the problems of slow speed and low detection accuracy, especially on small and occluded targets from aerial perspective. In this paper, we propose Multi-Scale Attention YOLO (MSA-YOLO) detection algorithm to address the above issues. MSA-YOLO includes a Squeeze, Excitation and Cross Stage Partial (SECSP) channel attention module for CNNs to extract richer pedestrian features with a small number of extra parameters. It also contains a multi-scale prediction module to capture the information among different pedestrian scales, which can recognize the small objects with higher accuracy and significantly reduce the missed detection. To sufficiently evaluate our proposed model, we manually collect and annotate a new benchmark dataset, Luoyang Pedestrian Dataset \footnote{The dataset can be downloaded through this anonymous link: \url{https://drive.google.com/drive/folders/13po1FX7Qk5RDgb60-dzOi74cq_kqDJtM?usp=sharing} }, which has much more sample annotations, features, scenes and image view angles than the existing benchmark datasets. In addition, the images in our dataset have higher resolution than most of benchmark pedestrian detection datasets, which can provide more detailed features of pedestrians and thus improve the model performance. When tested on Luoyang Pedestrian Dataset, our proposed MSA-YOLO algorithm significantly outperform the most commonly used baseline models with almost the same model size. This shows the efficiency of our proposed model. (The code and new dataset will be released to the public later.)

Photoelectric smoke detectors are the most cost-effective devices for very early fire alarms. However, due to different light intensity response values for different fire smoke and interference from interferential aerosols, they have a high false alarm rate, which limits their popularity in Chinese homes. To address these issues, an embedded spatial-temporal convolutional neural network (EST-CNN) model is proposed for real fire smokes identification and aerosols (fire smokes and interferential aerosol) classification. EST-CNN consists of three modules including information fusion, scattering feature extraction, and aerosol classification. Moreover, a two dimensional spatial-temporal scattering (2D-TS) matrix is designed to fuse the scattered light intensities in different channels and adjacent time slices, which is the output of the information fusion module and the input of the scattering feature extraction module. EST-CNN is trained and tested with experimental data measured on the established fire test platform using the developed dual-wavelength dual-angle photoelectric smoke detector. The optimal network parameters are selected through extensive experiments resulting in an average classification accuracy of 95.6% for different aerosols with only 66 kB network parameters. The experimental results demonstrate the feasibility of the designed EST-CNN model to be directly installed in existing commercial photoelectric smoke detectors to realize aerosol classification.

To digital grade the color fastness of fabrics after rubbing, an automatic grading method based on spectral reconstruction technology and BP neural network was proposed. Firstly, the modeling samples are prepared by rubbing the fabrics according to the ISO standard of 105-X12. Then, to comply with visual rating standards for color fastness, the modeling samples are professionally graded to obtain the visual rating result. After that, a digital camera is used to capture digital images of the modeling samples inside a closed and uniform lighting box, and the color data values of the modeling samples are obtained through spectral reconstruction technology. Finally, the color fastness prediction model for rubbing was constructed using the modeling samples data and BP neural network. The color fastness level of the testing samples was predicted using the prediction model, and the prediction results were compared with the existing color difference conversion method and curve fitting method. Experimental show that the prediction model of fabric color fastness can be better constructed using the BP neural network, where the root-mean-square error of the prediction for the training sample is 0.30, and the root-mean-square error of the prediction for the test sample is 0.25. The overall performance of the method is slightly better than the color difference conversion method, and it is significantly outperforming the curve fitting method. It can be seen that the digital rating method of fabric color fastness to rubbing based on spectral reconstruction and BP neural network has a high consistency with the visual evaluation, which will help for the automatic color fastness grading.

The accurate identification of the primary tumor origin in metastatic cancer cases is crucial for guiding treatment decisions and improving patient outcomes. Copy Number Alterations (CNA) have emerged as valuable genomic markers for predicting the origin of metastases. This research article presents a comprehensive analysis of CNA-based prediction models in metastatic cancer. The study utilizes a dataset comprising CNA profiles from twenty different cancer types and employs advanced AI-based techniques for prediction. The research workflow consists of two models. The first is convolution network-based, while the other is a multi-stage model. In the first stage, a RELU model is developed to differentiate between 16 cancer types, considering their CNA, chromosome location, strand, and overall location. The second stage involves building specialized models to detect differences between cancer types within the same location or organs, such as brain lower-grade glioma and glioblastoma multiforme. Both generalized models achieve an overall accuracy of over 90%, while the specialized models achieve an accuracy of approximately 95% with minimal loss values. The results demonstrate the potential of AI-based approaches utilizing CNA data for improved diagnosis and personalized treatment strategies in metastatic cancer. This research establishes a solid foundation for future advancements in the field, paving the way for more effective and targeted approaches in metastatic cancer management.

In order to solve the labor-intensive and time-consuming problem in the process of measuring yak body ruler and weight in yak breeding industry in Qinghai Province, a non-contact method for measuring yak body ruler and weight was proposed in this experiment, and key technologies based on semantic segmentation, binocular ranging and neural network algorithm were studied to boost the development of yak breeding industry in Qinghai Province. Main conclusions: (1) Study yak foreground image extraction, and implement yak foreground image extraction model based on U-net algorithm; select 2263 yak images for experiment, and verify that the accuracy of the model in yak image extraction is over 97%. (2) Develop an algorithm for estimating yak body ruler based on binocular vision, and use the extraction algorithm of yak body ruler related measurement points combined with depth image to estimate yak body ruler. The final test shows that the average estimation error of body height and body oblique length is 2.6%, and the average estimation error of chest depth is 5.94%. (3) Study the yak weight prediction model; select the body height, body oblique length and chest depth obtained by binocular vision to estimate the yak weight; use two algorithms to establish the yak weight prediction model, and verify that the average estimation error of the model for yak weight is 10.7% and 13.01% respectively.

High-strength low-alloy steels (HSLAs) are widely used in the structural body components of many domestic motor vehicles owing to their better mechanical properties and greater resistance. The real production process of HSLA steelmaking can be regarded as a model that builds on the relationship between process parameters and product quality attributes. A surrogate modeling method is used, and the resulting production process model can be applied to predict the optimal manufacturing process parameters. We used different methods in this paper to build such a surrogate model, including linear regression, random forests, support vector regression, multilayer perception, and a simplified VGG model. We then applied three bio-inspired search algorithms, namely particle swarm optimization, the artificial bee colony algorithm, and the firefly algorithm, to search for the optimal controllable manufacturing process parameters. Through experiments on 9,000 test samples used for building the surrogate model, and 299 test samples for making the optimal process parameter selection, we found that the combination of a simplified VGG model and the firefly algorithm was the most successful at reaching a success rate of 100%—in other words, when the product quality attributes of all test samples satisfy the mechanical requirements of the end products.

Knowledge-based approaches are useful alternatives to predict the Failure Probability (FP) coping with the insufficient data, process integrity, and complexity issue in manufacturing systems. This study proposes a Fault Tree Analysis (FTA) approach as proactive knowledge-based technique to estimate the FP based maintenance planning with subjective information from domain experts. However, the classical-FTA still suffers from uncertainty and static structure limitations which poses a substantial dilemma in predicting FP. To deal with the uncertainty issues, a Fuzzy-FTA (FFTA) model was developed by statistical analysing the effective attributes such as experts' trait impacts, scales variation and, assorted membership and defuzzification functions. Besides, a Bayesian Network (BN) theory was conducted to overcome the static limitation of classical-FTA. The results of FFTA model revealed that the changes in decision attributes were not statistically significant on FP variation while BN model considering conditional rules to reflect the dynamic relationship between events had more impact on predicting FP. After all, the integrated FFTA-BN model was used in the optimization model to find the optimal maintenance intervals according to estimated FP and the total expected cost. As a practical example, the proposed model was implemented in a semi-automatic filling system in an automotive production line. The outcomes could be useful for upgrading the availability and safety of complex equipment in manufacturing systems.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

In this research, the application of the Physics-Informed Neural Network (PINN) model is explored to solve transport equation-based Partial Differential Equations (PDEs). The primary objective is to analyze the impact of different activation functions incorporated within the PINN model on its predictive performance, specifically assessing the Mean Squared Error (MSE) and Mean Absolute Error (MAE). The dataset used in the study consists of a varied set of input parameters related to strut diameter, unit cell size, and the corresponding yield stress values. Through this investigation, the aim is to understand the effectiveness of the PINN model and the significance of choosing appropriate activation functions for solving complex PDEs in real-world applications. The outcomes suggest that the choice of activation function may have minimal influence on the model's predictive accuracy for this particular problem. The PINN model showcases exceptional generalization capabilities, indicating its capacity to avoid overfitting with the provided dataset. The research underscores the importance of striking a balance between performance and computational efficiency while selecting an activation function for specific real-world applications. These valuable findings contribute to advancing the understanding and potential adoption of PINN as an effective tool for solving challenging PDEs in diverse scientific and engineering domains.

Grapes are a globally popular fruit, with grape cultivation worldwide being second only to citrus. This article focuses on the low efficiency and accuracy of traditional manual grading of red grape external appearance and proposes a small-sample red grape external appearance grading model based on transfer learning with convolutional neural networks (CNNs). Initially, the CNN transfer learning method was used to transfer the pre-trained AlexNet, VGG16, GoogleNet, InceptionV3, and ResNet50 network models on the ImageNet image dataset to the red grape image grading task. By comparing the classification performance of the CNN models of these five different network depths with fine-tuning, ResNet50 with a learning rate of 0.001 and a loop number of 10 was determined to be the best feature extractor for red grape images. Moreover, given the small number of red grape image samples in this study, different convolutional layer features output by the ResNet50 feature extractor were analyzed layer by layer to determine the effect of deep features extracted by each convolutional layer on SVM classification performance. This analysis helped to obtain a ResNet50+SVM red grape external appearance grading model based on the optimal ResNet50 feature extraction strategy. Experimental data showed that the classification model constructed using the feature parameters extracted from the 10th node of the ResNet50 network achieved an accuracy rate of 95.08% for red grape grading. These research results provide a reference for the online grading of red grape clusters based on external appearance quality and have certain guiding significance for the quality and efficiency of grape industry circulation and production.

In this essay, I revisit Neural Networks (NNs) through the lens of evolutionary dynamics. From the two most important features of NNs, I recover the two most general equations of evolutionary dynamics. These two equations may thus serve as a connection between NNs and a body of knowledge that has been built over multiple centuries and has found application across a vast range of disciplines. This connection may therefore also help explain why NNs with the two features in question are applicable across a much broader range of domains than initially envisioned.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

Creating self-learning algorithms, developing deep neural networks and improving other methods that "learn" for various areas of human activity is the main goal of the theory of machine learning. It helps to replace the human with a machine, aiming to increase the quality of production. The theory of artificial neural networks, which already have replaced the humans in problems of detection of moving objects, recognition of images or sounds, time series prediction, big data analysis and numerical methods remains the most dispersed branch of the theory of machine learning. Certainly, for each area of human activity it is necessary to select appropriate neural network architectures, methods of data processing and some novel tools from applied mathematics. But the universal problem for all these neural networks with specific data is the achieving the highest accuracy in short time. Such problem can be resolved by increasing sizes of architectures and improving data preprocessing, where the accuracy rises with the training time. But there is a possibility to increase the accuracy without time growing, applying optimization methods. In this survey we demonstrate existing optimization algorithms of all types, which can be used in neural networks. There are presented modifications of basic optimization algorithms, such as stochastic gradient descent, adaptive moment estimation, Newton and quasi-Newton optimization methods. But the most recent optimization algorithms are related to information geometry, for Fisher-Rao and Bregman metrics. This approach in optimization extended the theory of classic neural networks to quantum and complex-valued neural networks, due to geometric and probabilistic tools. There are provided applications of all introduced optimization algorithms, what delighted many kinds of neural networks, which can be improved by including any advanced approaches in minimization of the loss function. Afterwards, we demonstrated ways of developing optimization algorithms in further researches, engaging neural networks with progressive architectures. Classical gradient based optimizers can be replaced by fractional order, bilevel and, even, gradient free optimization methods. There is a possibility to add such analogues in graph, spiking, complex-valued, quantum and wavelet neural networks. Besides the usual problems of image recognition, time series prediction, object detection, there are many are other tasks for modern theory of machine learning, such as solving problem of quantum computations, partial differential and integro-differential equations, stochastic processes and Brownian motion, making decisions and computer algebra.

Creating intelligent systems capable of recognizing emotions is a difficult task, especially when looking at emotions in animals. This paper describes the process of designing a “proof of concept” system to recognize emotions in horses. This system is formed by two elements, a detector and a model. The detector is a fast region-based convolutional neural network that detects horses in an image. The model is a convolutional neural network that predicts the emotions of those horses. These two elements were trained with multiple images of horses until they achieved high accuracy in their tasks. 400 images of horses were collected and labeled to train both the detector and the model while 80 were used to validate the system. Once the two components were validated, they were combined into a testable system that would detect equine emotions based on established behavioral ethograms indicating emotional affect through head, neck, ear, muzzle and eye position. The system showed an accuracy of between 69% and 74% on the validation set, demonstrating that it is possible to predict emotions in animals using autonomous intelligent systems. Such a system has multiple applications including further studies in the growing field of animal emotions as well as in the veterinary field to determine the physical welfare of horses or other livestock.

In recent years, the field of deep learning achieved considerable success in pattern recognition, image segmentation and may other classification fields. There are a lot of studies and practical applications of deep learning on images, video or text classification. In this study, we suggest a method for changing the architecture of the most performing CNN models with the aim of designing new models to be used as stand-alone networks or as a component of an ensemble. We propose to replace each activation layer of a CNN (usually a ReLu layer) by a different activation function stochastically drawn from a set of activation functions: in this way the resulting CNN has a different set of activation function layers.

In this paper, we leverage state of the art models on Imagenet data-sets. We use the pre-trained model and learned weighs to extract the feature from the Dog breeds identification data-set. Afterwards, we applied fine-tuning and dataaugmentation to increase the performance of our test accuracy in classification of dog breeds datasets. The performance of the proposed approaches are compared with the state of the art models of Image-Net datasets such as ResNet-50, DenseNet-121, DenseNet-169 and GoogleNet. we achieved 89.66% , 85.37% 84.01% and 82.08% test accuracy respectively which shows the superior performance of proposed method to the previous works on Stanford dog breeds datasets.

Recent advancements in semiconductor photonic and electronic devices such as Uni-travelling-carrier photodiodes (UTC-PDs), have played a significant role in the development of Terahertz communication technology. However, a major challenge that still persists is the limited output power from a single UTC-PD required for practical transmission distances. To enhance the output power, we propose and demonstrate a novel Terahertz wave power combining technique using a photomixer device that comprises of two arrayed UTC-PDs monolithically integrated with a microstrip line-based 2 × 1 Wilkinson power combiner and a rectangular patch antenna on a Silicon Carbide (SiC) substrate at 300 GHz. At photocurrents of 8 mA and 10 mA from the two UTC-PDs, the device experimentally exhibited a 7.3 dB increase in power relative to the power obtained with 8 mA UTC-PD and a 4.4 dB increase in power relative to the power obtained with 10 mA UTC-PD, when both UTC-PDs were irradiated. This implies that power can be enhanced by a factor of N2 if the photocurrent is multiplied by a factor of N. This technology presents a holistic and cutting edge platform for further power multiplication by further increasing the number of arrayed UTC-PDs.

A novel quasi-twisted miniaturized wideband Branch Line Coupler (BLC) is proposed. The design is based on bisecting the conventional microstrip line BLC transversely and folding bisected sections on double-layered substrates with a common ground plane in between. The pair of quarter wavelength horizontal parallel arms is converted to a Z-shape meandered microstrip line in the designed structure. On the other hand, the pair of quarter wavelength vertical arms are cut by half into two lines and converted to a periodically loaded slow wave structure. The bisected parts of BLC are placed on the opposite side of the doubled-layer substrate and connected through four vias passing through the common ground plane. This technique enabled a compact BLC size of 6.4×18 mm2, which corresponds to a surface area miniaturization by ~50% as compared to the classical BLC size of 10×23 mm2 at 6GHz, Moreover, the attained relative bandwidth is 73.9% (4.6-10 GHz) for S11, and 75.8% (4.5-10 GHz) for S33 as compared to 41% for the ordinary BLC at the same resonant frequency. The circuit is constructed on a double-layered low-cost FR4 substrate with a relative permittivity of 4.3, and a loss tangent of 0.025. An isolation of -13dB was realized in both S13 and S31 demonstrating an excellent performance. The transmission coefficients between input/output ports S21, S41, S23, and S43 are between -3.1dB to -3.5dB at the frequency of 6GHz. Finally, the proposed BLC provides phase differences between output ports of 90.5o and 94.8o at the frequency of 6GHz when the input ports 1 and 3 are excited, respectively. The presented design offers the potential of being utilized as a unit cell for building a Butler-matrix (BM) for sub-6GHz 5G beamforming networks.

Underwater wireless sensor networks (UWSNs) represent a specialized category of WSNs with versatile applications including acoustic monitoring, oil and gas exploration, and military surveillance. UWSNs face formidable challenges such as limited energy resources, extended propagation delays, and harsh conditions. Existing clustering and multi-hop routing protocols often unevenly distribute nodes geographically, causing network fragmentation and disproportionately draining the battery life of nodes near the sink due to higher data transmission demands. In this paper, we introduce an Energy-efficient Artificial Fish Swarm-based Clustering Protocol (EAFSCP), inspired by the collective behavior of fish swarms. EAFSCP is a decentralized clustering algorithm designed for acoustic monitoring in UWSNs. Its decentralized nature makes it particularly well-suited for large-scale UWSNs, where centralized algorithms may not be feasible. Through comprehensive comparisons with existing cluster-based routing protocols, our findings indicate that EAFSCP consistently outperforms them across multiple key performance metrics, including network lifetime, energy consumption, packet delivery ratio, packet loss rate, and throughput. According to the results, EAFSCP represents an effective clustering algorithm that enhances network performance, prolongs network lifespan by reducing energy consumption, promotes scalability, and provides valuable guidance for emergency response efforts.

We present a new unsupervised method aimed to obtain a partition of a complex urban system in homogenous urban areas, called urban contexts. The area of study is initially partitioned in microzones, homogeneous portion of the urban system, that are the atomic reference elements for the census data. With the contribution of domain experts, we identify the physical, morphological, environmental and socio-economic indicators need to identify synthetic characteristics of urban contexts and create the fuzzy rule set necessary to determine the type of urban context. We implement the set of spatial analysis processes necessary to calculate the indicators for microzone and apply a Mamdani fuzzy rule system to classify the microzones. Finally, the partition of the area of study in urban contexts is obtained by dissolving continuous microzones belonging to the same type of urban context. Tests are performed on the Municipality of Pozzuoli (Naples - Italy); the reliability of out model is measured by comparing the results with the ones obtained by detailed analysis.

Human keratinocytes and melanoma can stick together to form clusters after eight days in co-culture. As in dynamic system concepts, one can consider cluster formation as the system attractor, cell seeding as the initial condition, and density change over time as a path within the basin of attraction. Herein, Cellular Automata, which is a class of Agent-Based Models, and Boolean Networks are discrete modeling methods used in population dynamics such that running the dynamics of cellular automata backward reveals an underlying network in terms of basin of attraction, also known as global dynamics. Thus, we hypothesize that one can estimate the local dynamic of an agent-based model from the basin of attraction of a boolean network. Here, we propose an approach to estimating these agent-based model rules, which consists of comparing the density states within each state transition and reaching a consensus among state transitions belonging to a basin of attraction of a boolean network. The objectives of this study are: (1) to infer a boolean network from the co-culture growth curve; (2) to estimate the rules of agent-based models; and (3) to implement spatial dynamics simulations. The binarization of the growth curve shows high population density after four days; the estimated agent-based model rules were compatible with cell proliferation and migration in agreement with literature, so we had to propose individual rules for survival and death. Spatial dynamics shows that (1) keratinocytes exhibit a higher density in neighborhoods where melanoma is present; (2) the chance of keratinocyte migration increases until the fourth day, then decreases, and the probability of survival increases substantially after four days; and (3) cells with low proliferation capacity die and free space for those with high ones. Our approach suggests that the attractor state of cell co-culture is induced mainly by an increase in keratinocyte migration and survival. Our approach has the potential to offer valuable clues about microenvironmental interactions or configurations that drive population dynamics.

Attackers are perpetually modifying their tactics to avoid detection and frequently leverage legitimate credentials with trusted tools already deployed in a network environment, making it difficult for organizations to proactively identify critical security risks. Network traffic analysis products have emerged in response to attackers’ relentless innovation, offering organizations a realistic path forward for combatting creative attackers. Additionally, thanks to the widespread adoption of cloud computing, Device Operators (DevOps) processes, and the Internet of Things (IoT), maintaining effective network visibility has become a highly complex and overwhelming process. What makes network traffic analysis technology particularly meaningful is its ability to combine its core capabilities to deliver malicious intent detection. In this paper, we propose a novel darknet traffic analysis and network management framework to real-time automating the malicious intent detection process, using a weight agnostic neural networks architecture. It is an effective and accurate computational intelligent forensics tool for network traffic analysis, the demystification of malware traffic, and encrypted traffic identification in real-time. Based on Weight Agnostic Neural Networks (WANNs) methodology, we propose an automated searching neural net architectures strategy that can perform various tasks such as identify zero-day attacks. By automating the malicious intent detection process from the darknet, the advanced proposed solution is reducing the skills and effort barrier that prevents many organizations from effectively protecting their most critical assets.

In order to overcome the limitation of the traditional adaptive Unscented Kalman Filtering (UKF) algorithm in noise covariance estimation for statement and measurement, we propose a hybrid adaptive UKF algorithm based on combining Maximum a posteriori (MAP) criterion and Maximum likelihood (ML) criterion, in this paper. First, to prevent the actual noise covariance deviating from the true value which can lead to the state estimation error and arouse the filtering divergence, a real-time covariance matrices estimation algorithm based on hybrid MAP and ML is proposed for obtaining the statement and measurement noises covariance, respectively; and then, a balance equation the two kinds of covariance matrix is structured in this proposed to minimize the statement estimation error. Compared with the UFK based MAP and based ML, the proposed algorithm provides better convergence and stability.

Focused microwave breast hyperthermia (FMBH) employs a phased antenna array to perform beamforming that can focus microwave energy at targeted breast tumors. Selective heating of the tumor endows the hyperthermia treatment with high accuracy and low side effects. The effect of FMBH is highly dependent on the applied phased antenna array. This work investigates the effect of polarizations of antenna elements on the microwave focusing results by simulations. We explore two kinds of antenna arrays with the same number of elements using different digital realistic human breast phantoms. The first array has all the elements’ polarization in the vertical plane of the breast while the second array has half elements’ polarization in the vertical plane and the other half in the transverse plane, i.e., cross polarization. In total 96 sets of different simulations are performed, and the results show that the second array leads to a better focusing effect in dense breasts than the first array. This work is very meaningful for the potential improvement of the antenna array for FMBH, which is of great significance for the future clinical applications of FMBH. The antenna array with cross polarization can also be applied in micro-wave imaging and sensing for biomedical applications.

One of the most crucial elements in deeply understanding humans on a psychological level is manifested through facial expressions. The analysis of a human behavior can be informed by their facial expressions, making it essential to employ indicators such as expression (Expr), valence-arousal (VA), and action units (AU). In this paper, we introduce the method proposed in the Challenge of the 6th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW) at CVPR 2024. Our proposed method utilizes the multi-modal Aff-wild2 dataset, which is splitted into spatial and audio modalities. For the spatial data, we extract features using a SimMiM model that was pre-trained on a diverse set of facial expression data. For the audio data, we extract features using a WAV2VEC model. To fusion the extracted spatial and audio features, we employed the cascaded cross-attention mechanism of a transformer.

We propose a new Mamdani fuzzy rule-based system in which the fuzzy sets in the antecedents and consequents are assigned in a discrete set of points and approximated by using the extended inverse fuzzy transforms, whose components are calculated by verifying that the dataset is sufficiently dense with respect to the uniform fuzzy partition. We test our system in the problem of spatial analysis consisting in the evaluation of the liveability of residential housings in all the municipalities of the district of Naples (Italy). Comparisons are done with the results obtained by using trapezoidal fuzzy numbers in the fuzzy rules.

One of the challenges posed by renewable energies is the stabilization of parameters related to the quality of electrical energy. This study demonstrates the existence of a relationship between input blocks of hydropower and the variation of the fundamental frequency of the electricity grid. By mapping production data provided by Spanish Electric Network with frequency measured in the laboratory, it is shown that gradients of hydropower are correlated with frequency fluctuations for certain characteristic times. Considering hourly instances of energy input, the study compares two methods for calculating hydropower gradients (linear regression and pseudo-linear regression); and two methods for calculating local frequency extremes (the "specular inertia" method and analysis by comparison with the moving average), in order to corroborate the results.

This paper presents the development of a novel anti-violence device titled "no pAIn" (an acronym for Never Oppressed Protected by Artificial Intelligence Nonviolence system), which harnesses the power of artificial intelligence (AI). Primarily designed to combat violence against women, the device offers personal safety benefits for individuals across diverse demographics. Operating autonomously, it necessitates no user interaction post-activation. The AI engine conducts real-time speech recognition and effectively discerns genuine instances of aggression from non-violent disputes or conversations. Facilitated by its Internet connectivity, in the event of detected aggression, the device promptly issues assistance requests with real-time precise geolocation tracking to predetermined recipients, for immediate assistance. Its compact size enables discreet concealment within commonplace items like candy wrappers, or within purpose-built casings, or as wearable accessories. The device is battery-operated. The prototype was developed using a microcontroller board (Arduino Nano RP2040 Connect), incorporating an omnidirectional microphone and Wi-Fi module, all at a remarkably low cost. Subsequent functionality testing, performed in debug mode using the Arduino IDE serial monitor, yielded successful results. The AI engine exhibited exceptional accuracy in word recognition, complemented by a robust logic implementation, rendering the device highly reliable in discerning genuine instances of aggression from non-violent scenarios

A correct system design can be systematically obtained from a specification model of a real-time system that integrates hybrid measurements in a realistic industrial environment, this has been carried out through complete Matlab / Simulink / Stateflow models. However, there is a widespread interest in carrying out that modeling by resorting to Machine Learning models, which can be understood as Automated Machine Learning for Real-time systems that present some degree of hybridization. An induction motor controller which must be able to maintain a constant air flow through a filter is one of these systems and it is discussed in the paper as a study case of closed-loop control system. The article discusses a practical application of ML methods that demonstrates how to replace such closed loop in industrial control systems with a Simulink block generated from neural networks to show how the proposed procedure can be applied to derive complete hybrid system designs with artificial neural networks (ANN). In the proposed ANN-based method to design a real-time hybrid system with continuous and discrete components, we use a typical design of a neural network, in which we define the usual phases: training, validation, and testing. The generated output of the model is made up of reference variables values of the cyber-physical system, which represent the functional and dynamic aspects of model. They are used to feed Simulink/Stateflow blocks in the real target system.

This study addresses the critical challenge of Speech Enhancement (SE) in noisy environments, where the deployment of Deep Neural Networksolutions on microcontrollers is hindered by their extensive computational demands. Focusing on this gap, our research introduces a novel SE method optimized for MCUs, employing a 2-layer GRU model that capitalizes on perceptual speech properties and innovative training methodologies. By incorporating self-reference signals and a dual strategy of compression and recovery based on the Mel scale, we develop an efficient model tailored for low-latency applications. Our GRU-2L-128 model demonstrates a significant reduction in size and computational requirements, achieving a 14.2× decrease in model size and a 409.1× reduction in operations compared to traditional DNN methods like DCCRN, without compromising performance. This advancement offers a promising solution for enhancing speech intelligibility in resource-constrained devices, marking a pivotal step in SE research and application.

Manual traffic surveillance can be a daunting task as Traffic Management Centers operate a myriad of cameras installed over a network. Injecting some level of automation could help lighten the workload of human operators performing manual surveillance and facilitate making proactive decisions which would reduce the impact of incidents and recurring congestion on roadways. This article presents a novel approach to automatically monitor real time traffic footage using deep convolutional neural networks and a stand-alone graphical user interface. The authors describe the results of research received in the process of developing models that serve as an integrated framework for an artificial intelligence enabled traffic monitoring system. The proposed system deploys several state-of-the-art deep learning algorithms to automate different traffic monitoring needs. Taking advantage of a large database of annotated video surveillance data, deep learning-based models are trained to detect queues, track stationary vehicles, and tabulate vehicle counts. A pixel-level segmentation approach is applied to detect traffic queues and predict severity. Real-time object detection algorithms coupled with different tracking systems are deployed to automatically detect stranded vehicles as well as perform vehicular counts. At each stages of development, interesting experimental results are presented to demonstrate the effectiveness of the proposed system. Overall, the results demonstrate that the proposed framework performs satisfactorily under varied conditions without being immensely impacted by environmental hazards such as blurry camera views, low illumination, rain, or snow.

In this paper, an adaptive technology and the interconnection and damping assignment passivity-based control method are combined to solve the stabilization problem for underactuated mechanical systems with uncertainties (including matched and unmatched). Uncertainties include unknown friction coefficients and unknown terms in kinetic energy and potential energy. A novel adaptive interconnection and damping assignment passivity-based control scheme is proposed and an adaptive stabilization controller is designed to make the closed-loop system locally stable. Verification is conducted on the ball and beam system, taking into account uncertainties of friction coefficients, kinetic energy, and potential energy. The locally asymptotic stability is demonstrated using the LaSalle’s invariance principle and approximate linearization. The effectiveness of the proposed control law is verified through numerical simulations.

Standard Ethernet (IEEE 802.3 and the TCP/IP protocol suite) is gradually applied in industrial control system (ICS) with the development of information technology. It breaks the natural isolation of ICS, but contains no security mechanism. A modified intrusion detection system (IDS), which is strongly correlated to specific industrial scenario, is necessary for modern ICS. On the one hand, this paper outlines attack models, including infiltration attacks and our creative forging attack. On the other hand, we proposes a hierarchical IDS, which contains a traffic prediction model and an anomaly detection model. The traffic prediction model, which is based on autoregressive integrated moving average (ARIMA), can forecast the traffic of ICS network in the short term and precisely detect the infiltration attacks according to abnormal changes in traffic pattern. The anomaly detection model using one-class support vector machine (OCSVM) is able to detect malicious control instructions by analyzing the key field in EtherNet/IP packets. The experimental results show that the hierarchical IDS has an outstanding performance in detecting infiltration attacks and forging attack compared with other two innovative IDSs.

A scalable optical convolutional neural network (SOCNN) based on free-space optics and Koehler illumination was proposed to address the limitations of the previous 4f correlator system. Unlike Abbe illumination, Koehler illumination provides more uniform illumination and reduces crosstalk. SOCNN allows for scaling up of the input array and the use of incoherent light sources. Hence, the problems associated with 4f correlator systems can be avoided. We analyzed the limitations in scaling the kernel size and parallel throughput and found that SOCNN can offer a multilayer convolutional neural network with massive optical parallelism.

Ligand-based virtual screening (LBVS) is a promising approach for rapid and low-cost screening of potentially bioactive molecules in the early stage of drug discovery. Compared with traditional similarity-based machine learning methods, deep learning frameworks for LBVS can more effectively extract high-order molecule structure representations from molecular fingerprints or structures. However, the 3D conformation of a molecule largely influences its bioactivity and physical properties, and has rarely been considered in previous deep learning-based LBVS methods. Moreover, the relative bioactivity benchmark dataset is still lacking. To address these issues, we introduce a novel end-to-end deep learning architecture trained from molecular conformers for LBVS. We first extracted molecule conformers from multiple public molecular bioactivity data and consolidated them into a large-scale bioactivity benchmark dataset, which totally includes millions of endpoints and molecules corresponding to 954 targets. Then, we devised a deep learning-based LBVS called EquiVS to learn molecule representations from conformers for bioactivity prediction. Specifically, graph convolutional network (GCN) and equivariant graph neural network (EGNN) are sequentially stacked to learn high-order molecule-level and conformer-level representations, followed by attention-based deep multiple-instance learning (MIL) to aggregate these representations and then predict the potential bioactivity for the query molecule on a given target. We conducted various experiments to validate the data quality of our benchmark dataset, and confirmed EquiVS achieved better performance compared with 10 traditional machine learning or deep learning-based LBVS methods. Further ablation studies demonstrate the significant contribution of molecular conformation for bioactivity prediction, as well as the reasonability and non-redundancy of deep learning architecture in EquiVS. Finally, a model interpretation case study on CDK2 shows the potential of EquiVS in optimal conformer discovery. The overall study shows that our proposed benchmark dataset and EquiVS method have promising prospects in virtual screening applications.

Extensive growth in the volume of irregular brain cells is known as brain tumor. Human brain is surrounded by stiff skull. There are various issues that occur due to the growth of any tumor inside this restricted space. The malignant and benign are two main categories of the brain tumor. The skull is pressurized to enlarge from inside in case of growth of any benign or malignant tumor. This tumor leads to harm in brain and it may be dangerous to life also. The brain tumor is divided into two kinds - primary or secondary. The brain tumor detection techniques have various phases. In this paper, comparative study of CNN with GLCM approach and superpixel based spectral clustering is done tumor. This work takes into account metrics like accuracy, sensitivity and specificity for drawing the comparison between both the techniques.

Wireless Body Area Networks are composed of sensor nodes that may be implanted in the body or worn on it. A node is composed of a sensing unit, a processor and a radio unit. One of the nodes, the sink, acts as a gateway between the body area network and other networks such as the Internet. We propose a routing protocol that constructs paths between nodes such that the final network topology is a tree rooted at the sink. The protocol's aim is to increase network lifetime and reliability, and to adapt to network conditions dynamically. Moreover, the protocol enables communications between nodes and sink both in the upstream direction, from nodes to sink, and in the downstream direction from sink to nodes. When the network tree is constructed, a node chooses its parent, i.e., next hop to sink, by using one of various criteria. Namely, these are the number of hops between parent and sink, energy level of parent, received signal strength from parent, number of current parent's children, and a fuzzy logic function that combines multiple criteria. Moreover, as time progresses the tree structure may dynamically change to adapt to conditions such as the near-depletion of a routing node's energy. Simulation results show improvements in network lifetime and energy consumption over the older version of the protocol.

Motivated by the way animals react in nature, we introduce a fully-connected neural-network model, which incorporates the external pattern presented to the system as a fundamental tool of the recognition process. In this new scenario, in the absence of this external field, memories are not attractors inside basins of attraction, as in usual attractor neural networks, although basins may be created according to the external pattern, thus allowing storing a much larger number of memories. The key point consists in calibrating the influence of the external pattern such as to cancel the noise generated by those memories not correlated with the external pattern.We illustrate how this proposal works by including this new contribution in the standard Hopfield model, showing a significant increase in its recognition capacity (typically by a factor $10^{2}$). As an additional feature of this model, we show its ability to react promptly to changes in the external environment, a crucial attribute of living beings. This procedure can be applied to a wide variety of neural-network models to increase considerably their recognition and reaction capabilities.

An application of deep convolutional neural network and recurrence plot for financial market movement prediction is presented. Though it is challenging and subjective to interpret its information, the pattern formed by a recurrence plot provide a useful insight into the dy- namical system. We used a recurrence plot of seven financial time series to train a deep neural network for financial market movement predic- tion. Our approach is tested on our dataset and achieved an average of 53.25% classification accuracy. The result suggests that a well trained deep convolutional neural network can learn a recurrence plot and pre- dict a financial market direction.

With the increase of the Artificial Neural Network (ANN), machine learning has taken a forceful twist in recent times. One of the most spectacular kinds of ANN design is the Convolutional Neural Network (CNN). The Convolutional Neural Network (CNN) is a technology that mixes artificial neural networks and up to date deep learning strategies. In deep learning, Convolutional Neural Network is at the center of spectacular advances. This artificial neural network has been applied to several image recognition tasks for decades and attracted the eye of the researchers of the many countries in recent years as the CNN has shown promising performances in several computer vision and machine learning tasks. This paper describes the underlying architecture and various applications of Convolutional Neural Network.

Aiming at the problem of UAV cluster configuration reconstruction, in order to obtain the cluster reconstruction method, the theory and simulation of cluster reconstruction control strategy is studied by simplifying the model，deducing the theoretical formula and analyzing the example. Taking 10 UAVs cluster as an example, the distribution of UAVs in different configurations was analyzed. According to the change of cluster configuration, the principle of formation reconstruction and the execution ability of configuration, the cluster capability was analyzed. The group behavior is modeled by group behavior rules, reconfiguration topology analysis and reconfiguration cost measurement. Based on the cluster parameters and configuration characteristics, simulation experiments were carried out to obtain the change curve of the reconstruction cost and time and the trajectory movement diagram of the UAV in different configurations.

The hybridization of machine learning methods with soft computing techniques is an essential approach to improve the performance of the prediction models. Hybrid machine learning models, particularly, have gained popularity in the advancement of the high-performance control systems. Higher accuracy and better performance for prediction models of exergy destruction and energy consumption used in the control circuit of heating, ventilation, and air conditioning (HVAC) systems can be highly economical in the industrial scale to save energy. This research proposes two hybrid models of adaptive neuro-fuzzy inference system-particle swarm optimization (ANFIS-PSO), and adaptive neuro-fuzzy inference system-genetic algorithm (ANFIS-GA) for HVAC. The results are further compared with the single ANFIS model. The ANFIS-PSO model with the RMSE of 0.0065, MAE of 0.0028, and R² equal to 0.9999, with a minimum deviation of 0.0691 (KJ/s), outperforms the ANFIS-GA and single ANFIS models.

The vast network of interconnected devices of the Internet of Things poses significant security challenges, necessitating the upgrade of current wireless networks to the 6G standard and an improved intrusion detection system for host networks. Thus this article therefore underscores a game theory concept to analyze the security impediments in wireless communication systems, where a host network bandwidth is jeopardized by the intruder while acting as a legitimate user. While game theory can help with the impending security concerns, network slicing is saliently proposed for large and complicated networks, precipitating a layer wise fragmentation of the concerned network and effectively addressing the security issues in different layers of the IoT framework. However, with increasing network complexity, network security issues incorporating traditional measures become increasingly cumbersome. Therefore, this paper also briefly mentions some of the ML techniques that can be used to classify and segregate valid users from the compromised nodes in the host network. The paper discusses the potential of incorporating intelligence into wireless communication systems to enhance the host network security. The paper further aids in analyzing existing security issues in different layers of wireless communication systems, underscoring network slicing for further classification of intruders from user nodes and training the host network using ML/AI per the user application specification.

The accurate prediction of molecular properties such as lipophilicity and aqueous solubility are of great importance and pose challenges in several stages of the drug discovery pipeline. Machine learning methods like graph-based neural networks (GNNs) have shown exceptionally good performance in predicting these properties. In this work, we introduce a novel GNN architecture, called directed edge graph isomorphism network (D-GIN). It is composed of two distinct sub-architectures (D-MPNN, GIN) and achieves an improvement in accuracy over its sub-architectures employing various learning, and featurization strategies. We argue that combining models with different key aspects help make graph neural networks deeper and simultaneously increase their predictive power. Furthermore, we address current limitations in assessment of deep-learning models, namely, comparison of single training run performance metrics, and offer a more robust solution.

Autonomous image recognition has numerous potential applications in the field of planetary science and geology. For instance, having the ability to classify images of rocks would allow geologists to have immediate feedback without having to bring back samples to the laboratory. Also, planetary rovers could classify rocks in remote places and even in other planets without needing human intervention. Shu et al. classified 9 different types of rock images using a Support Vector Machine (SVM) with the image features extracted autonomously. Through this method, the authors achieved a test accuracy of 96.71%. In this research, Convolutional Neural Networks(CNN) have been used to classify the same set of rock images. Results show that a 3-layer network obtains an average accuracy of 99.60% across 10 trials on the test set. A version of Self-taught Learning was also implemented to prove the generalizability of the features extracted by the CNN. Finally, one model has been chosen to be deployed on a mobile device to demonstrate practicality and portability. The deployed model achieves a perfect classification accuracy on the test set, while taking only 0.068 seconds to make a prediction, equivalent to about 14 frames per second.

Cities exemplify the evolving world with changing demographics and climates. Urban green spaces play a crucial role in improving the quality of life of people through their potential to mitigate temperatures. Therefore, comprehending their impact is of para-mount interest. Given the challenges in obtaining temperature data from urban locations, this study develops Artificial Neural Networks (ANNs) to predict daily and hourly temperatures in Valladolid, Spain, with a particular focus on urban allotment gardens and a forested urban park. ANNs were built and evaluated from various combinations of inputs (X), hidden neurons (Y) and outputs (Z) under the practical rule of "making net-works simple, to obtain better results". The best performing model was 6-Y-1 ANN archi-tecture with an impressive result of Root Mean Square Error (RMSE) = 0.42°C in the urban garden called Valle de Arán. However, other five ANN architectures were also tested (7-Y-5; 6-Y-5; 7-Y-1; 3-Y-Z and 2-Y-1). ANNs dedicated to urban temperature analysis hold immense potential for urban planning and research, aiding in under-standing the urban climate, forecasting future temperatures, identifying temperature mitigation strategies and even for managing urban crops

Adjustable frequency converters are widely used in modern automated asynchronous drives due to their high efficiency and high responsiveness control strategies. Control algorithms for frequency converters are divided into two main groups: constant frequency commutation and random frequency commutation. Research results on various commutation frequencies, conducted using Matlab/Simulink software, show that the use of random frequency commutation provides better efficiency by significantly reducing the amplitude of harmonic oscillations at different frequencies, with a reduction in switching losses in transistors. Currently, a converter with random frequency commutation is being researched and applied in the direct torque control system. The traditional direct control system, based on a two-level inverter, is widely used due to its simplicity and ease of implementation. However, this method results in the output current of the two-level converter, supplied to the motor stator, having many harmonic distortions, leading to strong torque fluctuations regardless of the rotation speed and ultimately causing additional losses in the stator windings and reducing the motor's lifespan. To enhance the efficiency of automated asynchronous drives, this article presents an algorithm for a direct control system based on a three-level NPC inverter using a PI speed regulator. The proposed algorithm's research is validated in the Matlab/Simulink environment. The research results show that in the absence of harmonic filtering, the stator current harmonic distortion coefficient is approximately 11%, and torque fluctuations are less than 5% of the resistive torque. The fluctuations between the two capacitors remain almost unchanged throughout the entire process.

This paper introduces a chip-level oven-controlled system for improving the temperature stability of MEMS resonators. Wherein the resonator and the micro-hotplate are manufactured by MEMS technology, then wire-bounded in a package shell at the chip level. The proposed resonator is transduced by the AlN film, and its temperature is monitored by temperature-sensing resistors on both sides. The designed micro-hotplate is placed at the bottom of the resonator chip as a heater and insulated by airgel. The PID pulse width modulation (PWM) circuit controls the heater according to the temperature detection result to provide a constant temperature for the resonator. The proposed oven-controlled MEMS resonator (OCMR) exhibits a frequency drift of 3.5ppm in the range of -50°C to 125°C, and the method also can be applied to other MEMS devices that require temperature control.

Abstract: This study investigates the transition to sustainable shipping industry within the framework of the IMO's 2050 carbon neutrality objective, focusing on socio-technical systems analysis. The research delves into the sustainable paradigm shift towards alternative marine fuels such as LNG, methanol, ammonia, and hydrogen from a socio-technical transition perspective, analyzing the multi-level per-spective challenges and opportunities. Specifically, it scrutinizes the implications of adopting these al-ternative fuels for global shipping, identifying technical uncertainties, financial constraints, and infra-structure needs. Through a comprehensive review of existing literature on ship emissions and alterna-tive fuels, coupled with socio-technical transition theory, the study addresses the multifaceted chal-lenges and opportunities in meeting the IMO's environmental objectives. It emphasizes the necessity of collaborative governance, innovative niche strategies, and a holistic approach to leverage the current window of opportunity in facilitating the maritime industry's transition to sustainable fuel options. Fi-nally, this research enhances our understanding of the intricate interplay between technological, social, industrial, and cultural dynamics in the greening of shipping and offers insights into the strategic adop-tion of environmentally friendly marine fuels for a sustainable future.

Interferometry Synthetic Aperture Radar (InSAR) is an advanced remote sensing technique for studying the earth's surface topography and deformations. It is used to generate high-quality Digital Elevation Models (DEMs). DEMs are a crucial and primary input to various topographical quantification and modelling applications. The quality of input DEMs can be further improved using fusion methods, which combine multi-sensor or multi-temporal datasets intelligently to retrieve the best information amongst the input data. This research study is based on developing a Neural Network based fusion approach for improving InSAR based DEMs in plain and hilly terrains. The study areas comprise of relatively plain terrain from Ghaziabad and hilly terrain of Dehradun and their surrounding regions. The training dataset consists of DEM elevations and derived topographic attributes like slope, aspect, topographic position index (TPI), terrain ruggedness index (TRI), and vector roughness measure (VRM) in different land use land cover classes of the study areas. The spaceborne altimetry ICESat-2 ATL08 photon data is used as a reference elevation. A Feed Forward Neural Network with backpropagation algorithm is trained based on the prepared training samples. The trained model produces fused DEMs by learning the relationship between the input and target samples. This is used to predict elevations in the test areas. The accuracy of results from the models are assessed with TanDEM-X 90 m DEM. The fused DEMs show significant improvement in terms of RMSE over the input DEMs with improvement factor of 94.65 % in plain area and 82.62 % in hilly area. The study concludes that the ANN with its universal approximation property is able to significantly improve the fused DEM.

The study presents a comparative approach between response surface methodology (RSM) and hybridized, genetic algorithm artificial neural network (GA-ANN) in predicting the water absorption, compressive strength, flexural strength split tensile strength and slump for steel fiber reinforced concrete. The effect of process variables such as aspect ratio, water cement ratio and cement content were investigated using the central composite design of response surface methodology. This same experimental design was used in training the hybrid-training approach of artificial neural network. The predicting ability of both methodologies were compared using the root mean sqaured error (RMSE), mean absolute error (MAE), model predictive error (MPE) and absolute average deviation (AAD). The RSM model was found more accurate in prediction compared to hybrid GA-ANN.

Battery/Supercapacitor(SC) current tracking control is a key issue for hybrid energy storage system (HESS) in electric vehicles. An innovative passivity-based L2-gain adaptive control (PBL2AC) based on port-controlled Hamiltonian model with dissipativity (PCHD) for reference current tracking and bus voltage stability in HESS is presented. The developed PCHD model has considered both parameter variations and external disturbances. By using L2-gain disturbance attenuation, the PBL2AC ensures robust reference current tracking and stable bus voltage. Moreover, adaptive mechanism is adopted to estimate the electrical parameters. To validate the proposed control scheme for HESS, simulations and experiments were done and compared with traditional PID and sliding mode control under several typical driving cycles, and results show that the effectiveness of the proposed controller can be confirmed.

During the 1950s, the Gros Michel species of bananas were nearly wiped out by the incurable Fusarium Wilt, also known as Panama Disease. Originating in Southeast Asia, Fusarium Wilt is a banana pandemic that has been threatening the multi-billion-dollar banana industry worldwide. The disease is caused by a fungus that spreads rapidly throughout the soil and into the roots of banana plants. Currently, the only way to stop the spread of this disease is for farmers to manually inspect and remove infected plants as quickly as possible, whereas it is a time-consuming process. The main purpose of this study is to build a deep Convolutional Neural Network (CNN) using a transfer learning approach to rapidly identify fusarium wilt infections on banana crop leaves. We chose to use the ResNet50 architecture as the base CNN model for our transfer learning approach owing to its remarkable performance in image classification, which was demonstrated through its victory in the ImageNet competition. After its initial training and fine-tuning on a data set consisting of 300 healthy and diseased images, the CNN model achieved near-perfect accuracy of 0.99 and was fine-tuned to adapt the ResNet base model. ResNet50’s distinctive residual block structure could be the reason behind these results. To evaluate this CNN model, 500 test images, consisting of 250 diseased and healthy banana leaf images, were classified by the model. The deep CNN model was able to achieve an accuracy of 0.98 and an F-1 score of 0.98 by correctly identifying the class of 492 of the 500 images. These results show that this DCNN model outperforms existing models such as Sangeetha et al., 2023’s deep CNN model by at least 0.07 in accuracy and is a viable option for identifying Fusarium Wilt in banana crops.

Link prediction is to complete the missing links in the network or to predict the generation of new links according to the current network structure information, which is very important for mining and analyzing the evolution of the network such for construction and analysis of logical architecture in 6G network. Link prediction algorithms based on node similarity need predefined similarity functions, which is highly hypothetical and only applies to specific network structures without generality. To solve this problem, this paper proposes a link prediction algorithm based on the subgraph of the target node pair. In order to automatically learn the graph structure characteristics, the algorithm firstly extracts the h-hop subgraph of the target node pair, and then predicts whether the target node pair will be linked according to the subgraph. Experiments on seven real data sets show that the link prediction algorithm based on target node pair subgraph is suitable for various network structures and superior to other link prediction algorithms.

Vision-based tactile sensors (VBTS) have become the de facto method of giving robots the ability to obtain tactile feedback from their environment. Unlike other solutions to tactile sensing, VBTS offers high spatial resolution feedback without compromising on instrumentation costs or incurring additional maintenance expenses. However, conventional cameras used in VBTS have a fixed update rate and output redundant data, leading to computational overhead downstream. In this work, we present a neuromorphic vision-based tactile sensor (N-VBTS) that employs observations from an event-based camera for contact angle prediction. Particularly, we design and develop a novel graph neural network, dubbed TactiGraph, that asynchronously operates on graphs constructed from raw N-VBTS streams exploiting their spatiotemporal correlations to perform predictions. Although conventional VBTS uses an internal illumination source, TactiGraph is reported to perform efficiently in both scenarios, with and without an internal illumination source. Rigorous experimental results revealed that TactiGraph achieved a mean absolute error of 0.62∘ in predicting the contact angle and was faster and more efficient than both conventional VBTS and other N-VBTS, with lower instrumentation costs. Specifically, N-VBTS requires only 5.5% of the compute-time needed by VBTS when both are tested on the same scenario.

Next-generation cancer and oncology research needs to take full advantage of the multi-modal structured, or graph, information, with the graph datatypes ranging from molecular structures to spatially resolved imaging and digital pathology to biological networks to knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on the large multi-modal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. Subsequently, we identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise the guidelines for cancer and oncology researchers or physician-scientists asking the question of whether they should adopt the GNN methodology in their research pipelines.

This paper presents a compact on-chip antenna architecture for 5G body centric networks (BCNs) applications. A dual meander line (DML) integrated antenna consists of two stacked layers of two turns of meander lines and a ground metal layer. The DML structure decreases the resonant frequency, increases tuning bands and broadens the operating bandwidth to be a suitable choice for high data rate biomedical applications. The antenna’s performance is evaluated in both scenarios inside and outside the human body. The proposed antenna is fabricated using UMC180 nm CMOS technology with a total area of 1150µm×200µm, and operates at bands 22 GHz, 34 GHz, 44 GHz and 58 GHz with an operating bandwidth up to 2 GHz at impedance bandwidth ≤ 7.5 dB (VSWR≤2.5). The proposed antenna is simulated using high frequency structure simulator (HFSS) and shows good agreement between measured and simulated results.

When extract building from high resolution remote sensing image with meter/sub-meter accuracy, the shade of trees and interference of roads are the main factors of reducing the extraction accuracy. Proposed a Bayesian Convolutional Neural Networks(BCNET) model base on standard fully convolutional networks(FCN) to solve these problems. First take building with no shade or artificial removal of shade as Sample-A, woodland as Sample-B, road as Sample-C. Set up 3 sample libraries. Learn these sample libraries respectively, get their own set of feature vector; Mixture Gauss model these feature vector set, evaluate the conditional probability density function of mixture of noise object and roofs; Improve the standard FCN from the 2 aspect:(1) Introduce atrous convolution. (2) Take conditional probability density function as the activation function of the last convolution. Carry out experiment using unmanned aerial vehicle(UVA) image, the results show that BCNET model can effectively eliminate the influence of trees and roads, the building extraction accuracy can reach 97%.

Sarcopenia is associated with clinical complications, which increase mortality. Effective sarcopenia risk screening in the elderly should be grounded in a comprehensive assessment, encompassing both nutritional status and medication use. Current screening tools, while emphasizing muscular per-formance, exhibit limited sensitivity in identifying elderly individuals at risk of sarcopenia. This cross-sectional study aimed to develop a sarcopenia risk screening tool, named Sarc-Global, with enhanced sensitivity, incorporating factors pertinent to the overall health of the elderly. Utilizing the criteria established by EWGSOP2 for diagnosing sarcopenia, we evaluated 395 communi-ty-dwelling elderly individuals. This evaluation served as a reference for assessing the efficacy of two validated questionnaires, Sarc-F and Sarc-CalF, and our newly developed Sarc-Global. Con-structed through multiple logistic regression, Sarc-Global integrates variables such as sex, age, medication use, body mass index, arm circumference, and handgrip strength – all significantly associated with sarcopenia (p

This paper presents a system for identification of wind features, such as gusts and wind shear. These are of particular interest in the context of energy-efficient navigation of Small Unmanned Aerial Systems (UAS). The proposed system generates real-time wind vector estimates and a novel algorithm to generate wind field predictions. Estimations are based on the integration of an off-the-shelf navigation system and airspeed readings in a so-called direct approach. Wind predictions use atmospheric models to characterize the wind field with different statistical analyses. During the prediction stage, the system is able to incorporate, in a big-data approach, wind measurements from previous flights in order to enhance the approximations. Wind estimates are classified and fitted into a Weibull probability density function. A Genetic Algorithm (GA) is utilized to determine the shaping and scale parameters of the distribution, which are employed to determine the most probable wind speed at a certain position. The system uses this information to characterize a wind shear or a discrete gust and also utilizes a Gaussian Process regression to characterize continuous gusts. The knowledge of the wind features is crucial for computing energy-efficient trajectories with low cost and payload. Therefore, the system provides a solution that does not require any additional sensors. The system architecture presents a modular decentralized approach, in which the main parts of the system are separated in modules and the exchange of information is managed by a communication handler to enhance upgradeability and maintainability. Validation is done providing preliminary results of both simulations and Software-In-The-Loop testing. Telemetry data collected from real flights, performed in the Seville Metropolitan Area in Andalusia (Spain), was used for testing. Results show that wind estimation and predictions can be calculated at 1 Hz and a wind map can be updated at 0.4 Hz. Predictions show a convergence time with a 95% confidence interval of approximately 30 s.

The work at hand focuses on an adaptive system aimed at improving the soundproof performance of car door seals at specific working regimes (cruise), without interfering with the conventional open-closure operations. The idea addresses the necessity of increasing the seal effectiveness, jeopardized by aerodynamic actions more and more important as the speed increase, generating a pressure difference between the internal and the external filed, in the direction of opening the door. To recover this effect, an expanding mechanism was integrated within the seal cavity, driven by an SMA actuator. The material was activated (heated) by Joule effect; its compactness, intrinsic of smart materials, contributed to arrive to a final system characterized by a high level of integrability (expanding cells). In this paper, the development process is described together with the verification activity, aimed at proving the functionality of the realized device. Starting from the industrial requirements, the most appropriate solution was identified highlighting the working principle and the main design parameters involved. Then, the envisaged system was designed and its executive digital mock up (CAD) was released. Prototyping and laboratory validation showed the reliability of the numerical models and the associated predictions. On this basis, the integration task within the actual reference car was faced. To demonstrate the isolation effect of the proposed system, an experimental campaign was finally organized in an anechoic room, achieving significant results on the concept value.

Nowadays smartphone utilization for disease diagnosis and remote health care applications has become promising due to their ubiquity. Here, a novel convolutional neural network method for detecting keratoconus that is wholly implemented on a smartphone is proposed. The proposed method provides accurate detection of over 72.9% for all stages of keratoconus. Preliminary results indicate 90%, 83%, 64% and 52% detection rate for severe, advanced, moderate and mild stages of disease, respectively.

The many-body problem in quantum physics originates from the difficulty of describing the non-trivial correlations encoded in the exponential complexity of the many-body wave function. Motivated by the Giuseppe Carleo's work titled solving the quantum many-body problem with artificial neural networks [Science, 2017, 355: 602], we focus on finding the NNQS approximation of the unknown ground state of a given Hamiltonian $H$ in terms of the best relative error and explore the influences of sum, tensor product, local unitary of Hamiltonians on the best relative error. Besides, we illustrate our method with some examples.