Geospatial knowledge in massive academic papers can provide knowledge services such as location-based research hotspot analysis, spatio-temporal data aggregation, research results recommendation, etc. However, geospatial knowledge often exists implicitly in literature resources in unstructured form, which is difficult to be directly accessed and mined and utilized for rapid production of massive thematic maps. In this paper, we take the geospatial knowledge of the area studied as an example and introduce its extraction method in detail. An integrated feature template matching and random forest classification algorithm is proposed for accurately identifying research areas from the abstract texts of academic papers and producing thematic maps. Firstly, the precise recognition of geographical names is achieved step by step based on BiLSTM-CRF algorithm and improved heuristic disambiguation method; then, the area studied is extracted by the designed integrated feature recognition template of area studied using random forest classification algorithm, and a fast thematic map is designed for the knowledge of area studied, topic and literature. The experimental results show that the area studied recognition accuracy can reach 97%, the F-value is 96%, and the recall rate reaches 96%, achieving high accuracy and high efficiency of area studied extraction in text. Based on the geospatial knowledge, the thematic map can achieve the effect of fast map formation and accurate expression.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

Predicting the remaining useful life (RUL) of mechanical bearings is crucial in the industry. 1 Estimating the RUL enables the assessment of health bearing, maintenance planning, and signifi- 2 cant cost reduction, thereby fostering industrial development. Existing models rely on traditional 3 feature engineering, with feature changes because operating conditions pose a major challenge to 4 the generalization of RUL prediction models. This study focuses on neural network-based feature 5 engineering and the downstream prediction of the RUL, eliminating the need for specific prior 6 knowledge and simplifying the development and maintenance of models. Initially, a convolutional 7 neural network (CNN) model is employed for feature engineering. Subsequently, a bidirectional 8 long short-term memory network (Bi-LSTM) model is used to capture the time-series degradation 9 characteristics of the engineered features and predict the RUL through regression. Finally, the study 10 examines the influence of operating conditions in the model and integrates domain adaptation to 11 minimize differences in feature distribution, thereby enhancing the model’s generalizability for the 12 RUL prediction.

Nowadays people express their opinions on social media. Also provides product reviews on eCommerce websites and responds to various news as comments. It is necessary to know the polarity and aspect of various posts and comments for business, education and security. Aspect-based sentiment analysis (ABSA) predicts text category and polarity. In this paper, we proposed a deep learning framework Deep-ABSA for aspect-based sentiment analysis from Bangla texts. Our proposed framework is a multi-channel architecture. We implemented the word embedding, Bi-LSTM with the attention mechanism for one channel. And for another channel, we adopted the character-embedded convolutional neural network. Finally, we concatenated both channels for adjoining the features of each channel. We obtained an adequate performance from our proposed framework for aspect term analysis from Bangla sentences.

The accurate forecasting of solar power output is essential for ensuring the stable and efficient operation of grid-connected photovoltaic (PV) systems, especially when faced with variable weather patterns. This research focuses on the integration of Machine Learning (ML) methodologies and climatic parameters to predict solar panel energy generation, with a specific emphasis on addressing consumption-production imbalances. Leveraging a dataset sourced from the Kaggle platform, the study is conducted in the context of Estonia, aiming to optimize solar energy utilization in this geographic region. The dataset, obtained from Kaggle, encompasses comprehensive information on climatic variables, including sunlight intensity, temperature, and humidity, alongside corresponding solar panel energy output. Leveraging machine learning algorithms, including XGBoost regression and neural networks, our model aims to identify complex patterns and relationships within the datasets. By tailoring the model to Estonia's climatic nuances, we seek to enhance the accuracy of energy production forecasts and, consequently, better manage the challenges associated with consumption-production imbalances. Furthermore, the research investigates the adaptability of the proposed model to diverse climatic conditions, ensuring its applicability for similar endeavors in other geographical locations. The performance of the forecasting model will be evaluated using error metrics like mean absolute error (MAE) and root mean squared error (RMSE). This study leverages a comprehensive dataset from Kaggle and utilizes advanced machine learning techniques to generate valuable insights. These insights can inform the development of sustainable energy policies and practices, ultimately leading to a more efficient and reliable renewable energy infrastructure.

In the domain of software engineering, the accurate and effective classification of requirements is of paramount importance. Proper classifications of these requirements enable developers to create robust and error-free software solution. Traditional methods of user requirements classification face the issue of the reliance on manual processes, which are time-consuming, labor-intensive, and prone to human error. The limitations of traditional methods underscore the need for more automated, scalable, and robust approaches to user requirements classification in order to meet the demands of modern software development practices. To improve the classification process, we employed a Deep Learning (DL) methodology termed the Bidirectional Long Short-Term Memory (Bi-LSTM) model to conduct feature extraction, after which we merged these feature vectors into ML classifiers. Our research methodology is structured around a five-step process. Initially, the textual input is tokenized and converted to lowercase. Subsequently, we eliminate all punctuation. The pre-processed text is then subjected to a Bi-LSTM (Bidirectional Long Short-Term Memory) model for feature vector extraction. After that, this feature vector is fed into different classifiers such as Medium KNN, Cubic KNN, Linear SVM, Quadratic SVM, and Cubic SVM and obtained an accuracy of around 99.60% to 99.80% on a publicly available dataset of requirements.

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

Parkinson’s Disease (PD) is a neurodegenerative disorder characterized by motor and non-motor impairment with various implications on patients’ quality of life. Since currently available therapies are only symptomatic, identifying individuals with prodromal, preclinical or early-stage PD is crucial, as they would be ideal candidates for future disease-modifying therapies. Our analysis aims to develop a robust model for accurate PD detection using accelerometer data collected from PD and non-PD individuals with mild or no tremor during phone conversations. An open-access dataset comprising accelerometer recordings from 22 PD patients and 11 healthy controls (HC) was utilized. The data were pre-processed to extract relevant time, frequency and energy-related features, and a Bidirectional Long Short-Term Memory (Bi-LSTM) model with attention mechanism was employed for classification. The performance of the model was evaluated using 5-fold cross-validation, and metrics of accuracy, precision, recall, specificity, and f1-score were computed. The proposed model demonstrated high accuracy (98%), precision (99%), recall (98%), specificity (96%), and f1-score (98%) in accurately distinguishing PD patients from HC. Our findings indicate that the proposed model outperforms existing approaches and holds promise for detection of PD with subtle symptoms, like tremor, in the wild. Such symptoms can present in the early or even prodromal stage of the disease, and appropriate mobile-based applications may be a practical tool in real-life settings to alert individuals at risk to seek medical assistance or give patients feedback in monitoring their symptoms.

The landscape of business intelligence (BI) is marked by rapid growth, extensive research, and practical implementations, reflecting its sustained relevance in modern business strategies. This paper delves into the dynamics of BI, particularly focusing on the interplay between maturity and agility. While BI maturity emphasizes optimization and predefined goals, BI agility prioritizes adaptability and response to change. The paper highlights the contradictions between these concepts, emphasizing the need for a balanced approach in BI strategy formulation.The role of organizational culture in fostering BI agility is explored through literature review and interviews with BI professionals. Key insights include the necessity of an open culture for effective BI utilization, clear strategic vision, decision delegation, information sharing, business-IT cooperation, and a learning-oriented mindset. These cultural factors contribute significantly to BI effectiveness and the ability to navigate dynamic business landscapes. The paper proposes pillars of agile maturity supported by an open organizational culture, including efficient communication, information integration, creative problem-solving, and close collaboration between business and IT. These pillars underscore the importance of a flexible and open mindset in navigating BI challenges and ensuring sustained value. Empirical validation and further research are suggested to deepen our understanding of the impact of organizational culture on BI agility and effectiveness.

Accurately predicting electrical signals of three-phase Direct Torque Control (DTC) induction motors is crucial for optimal motor performance and effective condition monitoring. However, multiple DTC motors’ complexity and operating conditions’ variations pose challenges for traditional prediction methods. To overcome these challenges, we propose an innovative approach that combines Fast Fourier Transform (FFT) to transform electrical motor simulation data and a Bi-directional Long Short-Term Memory (Bi-LSTM) network to forecast processed motor data. By transforming the DTC induction motor signals from the time domain to the frequency domain, we enhance the capability of learning models to capture subtle differences and generate various input features. The Bi-LSTM model effectively captures both forward and backward dependencies in time series data, enabling accurate prediction of electrical signals. We evaluate the proposed approach using our simulated dataset and compare the proposed method to a state-of-the-art model, the Gated Recurrent Unit (GRU), demonstrating its effectiveness in improving the accuracy and reliability of induction motor signals forecasting. The finding provides valuable insights for advancing motor control and operation in industrial applications.

This study focuses on the reasoning of symptoms of TCM internal diseases. Taking cough as an example, the BERT-BiLSTM-CRF model is used for entity recognition. Experiments show that the model has the best entity recognition effect on three types of texts, including teaching cases, clinical cases and literature data, and the F1 value is up to 0.967. It can effectively identify symptoms, course of disease, tongue condition and pulse condition in TCM diagnosis and treatment texts, which lays a solid foundation for intelligent assisted syndrome differentiation and treatment of TCM. By constructing four types of entity corpora and using three mainstream entity recognition models for experiments, it is found that the BERT-BiLSTM-CRF model has a good entity recognition effect in three types of data: teaching cases, clinical cases and literature data. Experimental results show that the F1 values of the BERT-bilSTM-CRF model in teaching cases, clinical cases and literature data are 0.967, 0.82 and 0.91, respectively, which provides an effective method for information extraction in the field of TCM syndrome differentiation diagnosis and treatment, and lays a foundation for further research on knowledge reasoning.

A field experiment was conducted for 2 years in Green Tea Laboratory of Saitama Prefectural Agriculture and Forestry Research Center, Iruma, Saitama, Japan from March 2014 to December 2015. Controlled release fertilizers (CRF) or organic fertilizers (ORG) which is the mixture of chicken manure and oil cakewere applied with the amount of 450 kg N ha^-1 yr^-1 in 2014 and 397 kg N ha^-1 yr^-1 in 2015. Nitrous oxide (N₂O) emissionsfrom soil in green tea fields were measured by closed chamber method. The results showed that CRF has significantly lower N₂O compared to ORG. The cumulative N₂O emissions from CRF accounted for 51% of N₂O emissions from ORG fields and 138% of control with no fertilizer treatment. The N₂O flux from the row was higher than that of under the canopy, since fertilizer were applied on the row. However the total emission from the area between the rows was lower than that under the canopy because of the area ratio of row and canopy was 1:5.

The Dst index is the geomagnetic storm index used to measure the energy level of geomagnetic storms, and the prediction of this index is of great significance for the geomagnetic storm study and the solar activity. In contrast to traditional numerical modelling techniques, machine learning, which has emerged in decades ago based on rapidly developing computer hardware and software and artificial intelligence methods, has been unprecedentedly developed in geophysics, especially solar-terrestrial space physics. This study chooses two machine learning models, the LSTM (Long-Short Time Memory, LSTM) and EMD-LSTM model (Empirical Mode Decomposition, EMD), to model and predict the Dst index. By building the Dst index data series from 2018-2023, two models were built to fit and predict the data. Firstly, we evaluated the influences of the learning rate and the amount of training data on the prediction accuracy of the LSTM model, and finally, 10-3 was thought as the optimal learning rate; secondly, the two models were used to predict the Dst index in the solar active and quiet periods, respectively, and the RMSE (Root Mean Square Error) of the LSTM model in the active period is 7.34 nT, the CC (correlation coefficient) is 0.96, those of the quiet period are 2.64nT and 0.97; the RMSE and r of EMD-LSTM model are 8.87nT and 0.93 in active time and 3.29nT and 0.95 in the quiet time. Finally, the prediction accuracy of the LSTM model in short time period is slightly better than the EMD-LSTM model. However, there will be a problem of prediction lag, which the EMD-LSTM model can then solve, and can better predict the geomagnetic storm.

Accurate assessment of the breast cancer deterioration degree plays a crucial role in making medical plan, and the important basis for degree assessment is the number of mitoses in a given area of the pathological image. We utilized deep multi-scale fused fully convolutional neural network (MFF-CNN) combing with conditional random felid (CRF) to detect mitoses in hematoxylin and eosin stained histology image. Analyze the characteristics of mitotic detection ----scale invariance and sparsity, as well as the difficulties ---- small amount of data , inconsistent image staining and sample class unbalanced. Based on this, mitotic detection model is designed. In this paper, a tissue-based staining equalization method is used, and to establish an effective training sample set, we select training samples by using CNN. A mitotic detection model fusing multi-level and multi-scale features and context information was designed, and the corresponding training strategy was made to reduce over-fitting. As preliminarily validated on the public 2014 ICPR MITOSIS data, our method achieves a better performance in term of detection accuracy than ever recorded for this dataset.

This study investigates the application of frequency augmentation techniques to improve condition-based maintenance (CBM+) systems for airborne weapon systems, focusing on the predictive accuracy of velocity and acceleration parameters. Utilizing MIL-STD-1553B MUX data from 138 sorties of fixed-wing aircraft, we explored six augmentation methods, including traditional interpolations (linear, quadratic, cubic spline) and advanced machine learning models (K-Nearest Neighbor, LSTM, and Bi-LSTM). Our findings indicate that while traditional methods like linear interpolation are more effective for velocity parameters, advanced ML techniques, particularly Bi-LSTM, provide better results for acceleration parameters, which exhibit more complex and rapid variability. The study underscores the necessity of tailoring augmentation approaches to specific parameter characteristics and highlights the potential of ML models in capturing intricate patterns within time-series data. These insights are critical for advancing CBM+ systems in military avionics, enhancing reliability and operational efficiency through improved data processing strategies. Future work should explore more performant augmentation techniques, such as by integrating multi-dimensional datasets, and explore ways to develop automated tools for a more powerful predictive maintenance framework.

To enhance the safety of power grid operations, this study proposes a high-precision short-term photovoltaic power prediction method that integrates information from surrounding pho-tovoltaic stations and the Conv-LSTM-ATT model. In the deep learning prediction model, not only is numerical weather prediction (NWP) data from the target photovoltaic station used as input features, but also highly correlated features from nearby photovoltaic stations are incor-porated. The research begins by analyzing the correlation between irradiance and power se-quences, along with distance factors, to calculate a composite similarity index between the target and other regional photovoltaic stations. Stations with high similarity indices are then selected as data sources. Subsequently, Bayesian optimization techniques are employed to find the optimal data fusion ratios. Ultimately, using the selected data, power prediction mod-eling is conducted via the Conv-LSTM-ATT deep neural network. Experimental results con-firm the superiority of the proposed model, which demonstrates higher predictive accuracy compared to three other classical models. The data fusion strategy determined by Bayesian optimization significantly enhances prediction accuracy, reducing the root mean square error (RMSE) of the test set by 20.04%, 28.24%, and 30.94% for three weather types, respectively.

Industrial process control systems commonly exhibit features of time-varying, strong coupling, and strong nonlinearity. Obtaining accurate mathematical models of these nonlinear systems and achieving satisfactory control performance is still a challenging task. In this paper, data-driven modeling techniques and deep learning methods are used to accurately capture a category of smooth nonlinear system’s spatiotemporal features. The operating point of these systems may change over time, and their nonlinear characteristics can be locally linearized. We established the LSTM-CNN-ARX model by utilizing a fusion of long short-term memory (LSTM) network and convolutional neural network (CNN) to fit the coefficients of the state-dependent exogenous variable autoregressive (SD-ARX) model. Compared to other models, the hybrid LSTM-CNN-ARX model is more effective in capturing the nonlinear system’s spatiotemporal characteristics due to its incorporating the strengths of LSTM for learning temporal characteristics and CNN for capturing spatial characteristics. The model-based predictive control (MPC) strategy, namely LSTM-CNN-ARX-MPC, is developed by utilizing the model's local linear and global nonlinear features. The control comparison experiments conducted on a water tank system (WTS) show the effectiveness of the developed models and MPC methods.

Breast Cancer diagnosis is one of the most studied problems in the medical domain. In the medical domain, cancer diagnosis has been studied extensively which instantiates the need of early prediction of cancer disease. For obtaining advance prediction, health records are exploited and given as input to an automated system. This paper focuses on constructing an automated system by employing deep learning based recurrent neural network models. A stacked GRU-LSTM-BRNN is proposed in this paper that accepts health records of a patient for determining possibility of being affected by breast cancer. Proposed model is compared against other baseline classifiers such as stacked Simple-RNN model, stacked LSTM-RNN model, stacked GRU-RNN model. Comparative results obtained in this study indicate that stacked GRU-LSTM-BRNN yield better classification performance for predictions related to breast cancer disease.

Climate change poses new challenges for agricultural production as an increase in temperature also brings an increase in frequency and intensity of droughts. We study the occurrences of droughts in recent years as well as their effect on agricultural yields in combination with other factors such as winter frost. Furthermore we run experiments that aim to predict future drought events in order to provide insights whether current agricultural products will remain viable long-term and to indicate short-term drought risks. Our study area consists of the South-Moravian region in the Czech Republic and Saxony in Germany with the timeframe ranging from 1990 − 2022. For the effect on agricultural yields we use statistical methods such as regression and correlation. We train a Long-Short Term Memory (LSTM) neural net on data for the Standardised Precipitation-Evapotranspiration Index (SPEI) in order to predict future events. Our results indicate that the increased severity of droughts in recent years didn’t yet cause yield losses in our researched area. Our predictions with the LSTM look promising, but will need more data for future use-cases in order to increase accuracy and robustness.

As shown in former papers, the nonadiabatic Heisenberg model presents a novel mechanism of Cooper pair formation generated by the strongly correlated atomic-like motion of the electrons in narrow, roughly half-filled "superconducting bands". These are energy bands represented by optimally localized spin-dependent Wannier functions adapted to the symmetry of the material under consideration. The formation of Cooper pairs is not the result of an attractive electron-electron interaction but can be described in terms of quantum mechanical constraining forces constraining the electrons to form Cooper pairs. There is theoretical and experimental evidence that only this nonadiabatic mechanism operating in superconducting bands may produce eigenstates in which the electrons form Cooper pairs. These constraining forces stabilize the Cooper pairs in any superconductor, whether conventional or unconventional. Here we report evidence that also the experimentally found superconducting state in bismuth at ambient as well as at high pressure is connected with a narrow, roughly half-filled superconducting band in the respective band structure. This observation corroborates once more the significance of constraining forces in the theory of superconductivity.

When analyzing user geospatial information through deep learning methods, it is typically necessary to annotate existing geospatial data. Currently, manual annotation methods are commonly employed, suffering from issues related to low efficiency and accuracy. This design is based on the TensorFlow deep learning framework and first realizes the BiLSTM+CRF+AGG deep learning model. Among the models, AGG is the aggregation layer, which is introduced to solve the problem of solid particle size equilibrium. Secondly, based on the characteristics of original data and professional data, an automatic labeling algorithm is proposed. The algorithm first preprocesses the acquired original data set and professional data set, The most valuable unlabeled data set which can make the training model converge quickly is selected from the original data set as the target data set. Sort the target data set based on preset rules and set annotation parameters for the sorted target data set. Based on the set annotation parameters, the corpus is synthesized and used as the annotation result. Thirdly, based on the active learning strategy, a manual annotation auxiliary scheme is proposed, and an Excel generation module that is convenient for manual annotation correction is designed and developed to further improve the efficiency and quality of annotation through iterative processing. The combination of the BiLSTM+CRF+AGG deep learning model and high-quality annotation can accurately identify non-standard, incomplete, or even incorrect geographical information entities. This annotation method has found successful practical application within the context of the research project and has been granted an invention patent.

Long Short-Term Memory (LSTM) networks have gained attention for their forecasting capabilities, especially in volatile markets like oil. This study compares LSTM networks with traditional time series models such as ARIMA and Exponential Smoothing in predicting oil prices. We analyze a comprehensive dataset of historical oil price movements and apply preprocessing techniques to ensure the reliability of our model training and evaluation processes. The models are evaluated using metrics like Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE) to measure their forecasting performance. The results demonstrate that LSTM networks significantly outperform traditional time series models, effectively capturing price trends and fluctuations. Additionally, LSTM shows enhanced adaptability to sudden changes in the market, while traditional models tend to struggle in such scenarios. This comparative analysis underscores the significance of model selection in time series forecasting, especially for industries characterized by high volatility, and suggests a shift towards utilizing LSTM for enhanced financial forecasting accuracy. Future research may further investigate hybrid models that combine the strengths of both LSTM and traditional methodologies.

In detecting DDoS, deep learning faces challenges and difficulties such as high computational demands, long training times, and complex model interpretation. This research focuses on overcoming these challenges by proposing an effective strategy for detecting DDoS attacks in unbalanced network environments. This research uses SMOTE to increase the class distribution of the data set by allowing models using LSTM to learn time anomalies effectively when DDoS attacks occur. The experiments carried out have shown significant improvement in the performance of the LSTM model when integrated with SMOTE. These include validation loss results of 0.048 for LSTM SMOTE and 0.1943 for LSTM without SMOTE, accuracy of 99.50 and 97.50. Apart from that, there was an increase in the f1 score from 93.4% to 98.3%. In this research, it is proven that SMOTE can be used as an effective strategy to improve model performance in detecting DDoS attacks on heterogeneous networks, as well as increasing model robustness and reliability.

Predicting the prices of cryptocurrency owing to its volatility, instability, and other factors has been challenging; investors and traders especially in Nigeria have been on a constant look for a more reliable way of knowing market trends and prices and while there has been so many research conducted using deep learning, the results for which has fall short of what investors could called a strong predictor. This research reviewed the results of many works that had been done and proposed two types of recurrent neural network (RNNs) namely Long Short-Term Memory and Gated Recurrent Unit (GRU) for predicting the future prices of two of the most common crypto assets namely Bitcoin (BTC) and Ethereum (ETH), these two were selected based on their popularity, the volume traded and their market capitalization. The experiment was conducted in a GPU Jupyter Notebook environment and the performance of our experiment was evaluated on a test set using root mean square error (RMSE) and based on its values, the LSTM presented a better performance with rsme scores of 654.66, and 80.30 respectively for BTC and ETH as compared to GRU. The paper proceeds further to compare the results of this experiment with other related works and we discovered that its performance is a great improvement.

Soil moisture is an important factor affecting the plant growth. For a long time, the convenience, timeliness and accuracy of soil moisture monitoring have been limited due to the backward of observation methods and equipment. Therefore, the quantitative prediction of soil moisture has become a difficult problem. Aiming at the problems of high erection cost, easily damaged sensors and low measurement accuracy of the existing fixed sensor soil moisture monitoring system, a soil moisture prediction model based on the long short term memory neural network (LSTM) integrating the particle swarm optimization (PSO) (PSO-LSTM) is designed and implemented. The hyperparameters of the LSTM network can be obtained based on the excellent global search ability of the PSO algorithm. According to the meteorological data and soil moisture data of Haidian Park in 2019, the long short term memory(LSTM) neural network based prediction model is constructed with input vectors of surface temperature, average temperature, evaporation, sunshine hours, precipitation and average wind speed, and the output vector of soil relative humidity. The results show that compared with the back propagation(BP) neural network, the Elman neural network and the LSTM neural network, the proposed PSO-LSTM model has higher prediction performance.

Many studies in the current literature annotate patterns in stock prices and use computer vision models to learn and recognize these patterns from stock price-action chart images. Additionally, current literature also use Long Short-Term Memory Networks to predict prices from continuous dollar amount data. In this study, we combine the two techniques. We annotate the consolidation breakouts for a given stock price data, and we use continuous stock price data to predict consolidation breakouts. Unlike computer vision models that look at the image of a stock price action, we explore using the convolution operation on raw dollar values to predict consolidation breakouts under a supervised learning problem setting. Unlike LSTMs that predict stock prices given continuous stock data, we use the continuous stock data to classify a given price window as breakout or not. Finally, we do a regularization study to see the effect of L₁, L₂, and Elastic Net regularization. We hope that combining regression and classification shed more light on stock market prediction studies.

The interpretation of land use and land cover (LULC) is an important issue in the fields of high-resolution remote sensing (RS) image processing and land resource management. Fully training a new or existing convolutional neural network (CNN) architecture for LULC classification requires a large amount of remote sensing images. Thus, fine-tuning a pre-trained CNN for LULC detection is required. To improve the classification accuracy for high resolution remote sensing images, it is necessary to use another feature descriptor and to adopt a classifier for post-processing. A fully connected conditional random fields (FC-CRF), to use the fine-tuned CNN layers, spectral features, and fully connected pairwise potentials, is proposed for image classification of high-resolution remote sensing images. First, an existing CNN model is adopted, and the parameters of CNN are fine-tuned by training datasets. Then, the probabilities of image pixels belong to each class type are calculated. Second, we consider the spectral features and digital surface model (DSM) and combined with a support vector machine (SVM) classifier, the probabilities belong to each LULC class type are determined. Combined with the probabilities achieved by the fine-tuned CNN, new feature descriptors are built. Finally, FC-CRF are introduced to produce the classification results, whereas the unary potentials are achieved by the new feature descriptors and SVM classifier, and the pairwise potentials are achieved by the three-band RS imagery and DSM. Experimental results show that the proposed classification scheme achieves good performance when the total accuracy is about 85%.

Proteins are the workhorses of the cell that perform biological functions by interacting with other proteins. Many statistical methods for protein-protein interaction (PPI) have been studied without considering time-dependent changes in networks and the functionalities. I introduced a novel method that models PPI networks as being dynamic in nature and evolving time-varying multivariate distribution with Conditional Random Fields (CRF). This research is directed towards implementing this new combinatorial algorithm on massively parallel architectures such as Graphics Processing Units (GPUs) for efficient computations for large scale bioinformatics datasets. I compared Conditional Random Fields (CRF) and the proposed novel method using CRF combined with the Block Coordinate Descent algorithm for human protein-protein interaction data set. Both are implemented on GPU-Accelerated Computing Architecture and the proposed novel method showed the advantages in predicting protein-protein interaction sites. I also show that the proposed approach is more efficient in 6.13% than standalone CRF++ in predicting protein-protein interaction sites.

Background: In the landscape of thoracic surgery, innovation continually drives progress, offering novel approaches to address complex pathologies while prioritizing patient well-being. Dual-portal robotic-assisted thoracic surgery DRATS represents the next frontier in this evolution. In this report we describe our experience with the DRATS approach for segmentectomy with the indocyanine green intersegmental plane identification. Methods: We presented the case of a patient who underwent a DRATS lingulectomy and lymphadenectomy stations 5, 6, 7, and 10 using the daVinci Surgical System. Results: The patient's postoperative course was uneventful with chest tube was removed in second post operative day. The final pathological analysis confirmed a low-grade malignant potential adenocarcinoma, with main diameter of 1.1 cm, at 3 cm from lung margins. 12 nodes were removed, from station 5,6,7,10,11, all of the free of metastases. Conclusions: Our initial observations suggest that Dual-Portal Robotic-Assisted Tho-racic Surgery (DRATS) demonstrates notable feasibility.

Flood forecasting helps anticipate floods and evacuate people, but due to the access of a large number of iot data acquisition devices, the explosive growth of multidimensional data and the increasingly demanding prediction accuracy, classical parameter models and traditional machine learning algorithms are unable to meet the high efficiency and high precision requirements of prediction tasks. In recent years, deep learning algorithms represented by convolutional neural networks, recurrent neural networks and Informer models have achieved fruitful results in time series prediction tasks. The Informer model is used to predict the flood flow of the reservoir. At the same time, the prediction results are compared with the prediction results of the traditional method and the LSTM model, and how to apply the Informer model in the field of flood prediction to improve the accuracy of flood prediction is studied. The data of 28 floods in the Wan 'an Reservoir control basin from May 2014 to June 2020 were used, with areal rainfall in five subzones and outflow from two reservoirs as inputs and flood processes with different sequence lengths as outputs. The results show that the Informer model has good accuracy and applicability in flood forecasting. In the flood forecasting with sequence length of 4, 5 and 6, Informer has higher prediction accuracy, and the prediction accuracy is better than other models under the same sequence length, but the prediction accuracy will decline to a certain extent with the increase of sequence length. The Informer model stably predicts the flood peak better, and its average flood peak difference and average maximum flood peak difference are the smallest. As the length of the sequence increases, the number of fields with a maximum flood peak difference less than 15% increases, and the maximum flood peak difference decreases. Therefore, the Informer model can be used as one of the better flood forecasting methods, and it provides a new forecasting method and scientific decision-making basis for reservoir flood control.

In the quest for sustainable energy solutions, predicting electricity prices for renewable energy sources plays a pivotal role in efficient resource allocation and decision-making. This article presents a novel approach to forecasting electricity prices for renewable energy sources using deep learning models, leveraging historical data from the Power System Operator (PSE). The proposed methodology encompasses data collection, preprocessing, feature engineering, model selection, training, and evaluation. By harnessing the power of recurrent neural networks (RNNs) and other advanced deep learning architectures, the model captures intricate temporal relationships, weather patterns, and demand fluctuations that impact renewable energy prices. The study demonstrates the applicability of this approach through empirical analysis, showcasing its potential to enhance energy market predictions and aid in the transition to more sustainable energy systems. The outcomes underscore the importance of accurate renewable energy price predictions in fostering informed decision-making and facilitating the integration of renewable sources into the energy landscape. As governments worldwide prioritize renewable energy adoption, this research contributes to the arsenal of tools driving the evolution towards a cleaner and more resilient energy future.

Recent SDN advances address traditional network management challenges through centralized control and plane separation. SDN prevents breaches using a centralized controller but introduces risks. The controller can be a single point of failure. Thus, an OpenFlow Controller's flow-based anomaly detection enhances SDN security. Our research explored two OpenFlow intrusion detection methods. The first employed machine learning, NSL-KDD dataset, and feature selection, yielding 82% accuracy with random forest. The second combined deep neural networks with GRU-LSTM, achieving 88% accuracy using ANOVA F-Test and feature elimination. Experiments highlighted deep learning as superior for OpenFlow intrusion detection.

Chatbots are extensively needed in customer services to handle customer inquiries, such as tracking orders or providing information about products and services. One of the most reliable implementations of chatbots is using the common architectures of LSTM networks named Seq2Seq networks. The networks are using an encoder and a decoder. Seq2Seq chatbot is a type of chat system that is professional enough to pass the Turing test. The Turing test is a way of deciding the accuracy of the machine by examining its response, it should appear like a human response. In this research, we will introduce a novel architecture that can pass the Turing test. The seq2seq Accuracy is improved by making incremental training to the chatbot. The new proposal provides higher accuracy and high similarity to human chat responses.

The article considers an approach to the problem of assessing the quality of speech during speech rehabilitation as a classification problem. For this, a classifier is built on the basis of an LSTM neural network for dividing speech signals into two classes: before the operation and immediately after. At the same time, speech before the operation is the standard to which it is necessary to approach in the process of rehabilitation. The metric of belonging of the evaluated signal to the reference class acts as an assessment of speech. An experimental assessment of rehabilitation sessions and a comparison of the resulting assessments with expert assessments of phrasal intelligibility were carried out.

This work addresses the intricate task of predicting the prices of diverse financial assets, including stocks, indices, and cryptocurrencies, each exhibiting distinct characteristics and behaviors under varied market conditions. To tackle the challenge effectively, a novel hybridized architecture, AE-GRU, integrating the encoder-decoder principle with GRU is designed. The experimentation involves multiple activation functions and hyperparameter tuning. With extensive experimentation and enhancements applied to AE-LSTM, the proposed AE-GRU architecture still demonstrates significant superiority in forecasting the annual prices of volatile financial assets from multiple sectors mentioned above. Thus, the novel AE-GRU architecture emerges as a superior choice for price prediction across diverse sectors and fluctuating market scenarios by extracting important non-linear features of financial data and retaining the long-term context from past observations.

This study explores the application of the BPM lifecycle to optimize the Market Analysis process within the Market Intelligence department of a major energy company. The semi-structured, virtual nature of the process necessitated careful adaptation of BPM methodology, starting with process discovery through data collection, modeling, and validation. Qualitative analysis, including value-added and root-cause analysis, revealed inefficiencies. The redesign strategy focused on selective automation using Python scripts and Power BI dashboards, incorporating techniques such as linear programming and forecasting to improve process efficiency and quality while maintaining flexibility. Post-implementation, monitoring through a questionnaire showed positive results, though ongoing interviews were recommended for sustained performance evaluation. This study highlights the value of BPM methodology in enhancing decision-critical processes and offers a model for adaptable, value-driven process improvements in complex organizational environments.

In this review, we summarize recent progress in crystal growth and understanding the influence of crystal structure on the superconductivity in pure and Pb-doped Bi2Sr2CuOy (Bi-2201) materials belonging to the overdoped region of high temperature cuprate superconductors. The crystal growth of Bi-2201 superconductors faces challenges due to intricate materials chemistry and lack of knowledge of corresponding phase diagrams. Historically, a crucible-free floating zone method has emerged as the most promising growth approach for these materials, resulting in high-quality single crystals. This review outlines the described in the literature and the authors' synthesis endeavors, encompassing Pb-doped Bi-2201 crystals, detailed structural characterization of as-grown and post-growth annealed samples, and highlights optimal growth conditions that yield large-size, single-phase, and compositionally homogeneous Bi-2201 single crystals.

Existence of carcinogenic nitrite in food has attracted much attention, however, it is still a challenge to develop nitrite sensor with higher sensitivity and selectivity to enlarge its applications in daily life. Herein, one-dimensional honeycomb-like carbon nanofibers (HCNFs) were synthesized with an electrospun technology, and its specific structure enables the controlling growth and highly dispersed bismuth nanoparticles (Bi NPs) on its surface, which endows the obtained Bi/HCNFs with excellent electrocatalytic activity toward nitrite oxidation. By modifying Bi/HCNFs on screen-printed electrode, the constructed Bi/HCNFs electrode (Bi/HCNFs-SPE) can be used for nitrite detection in one drop of solution, and exhibits higher sensitivity (1269.9 μA mM-1 cm-2) in a wide range of 0.1~800 μM with lower detection limit (19 nM). Impressively, the Bi/HCNFs-SPE has been successfully used for nitrite detection in food and environment samples, the satisfactory property and recovery indicates its feasibility in further practical applications.

Terrestrial laser scanning (TLS) has been adopted as a feasible technique to digitize trees and forest stands, providing accurate information on tree and forest structural attributes. However, there is limited understanding on how a variety of forest structural changes can be quantified using TLS in boreal forest conditions. In this study, we assessed the accuracy and feasibility of TLS in quantifying changes in the structure of boreal forests. We collected TLS data and field reference from 37 sample plots in 2014 (T1) and 2019 (T2). Tree stems typically have planar, vertical, and cylindrical characteristics in a point cloud, and thus we applied surface normal filtering, point cloud clustering, and RANSAC-cylinder filtering to identify these geometries and to characterize trees and forest stands at both time points. The results strengthened the existing knowledge that TLS has the capacity to characterize trees and forest stands in space and showed that TLS could characterize structural changes in time in boreal forest conditions. Root-mean-square-errors (RMSEs) in the estimates for changes in the tree attributes were 0.99-1.22 cm for diameter at breast height (Δdbh), 44.14-55.49 cm2 for basal area (Δg), and 1.91-4.85 m for tree height (Δh). In general, tree attributes were estimated more accurately for Scots pine trees, followed by Norway spruce and broadleaved trees. At the forest stand level, an RMSE of 0.60-1.13 cm was recorded for changes in basal area-weighted mean diameter (ΔDg), 0.81-2.26 m for changes in basal area-weighted mean height (ΔHg), 1.40-2.34 m2/ha for changes in mean basal area (ΔG), and 74-193 n/ha for changes in the number of trees per hectare (ΔTPH). The plot-level accuracy was higher in Scots pine-dominated sample plots than in Norway spruce-dominated and mixed-species sample plots. TLS-derived tree and forest structural attributes at time points T1 and T2 differed significantly from each other (p < 0.05). If there was an increase or decrease in dbh, g, h, height of the crown base, crown ratio, Dg, Hg, or G recorded in the field, a similar outcome was achieved by using TLS. Our results provided new information on the feasibility of TLS for the purposes of forest ecosystem growth monitoring.

This article puts forward the bi-matrix games with crisp parametric payoffs based on interval value function approach. We conclude that the equilibrium solution of the game model can converted into optimal solutions of the pair of the non-linear optimization problem. Finally, experiment results show the efficiency of the model.

The volatility of global energy markets, particularly electricity prices, plays a crucial role in influencing international economic activities. With the ongoing global energy transition and the push for low-carbon development, predicting electricity prices has become increasingly important for policymakers and market participants. This paper explores the forecasting capabilities of the ARIMA and LSTM models in analyzing electricity prices in the United States, drawing from data spanning 2001 to 2024.ARIMA, a traditional time series model, is valued for its simplicity and effectiveness in capturing linear trends, while LSTM, a deep learning-based model, excels at handling long-term dependencies in complex datasets. This study reveals that while both models offer valuable insights, each exhibits limitations. ARIMA struggles with non-linear patterns and volatility, whereas LSTM tends to underestimate extreme price values. The findings highlight the potential of hybrid models that combine traditional and machine learning approaches to enhance forecasting accuracy in the increasingly dynamic energy market. This research provides essential guidance for improving decision-making processes in the context of the global shift towards clean energy.

Sign language recognition technology can help people with hearing impairments to communicate with those who are hearing impaired. At present, with the rapid development of society, deep learning technology also provided certain technical support for sign language recognition work. In sign language recognition tasks, the use of traditional convolutional neural networks to extract spatio-temporal features from sign language videos suffers from insufficient feature extraction, resulting in low recognition rates. Nevertheless, video-based sign language datasets are very large and require a lot of computational resources for training and generalisation must be ensured, which poses a challenge for recognition. In this paper, we have presented a video-based sign language recognition method based on resnet and lstm. As the number of network layers increases, the ResNet network can effectively solve the granularity explosion problem and obtain better time series features. We use the Resnet convolutional network as the backbone model. At the initialisation stage, we obtain sign language features using ResNet; then, the learned feature space is used as the input of LSTM network to obtain long sequence features. The experimental results show that the accuracy of the above model is better than the mainstream model, and it can effectively extract the spatio-temporal features in sign language videos and improve the recognition rate of sign language actions.

: In today’s rapidly expanding era of the Internet of Things (IoT) and the Industrial Internet of Things (IIoT), the emphasis on robust data security and insightful data interpreta- tion is more pronounced than ever. This research introduces a comprehensive approach to both data protection and predictive analytics, leveraging the diverse dataset TON IoT.csv, sourced from a myriad of IoT and IIoT environments. For data security, a dual-encryption technique incorporating both AES and RSA algorithms is established. Its efficacy is evidenced by a perfect match between the original and decrypted datasets, underscoring the integrity of our encryption process. Concurrently, the study ventures into predictive modeling using a modified Snake Optimization Algorithm (SOA) to streamline hyperparameter selection. This subsequently aids in the development and fine-tuning of an LSTM network, which exhibits remarkable predictive accuracy. Additionally, the paper provides an in-depth examination of various encryption methodologies like elliptic curve cryptography (ECC), Lightweight Cryptography for Cloud computing, and homomorphic encryption, while also emphasizing the nuances of encryption in cloud setups, particularly contrasting server-side with client-side encryption and efficient key management. The insights presented serve as a cornerstone for ensuing research, promising a bright future for advancements in IoT and IIoT data protection and analysis

With an explosion of data in the nearly every domain, from physical and environmental sciences to econometrics and even social science, we have entered a golden era of time-domain data science. In addition to ever increasing data volumes and varieties of time-series, there's a plethora of techniques available to analyses them. Unsurprisingly, machine learning approaches are very popular. In environmental sciences (ranging from climate studies to space weather/solar physics), machine learning (ML )and deep learning (DL) approaches complement the traditional data assimilation approaches. In solar and astrophysics, multiwavelength time-series or lightcurves along with observations of other messengers like gravitational waves provide a treasure trove of time-domain data for ML/DL approaches for modeling and forecasting. In this regard, deep learning algorithms such as recurrent neural networks (RNNs) should prove extremely powerful for forecasting as it has in several other domains. Such methods agnostic of the physics can only predict transient flares that are represented in the original distribution trained on (eg. coloured noise fluctuations) and not special, isolated episodes (eg. a one-off outburst like a major coronal mass ejection) potentially distinguishing them. Therefore it is vital to test robustness of these techniques ; here we attempt to make a small contribution to this by exploring sensitivity of RNNs with some rudimentary experiments. We test the performance of a very successful class of RNNs, the Long Short Term Memory (LSTM) algorithms with simulated lightcurves. As an example, we focus on univariate forecasting of time-series (or lightcurves) characteristic certain variable astrophysical objects (eg. active galactic nuclei or AGN). Specifically, we explore the sensitivity of training and test losses to key parameters of the LSTM network and data characteristics namely gaps and complexity measured in terms of number of Fourier components. We find that typically, the performances of LSTMs are better for pink or flicker noise type sources. The key parameters on which performance is dependent are batch size for LSTM and the gap percentage of the lightcurves. While a batch size of $10-30$ seems optimal, the most optimal test and train losses are under $10 \%$ of missing data for both periodic and random gaps in pink noise. The performance is far worse for red noise. This compromises detectability of transients. Thus, we show that generative models (time-series simulations) are excellent guides for use of RNN-LSTMs in building forecasting systems

The deployment of a Static Synchronous Compensator within a microgrid can facilitate voltage and reactive power regulation, leading to enhanced stability and reliability. Within a microgrid setting, a STATCOM can effectively balance power supply and demand, and mitigate voltage fluctuations caused by the intermittent nature of renewable energy sources. To ensure the successful integration of a STATCOM within a microgrid, coordinating the control system with other Distributed Energy Resources, especially when multiple control strategies are employed, can be a challenging task. Therefore, a meticulously designed control system is indispensable to guarantee the microgrid’s efficient and effective operation. The use of GA in LSTM tuning can accelerate the process of finding optimal hyperparameters for a specific task, obviating the necessity for time-consuming and computationally expensive grid search or manual tuning. This method can be particularly advantageous when handling large data sets and complex models. In this paper, an attempt has been made to model the STATCOM to communicate with the microgrid tuned using LSTM-GA for effective calculation of real and reactive power support during grid disturbances.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

This review focuses on the emerging evidence for the association between estimated cardiorespiratory fitness (eCRF) and metabolic risk factors. Given the challenges associated with directly measuring cardiorespiratory fitness (CRF) in large populations, eCRF presents a practical alternative for predicting metabolic health risks. A literature search identified six relevant cohort studies from 2021 to 2024 that investigated the association of eCRF with hypertension, hyperglycemia, dyslipidemia, and obesity. The review findings highlight a consistent inverse relationship between higher eCRF and lower incidence of metabolic risks in line with CRF cohort studies. This review highlights the importance of low eCRF as a primordial indicator for metabolic risks and underscores the need for broader application. Future research directions should include exploring eCRF's predictive accuracy across diverse populations and health outcomes and testing its real-world applicability in healthcare and public health settings.

Cemented rock fill (CRF) is commonly used in cut-and-fill stoping operation in underground mining. This allows for the maximum recovery of ore. Backfilling can improve stope stability in underground workings, and then improve ground stability of the whole mine site. Backfilling step scenarios vary from site to site. This paper presents the investigation of five different backfilling step scenarios and their impacts on the stability of stopes at four different mining levels. A comprehensive comparison of displacements, major principal stress and stress concentration factor (SCF) was conducted. The results show that different backfilling step scenarios have little influence on the final displacement for displacement in the stopes. Among the five backfilling scenarios, the major principal stress and stress concentration factor (SCF) have almost the same final results. The backfilling scenario SCN-1 is the optimum option among these five backfilling scenarios. It can immediately prevent the increase of the displacement and reduce the sidewall stress concentration, thereby preventing possible failures. Using the same strength of CRF can achieve same effects among the four mining levels. Applying backfilling CRF of the same strength at different mining depths is acceptable and feasible to improve the stability of the stopes.

In the era of information explosion in e-commerce, users face an overload problem. Recommender systems alleviate this by filtering target products based on user preferences. Collaborative Filtering (CF) is a popular method but struggles with high-quality recommendations due to data sparsity. Utilizing review texts to capture user preferences has improved CF recommendations. This paper proposes a deep learning-based recommendation framework leveraging bidirectional gated recurrent units (Bi-GRUs) and an attention-based Recurrent Neural Networks (RNN) structure. This framework addresses insufficient user rating data by utilizing user reviews to infer preferences. Experimental results on three datasets show that the proposed Bi-GRUCF model outperforms other state-of-the-art methods, achieving a 55.4% improvement in Mean Absolute Error (MAE) over traditional methods and a 77.8% improvement over other deep learning approaches. This demonstrates the framework's superior recommendation quality, particularly in sparse data scenarios.

Bicyclic peptides have attracted the interest of pharmaceutical companies because of their remarkable properties putting them on a new path in medicine. Their conformational rigidity that improves proteolytic stability, leads to rapid penetration into tissues via any possible route of administration and elimination, occurring by renal metabolism, is of great importance for people with a history of liver diseases. In addition, each ring can function independently, making them extremely versatile molecules for further optimization. In this paper we compared the potentiometric and spectroscopic properties studied by UV-Vis, MCD, and EPR, of four synthetic analogues of the bi-cyclic peptide c(PKKHP-c(CFWKTC)-PKKH). In particular we correlated the structural and spectral properties of complexes with coordinating abilities toward Cu(II) ions of MCL (Ac-PKKHPc(CFWKTC)PKKH-NH2) that contains the unbinding cycle and N- and C-terminal linear parts, with two histidine residues, one per part; two monocyclic ligands containing one histidine residue, both in the N-terminal position i.e., MCL2 (Ac-PKKHPc(CFWKTC)PKKS-NH2) and in the C-terminal position i.e., MCL3 (Ac-PKKSPc(CFWKTC)PKKH-NH2), respectively, and the linear structure LNL (Ac-PKKHPSFWKTSPKKH-NH2).

The technique of optical interferometry has many applications in various fields of knowledge, including astronomy, optical metrology, biology, and chemistry. The visible interference pattern of a conventional single mode fiber (SMF-28) tapered and core-offset structured in-line Mach-Zehnder interferometer has been demonstrated. The white source is generated by an LED, with a wavelength range of 400 nm to 650 nm emission. We analyze the performance of the interference emission with a waist length of 1.8 mm to 6 mm and with a waist diameter of 10 µm to 60 µm for the tapered structure. The achieved visibility is V=0.14 with an FSR of 23 nm. The core-offset structure interferometer is analyzed with different displacements in x and y axis and with a separation length L of 2.5 cm, 4.0 cm and 5.0 cm between two core joints. The output interference emission has a visibility of V= 0.3, V=0.27 and V=0.34 with an FSR of 23 nm, 17 nm and 8 nm, respectively. The sensitivity obtained from the temperature sensor is of 3.53 a.u./°C, with R2 of 0.99769. The proposed MZIs are low cost and can be used for implementation of sensing system in the field as the industry and medical applications.

In this paper, we give all non splitting bi-unitary superperfect polynomials divisible by one or two irreducible polynomials over the prime field of two elements. We prove the nonexistence of odd bi-unitary superperfect polynomials over F2.

Background: Oral narratives are crucial for evaluating youngsters since they reveal a plethora of information about young children's language development. This study aimed to investigate the development of narrative productivity, lexical diversity, syntactic complexity and in Cypriot-Greek-speaking children during preschool and primary school years. An additional aim was to measure the effect of the children’s gender in their performance on the measures of narratives. Methods: One hundred and twenty-nine typically developing Cypriot-Greek-speaking children were recruited for the study. Results: The results showed that the linguistic structure of narrations reflects a subtle developmental trend. As expected, older children tended to produce longer and syntactically more complex stories than the younger ones, which is in line with previous studies. There were significant differences in all productivity measures between the four-year-olds and those aged seven and ten years old. In addition, the results illustrated that there was not any significant effect of gender in the measures of narrative skills. Specifically, gender did not affect the children’s performance in the sample. Boys and girls had similar narrative measurements in all the variables. Conclusions: This study aims to provide initial evidence in retelling narrative development patterns on typically developing Cypriot-Greek speaking children that could be used by speech and language to compare children’s performance and detect language disorders.

Multiple sclerosis (MS) is a heterogeneous disease of the central nervous system that is governed by neural tissue loss and dystrophy during its progressive phase, with complex reactive pathological cellular changes. The immune-mediated mechanisms that promulgate the demyelinating lesions during the relapses of acute episodes are not characteristic of chronic lesions during progressive MS. This has limited our capacity to target the disease effectively as it evolves within the central nervous system white and gray matter, thereby leaving neurologists without effective options to manage individuals as they transition to a secondary progressive phase. The current review highlights the molecular and cellular sequelae that have been identified to cooperate and/or contribute to neurodegeneration that identifies individuals with progressive forms of MS. We emphasize the need for appropriate monitoring via known and novel molecular and imaging biomarkers that can accurately detect and predict progression for the purposes of newly designed clinical trials that may demonstrate efficacy of neuroprotection and potentially neurorepair. To achieve neurorepair, we focus on the modifications required in the reactive cellular and extracellular milieu, in order to enable endogenous cell growth as well as transplanted cells that can integrate and/or renew the degenerative MS plaque.

The incorporation of renewable energy into power systems poses serious challenges to the transmission and distribution power system operators (TSOs and DSOs). To fully leverage these resources there is a need for a new market design with improved coordination between TSOs and DSOs. In this paper we propose two coordination schemes between TSOs and DSOs: one centralised and another decentralised that facilitate the integration of distributed based generation; minimise operational cost; relieve congestion; and promote a sustainable system. To this end, we approximate the power equations with linearised equations so that the resulting optimal power flows (OPFs) in both the TSO and DSO become convex optimisation problems. In the resulting decentralised scheme, the TSO and DSO collaborate to optimally allocate all resources in the system. In particular, we propose an iterative bi-level optimisation technique where the upper level is the TSO that solves its own OPF and determines the locational marginal prices at substations. We demonstrate numerically that the algorithm converges to a near optimal solution. We study the interaction of TSOs and DSOs and the existence of any conflicting objectives with the centralised scheme. More specifically, we approximate the Pareto front of the multi-objective optimal power flow problem where the entire system, i.e., transmission and distribution systems, is modelled. The proposed ideas are illustrated through a five bus transmission system connected with distribution systems, represented by the IEEE 33 and 69 bus feeders.

Stability considerations play a central role in structural dynamics to determine states that are robust against perturbations during the operation. Linear stability concepts, such as the complex eigenvalue analysis, constitute the core of analysis approaches in engineering reality. However, most stability concepts are limited to local perturbations, i.e. they can only measure a state’s stability against small perturbations. Recently, the concept of basin stability has been proposed as a global stability concept for multi-stable systems. As multi-stability is a well-known property of a range of nonlinear dynamical systems, this work studies the basin stability of bi-stable mechanical oscillators that are affected and self-excited by dry friction. The results indicate how the basin stability complements the classical binary stability concepts for quantifying how stable a state is given a set of permissible perturbations.

This article reports the two-step synthesis of NiFeO_x nanomaterials, their characterisation and bifunctional electrocatalytic activity measurements in alkaline electrolyte for metal-air batteries. The samples were mostly in layered double hydroxide at the initial temperature, but upon heat treatment, they were converted to NiFe₂O₄ phases. The electrochemical behaviour of the different samples was studied by linear sweep voltammetry and cyclic voltammetry on the glassy carbon electrode. The OER catalyst activity was observed for low mass loadings (0.125 mg cm⁻²), whereas high catalyst loading exhibited the best performance on the ORR side. The sample heat treated at 250 °C delivered the highest bi-functional oxygen evolution and reduction reaction activity (OER/ORR) thanks to its thin-holey nanosheet like structure with higher nickel oxidation state at 250 °C. This work further helps to develop low-cost electrocatalyst development for metal-air batteries.

Accurate exchange rate prediction is fundamental to financial stability and international trade, positioning it as a critical focus in economic and financial research. Traditional forecasting models often falter when addressing the inherent complexities and non-linearities of exchange rate data. This study explores the application of advanced deep learning models, including LSTM, CNN, and transformer-based architectures, to enhance the predictive accuracy of the RMB/USD exchange rate. Utilizing 40 features across 6 categories, the analysis identifies TSMixer as the most effective model for this task. A rigorous feature selection process emphasizes the inclusion of key economic indicators, such as China-U.S. trade volumes and exchange rates of other major currencies like the euro-RMB and yen-dollar pairs. The integration of grad-CAM visualization techniques further enhances model interpretability, allowing for clearer identification of the most influential features and bolstering the credibility of the predictions. These findings underscore the pivotal role of fundamental economic data in exchange rate forecasting and highlight the substantial potential of machine learning models to deliver more accurate and reliable predictions, thereby serving as a valuable tool for financial analysis and decision-making.

Recurrent Neural Networks (RNNs) have significantly advanced the field of machine learning by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures such as Long Short-Term Memory (LSTM) networks, Gated Recurrent Units (GRUs), Bidirectional LSTM (BiLSTM), and stacked LSTM. The study examines the application of RNNs in different domains, including natural language processing (NLP), speech recognition, financial time series forecasting, bioinformatics, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide machine learning researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research.

Text-based CAPTCHA remains the most widely adopted security scheme, which is the first barrier to securing websites. Deep learning methods, especially Convolutional Neural Networks (CNNs) are the mainstream approach for text-CAPTCHA recognition, which are widely used in CAPTCHA vulnerability assessment and data collection. However, verification code recognizers are mostly deployed on the CPU platform as part of a web crawler and security assessment, they are required to have both low complexity and high recognition accuracy. Due to the specifically designed anti-attack mechanisms like noise, interference, geometric deformation, twisting, rotation, and character adhesion in text CAPTCHAs, some characters are difficult to efficiently identify with high accuracy in these complex CAPTCHA images. This paper proposed a recognition model named Adaptive-CAPTCHA with a CRNN module and trainable and configurable filtering networks, which effectively handle the interference and learn the correlation between characters in CAPTCHAs to enhance recognition accuracy. Experimental results on two datasets of different complexity show that compared with the baseline model Deep-CAPTCHA, the number of parameters of our proposed model is reduced by about 70% and the recognition accuracy is improved by more than 10 percentage points in the two datasets. In addition, the proposed model has a faster training convergence speed.

In cutting processes tool condition affects the quality of the manufactured parts. As such an essential component to prevent unplanned downtime and to assure machining quality is having information about the state of the cutting tool. The primary function of it is to alert the operator that the tool has reached or is reaching a level of ware beyond which behavior is unreliable. In this paper the tool condition is being monitored by analyzing the electric current on the main spindle via an artificial intelligence model utilizing a LSTM neural network. In the current study the tool is monitored while working on a cylindrical raw piece made of AA6013 aluminum alloy with a custom polycrystalline diamond tool, for the purposes of monitoring the ware of these tools. Spindle current characteristics were obtained using external measuring equipment to not influence the operation of the machine included in a larger production line. As a novel approach, an artificial intelligence model based on a LSTM neural network is utilized for the analysis of the spindle current obtained during a manufacturing cycle and assessing the tool ware range in real time. The neural network was designed and trained to notice significant char-acteristics of the captured current signal. The conducted research serves as a proof of concept for use of a LSTM neural network-based model as a method of monitoring the condition of cutting tools.

This paper investigates nonverbal communication in human interactions, with a specific focus on facial expressions. Employing a Long Short-Term Memory (LSTM) architecture and a custom-ized facial expression framework, our approach aims to improve virtual agent interactions by incorporating subtle nonverbal cues. The paper contributes to the emerging field of facial expres-sion generation, addressing gaps in current research and presenting a novel framework within Unreal Engine 5. The model's architecture, trained on the CANDOR corpus, captures temporal dynamics, and refines hyperparameters for optimal performance. During testing, the trained model showed a cosine similarity of -0.95. This enables the algorithm to accurately respond to non-verbal cues and interact with humans in a way that is comparable to human-human interac-tion. Unlike other approaches in the field of facial expression generation, the presented method is more comprehensive and enables the integration of a multi-modal approach for generating facial expressions. Future work involves integrating blendshape generation, real-world testing, and the inclusion of additional modalities to create a comprehensive framework for seamless hu-man-agent interactions beyond facial expressions.

This study proposes a short- and medium-term electricity consumption prediction algorithm by combining the GRU model suitable for long-term forecasting and the Prophet model suitable for seasonality and event handling. (1) Manufacturing Company B's Electricity consumption data and meteorological data in Naju, Jeollanam-do, South Korea are collected and preprocessed. (2) The preprocessed data proposes the Prophet model in the first step for seasonality and event handling prediction. (3) In the second step, seven multivariate data are experimented with GRU. Specifically, the seven multivariate data consist of six meteorological data and the residuals between the predicted data from the proposed Prophet model in Step 1 and the observed data. These are utilized to predict electricity consumption at 15-minute intervals. (4) Electricity consumption is predicted for short-term (2 days and 7 days) and medium-term (15 days and 30 days) scenarios. The experimental results demonstrate that the proposed method outperforms the conventional Prophet model by more than 23 times and the modified GRU model by more than 2 times in terms of MAPE.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

GNSS time series prediction plays a significant role in monitoring crustal plate motion, landslide detection, and maintenance of the global coordinate framework. Long Short-Term Memory (LSTM), a deep learning model has been widely applied in the field of high-precision time series prediction especially when combined with Variational Mode Decomposition (VMD) to form the VMD-LSTM hybrid model. To further improve the prediction accuracy of the VMD-LSTM model, this paper proposes a dual variational modal decomposition long short-term memory (DVMD-LSTM) model to effectively handle the noise in GNSS time series prediction. This model extracts fluctuation features from the residual terms obtained after VMD decomposition to reduce the prediction errors associated with residual terms in the VMD-LSTM model. Daily E, N, and U coordinate data recorded at multiple GNSS stations between 2000 and 2022 are used to validate the performance of the proposed DVMD-LSTM model. The experimental results demonstrate that compared to the VMD-LSTM model, the DVMD-LSTM model achieves significant improvements in prediction performance across all measurement stations. The average RMSE is reduced by 9.86%, and the average MAE is reduced by 9.44%. Furthermore, the average accuracy of the optimal noise model for the predicted results is improved by 36.50%, and the average speed accuracy of the predicted results is enhanced by 33.02%. These findings collectively attest to the superior predictive capabilities of the DVMD-LSTM model, thereby enhancing the reliability of the predicted results.

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

A full connected world is expected to gain in the 6th generation mobile network (6G). As a typi-cal fully connected scenario, the internet of vehicle (IoV) enables intelligent vehicle operations via artificial intelligence (AI) and edge computing technologies. In the future of vehicular net-works, wide variety of services need powerful computing resources and higher quality of ser-vice (QoS). Existing resources are insufficient to match these requirements. Aim to this problem, An intelligent service offloading framework is provided. Based on the framework, an Algorithm of Improved Gradient Descent (AIGD) is created to accelerate the speed of iteration. So, the con-vergence of convolutional neural network (CNN) based on AIGD is able to be accelerated too. Then, an Algorithm of convolutional long short-term memory (CN_LSTM) Based Traffic Predic-tion (ACLBTP) is designed to gain the predicted number of vehicles belonged to the edge node. At last, an Algorithm of Service Offloading Based on CN_LSTM (ASOBCL) is conducted to of-fload these services to the vehicles belonged to the edge node. In ASOBCL, sorting technique is adopted to speed up the offloading work. Simulation results demonstrate the fact that the pre-diction strategy designed in this paper has high accuracy. The low offloading time and main-taining stable load balance is gained via running ASOBCL. Low offloading time means short response time. And, the QoS is guaranteed. So, these strategies designed in this paper are effec-tive and valuable.

Photovoltaic(PV) power generation is highly nonlinear and stochastic. Accurate prediction of PV power generation plays a crucial role in grid connection as well as the operation and scheduling of power plants. To predict the PV power combination model, this paper suggests a method based on Empirical Mode Decomposition (EMD), Ensemble Empirical Mode Decomposition (EEMD), Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN), Nonlinear Auto-Regressive Neural Networks with Exogenous Input (NARXNN), Long Short Term Memory (LSTM) Neural Network, and Light Gradient Boosting Machine (LightGBM) algorithms. To attempt to reduce the non-smoothness of PV power, the weather variable features with the greatest effect on PV power are first identified by correlation analysis. Following this, the PV power modal decomposition is split and reorganized into a new feature matrix. Finally， a NARX is used to obtain preliminary PV power components and residual vector features， and the PV power is predicted by combining three models of LightGBM， LSTM, and NARX and then the final prediction results are obtained by combining the PV power prediction results using error inverse method weighted optimization. The prediction results demonstrate that the model put forth in this paper outperforms those of other models and validate the model's validity by utilizing real measurement data from Andre Agassi College in the United States.

Computer systems that operate in remote locations such as satellites, remote weather stations and autonomous robots are highly limited in the availability of energy for their operation. This work aims to employ artificial intelligence algorithms in energy management in order to obtain the maximum energy yield and the prediction of energy availability to the system. The work presents the main types of algorithms used in artificial intelligence and presents the creation of a prototype that will operate as a low power system powered by batteries and a small solar plate, the prototype will perform inferences on the LSTM neural network algorithm in order to predict the future availability of energy, consequently the management system will carry out the energy distribution in order to obtain the maximum operation of the prototype without total discharge of the batteries. So that the artificial intelligence system could be embedded in the prototype, the TensorFlow Lite framework was used, which allows the inference to be carried out in devices with low consumption and limited processing power.

Speech signals are degraded in real-life environments, product of background noise or other factors. The processing of such signals for voice recognition and voice analysis systems presents important challenges. One of the conditions that make adverse quality difficult to handle in those systems is reverberation, produced by sound wave reflections that travel from the source to the microphone in multiple directions.To enhance signals in such adverse conditions, several deep learning-based methods have been proposed and proven to be effective. Recently, recurrent neural networks, especially those with long and short-term memory (LSTM), have presented surprising results in tasks related to time-dependent processing of signals, such as speech. One of the most challenging aspects of LSTM networks is the high computational cost of the training procedure, which has limited extended experimentation in several cases. In this work, we present a proposal to evaluate the hybrid models of neural networks to learn different reverberation conditions without any previous information. The results show that some combination of LSTM and perceptron layers produce good results in comparison to those from pure LSTM networks, given a fixed number of layers. The evaluation has been made based on quality measurements of the signal's spectrum, training time of the networks and statistical validation of results. Results help to affirm the fact that hybrid networks represent an important solution for speech signal enhancement, with advantages in efficiency, but without a significan drop in quality.

Accurate and fast traffic flow forecasting is vital in intelligent transportation system because many of the advanced features in intelligent transportation systems are based on it. However, existing methods have poor performance regarding accuracy and computational efficiency in long-term traffic flow forecasting under big data. Hence, we propose an improved Long short-term memory (LSTM) Network and its cluster computing implementation in this paper to address the above challenge. We propose a singular point probability LSTM (SDLSTM) algorithm. The method discards the units of the network according to the singular point probability during the training process and amends the SDLSTM by Autoregressive Integrated Moving Average Model (ARIMA) to achieve the accurate prediction of 24-hour traffic flow data. Furthermore, the paper designs a scheme for implementing this method through cluster computing to shorten the calculation time and improve the system's operating speed. Theoretical analysis and experimental results show that SDLSTM gains a higher accuracy rate and better stability in the long-term traffic flow forecasting compared with previous methods.

We describe a multi-resolution approach for audio classification and illustrate its application to the open data set for environmental sound classification. The proposed approach utilizes a multi-resolution based ensemble consisting of targeted feature extraction of approximation (coarse scale) and detail (fine scale) portions of the signal under the action of multiple transforms. This is paired with an automatic machine learning engine for algorithm and parameter selection and the LSTM algorithm, capable of mapping several sequences of features to a predicted class membership probability distribution. Initial results show an improvement in multi-class classification accuracy.

The sustainability of the planet and its inhabitants is in dire danger and is among the highest priorities on global agendas such as the Sustainable Development Goals (SDGs) of the United Nations (UN). Solar energy -- among other clean, renewable, and sustainable energies -- is seen as essential for environmental, social, and economic sustainability. Predicting solar energy accurately is critical to increasing reliability and stability, and reducing the risks and costs of the energy systems and markets. Researchers have come a long way in developing cutting-edge solar energy forecasting methods. However, these methods are far from optimal in terms of their accuracies, generalizability, benchmarking, and other requirements. Particularly, no single method performs well across all climates and weathers due to the large variations in meteorological data. This paper proposes SENERGY (an acronym for Sustainable Energy), a novel deep learning-based auto-selective approach and tool that, instead of generalising a specific model for all climates, predicts the best performing deep learning model for GHI forecasting in terms of forecasting error. The approach is based on carefully devised deep learning methods and feature sets through an extensive analysis of deep learning forecasting and classification methods using ten meteorological datasets from three continents. We analyse the tool in great detail through a range of metrics and methods for performance analysis, visualization, and comparison of solar forecasting methods. SENERGY outperforms existing methods in all performance metrics including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Forecast Skills (FS), Relative Forecasting Error, and the normalised versions of these metrics. The proposed auto-selective approach can be extended to other research problems such as wind energy forecasting and predict forecasting models based on different criteria (in addition to the minimum forecasting error used in this paper) such as the energy required or speed of model execution, different input features, different optimisations of the same models, or other user preferences.

We show succinctly a natural origin of the beautiful Gamma function in light of the WJ distribution, linking to quite distinct fields.

In this study, we focus on an abstract form of summation equations, which can be regarded as a particular class of nonlinear difference equations. We investigate sufficient conditions for the existence of discrete almost automorphic solutions by appealing to the fixed point theory and establish a linkage between the existence of discrete almost automorphic solutions and the existence of bounded solutions for the nonlinear difference equations in the spotlight. Consequentially, we propose a discrete counterpart of the Bohr-Neugebauer theorem for the qualitative theory of difference equations.

The conceptual and theoretical backbones of symmetry/asymmetry detections or similarity/dissimilarity, and identity/unidentity study are automorphism or isomorphism respectively. However, the development of equations and methods for symmetry/asymmetry detections, similarity/dissimilarity, and identity/unidentity measures deviates from these backbones. In this article, an equation was proposed for symmetry/asymmetry detections, similarity/dissimilarity, and identity/unidentity measures, and proved that its isoreflective pairs-points are functionally bijective and inverse. The proposal, called Kabirian-based optinalysis, is based on the conceptual and theoretical frameworks of automorphism and isomorphism. The Kabirian-based optinalysis is also proven and characterized as invariant (robust) under translation (i.e., scaling and location shift), and rotation or reflection. Computing codes were written in python language for Kabirian-based optinalysis to serve as working codes for application and verification.

The relative operating characteristic (ROC) curve is a popular diagnostic tool in forecast verification, with the area under the ROC curve (AUC) used as a verification metric measuring the discrimination ability of a forecast. Along with calibration, discrimination is deemed as a fundamental probabilistic forecast attribute. In particular, in ensemble forecast verification, AUC provides a basis for the comparison of potential predictive skill of competing forecasts. While this approach is straightforward when dealing with forecasts of common events (e.g. probability of precipitation), the AUC interpretation can turn out to be oversimplistic or misleading when focusing on rare events (e.g. precipitation exceeding some warning criterion). How should we interpret AUC of ensemble forecasts when focusing on rare events? How can changes in the way probability forecasts are derived from the ensemble forecast affect AUC results? How can we detect a genuine improvement in terms of predictive skill? Based on verification experiments, a critical eye is cast on the AUC interpretation to answer these questions. As well as the traditional trapezoidal approximation and the well-known bi-normal fitting model, we discuss a new approach which embraces the concept of imprecise probabilities and relies on the subdivision of the lowest ensemble probability category.

(1) Background: The diphtheria toxoid antigen is a major component in pediatric and booster combination vaccines and is known to raise a protective humoral immune response upon vaccination. Although antibodies are considered critical for diphtheria protection, little is known about the antigenic determinants that maintain humoral immunity. (2) Methods: One hundred twelve 15-mer peptides covering the entire sequence of DTx protein were prepared by Spot-synthesis. Membrane-bound peptides immunoreactivity with sera from mice immunized with triple DTP vaccine allowed mapping of continuous B-cell epitopes, topological studies, MAPs synthesis, and ELISA development. (3) Results: Twenty epitopes were identified, being 2 in the signal peptide, 5 in the CD, 7 in the HBFT domain, and 5 in the RBD. Two 17-mer (CB/Tx-2/12 and CB/DTx-4-13) derived bi-epitope peptides linked by a Gly-Gly spacer were chemically synthesized. The peptides were used as antigens to coat ELISA plates and assayed with human (huVS) and mice vaccined sera (miVS) for in vitro diagnosis of diphtheria. The assay proved to be highly sensitive (99.96%) and specific (100%) either for huVS and miVS and when compared with a commercial ELISA test, demonstrate high performance. (4) Conclusions: Our work displayed the complete picture of the linear B cell IgG response epitope of the DTx responsible for the protective effect and demonstrated the specificity and eligibility to enter phase IIB studies of some epitopes to develop new and fast diagnostic assays.

The paper discusses the electroreduction of Bi(III) ions in the aspect of expanding the ”cap – pair” effect. The ”cap – pair” rule is associated with the acceleration of the electrode’s processes by organic substances. The interpretation of the ”cap – pair” effect mechanism was expanded to include the effect of supporting electrolyte concentration on the acceleration process and the type of electrochemical active as well as used protonated organic substances. It has also been shown that the phenomena occurring at the electrode/solution interface can influence a change in the dynamics of the electrode’s process according to the ”cap – pair” rule.

Land cover change detection (LCCD) based on bi-temporal remote sensing images plays an important role in the inventory of land cover change. Due to the benefit of having spatial dependency properties within the image space while using remote sensing images for detecting land cover change, many contextual information based change detection methods have been proposed during past decades. However, there is still a space for improvement in accuracies and usability of LCCD. In this paper, a LCCD method based on adaptive contextual information is proposed. First, an adaptive region is constructed by gradually detecting the spectral similarity surrounding a central pixel. Second, the Euclidean distance between pairwise extended regions is calculated to measure the change magnitude between the pairwise central pixels of bi-temporal images. While the whole bi-temporal images are scanned pixel-by-pixel, the change magnitude image (CMI) can be generated. Then, the Otsu or a manual threshold is employed to acquire the binary change detection map (BCDM). The detection accuracies of the proposed approach are investigated by two land cover change cases with Landsat bi-temporal remote sensing images. In comparison to several widely used change detection methods, the proposed approach can achieve a land cover change inventory map with a competitive accuracy.

Accurate solar power forecasting is pivotal for the effective planning, management, and operation of power systems, ensuring a sustainable energy supply for consumers while optimizing the integration of renewable energy sources and the functioning of electricity markets. Recent advancements have focused on developing predictive models that offer precise daily forecasts for solar power generation, which are critical for power usage planning and production efficiency. These models typically leverage a diverse range of data inputs, including solar power metrics and meteorological variables such as temperature, humidity, precipitation, solar radiation, and wind speed—factors that significantly influence solar power generation due to their weather-dependent nature. This study introduces a novel hybrid forecasting model that synergizes the capabilities of the Prophet model and Gated Recurrent Units (GRU), leveraging their respective strengths to enhance predictive performance. The proposed model is rigorously evaluated across short-term (2 days, 7 days) and medium-term (15 days, 30 days) forecasting horizons. Experimental results demonstrate that the hybrid model significantly outperforms the existing models, delivering superior accuracy in solar power generation forecasts.

Machine learning (ML) has transformed the financial industry by enabling advanced applications such as credit scoring, fraud detection, and market forecasting. At the core of this transformation is deep learning (DL), a subset of ML that is robust at processing and analyzing complex and large datasets. This paper provides a concise overview of key deep learning models, including Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), Deep Belief Networks (DBNs), Transformers, Generative Adversarial Networks (GANs), and Deep Reinforcement Learning (Deep RL). The study examines their learning processes, mathematical foundations, and practical applications in finance. It also explores recent advances and emerging trends in the financial industry alongside critical challenges such as data quality, model interpretability, and computational complexity, offering insights into future research directions that can guide the development of more robust and explainable financial models.

The advent of Sixth Generation (6G) wireless technologies introduces challenges and opportunities for Mobile Ad Hoc Networks (MANETs) and Vehicular Ad Hoc Networks (VANETs), necessitating a reevaluation of traditional routing protocols. This paper introduces the Multi-Metric Scoring Dynamic Source Routing (MMS-DSR), a novel enhancement of the Dynamic Source Routing (DSR) protocol, designed to meet the demands of 6G-enabled MANETs and the dynamic environments of VANETs. MMS-DSR integrates advanced technologies and methodologies to enhance routing performance in dynamic scenarios. Key among these is the use of a CNN-LSTM based beamforming algorithm, which optimizes beamforming vectors dynamically, exploiting spatial-temporal variations characteristic of 6G channels. This enables MMS-DSR to adapt beam directions in real-time based on evolving network conditions, improving link reliability and throughput. Furthermore, MMS-DSR incorporates a multi-metric scoring mechanism that evaluates routes based on multiple QoS parameters, including latency, bandwidth, and reliability, enhanced by the capabilities of Massive MIMO and the IEEE 802.11ax standard. This ensures route selection is context-aware and adaptive to changing dynamics, making it effective in urban settings where vehicular and mobile nodes coexist. Additionally, the protocol uses machine learning techniques to predict future route performance, enabling proactive adjustments in routing decisions. The integration of dynamic beamforming and machine learning allows MMS-DSR to effectively handle the high mobility and variability of 6G networks, offering a robust solution for future wireless communications, particularly in smart cities.

Achieving Net Zero emissions target is driving up the need for offshore wind as an alternate energy source. Ireland has the capacity to produce upwards of 30GWof power through offshore wind alone. Wind resource assessments are extremely vital in determining the long term trends of a site. The instruments used for this often suffer breakdowns or miss readings which impacts the long term trend analysis. Wind time series data from Ireland’s Marine Institute is used which is shown to have significant gaps in it’s 20 years of service. Data imputation is necessary to fill in these gaps as accurately as possible. This paper compares LSTMs and ARIMA as two competing methodologies for data imputation. LSTMs are shown to be marginally superior to ARIMA imputation with a mean squared error of 0.45 compared to that of ARIMA of 0.60.

Reasonable allocation of production plans and saving the overall electricity cost are crucial for large manufacturing conglomerates, which is an effective way for conglomerates to realize open-source and cost-saving. This paper develops an optimization model of off-site industrial production scheduling for enterprises in response to the problems of high electricity costs due to the irrational allocation of production schedules on the demand side of China's electric power and the difficulty of promoting industrial and commercial distributed photovoltaic (PV) projects in China. The model makes full use of the conditions of different PV resources and different electricity prices in different places to optimize the scheduling of industrial production in different places. The model is embedded with two sub-models of the electricity price prediction model and distributed photovoltaic kWh cost model to complete the model parameters, in which the electricity price prediction model utilizes the LSTM neural network. The integrated model is then solved by the particle swarm algorithm. To verify the effectiveness of the model in solving the problem of off-site production scheduling on the demand side of electricity, the research team researched two off-site pharmaceutical factories belonging to the same large pharmaceutical company. Finally, the research data were substituted into the model for solving, and it was concluded that the optimization model could significantly reduce the cost of electricity consumption of the enterprise by about 7.9 %.

Solar energy adoption worldwide has expanded exponentially due to a surge in international interest in producing clean energy and the declining cost of solar power plants and their technology. It is anticipated that by 2050, solar will have surpassed fossil fuels to become the primary source of energy. However, one of the main challenges associated with solar energy production is the instability of photovoltaic (PV) power generation because of weather changes. Short-term forecasting of the power output of photovoltaic systems is essential for efficient management of the power grid and energy markets. This paper aims to evaluate the ability of deep learning (DL) models to provide accurate forecasting of hourly global horizontal irradiance (GHI) using different sets of features, including weather and aerosol variables along with solar radiation components. The results show that the best forecast skills are achieved by the long short-term memory autoencoder (LSTM-AE) model.

This paper introduces an innovative approach to lipreading, leveraging a web application designed to generate subtitles for videos where the speaker's mouth is visible and a comprehensive literature review that precedes the discussion, encompassing a thorough examination of various lipreading methods employed over the past decade. Our method employs a powerful deep learning model, featuring a 3D-convolution network and bidirectional LSTM, enabling accurate sentence-level predictions based solely on visual lip movements. With an impressive accuracy of 97%, our model is trained using pre-segmented lips regions, transformed into animated GIFs for effective pre-training. This work stands as a significant contribution to the evolving landscape of lipreading research, offering a practical and accurate solution for real-world applications.

Background: Novel technologies like continuous glucose monitor (CGM) systems are improving diabetes management by means of real-time sensor glucose levels, retrospective course of glucose and trend arrows. Continuous Glucose Monitoring (CGM) offers real-time alerts for (prognostic) hypo- and hyperglycemia, fast dropping or increasing glucose, and hence improving glycaemia under unstable conditions like during meals, physical activity and exercise management. Complex CGM systems challenge people with diabetes and health care professionals in interpreting rapid changes, sensor delay (~10-minute difference between interstitial and plasma glucose), and malfunctions. Enhanced prediction models are necessary for optimal insulin dosing, daily activities, and especially for future fully closed-loop systems. Methods: The aim of this study was to investigate the efficacy of three different predictive models for glucose responses: 1) an autoregressive integrated moving average model (ARIMA), 2) logistic regression, 3)and long short-term memory networks (LSTM), in predicting glucose levels after 15 minutes and one hour. We compared and evaluated the performance of these models in predicting hypoglycemia (<70 mg/dL), euglycemia (70-180 mg/dL), and hyperglycemia (>180 mg/dL). In more detail, by assessing metrics such as precision, recall, F1-score, and accuracy, we specifically assessed which model provided the most accurate and reliable predictions for glucose levels Results: As expected, ARIMA showed the worst accuracy especially predicting hypoglycaemia withing 1-hour (7.3%). The accuracy of the logistic regression model, predicting hypoglycemia during the first 15 min was higher (98%), comparing to LSTM (88%). However, the LSTM model (87%) exceeded the accuracy of hypoglycemia prediction of the logistic regression (83%) during an hour prognosis. The same pattern observed in hyperglycemia - ARIMA model (60%, 1 hour), logistic regression (96%, 15 minutes) and LSTM (85%, 1 hour) Conclusions: These findings suggest that different models may have varying strengths and weaknesses in predicting glucose levels, and the choice of model should be carefully considered based on the specific requirements and context of the clinical application. The logistic regression model was more accurate for the next 15 minutes, especially predicting hypoglycemia. However, the LSTM model exceeded logistic regression for the next one hour prediction. Future research could explore hybrid models or ensemble approaches that combine the strengths of multiple models to further improve the accuracy and reliability of glucose predictions.

With the advancement of urbanization in China, effective control of pollutant emissions and air quality have become important goals in current environmental management. Nitrogen dioxide (NO2), as a precursor of tropospheric ozone and fine particulate matter, plays a significant role in atmospheric chemistry research and air pollution control. However, the uneven ground monitoring stations and low temporal resolution of polar-orbiting satellites set challenges for accurately assessing near-surface NO2. To address this issue, a spatiotemporal refined NO2 retrieval model was established for China using the geostationary satellite Himawari-8. The spatiotemporal characteristics of NO2 were analyzed and its contribution factors were explored. Firstly, seven Himawari-8 channels sensitive to NO2 were selected by using the forward feature selection based on information entropy. Subsequently, a 2DCNN-LSTM network model was constructed, incorporating the selected channels and meteorological variables as retrieval factors to estimate hourly NO2 in China from March 2018 to February 2020 (with a resolution of 0.05°, per hour). The performance evaluation demonstrated that the full-channel 2DCNN-LSTM model had good fitting capability and robustness (R2=0.74, RMSE=10.93), and further improvements were achieved after channel selection (R2=0.87, RMSE=6.84). The 10-fold cross-validation results indicated that the R2 between retrieval and measured values was above 0.85, the MAE was within 5.60, and the RMSE was within 7.90. R2 varied between 0.85 and 0.90, showing better validation at mid-day (R2=0.89) and in spring and fall transition seasons (R2 =0.88 and R2 =0.90). To investigate the cooperative effect of meteorological factors and other air pollutants on NO2, statistical methods (Beta coefficients) were used to test the factor interpretability. Meteorological factors as well as other pollutants were analyzed. From a statistical perspective, PM2.5, Boundary Layer Height, and O3 were found to have the largest impacts on near-surface NO2, with each standard deviation change in these factors leading to 0.28, 0.24, and 0.23 in standard deviations of near-surface NO2, respectively. Findings of the study contribute to a comprehensive understanding of the spatiotemporal distribution of NO2 and provide a scientific basis for formulating targeted air pollution policies.

The intrinsic non-linearity and complexity of suspended sediment dynamics, which are impacted by the geographical variability of basin parameters and temporal climatic patterns, make it difficult to estimate suspended sediment concentration (SSC) accurately in hydrological processes. Deep neural networks (DNNs), a cutting-edge modeling method that can capture the innate non-linearity in hydrological systems, have emerged as a solution to this problem. Using primary data on discharge, SSC, and turbidity, the long short-term memory method of DNNs was employed in this study to simulate the discharge-suspended sediment connection for the Esopus Creek, NY, USA as the first objective. To develop effective modeling strategies, multiple scenarios of feature selection, including combinations of discharge, turbidity and SSC for preceding days, were considered. Secondly, the variations in SSC and discharge between the three USGS gages along Esopus Creek that were upper stream, lower stream, and downstream, adjacent to the pourpoint were analyzed. Statistical metrics and scenarios of feature importance were used to evaluate the effectiveness of the DNN-based models. The study shows that among 24 DNN approaches feature selection is crucial in simulating the daily SSC, and discharge and presenting novel research directions for utilizing machine learning algorithms in water quality.

Activated sludge process is a well known method to treat municipal and industrial waste water. In this complex process, the oxygen concentration in the reactors plays a critical role in the plant efficiency. This paper proposes the use of a Long Short-Term Memory (LSTM) network to identify an input-output model suitable for the design of an oxygen concentration controller. The model is identified from easy-accessible measures collected from a real plant. This dataset covers almost a month. The performances achieved with the proposed LSTM model are compared with the ones obtained with a standard AutoRegressive model with eXogenous input (ARX). Both models catch the oscillation and the overall behaviour (ARX ρ=0.833 , LSTM ρ=0.921), but, while the ARX model fails in reaching the correct amplitude (FIT=41.20%), the LSTM presents satisfactory performance (FIT=60.56%).

Objective: The aim of this study was to provide a new machine learning method to determine temporal events and inner-cycle parameters (e.g., cycle, poles and skis contact and swing time) in cross-country roller ski skating on the field, using a single deported inertial measurement unit (IMU). Methods: The developed method is based on long short-term memory neural networks to detect poles and skis initial and final contact with the ground during the cyclic movements. Eleven athletes skied four laps of 2.5 km at low and high intensity using skis with two different rolling coefficients. They were equipped with IMUs attached to the upper back, lower back and to the sternum. Data from force insoles and force poles were used as reference system. Results: The IMU placed on the upper back provided the best results, as the LSTM network was able to determine the temporal events with an accuracy ranging from 49 to 55 ms and the corresponding inner-cycles parameters were calculated with a precision of 63 to 68 ms. The method detected 95% of the events for the poles and 87% of the events for the skis. Conclusion: The proposed LSTM method provides a promising tool for assessing temporal events and inner-cycle phases in roller ski skating showing the potential of using a deported IMU to estimate different spatio-temporal parameters of human locomotion.

The choice of holiday destinations is highly depended on climate considerations. Nowadays, since the effects of climate crisis are being increasingly felt, the need of accurate weather and climate services for hotels is crucial. Such a service could be beneficial for both the future planning of tourists’ activities and destinations and for hotel managers as it could help in decision making about the planning and expansion of the touristic season, due to a prediction of higher temperatures for a longer time span, thus causing increased revenue for companies in the local touristic sector. The aim of this work is to calculate predictions on climatic variables using statistical techniques as well as Artificial Intelligence (AI) for a specific area of interest utilising data from in situ meteorological station, and produce valuable and reliable localised predictions with the most cost-effective method possible. This investigation will answer the question of the most suitable prediction method for time series data from a single meteorological station that is deployed in a specific location. As a result, an accurate representation of the microclimate in a specific are is achieved. To achieve this high accuracy in situ measurements and prediction techniques are used. As prediction techniques, Seasonal Auto Regressive Integrated Moving Average (SARIMA), AI techniques like the Long-Short-Term-Memory (LSTM) Neural Network and hybrid combinations of the two are used. Variables of interest are divided in the easier to predict temperature and humidity that are more periodic and less chaotic, and the wind speed as an example of a more stochastic variable with no known seasonality and patterns. Our results show that the examined Hybrid methodology performs the best at temperature and wind speed forecasts, closely followed by the SARIMA whereas LSTM perform better overall at the humidity forecast, even after the correction of the Hybrid to the SARIMA model.

Dissolved Oxygen (DO) concentration is a vital parameter that indicates water quality. DO short term forecasting using time series analysis on data collected from an aquaculture pond is presented here. This can provide data support for an early warning system for an improved management of the aquaculture farm. The conventional forecasting approaches are commonly characterized by low accuracy and poor generalization problems. In this article, we present a novel hybrid DO concentration forecasting method with ensemble empirical mode decomposition (EEMD) based LSTM (Long short-term memory) neural network (NN). With this method, first, the sensor data integrity is improved through linear interpolation and moving average filtering methods of data preprocessing. Next, the EEMD algorithm is applied to decompose the original sensor data into multiple intrinsic mode functions (IMFs). Finally, the feature selection is used to carefully select IMFs that are strongly correlated with the original sensor data and integrate both into inputs for the NN. The hybrid EEMD-based LSTM forecasting model is then constructed. Performance of this proposed model in training and validation sets was compared with the observed real sensor data. To obtain the exact evaluation accuracy of the forecasted results of the hybrid EEMD-based LSTM forecasting model, three statistical performance indices were adopted: MAE, MSE, and RMSE. Results presented for short term (12-hour period) and long term (1-month period) give a strong indication of suitability of this method for forecasting DO values.

Geological storage of carbon dioxide (CO2) is a crucial technology for mitigating global temperature rise. Near-depleted edge-bottom water reservoirs are attractive targets for CO2 storage, as they can not only enhance oil recovery (EOR) but also provide important potential candidates for geological storage. This study investigated CO2 enhanced oil recovery and storage for a typical near-depleted edge-bottom water reservoir that had been developed for a long time with a recovery factor of 51.93%. To improve the oil recovery and CO2 storage, new production scenarios are explored. At the near-depleted stage, by comparing the four different scenarios of water injection, gas injection, water alternating gas injection, and bi-directional injection, the highest additional recovery of 8.64% is achieved by the bi-directional injection scenario. Increasing the injection pressure leads to a higher gas-oil ratio and liquid production rate. After shifting from the near-depleted to depleted stage, the most effective approach to improve CO2 storage capacity is to increase reservoir pressure. At 1.4 times the initial reservoir pressure, the maximum storage capacity is 6.52×108 m3. However, excessive pressures boosting poses potential storage and leakage risks. Therefore, lower injection rates and longer intermittent injections are expected to achieve a larger amount of long-term CO2 storage. Through the numerical simulation study, a gas injection rate of 80,000 m3/day and a schedule of 4-6 years injection with 1 year shut-in was shown to be effective for the case considered. During 31 years of CO2 injection, the percentage dissolved CO2 increased from 5.46% to 6.23% during the near-depleted period, and to 7.76% during the depleted period. This study acts as a guide for the CO2 geological storage of typical near-depleted edge-bottom water reservoirs.

Laser-targeted weeding methods further enhance the sustainable development of green agriculture, with one key technology being the improvement of weed localization accuracy. Here, we propose an improved YOLOv8 instance segmentation based on bidirectional feature fusion and deformable convolution (BFFDC-YOLOv8-seg) to address the challenges of insufficient weed localization accuracy in complex environments with resource-limited laser weeding devices. Initially, by training on extensive datasets of plant images, the most appropriate model scale and training weights are determined, facilitating the development of a lightweight network. Subsequently, the introduction of the Bidirectional Feature Pyramid Network (BiFPN) during feature fusion effectively prevents the omission of weeds. Lastly, the use of Dynamic Snake Convolution (DSConv) to replace some convolutional kernels enhances flexibility, benefiting the segmentation of weeds with elongated stems and irregular edges. Experimental results indicate that the BFFDC-YOLOv8-seg model achieves a 4.9% increase in precision, an 8.1% increase in recall rate, and a 2.8% increase in mAP50 value to 98.8% on a vegetable weed dataset compared to the original model. It also shows improved mAP50 over other typical segmentation models such as Mask R-CNN, YOLOv5-seg, and YOLOv7-seg by 10.8%, 13.4%, and 1.8%, respectively. Furthermore, the model achieves a detection speed of 24.8 FPS on the Jetson Orin nano standalone device, with a model size of 6.8MB that balances between size and accuracy. The model meets the requirements for real-time precise weed segmentation, suitable for complex vegetable field environments and resource-limited laser weeding devices.

We introduce and discuss a generalization of the classical multi-objective optimization to pairs of functions. This procedure is referred to as bi-multi-objective optimization. A justification of this general optimization procedure is presented, related both to multi-objective optimization under ambiguity concerning individual preferences and to Pareto optimality for a family of preferences with nontransitive indifference. Incidentally, the binary relation naturally associated to a bi-multi-objective optimization problem is represented by a finite bi-multi-utility, which generalizes to the nontransitive case the classical finite multi-utility representation. An important application is presented to Markowitz portfolio selection under ambiguity concerning both the vector of returns and the covariance matrix.

Shannon entropy quantifying bi-colored Ramsey complete graphs is introduced. Complete graphs in which vertices are connected with two types of links, labeled as α-links and β-links are considered. Shannon-entropy is introduced according to the classical Shannon formula considering the fractions of monochromatic convex α-colored polygons with n α-sides or edges, and the fraction of monochromatic β-colored convex polygons with m β-sides in the given complete graph. Introduced Shannon entropy is insensitive to the exact shape of the graph, but it is sensitive to the distribution of monochromatic polygons in a given graph. The introduced Shannon Entropies Sα and Sβ are interpreted as follows: Sα is interpreted as an average uncertainty to find the green α-polygon in the given graph, Sβ is, in turn, an average uncertainty to find the red β-polygon in the same graph. The re-shaping of the Ramsey theorem in terms of the Shannon Entropy is suggested. Various measures quantifying the Shannon Entropy of the entire complete bi-colored graphs are suggested. Physical interpretations of the suggested Shannon Entropies are discussed.

MT4-MMP (or MMP-17) belongs to the Membrane-Type Matrix Metalloproteinases (MT-MMPs), a distinct subset of the MMP family that is anchored to the cell surface by a glycosylphosphatidylinositol (GPI) motif. Its expression in a variety of cancers is well documented. However, the molecular mechanisms by which MT4-MMP contributes to tumor development need further investigation. In this review, we aim to summarize the contribution of MT4-MMP in tumorigenesis, focusing on the molecular mechanisms triggered by the enzyme in tumor cell migration, invasiveness, and proliferation, in the tumor vasculature and microenvironment, as well as during metastasis. In particular, we highlight the putative substrates processed and signaling cascades activated by MT4-MMP that may underlie these malignancy processes and compare this with what is known about its role during embryonic development. Finally, MT4-MMP is a relevant biomarker of malignancy that can be used for monitoring cancer diseases progression in patients as well as a potential target for future therapeutic drug development.

Although Cable driven rehabilitation devices (CDRD) have advantages over traditional link-driven devices, including lightweight, ease of reconfiguration, remote actuation, etc, the majority of existing lower-limb CDRD is limited to rehabilitation in the sagittal plane. In this work, we extend our previous sagittal plane model (2DOF) to accommodate hip motion in the frontal plane (abduction/adduction) toward studying the feasibility of tracking bi-planar motion (combined frontal and sagittal plane motion) via intra-planar cable routing. Two optimization problems have been formulated to estimate an optimal location of the hip cuffs, first to estimate the optimal cuff location at each time step to identify a single ‘averaged’ optimal cuff location and second to calculate a single optimal cuff location for the entire gait cycle. The optimization solutions identified for the 3DOF model revealed that optimization of the location of cuffs on the anterior and posterior side of the hip joint for 4 cable configuration is not sufficient to generate the desired bi-planar motion. For simultaneous tracking of the bi-planar motion, 2 additional cables have been added at hip joints and are routed in an intra-planar manner. The simulation result with the 3DOF model confirmed successful bi-planar trajectory tracking. The various number of cables and cable routings for tracking bi-planar motion will be studied in future work.