Restricted Boltzmann machines (RBMs) are the building blocks of some deep learning networks. However, despite their importance, it is our perception that some very important derivations about the RBM are missing in the literature, and a beginner may feel RBM very hard to understand. We provide here these missing derivations. We cover the classic Bernoulli-Bernoulli RBM and the Gaussian-Bernoulli RBM, but leave out the ``continuous'' RBM as it is believed not as mature as the former two. This tutorial can be used as a companion or complement to the famous RBM paper ``Training restricted Boltzmann machines: An introduction'' by Fisher and Igel.

While visual assessment is the standard technique for burn evaluation, computer-aided diagnosis is increasingly sought due to high number of incidences globally. Patients are increasingly facing challenges which are not limited to shortage of experienced clinicians, lack of accessibility to healthcare facilities, and high diagnostic cost. Certain number of studies were proposed in discriminating burn and healthy skin using machine learning leaving a huge and important gap unaddressed; whether burns and related skin injuries can be effectively discriminated using machine learning techniques. Therefore, we specifically use pre-trained deep learning models due to deficient dataset to train a new model from scratch. Experiments were extensively conducted using three state-of-the-art pre-trained deep learning models that includes ResNet50, ResNet101 and ResNet152 for image patterns extraction via two transfer learning strategies: fine-tuning approach where dense and classification layers were modified and trained with features extracted by base layers, and in the second approach support vector machine (SVM) was used to replace top-layers of the pre-trained models, trained using off-the-shelf features from the base layers. Our proposed approach records near perfect classification accuracy of approximately 99.9%.

In recent years, a range of problems under the broad umbrella of computer vision based analysis of ancient coins have been attracting an increasing amount of attention. Notwithstanding this research effort, the results achieved by the state of the art in published literature remain poor and far from sufficiently well performing for any practical purpose. In the present paper we present a series of contributions which we believe will benefit the interested community. We explain that the approach of visual matching of coins, universally adopted in existing published papers on the topic, is not of practical interest because the number of ancient coin types exceeds by far the number of those types which have been imaged, be it in digital form (e.g., online) or otherwise (traditional film, in print, etc.). Rather, we argue that the focus should be on understanding the semantic content of coins. Hence, we describe a novel approach—to first extract semantic concepts from real-world multimodal input and associate them with their corresponding coin images, and then to train a convolutional neural network to learn the appearance of these concepts. On a real-world data set, we demonstrate highly promising results, correctly identifying a range of visual elements on unseen coins with up to 84% accuracy.

Machine learning (ML) has emerged as a critical tool for making sense of the growing amount of genetic and genomic data available because of its ability to find complex patterns in high dimensional and heterogeneous data. While the complexity of ML models is what makes them powerful, it also makes them difficult to interpret. Fortunately, recent efforts to develop approaches that make the inner workings of ML models understandable to humans have improved our ability to make novel biological insights using ML. Here we discuss the importance of interpretable ML, different strategies for interpreting ML models, and examples of how these strategies have been applied. Finally, we identify challenges and promising future directions for interpretable ML in genetics and genomics.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

The increasing trend of studying the innate softness of robotic structures and amalgamating it with the benefits of the extensive developments in the field of embodied intelligence has led to sprouting of a relatively new yet extremely rewarding sphere of technology. The fusion of current deep reinforcement algorithms with physical advantages of a soft bio-inspired structure certainly directs us to a fruitful prospect of designing completely self-sufficient agents that are capable of learning from observations collected from their environment to achieve a task they have been assigned. For soft robotics structure possessing countless degrees of freedom, it is often not easy (something not even possible) to formulate mathematical constraints necessary for training a deep reinforcement learning (DRL) agent for the task in hand, hence, we resolve to imitation learning techniques due to ease of manually performing such tasks like manipulation that could be comfortably mimicked by our agent. Deploying current imitation learning algorithms on soft robotic systems have been observed to provide satisfactory results but there are still challenges in doing so. This review article thus posits an overview of various such algorithms along with instances of them being applied to real world scenarios and yielding state-of-the-art results followed by brief descriptions on various pristine branches of DRL research that may be centers of future research in this field of interest.

We examine the use of deep learning (neural networks) to predict the movement of the S&P 500 Index using past returns of all the stocks in the index. Our analysis finds that the future direction of the S&P 500 index can be weakly predicted by the prior movements of the underlying stocks in the index. Decomposition of the prediction error indicates that most of the lack of predictability comes from randomness and only a little from nonstationarity. We believe this is the first test of S&P500 market efficiency that uses a very large information set, and it extends the domain of weak-form market efficiency tests.

Since the launch of Protein Data Bank (PDB) in 1971, Cartesian coordinate system (CCS) has been the default approach to specify atomic positions in biomolecular experimental structures with X, Y and Z. In 2020, a local spherical coordinate system (LSCS) approach was proposed as an alternative to CCS, i.e., ρ, θ and φ. Recently, the continued application of deep learning technology in protein structure prediction (PSP) saw a leap forward in the accuracy of PSP, as evidenced by AlphaFold of Google’s DeepMind. However, there still is room for the improvement of the performances of PSP algorithms to date. Given that geometrically, CCS and LSCS are like the two sides of a coin, this short article puts forward a hypothesis that the time is now ripe to end the half-a-century burial of ρ, θ and φ in PDB, and use them as LSCS features for the design of novel PSP algorithms in future.

Abstract: Introduction: Total knee arthroplasty (TKA) is a common orthopedic procedure driven by factors such as an aging population, rising obesity rates, and surgical advancements. Despite improved venous thromboembolism (VTE) prophylaxis, eradication remains challenging, necessitating personalized prevention strategies. This study aims to identify predictors of VTE following TKA. Methods: A retrospective analysis of the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) database (2016-2021) included 367,365 patients who underwent TKA (CPT code 27447). Univariate and multivariate analyses assessed preoperative factors associated with deep vein thrombosis (DVT) and pulmonary embolism (PE). Results: Significant associations were found between demographic and clinical variables and VTE prevalence. Notable predictors of DVT included female sex (OR=1.2, p=0.001), younger age (OR=1.2, p=0.001), Hispanic ethnicity (OR=1.2, p=0.026), and chronic obstructive pulmonary disease (COPD) (OR=1.4, p=0.001). Independent functional status was a strong predictor of both DVT (OR=5.0, p=0.001) and PE (OR=0.53, p=0.033). Smoking (OR=0.7, p=0.001), COPD (OR=1.4, p=0.005), congestive heart failure (OR=2.1, p=0.001), and malignancy (OR=2.9, p=0.009) were significant predictors of PE. Conclusion: The study underscores the impact of demographic factors (gender, age, race) and comorbidities (COPD, CHF, malignancy) on VTE risk post-TKA. Preoperative mobilization status emerged as a critical indicator of thromboembolic risk. Unexpected findings regarding smoking and PE require further investigation. Overall, the study contributes to optimizing VTE prevention in TKA patients through tailored risk assessment and intervention strategies.

This article presents an automated vision-based algorithm for the die-scale inspection of wafer images captured using scanning acoustic tomography (SAT). This algorithm can find defective and abnormal die-scale patterns, and produce a wafer map to visualize the distribution of defects and anomalies on the wafer. The main procedures include standard template extraction, die detection through template matching, pattern candidate prediction through clustering, and pattern classification through deep learning. To conduct the template matching, we first introduce a two-step method to obtain a standard template from the original SAT image. Subsequently, a majority of the die patterns are detected through template matching. Thereafter, the columns and rows arranged from the detected dies are predicted using a clustering method; thus, an initial wafer map is produced. This map is composed of detected die patterns and predicted pattern candidates. In the final phase of the proposed algorithm, we implement a deep learning-based model to determine defective and abnormal patterns in the wafer map. The experimental results verified the effectiveness and efficiency of our proposed algorithm. In conclusion, the proposed method performs well in identifying defective and abnormal die patterns, and produces a wafer map that presents important information for solving wafer fabrication issues.

An adaptive deep neural network is used in an inverse system identification setting to approximate the inverse of a nonlinear plant with the aim of constituting the plant controller by copying to the latter the weights and architecture of the converging deep neural network. This deep learning (DL) approach to the adaptive inverse control (AIC) problem is shown to outperform adaptive filtering techniques and algorithms normally used in adaptive control, especially when the plant is nonlinear. The deeper the controller the better the inverse function approximation, provided that the nonlinear plant have an inverse and that this inverse can be approximated. Simulation results prove the feasibility of this DL-based adaptive inverse control scheme. The DL-based AIC system is robust to parameter change of the nonlinear plant in that, under such change, the plant output reassumes the value of the reference signal considerably faster than with the adaptive filter counterpart of the deep neural network. Settling times and rise times of the step response are shown to improve in the DL-based AIC system.

The boosted interest in the use of rare earth elements (REEs) in modern technologies had also increase the necessity of their recovery from various sources, including raw materials and wastes. Though Hydrometallurgy plays a key role in these recovery processes, some drawbacks (apparent or not) of these processes, had led to the development of a more environmental friendship subclass named Solvometallurgy, in which non-aqueous solvents substituted to the aqueous media of the hydrometallurgical processing. The non-aqueous solvents chosen for these usages are, besides ionic liquids (ILs), the so-named Deep Eutectic Solvents (DEEs). The utilization of DEEs included the leaching of REEs from the different sources containing them, and also in the separation-purification steps necessary for the yielding of these elements, normally as oxides or salts, in the most purified form. This work reviewed the most recent literature (2023 year) about the utilization of deep eutectic solvents in the recovery of REEs from various sources, and in the coupling of these two (DESs and REEs) to derived compounds to be used in other fields.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

In this study, by using Least Square Method, the dataset for the Gross Domestic Product per capita is modeled as a function satisfying the fractional differential equation. The function itself is assumed to be the finite summation of its previous values and the derivatives with unknown coefficients. Then, the prediction for the upcoming years is done by having an approach dividing the dataset into 4 regions corresponding to four different tasks. The mathematical model of the Gross Domestic Product (GDP) per capita of the countries (and union) which are Brazil, China, European Union (EU), India, Italy, Japan, UK, the USA, Spain, and Turkey is constructed with a new methodology called as the deep assessment method which comes from the expressing an arbitrary function modeling the dataset as the finite summation of its previous values and the derivatives with unknown coefficient. The method uses the fractional calculus properties combining with Least Square Method and is compared to Long short-term memory (LSTM) algorithm which is a special type of neural network used for time sequences in general.

Reinforcement Learning (RL) has demonstrated considerable potential in solving challenges across various domains, notably in autonomous driving. Nevertheless, implementing RL in autonomous driving comes with its own set of difficulties, such as the overestimation phenomenon, extensive learning time, and sparse reward problems. Although solutions like Hindsight Experience Replay (HER) have been proposed to alleviate these issues, the direct utilization of RL in autonomous vehicles remains constrained due to the intricate fusion of information and the possibility of system failures during the learning process. In this paper, we present a novel RL-based autonomous driving system technology that combines Obstacle Dependent Gaussian (ODG) RL, Soft Actor-Critic (SAC), and meta-learning algorithms. Our approach addresses key issues in RL, including the overestimation phenomenon and sparse reward problems, by incorporating prior knowledge derived from the ODG algorithm. We evaluated our proposed algorithm on official F1 circuits, using high-fidelity racing simulations with complex dynamics. The results demonstrate exceptional performance, with our method achieving up to 89% faster learning speed compared to existing algorithms in these environments.

Remote sensing (RS) technology has significantly contributed to geological exploration and mineral resource assessment. However, its effective application in vegetated areas encounters various challenges. This paper aims to provide a comprehensive overview of the challenges and opportunities associated with RS-based lithological identification in vegetated regions. The article begins by introducing the sources and processing methods of RS data, which serve as the foundation for subsequent analysis. Moreover, it highlights the techniques and methodologies employed for lithological classification in vegetated areas. Notably, hyperspectral RS and Synthetic Aperture Radar (SAR) have emerged as prominent tools in lithological identification. In addition, this paper addresses the limitations inherent in RS technology, including issues related to vegetation cover and terrain effects, which significantly impact accurate lithological mapping. To propel further advancements in the field, the paper proposes promising avenues for future research and development. These include the integration of multi-source data to enhance classification accuracy and the exploration of novel RS technologies and algorithms. In summary, this paper presents valuable insights and recommendations for advancing the study of RS-based lithological identification in vegetated areas.

Blood cell analysis is a crucial diagnostic process in medical practice. In particular, detecting white blood cells (WBCs) is essential for diagnosing of many diseases. The manual screening of blood films is a time-consuming and subjective process, which can lead to inconsistencies and errors. Therefore, automated detection of blood cells can improve the accuracy and efficiency of the screening process. In this study, an explainable Vision Transformer (ViT) model was proposed for the automatic detection of WBCs from blood films. The proposed model utilizes the self-attention mechanism to extract relevant features from the input images and leverages transfer learning by incorporating pre-trained model weights to improve its performance. The proposed model achieved a classification accuracy of 99.40% for five distinct types of WBCs and exhibited potential in reducing the time required for manual screening of blood films by pathologists. Upon examination of the misclassified test samples, it was observed that incorrect predictions were correlated with the presence or absence of granules in the cell samples. To validate this observation, the dataset was divided into two classes, namely Granulocytes and Agranulocytes, and a secondary training process was conducted. The resulting ViT model trained for binary classification achieved an accuracy of 99.70%, recall of 99.54%, precision of 99.32%, and F-1 score of 99.43% during the test phase. To ensure the reliability of the ViT model's multi-class classification of WBCs, the pixel areas that the model focuses on in its predictions are visualized through the Score-CAM algorithm.

Numerous goods and services are now offered through online platforms due to the recent growth of online transactions like e-commerce. Users have trouble locating the product that best suits them from the numerous products available in online shopping. Many studies in deep learning-based recommender systems (RSs) have focused on the intricate relationships between the attributes of users and items. Deep learning techniques have used consumer or item-related traits to improve the quality of personalized recommender systems in many areas, such as tourism, news, and e-commerce. Various companies, primarily e-commerce, utilize sentiment analysis to enhance product quality and effectively navigate today's business environment. Customer feedback regarding a product is gathered through sentiment analysis, which uses contextual data to split it into separate polarities. The explosive rise of the e-commerce industry has resulted in a large body of literature on e-commerce from different perspectives. Researchers have made an effort to categorize the recommended future possibilities for e-commerce study as the field has grown. There are several challenges in e-commerce, such as fake reviews, frequency of user reviews, advertisement click fraud, and code-mixing. In this review, we introduce an overview of the preliminary design for e-commerce. Second, the concept of deep learning, e-commerce, and sentiment analysis are discussed. Third, we represent different versions of the commercial dataset. Finally, we explain various difficulties facing RS and future research directions.

Skin cancer is an exquisite disease globally nowadays. Because of the poor contrast and apparent resemblance between skin and lesions, automatic identification of skin cancer is complicated. The rate of human death can be massively reduced if melanoma skin cancer can be detected quickly using dermoscopy images. In this research, an anisotropic diffusion filtering method is used on dermoscopy images to remove multiplicative speckle noise and the fast-bounding box (FBB) method is applied to segment the skin cancer region. Furthermore, the paper consists of two feature extractor parts. One of the two features extractor parts is the hybrid feature extractor (HFE) part and another is the convolutional neural network VGG19 based CNN feature extractor part. The HFE portion combines three feature extraction approaches into a single fused feature vector: Histogram-Oriented Gradient (HOG), Local Binary Pattern (LBP), and Speed Up Robust Feature (SURF). The CNN method also is used to extract additional features from test and training datasets. This two-feature vector is fused to design the classification model. This classifier performs the classification of dermoscopy images whether it is melanoma or non-melanoma skin cancer. The proposed methodology is performed on two ordinary datasets and achieved the accuracy 99.85%, sensitivity 91.65%, and specificity 95.70%, which makes it more successful than previous machine learning algorithms.

With the evolution of computing technology in many application like human robot interaction, human computer interaction and health-care system, 3D human body models and their dynamic motions has gained popularity. Human performance accompanies human body shapes and their relative motions. Research on human activity recognition is structured around how the complex movement of a human body is identified and analyzed. Vision based action recognition from video is such kind of tasks where actions are inferred by observing the complete set of action sequence performed by human. Many techniques have been revised over the recent decades in order to develop a robust as well as effective framework for action recognition. In this survey, we summarize recent advances in human action recognition, namely the machine learning approach, deep learning approach and evaluation of these approaches.

Current stock market forecasting methods encompass fundamental, technical, emotional, and bargaining factors. Predominantly, price prediction hinges on order volume and price, although correlating these two within existing models proves challenging. This study employs Cycle Generative Adversarial Network (Cycle GAN) to unravel the intricate price-volume relationship, combining it with Bollinger Bands for trading signal analysis, overcoming hurdles in short-term forecasting prevalent in numerical analysis and AI. Focusing on TSMC (2330.TW) stock price, the research leverages Cycle GAN in deep learning to master the price-volume nexus, juxtaposed with LSTM and RNN. Historical TSMC closing prices and transaction counts are model inputs, scrutinizing their interconnectedness for predictions. This innovative approach aligns stock price, volume, market value, taxes, and prior changes via system engineering. By intertwining Bollinger Bands with stock price forecasts, trading signals are distilled, factoring in extended index %b for a comprehensive market picture.

Background: Periprosthetic joint infection (PJI) following total hip and knee arthroplasty remains an extremely challenging and relatively high complication. This study aims to develop, validate and evaluate the use of machine learning (ML) algorithm to predict PJI in patients undergoing revision arthroplasties. Methods: A comprehensive review of patients undergoing hip or knee revision arthroplasty from 1 January 2015 to 31 March 2021 was conducted. Clinical data coming from preoperative patients history, laboratory analysis and demographic characteristics of patients were screened. Final data have been used to train a Logistic Regression model with the aim of predicting PJI preoperatively. Results: 1360 patients were enrolled, 1141 in the aseptic cohort and 219 in the infected cohort were included. ML demonstrated good discriminatory performance in predicting PJI in the selected patients (area under the curve 0.770 ± 0.006 in the training set and 0.720 ± 0.057 in the test set), and identified 3 significant predictors of PJI. Conclusion: ML algorithm trained using preoperative clinical data accurately predicted PJI. The incorporation of ML models into preoperative assessment of patients undergoing prosthetic revision procedures are useful in providing specific risk assessment to aid individualised counselling, shared decision making and presurgical optimization.

A real-time monitoring system for the operational status of fishing vessels is an essential element for the modernization of the fishing industry. The operational status of fishing vessels can be identified by using onboard cameras to detect the deck crew and the use of fishing nets. Due to the typically limited processing capacity of shipboard equipment and the significant memory consumption of detection models, however, general target detection models are unable to perform real-time image detection to identify the operational status of fishing vessels. In this paper, we propose a lightweight real-time deck crew and the use of fishing nets detection method, YOLOv5s-SGC. It is based on the YOLOv5s model, which uses surveillance cameras to obtain video of fishing vessels operating at sea and enhances the dataset. YOLOv5s-SGC replaces YOLOv5s’s backbone and the ordinary convolutional blocks in the feature fusion network with ShufflNetV2 and Ghost module.

The advent of AI in medicine has transformed various medical specialties, including orthodontics. AI has shown promising results in enhancing the accuracy of diagnoses, treatment planning, and predicting treatment outcomes. With the growing number of AI applications and commercially available tools, there is an increase in their usage in orthodontic practices worldwide. This review aims to explore the principles of artificial intelligence (AI), its applications in the diagnostic process of modern orthodontic practices, and concerns associated with the implementation of AI algorithms in clinical practice. A comprehensive review of the literature was conducted, focusing on five categories where AI has been applied in orthodontics: dental diagnostics, cephalometric evaluation, skeletal age determination, temporomandibular joint (TMJ) evaluation, and extraction decision making. AI has demonstrated high efficacy in all those fields. However, variations in performance and the necessity of manual supervision indicate that AI should be used cautiously in clinical settings. Nevertheless, the high complexity and potential unpredictability of AI algorithms call for cautious implementation and regular manual validation of results. Continuous AI learning, proper governance, and addressing privacy and ethical concerns are crucial for the successful integration of AI into orthodontic practice.

Deep learning techniques, such as convolutional neural networks (CNN), generative adversarial networks (GAN), and graph neural networks (GNN), have over the past decade changed the ac-curacy of prediction in many diverse fields. In recent years, the application of deep learning tech-niques in computer vision tasks in pathology demonstrated extraordinary potential in assisting clinicians, automating diagnosis, and reducing costs for patients. Formerly unknown pathologi-cal evidence, such as morphological features related to specific biomarkers, copy number varia-tions, and other molecular features, were also able to be captured by deep learning models. In this paper, we review popular deep learning methods and some recent publications about their appli-cations in pathology.

The peculiar physicochemical features of deep eutectic solvents (DESs), in particular their tunability, make them ideal media for various applications. Despite their ability to solubilize metal oxides, their use as rust removers from valuable substrates has not yet been thoroughly investigated. In this study we chosen three known DESs, consisting of choline chloride and acetic, oxalic or citric acid for evaluating their ability to remove corrosion products from a cellulose-based material as linen fabric and two different lithotypes, as travertine and granite. The artificial staining was achieved by placing a rusty iron grid on their surfaces. The DESs were applied by means of cellulose poultice on the linen fabrics, while on the rusted stone surfaces with a cotton swab. Macro- and microscopic observations, colorimetry and SEM/EDS analysis were employed to ascertain the cleaning effectiveness and the absence of side effects on the samples after treatment. Oxalic acid-based DES was capable of removing rust stains from both stone and cellulose-based samples, while choline chloride/citric acid DES was effective only on stone specimens. The results suggest a new practical application of DESs for the elimination of rust from lithic and cellulosic substrates of precious and artistic value.

For autonomous driving, perception is a primary and essential element that fundamentally deals with the insight into the ego vehicle’s environment through sensors. Perception is a challenging task suffering from dynamic objects and continuous environmental changes. The issue gets worse due to interrupting the quality of perception by adverse weather like snow, rain, fog, night light, sand storm, strong daylight, etc. In this work, we have tried to improve camera-based perception accuracy, such as autonomous driving-related object detection in adverse weather. We proposed the improvement of YOLOv8-based object detection in adverse weather through transfer learning using merged data from various harsh weather datasets. Two prosperous open-source datasets (ACDC and DAWN) and their merged dataset were used to detect primary objects on the road in harsh weather. A set of training weights were collected from training on the individual datasets, their merged version, and several subsets of those datasets according to their characteristics. A comparison between the training weights also occurred by evaluating the detection performance on the above-mentioned datasets and their subsets. The evaluation revealed that using custom datasets for training significantly improves the detection performance compared to the YOLOv8 base weights. And using more images through the feature-related data merging technique steadily increases the object detection performance.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

Early diagnosis, prioritization, screening, clustering and tracking of COVID-19 patients, and production of drugs and vaccines are some of the applications that have made it necessary to use a new style of technology to involve, to manage and deal with this epidemic. Strategies backed by artificial intelligence (AI) and the Internet of Things (IoT) have been undeniable to understand how the virus works and try to prevent it from spreading. Accordingly, the main aim of this survey article is to highlight the methods of ML, IoT and the integration of IoT and ML-based techniques in the applications related to COVID-19 from the diagnosis of the disease to the prediction of its outbreak. According to the main findings, IoT provided a prompt and efficient approach of following the disease spread. Most of the studies developed by ML-based techniques for handling COVID-19 based dataset provided performance criteria. The most popular performance criteria, is related to accuracy factor. It can be employed for comparing the ML-based methods with different datasets. According to the results, CNN with SVM classifier, Genetic CNN and pre-trained CNN followed by ResNet, provided highest accuracy values. On the other hand, the lowest accuracy was related to single CNN followed by XGboost and KNN methods.

Studies have shown that STK11 mutation plays a critical role in affecting the lung adenocarcinoma (LUAD) tumor immune environment. By training an Inception-Resnet-v2 deep convolutional neural network model, we were able to classify STK11-mutated and wild type LUAD tumor histopathology images with a promising accuracy (per slide AUROC=0.795). Dimensional reduction of the activation maps before the output layer of the test set images revealed that fewer immune cells were accumulated around cancer cells in STK11-mutation cases. Our study demonstrated that deep convolutional network model can automatically identify STK11 mutations based on histopathology slides and confirmed that the immune cell density was the main feature used by the model to distinguish STK11-mutated cases.

Drought decreases grain yield of sorghum [Sorghum bicolor (L.) Moench], and understanding the mechanism(s) related to drought tolerance is critical for sustaining sorghum production. Variation in root and shoot traits associated with drought tolerance were analyzed to provide an integrated view of factors that underlie the drought tolerance of sorghum. The plants were grown in the root column up to the five-leaf stage, then exposed to either 0.9 fraction of transpirable soil water (FTSW) or 0.4 FTSW for five days. In another experiment, at the five-leaf stage, stress was imposed for 14 days. Various root and shoot traits associated with drought tolerance were recorded. The seminal root angle of IS13540 was lower (24.4) than IS23143 (42.6). Drought stress increased the maximum root length (40%) and total root length (58%) of IS13540 than its irrigated control. In contrast, the maximum root length and total root length were decreased in IS23143. Similarly, across the lines, drought stress decreased stomatal conductance (37%), transpiration rate (42%), photosynthetic rate (40%), photosystem II quantum yield (20%), photochemical quenching (44%), and total dry matter production (34%) than irrigated control. An increased transpiration rate was observed in IS23143 than IS13540 under irrigated and drought stress. In IS23143, the reduction in photosynthetic rate under drought may be a combination of stomatal and non-stomatal factors. However, in IS13540, the reduction is especially by the stomatal factors. It is evident that IS13540 is a drought-tolerant line, and tolerance is related to a deep prolific root system and reduced tran-spiration rate.

Robotics and autonomous technologies enable space travel. Robotics change space colonization. We study space-based robotics. Human-centric missions need robotics. Vision, decision-making, movement, and manipulation follow. These developments influence resource utilization, extravehicular activities, planetary surface exploration, long-duration space missions, and colonization. Robots improve research, productivity, and astronaut safety but present problems. Highlighting research and knowledge gaps. Space ethics, human-robot interaction, and failure recovery are gaps. This extensive study showed how robots and autonomous systems may transform space exploration and colonization. Researchers, engineers, and mission planners may benefit. Robotics and autonomy will improve space exploration.

: Cybersecurity has become a critical area in the digital field in recent years. The expansion of networks has revolutionised the way network structures are organised and managed. However, with increased connectivity and the growing complexity of modern networks, the threat of cyber-attacks has become more intense. As technology continues to advance, it brings both opportunities and challenges. One of the major challenges is the need to secure networks and sensitive data from various malicious activities. Traditional networks have evolved to include Software Defined Network (SDN), which offers a more flexible and programmable framework. Researchers should focus on detecting attacks in SDN because SDN networks are becoming more popular and attractive targets for clients due to their programmability and dynamic nature. The centralised controller, known as the backbone of an SDN, becomes a single point of failure and a potential target for attackers if not properly secured. Researchers need to emphasise the detection of attacks in SDN in order to mitigate these risks. By understanding the potential vulnerabilities and attack methods specific to SDN, researchers can develop effective detection approaches and propose countermeasures. This methodology helps protect the network from potential threats and minimises the impact of successful attacks. Therefore, this survey paper provides a review of Intrusion Detection Systems (IDSs) in Software-Defined Networks (SDN) to provide a thorough understanding of SDN security issues.

Owing to the reduction of rupture instability and the avoidance of wrinkle defect, hydrodynamic deep drawing (HDD) process is gradually becoming attractive for fabricating lightweight and complicated products. Meanwhile, since metallic material presents anisotropic deformation behavior, it is necessary to select an appropriate constitutive model for the prediction of plastic deformation behavior of applied material with high precision. In the present research, several anisotropic yield criteria namely, Hill’48, Yld2000-2d and BBC2005 are implemented to investigate the effect of yield functions on the prediction accuracy of the critical process window and deformation behavior for HDD process of 2024 and 5754 aluminum alloys. Material constants in the yield criteria are determined by applying uniaxial and equi-biaxial tension tests and optimizing an error-function by using the Levenberg-Marquardt algorithm. Furthermore, the process window diagram is computed utilizing the stress analytical model combined material properties with workpiece geometrical features. Numerical simulation results of predicted material anisotropic parameters, process window and HDD deformation for aluminum alloys are compared with the experimental data. Through the comparison of diverse yield criteria based on materials anisotropic coefficients, critical process window prediction, earing profile, and thickness distribution, it is revealed that the Yld2000-2d and the BBC2005 yield criteria can offer more precise models of material behavior in planar anisotropy properties for HDD process of 2024 and 5754 aluminum alloys.

While the foundations of climate science and ethics are well established, fine-grained climate predictions, as well as policy-decisions, are beset with uncertainties. This chapter maps climate uncertainties and classifies them as to their ground, extent and location. A typology of uncertainty is presented, centered along the axes of scientific and moral uncertainty. This typology is illustrated with paradigmatic examples of uncertainty in climate science, climate ethics and climate economics. Subsequently, the chapter discusses the IPCC’s preferred way of representing uncertainties and evaluates its strengths and weaknesses from a risk management perspective. Three general strategies for decision-makers to cope with climate uncertainty are outlined, the usefulness of which largely depends on whether or not decision-makers find themselves in a context of deep uncertainty. The chapter concludes by offering two recommendations to ease the work of policymakers, faced with the various uncertainties engrained in climate discourse.

The rapid development of Deep Learning brought novel methodologies for 3D Object Detection using LiDAR sensing technology. These improvements in precision and inference speed performances lead to notable high performance and real-time inference, which is especially important for self-driving purposes. However, the developments carried by these approaches overwhelm the research process in this area since new methods, new technologies, and software versions lead to different project necessities, specifications and requirements. Moreover, the improvements brought by the new methods may be due to improvements in newer versions of deep learning frameworks and not just the novelty and innovation of the model architecture. Thus, it became crucial to create a framework with the same software versions, specifications and requirements that accommodate all these methodologies and allow the easy introduction of new methods and models. A framework is proposed that abstracts the implementation, reusing and building of novel methods and models. The main idea is to facilitate the representation of state-of-the-art (SoA) approaches and simultaneously encourage the implementation of new approaches by reusing, improving and innovating modules in the proposed framework, which has the same software specifications to allow a fair comparison. This makes it possible to determine if the key innovation approach outperforms the current SoA by comparing models in a framework with the same software specifications and requirements.

Alzheimer's is a disease for which there is no cure. Diagnosing Alzheimer's Disease (AD) early facilitates family planning and cost control. The purpose of this study is to predict the presence of AD using socio-demographic, clinical, and Magnetic Resonance Imaging (MRI) data. Early detection of AD enables family planning and may reduce costs by delaying long-term care. Accurate, non-imagery methods also reduce patient costs. The Open Access Series of Imaging Studies (OASIS-1) cross-sectional MRI data were analyzed. A gradient boosted machine (GBM) predicted the presence of AD as a function of gender, age, education, socioeconomic status (SES), and Mini-Mental State Exam (MMSE). A Residual Network with 50 layers (ResNet-50) predicted CDR presence and severity from MRI's (multi-class classification). The GBM achieved a mean 91.3% prediction accuracy (10-fold stratified cross validation) for dichotomous CDR using socio-demographic and MMSE variables. MMSE was the most important feature. ResNet-50 using image generation techniques based on an 80% training set resulted in 98.99% three class prediction accuracy on 4,139 images (20% validation set) at Epoch 133 and nearly perfect multi-class predication accuracy on the training set (99.34%). Machine Learning methods classify AD with high accuracy. GBM models may help provide initial detection based on non-imagery analysis, while ResNet-50 network models might help identify AD patients automatically prior to provider review.

Keywords: Deep mining; Drill bit structural parameters; Fidelity coring; Abaqus simulation and analysis.

In recent years, different deep learning frameworks were introduced for hyperspectral image (HSI) classification. However, the proposed network models have a higher model complexity and do not provide high classification accuracy if few-shot learning is used. This paper pre-sents an HSI classification method that combines random patches network (RPNet) and re-cursive filtering (RF) to obtain informative deep features. The proposed method first convolves image bands with random patches to extract multi-level deep RPNet features. Thereafter, the RPNet feature set is subjected to dimension reduction through principal component analysis (PCA) and the extracted components are filtered using the RF procedure. Finally, HSI spectral features and the obtained RPNet-RF features are combined to classify the HSI using a support vector machine (SVM) classifier. In order to test the performance of the proposed RPNet-RF method, some experiments were performed on three widely known datasets using a few training samples for each class and classification results were compared with those obtained by other advanced HSI classification methods adopted for small training samples. The comparison showed that the RPNet-RF classification is characterized by higher values of such evaluation metrics as overall accuracy and Kappa coefficient (https://github.com/UchaevD/RPNet-RF).

Cardiovascular disease (CVD) may sometimes unexpected loss of life. It affects the heart and blood vessels of body. CVD plays an important factor of life since it may cause death of human. It is necessary to detect early of this disease for securing patients life. In this chpter two exclusively different methods are proposed for detection of heart disease. The first one is Pattern Recognition Approach with grammatical concept and the second one is machine learning approach. In the syntactic pattern recognition approach initially ECG wave from different leads is decomposed into pattern primitive based on diagnostic criteria. These primitives are then used as terminals of the proposed grammar. Pattern primitives are then input to the grammar. The parsing table is created in a tabular form. It finally indicates the patient with any disease or normal. Here five diseases beside normal are considered. Different Machine Learning (ML) approaches may be used for detecting patients with CVD and assisting health care systems also. These are useful for learning and utilizing the patterns discovered from large databases. It applies to a set of information in order to recognize underlying relationship patterns from the information set. It is basically a learning stage. Unknown incoming set of patterns can be tested using these methods. Due to its self-adaptive structure Deep Learning (DL) can process information with minimal processing time. DL exemplifies the use of neural network. A predictive model follows DL techniques for analyzing and assessing patients with heart disease. A hybrid approach based on Convolutional Layer and Gated-Recurrent Unit (GRU) are used in the paper for diagnosing the heart disease.

The analysis of microscopy images has always been an important yet time consuming process in in materials science. Convolutional Neural Networks (CNNs) have been very successfully used for a number of tasks, such as image segmentation. However, training a CNN requires a large amount of hand annotated data, which can be a problem for material science data. We present a procedure to generate synthetic data based on ad-hoc parametric data modelling for enhancing generalization of trained neural network models. Especially for situations where it is not possible to gather a lot of data, such an approach is beneficial and may enable to train a neural network reasonably. Furthermore, we show that targeted data generation by adaptively sampling the parameter space of the generative models gives superior results compared to generating random data points.

Appropriate vaccine selection is crucial in the control of foot-and-mouth disease (FMD). Vaccination can prevent clinical disease and reduces viral shedding, but there is a lack of cross-protection between the seven serotypes and their sublineages, making the selection of an adequately protective vaccine difficult. Since the exact composition of their vaccines is not consistently disclosed by all manufacturers, incompatibility of the strains used for vaccination with regionally circulating strains can cause vaccination campaigns to fail. Here, we present a deep sequencing approach for polyvalent inactivated FMD vaccines that can identify all component strains by their genome sequences. The genomes of all strains of a commercial pentavalent FMD vaccine were de-novo assembled and the vaccine composition determined semi-quantitatively. The genome assembly required high stringency parameters to prevent misassemblies caused by conserved regions of the genome shared by related strains. In contrast, reference-guided assembly is only recommended in cases where the number of strains is previously known and appropriate reference sequences are available. The presented approach can be applied not only to any inactivated whole-virus FMD vaccine, but also to vaccine quality testing in general and allows for better decision-making for vaccines with unknown composition.

Preliminaries Convolutional Neural Network (CNN) applications have recently emerged in Structural Health Monitoring (SHM) systems focusing mostly on vibration analysis. However, the SHM literature shows clearly that there is a lack of application regarding the combination of PZT (Lead Zirconate Titanate) based method and CNN. Likewise, applications using CNN along with the Electromechanical Impedance (EMI) technique applied to SHM systems are rare. To encourage this combination, an innovative SHM solution through the combination of the EMI-PZT and CNN is presented here. To accomplish this, the EMI signature is split into several parts followed by computing the Euclidean distances among them to form a RGB (red, green and blue) frame. As a result, we introduce a dataset formed from the EMI-PZT signals of 720 frames, encompassing a total of 4 types of structural conditions for each PZT. In a case study, the CNN-based method was experimentally evaluated using three PZTs glued onto an aluminum plate. The results reveal an effective pattern classification; yielding a 100% hit rate which outperforms other SHM approaches. Furthermore, the method needs only a small dataset for training the CNN, providing several advantages for industrial applications.

Medical image analysis is an important branch in the field of medicine, which mainly uses image processing and analysis techniques to interpret and diagnose medical image data. Medical image data helps doctors to effectively observe and diagnose patients' body structures, tissues and lesions. Medical image analysis has been an important research area in the medical field, and it is important for disease diagnosis, treatment planning, and condition monitoring. In recent years, the rapid development of deep learning and computer vision technologies has contributed greatly to the automation, multimodal data fusion, real-time application, and accuracy improvement of medical image analysis. In addition, the development of deep learning has given rise to some new research areas in medical image analysis, such as Generative Adversarial Networks (GANs) for synthetic medical images, self-supervised learning for unsupervised feature learning, and neural network interpretability. In this paper, we will introduce some optimisation methods for medical images which are effective in improving the accuracy, efficiency and reliability of medical image analysis.

Raman-based Distributed Temperature Sensing (DTS) is a valuable tool for field testing and validating heat transfer models in Borehole Heat Exchanger (BHE) and Ground Source Heat Pump (GSHP) applications. However, temperature uncertainty is rarely reported in the literature. In this paper, a new calibration method is proposed for single-ended DTS configurations, along with a method to remove fictitious temperature drifts due to ambient air variations. The methods are implemented for a Distributed Thermal Response Test case study in an 800 m deep coaxial BHE. The results show that the calibration method and temperature drift correction are robust and give adequate results, with a temperature uncertainty of ± 0.58, 0.74, 1.1 and 1.7 K found at depths of 200, 300, 500 and 800 m, respectively. The temperature uncertainty increases non-linearly with depth and is dominated by the uncertainty in the calibrated parameters for depths larger than 200 m. The paper also offers insights into thermal features observed during the DTRT, including a heat flux inversion along the borehole depth and the slow temperature homogenization under circulation. Distributed temperature measurements and their uncertainties are useful tools in determining the strengths and drawbacks of ground heat transfer models.

Raman spectroscopy (RS) turns out to be a promising tool for cancer di- agnosis. In particular, in the last years several studies have demonstrated how the diagnostic performances of Raman Spectroscopy can be significantly improved by employing Machine Learning (ML) algorithms for the interpre- tation of Raman-based data. In line with these findings, in this paper, we demonstrated how RS coupled with ML allowed to accurately distinguish the three grades of Chondrosarcoma and to distinguish Chondrosarcoma and a benign counterpart called Enchondroma. We obtained such results by ana- lyzing a dataset composed of a relatively small number of Raman spectra, collected in a previous study. Such spectra were acquired from micromet- ric tissue sections with a Confocal Raman Microscope. In particular, we tested the classification performances of a Support Vector Machine and a Random Forest Classifier, as representative of Machine Learning, and two versions of the Multi-Layer Perceptron, as representative of Deep Learning (DL). These models showed excellent classification performances, especially those belonging to DL, with accuracy reaching 99.7%. This outcome makes the aforementioned models a promising route for future improvements of di- agnostic devices focused on detecting bone cancerous tissues. In addition, we highlighted how the ML models studied resulted in slightly worse classifi- cation performances in comparison to DL. Alongside the diagnostic purpose, the aforementioned approach allowed to identify characteristic molecules, i. e. amino acids, nucleic acids and bioapatites, relevant for the obtainment of the final diagnostic response, through the analysis of the so-called Per- mutation Feature Importance. Permutation Feature Importance could hence represent a promising parameter for the understanding of the biochemical processes on the basis of the tumor progression. In turn, the spectral bands highlighted by Permutation Feature Importance could represent precious in- dicators in the attempt to restrict the spectral acquisition to specific Raman bands. This last objective could help to reduce the amount of experimental data needed to obtain an accurate final grading outcome, with consequent reduction of the computational cost.

The continuous advancements in healthcare technology have empowered the discovery, diagnosis, and prediction of diseases, revolutionizing the field. Artificial intelligence (AI) is expected to play a pivotal role in achieving the goals of precision medicine, particularly in disease prevention, detection, and personalized treatment. This study aims to determine the optimal combination of the mother wavelet and AI model for the analysis of pediatric electroretinogram (ERG) signals. The dataset, consisting of signals and corresponding diagnoses, undergoes Continuous Wavelet Transform (CWT) using commonly used wavelets to obtain a time-frequency representation. Wavelet images were used for the training of five widely used deep learning models: VGG-11, ResNet-50, DensNet-121, ResNext-50, and Vision Transformer, to evaluate their accuracy in classifying healthy and unhealthy patients. The findings demonstrate that the combination of Ricker Wavelet and Vision Transformer consistently yields the highest median accuracy values for ERG analysis, as evidenced by the upper and lower quartile values. The median balanced accuracy of the obtained combination of the three considered types of ERG signals in the article are 0.83, 0.85, and 0.88. However, other wavelet types also achieved high accuracy levels, indicating the importance of carefully selecting the mother wavelet for accurate classification. The study provides valuable insights into the effectiveness of different combinations of wavelets and models in classifying ERG wavelet scalograms.

Accurate and efficient traffic incident detection methods can effectively alleviate traffic congestion caused by traffic incidents, prevent secondary accidents and improve the safety of urban road traffic.Aiming at the problems that the traditional machine learning event detection method cannot fully extract the parameter characteristics of traffic flow and is not suitable formulti-dimensional and non-linear massive data, we propose a new traffic event detection method(CNN-XGBoost).This method combines the respective advantages of Convolution Neural Network(CNN) and Extreme Gradation Boosting (XGBoost). Firstly, we preprocessed the original freeway traffic incident detection data set by constructing initial variable set, data normalization, data balance processing and dimension reorganization. Secondly,we use CNN network to automatically extract the deep features of event detection data, and use XGBoost as a classifier to classify the extracted features for expressway traffic event detection.Finally, we use the data set of Hangzhou expressway microwave detector in China to carry out simulation experiments on CNN-XGBoost. The experimental results show that compared with XGBoost, CNN, Support Vector Machine (SVM) and Gradient Boosting Decision Tree (GBDT) and other methods, CNN-XGBoost method can effectively improve the accuracy of expressway traffic event detection and has better generalization ability.

Mice are not natural hosts for influenza A viruses (IAVs), but they are useful models for studying antiviral immune responses and pathogenesis. Serial passage of IAV in mice invariably causes the emergence of adaptive mutations and increased virulence. Typically, mouse-adaptation studies are conducted in inbred laboratory strains BALB/c and C57BL/6, which have defects in the antiviral Mx1 gene that results in increased susceptibility to infection and disease severity. Here, we report the adaptation of IAV reference strain A/California/07/2009(H1N1) (a.k.a. CA/07) in outbred Swiss Webster mice. Serial passage led to increased virulence and lung titers, and dissemination of the virus to brains. We adapted a deep-sequencing protocol to identify and enumerate adaptive mutations across all genome segments. Among mutations that emerged during mouse-adaptation, we focused on amino acid substitutions in polymerase subunits: polymerase basic-1 (PB1) T156A and F740L, and polymerase acidic (PA) E349G. These mutations were evaluated singly and in combination in minigenome replicon assays, which revealed that PA E349G increased polymerase activity. By selectively engineering these three adaptive PB1 and PA mutations into the parental CA/07 strain, we demonstrated that adaptive mutations in polymerase subunits decreased the production of defective viral genome segments with internal deletions, and dramatically increased the release of infectious virions from mouse cells. Together, these findings increase our understanding of the contribution of polymerase subunits to successful host adaptation.

The introduction of non-conventional renewable energies (photovoltaic and wind, in the residential case) demand new proposals and opportunities to obtain a domestic energy management system (HEMS), which allows reducing the use of electrical energy. The HEMS incorporates artificial intelligence (AI) techniques to respond to energy demand (DR), which can control, switch, turn on and off, modifying the consumption profile, reducing monthly billing, which as a consequence brings improvement. of the quality of life at home. Based on what has been described, a model for identifying electrical appliances and determining consumption patterns for the home is proposed, using intrusive measurement/actuator equipment called Smart Socket. The Smart Socket measures the electrical variables of voltage and current in real time, calculating the powers and active-reactive-apparent energies of each household appliance (or the most relevant ones). The information provided by the Smart Socket is used as a basis to configure the HEMS, with the aim of optimizing energy use using artificial intelligence techniques and tools, thus reducing energy consumption, CO2 emissions and the user's monthly billing. residential.

When an aircraft malfunctions, quickly and accurately identifying the faulty unit is essential for ensuring normal operation. Unfortunately, maintenance engineers often struggle to acquire the necessary fault-related knowledge due to poor management and utilization of aircraft fault documents. To address this issue, we introduce knowledge graph technology into the field of aircraft fault diagnosis, exploring its construction and application for effective knowledge management. Our work starts by analyzing the critical knowledge elements required for aircraft fault diagnosis and designing a schema layer for fault knowledge graphs. We then we then combine deep learning and heuristic rules to extract fault knowledge from both structured and unstructured data, enabling the construction of aircraft fault knowledge graphs. Finally, we develop a fault question-answering system based on fault knowledge graphs that can accurately give solutions to questions posed by maintenance engineers. Our practice demonstrates that knowledge graphs provide an effective means of managing aircraft fault knowledge, assisting engineers in locating fault reasons accurately and quickly.

“A Picture is worth a thousand words”. Given an image, humans are able to deduce various cause-and-effect captions of past, current, and future events beyond the image. The task of visual commonsense generation aims at generating three cause-and-effect captions (1) what needed to happen before, (2) what is the current intent, and (3) what will happen after for a given image. However, such a task is challenging for machines owing to two limitations: existing approaches (1) directly utilize conventional vision-language transformers to learn relationships between input modalities, and (2) ignore relations among target cause-and-effect captions but consider each caption independently. We propose Cause-and-Effect BART (CE-BART) which is based on (1) Structured Graph Reasoner that captures intra- and inter-modality relationships among visual and textual representations, and (2) Cause-and-Effect Generator that generates cause-and-effect captions by considering the causal relations among inferences. We demonstrate the validity of CE-BART on VisualCOMET and AVSD benchmarks. CE-BART achieves SOTA performances on both benchmarks, while extensive ablation study and qualitative analysis demonstrate the performance gain and improved interpretability.

Abstract: The main contribution of this paper is to introduce a new iterative training algorithm for restricted Boltzmann machines. The proposed learning path is inspired from online sequential extreme learning machine one of extreme learning machine variants which deals with time accumulated sequences of data with fixed or varied sizes. Recursive least squares rules are integrated for weights adaptation to avoid learning rate tuning and local minimum issues. The proposed approach is compared to one of the well known training algorithms for Boltzmann machines named “contrastive divergence”, in term of time, accuracy and algorithmic complexity under the same conditions. Results strongly encourage the new given rules during data reconstruction.

The experience of ego dissolution and self-transcendence induced by psychedelic substances offers a profound challenge to our conventional understanding of the self and our relationship with the natural world. This paper delves into the philosophical underpinnings and implications of this phenomenon, exploring how the temporary breakdown of ego boundaries during a psychedelic experience may foster a sense of profound interconnectedness with nature. Drawing from Western and Eastern philosophical traditions, as well as recent insights from neuroscience and consciousness studies, we examine the potential of psychedelic-induced self-transcendence to catalyze a shift in our perspectives on the human-nature relationship. The paper investigates the philosophical implications of this experience, including its resonance with deep ecological philosophies and its potential to inspire more ecocentric ethical frameworks. Furthermore, we explore the possible practical implications of fostering a sense of ecological connectedness through psychedelics, such as promoting environmentally sustainable behaviors and addressing the pressing challenges of climate change and ecological degradation. Ultimately, this exploration highlights the value of engaging with altered states of consciousness as a means to reconsider our place within the intricate web of life on Earth.

It is time-consuming for acquiring complete data by fully phase encoding in two orthogonal directions along with one frequency encoding direction. Undersampling in the 3D k-space is promising in accelerating such 3D MRI process. Though 3D undersampling can be conducted according to predefined probability density, the density based method is not optimal. Because of the large amount of 3D data and computational cost, it is challenging to perform data-driven and learning-based 3D undersampling and subsequent 3D reconstruction. To tackle this challenge, this paper proposes a deep neural network called EEUR-Net, realized by optimizing specific undersampling patterns for the fully-sampled 3D k-space data. Innovatively, our undersampling algorithm employs an end-to-end deep learning approach to optimize phase encoding patterns and uses a 3D U-Net for image reconstruction of undersampled data. Through end-to-end training, we obtain an optimized 3D undersampling pattern, which significantly enhances the quality of the reconstructed image under the same acceleration factor. A series of experiments on a knee MRI dataset demonstrated that, in comparison to standard random uniform, radial, Poisson and equispaced Cartesian undersampling schemes, our end-to-end learned undersampling pattern considerably improves the reconstruction quality of undersampled MRI images.

Microgrids (MGs) have evolved as critical components of modern energy distribution networks, providing increased dependability, efficiency, and sustainability. Effective control strategies are essential for optimising MG operation and maintaining stability in the face of changing environmental and load conditions. Traditional rule-based control systems are extensively used due to their interpretability and simplicity. However, these strategies frequently lack the flexibility for complex and changing system dynamics. This paper provides a novel method called hybrid intelligent control for adaptive MG that integrates basic rule-based-control and deep learning techniques, including gated recurrent units (GRU), basic recurrent neural network (RNN) and long short-term memory (LSTM). The main target of this hybrid approach is to improve MG management performance by combining the strengths of basic rule-based systems and deep learning techniques. These deep learning techniques readily enhance and adapt control decisions based on historical data and domain-specific rules, leading to increasing system efficiency, stability, and resilience in adaptive MG. Our results show that the proposed method optimises MG operation, especially under demanding conditions such as variable renewable energy supply and unanticipated load fluctuations. This study investigates special RNN architectures and hyper-parameter optimization techniques with the aim of predicting power consumption and generation within the adaptive MG system. Our promising results show the highest-performing models indicating high accuracy and efficiency in power prediction. The finest-performing model accomplishes an R2 value close to 1, representing a strong correlation between predicted and actual power values.

Advancements in technology, policies, and cost reductions have led to rapid growth in wind power production. One of the major challenges in wind energy production is the instability of wind power generation due to weather changes. Efficient power grid management requires accurate power output forecasting. New wind energy forecasting methods based on deep learning are better than traditional methods, like numerical weather prediction, statistical models, and machine learning models. This is more true for short-term prediction. Since there is a relationship between methods, climates, and forecasting complexity, forecasting methods do not always perform the same depending on the climate and terrain of the data source. This paper proposes a novel model that combines the variational mode decomposition method with a long short-term memory model, developed for next-hour wind speed prediction in a hot desert climate, such as the climate in Saudi Arabia. We compared the proposed model performance to two other hybrid models, six deep learning models, and four machine learning models using different feature sets. Also, we tested the proposed model on data from different climates, Caracas and Toronto. The proposed model showed a forecast skill between 61% to 74% based on mean absolute error, 64% to 72% based on root mean square error, and 59% to 68% based on mean absolute percentage error for locations in Saudi Arabia.

UEDVT still remains an underdiagnosed entity due to a significant percentage of patients who remain asymptomatic. The etiology of UEDVT is overwhelmingly attributed to secondary causes including but not limited to central venous access devices and malignancy. Treatment modalities include anticoagulation, catheter directed thrombolysis, percutaneous mechanical thrombectomy or a multimodality approach along with the management of underlying etiology. We describe a case of a female with breast cancer, who came with left UEDVT and CVC malfunction and was successfully treated using the ClotTriever system to maintain continuous intravenous access.

The surrounding rock during the coal mine excavation is prone to significant engineering disasters such as considerable deformation and rockbursts. Pressure release can improve the stress field of a deep rock mass and prevent the occurrence of dangers such as roadway collapse and coal and gas outbursts. This paper uses the ANSYS/LS-DYNA finite element software to simulate the crush area and fracture zone of a detonation charge with different diameters under in-situ stress. The stability of the surrounding rock was analyzed based on the impact stress and velocity, and was verified by field tests. The research results show that the blasting load primarily affects the damaged area near the borehole, while the in-situ stress affects the far-field crack propagation. The crack propagates in the direction of high surrounding rock pressure. When the uncoupling index is 1.5, the impact pressure of the 60 mm diameter cartridge is 8 times that of the 20 mm diameter cartridge. The impact speed can reach 2 times that of the 20 mm diameter cartridge. The high-energy event of the roof is transferred to the front of the working face, the distribution is no longer concentrated, and a better blasting pressure relief effect is achieved. The research results can help guide the prevention and control measures of rock bursts and other mining disasters.

The makeup of human microbiota has been linked to a number of autoimmune disorders. Recent developments in whole metagenome sequencing and 16S rRNA sequencing technology have considerably aided research into the microbiome and its relationship to disease. Due to the inherent high dimensionality and complexity of data generated by high-throughput platforms, conventional bioinformatics techniques could only provide an inadequate explanation for the most relevant changes and seldom provide correct predictions. Machine learning, on the other hand, is a subset of artificial intelligence applications that enable the untangling of high-dimensional systems and intricate knots in correlation by learning complex patterns and improving automatically from training data without being explicitly programmed. Machine learning is increasingly being utilized to research the influence of microbes on the onset of illness and other clinical features since computer power has increased dramatically in the last few decades. In this review paper, we focused on emerging methodological approaches of supervised machine learning algorithms for identification of autoimmune disorders utilizing metagenomics data, as well as the potential benefits and limitations of machine learning models in clinical applications.

The gut-brain axis (GBA) represents a complex, bidirectional communication network that intri-cately connects the gastrointestinal tract with the central nervous system (CNS). Understanding and intervening in this axis opens a pathway for therapeutic advancements. In light of this, the current review assesses the effectiveness of neuromodulation techniques in treating neurological and gastrointestinal disorders by modulating the GBA, involving key elements such as gut micro-biota, neurotrophic factors, and proinflammatory cytokines. Through a comprehensive literature review encompassing PubMed, Google Scholar, Web of Science, and the Cochrane Library, and analyzing 182 relevant articles, this research highlights how neuromodulation can positively impact the management of functional gastrointestinal disorders (FGIDs), chronic pain, inflammation, and a range of GI disorders like Crohn's disease and ulcerative colitis. Despite existing challenges, the ability of neuromodulation to adjust disrupted neural pathways, alleviate pain, and mitigate in-flammation is significant in improving the quality of life for patients, thereby offering exciting prospects for future advancements in patient care.

We have developed deep learning models for automatic identification of the maternal heart rate (MHR) and, more generally, false signals (FSs) on fetal heart rate (FHR) recordings. The models can be used to preprocess FHR data prior to automated analysis or as a clinical alert system to assist the practitioner. Three models were developed and used to detect (i) FSs on the MHR channel (the FSMHR model), (ii) the MHR and FSs on the Doppler FHR sensor (the FSDop model), and (iii) FSs on the scalp ECG channel (the FSScalp model). The FSDop model was the most useful because FSs are far more frequent on the Doppler FHR channel. All three models were based on a multilayer, symmetric, GRU and were trained on data recorded during the first and second stages of delivery. The FSMHR and FSDop models were also trained on antepartum recordings. The training dataset contained 1030 expert-annotated periods (mean duration: 36 min) from 635 recordings. In an initial evaluation of routine clinical practice, 30 fully annotated recordings for each sensor type (mean duration: 5 h for MHR and Doppler sensors, and 3 h for the scalp ECG sensor) were analyzed. The sensitivity, positive predictive value (PPV) and accuracy were respectively 62.20%, 87.1% and 99.90% for the FSMHR model, 93.1%, 95.6% and 99.68% for the FSDop model, and 44.6%, 87.2% and 99.93% for the FSScalp model. We built a second test dataset with a more solid ground truth by selecting 45 periods (lasting 20 min, on average) on which the Doppler FHR and scalp ECG signals were recorded simultaneously. Using scalp ECG data, the experts estimated the true FHR value more reliably and thus annotated the Doppler FHR channel more precisely. The models achieved a sensitivity of 53.3%, a PPV of 62.4%, and an accuracy of 97.29%. In comparison, two experts (blinded to the scalp ECG data) respectively achieved a sensitivity of 15.7%, a PPV of 74.3%, and an accuracy of 96.91% and a sensitivity of 60.7%, a PPV of 83.5% and an accuracy of 98.24%. Hence, the models performed at expert level (better than one expert and worse than the other), although a well-trained expert with good knowledge of FSs could probably do better in some cases. The models and datasets have been included in the Fetal Heart Rate Morphological Analysis open-source MATLAB toolbox and can be used freely for research purposes.

Infrared small target detection (ISTD) plays a crucial role in both civilian and military applications. The detection of small targets against dense cluttered backgrounds remains a challenging task, requiring the collaboration of false alarm source elimination and target detection. Existing approaches primarily focus on modeling targets while often neglecting false alarm sources. To address this limitation, we propose a Target and False Alarm Collaborative Detection Network to leverage the information provided by false alarm sources and the background. Firstly, we introduce a False Alarm Source Estimation Block (FEB) that estimates potential interferences present in the background by extracting features on multiple scales and employing stepwise upsampling for feature fusion. Subsequently, we propose a framework that employs multiple FEBs to eliminate false alarm sources across multiple scales. Finally, a Target Segmentation Block (TSB) is introduced to accurately segment the targets to produce the final detection result. Experiments on public datasets demonstrate that, compared to other methods, our model achieves high accuracy in segmenting targets while being able to extract false alarm sources which can be used for further studies.

The power converter is the significant device in a wind power system. Wind turbine will be shut down and off grid immediately with the occurrence of the IGBT module open-circuit fault of power converter, which will seriously impact the stability of grid and even threaten personal safety. However, in the existing diagnosis strategies of power converter, there are few single and double IGBT modules open-circuit fault diagnosis methods producing negative results including erroneous judgment, omissive judgment and low accuracy. In this paper, a novel method to diagnose the single and double IGBT modules open-circuit faults of the permanent magnet synchronous generator (PMSG) wind turbine grid-side converter (GSC) is proposed. Above all, collecting the three-phase current varying with wind speed of 22 failure states including a normal state of PMSG wind turbine GSC as the original signal data. Afterward, the original signal data are decomposed by using variational mode decomposition (VMD) to obtain the mode coefficient series, which are analyzed by the proposed method base on fault trend feature for extracting the trend feature vectors. Finally, the trend feature vectors are used as the input of deep belief network (DBN) for decision-making and obtaining the classification results. The simulation and experimental results show that the proposed method can diagnose the single and double IGBT modules open-circuit faults of GSC, and the accuracy is higher than the benchmark models.

The falling cost of cameras, the advancement of AI based computer vision algorithms, and powerful hardware accelerators for deep learning have enabled wide-spread deployment of surveillance cameras with the ability to automatically analyze streaming video feeds to detect events of interest. While streaming video analytics is currently largely done in the cloud, edge computing has emerged as a pivotal component due to its advantages of low latency, reduced bandwidth, and enhanced privacy. However, a distinct gap persists between the state-of-the-art computer vision algorithms, and successful practical implementation of edge-based streaming video analytics systems. This paper presents a comprehensive review of more than 30 research papers published over the last 6 years on edge video analytics systems. The papers are analyzed across 17 distinct dimensions. Unlike prior reviews, we examine each system holistically, identifying their strengths and weaknesses in diverse implementations. Our findings suggest that certain critical topics necessary for the practical realization of edge video analytics systems are not sufficiently addressed in current research. Based on these observations, we propose research trajectories across short, medium, and long term horizons. Additionally, we explore trending topics in other computing areas that can significantly impact the field of edge video analytics.

In the intersection of the Internet of Things (IoT) and Machine Learning (ML), the choice between high-level and low-level programming libraries presents a significant dilemma for developers, impacting not only the efficiency and effectiveness of ML models but also their environmental footprint. We have proposed a comprehensive framework to aid in this decision-making process, underpinned by a detailed comparative analysis of both types of libraries on one of the key IoT ML task; image classification. We have introduced a novel algorithm designed to calculate the green footprint of ML model training, factoring in execution time, memory utilization, power consumption, and CPU temperature, addressing the urgent need for sustainable ML practices. Through an empirical evaluation of popular libraries such as PyTorch for high-level and Libtorch for low-level development, we have assessed their performance, development efficiency, and hardware compatibility. The culmination of our research is a decision support system that synthesizes the experimental findings to guide developers toward choices that harmonize model performance with environmental sustainability.

Deep learning methods paired with sidescan sonar (SSS) are commonly used in underwater search and rescue operations for drowning victims, wrecks, and airplanes. However, these techniques are primarily designed to detect mine-like objects and are rarely applied to identifying features in dynamic dredge pit environments, due to a lack of datasets. In this study, we present a Sandy Point Dredge Pit (SPDP) dataset, in which high-resolution SSS data were collected from the west flank of Mississippi bird foot delta of the Louisiana inner shelf. This dataset contains a total of 385 SSS images. We introduce an Effective Geomorphology Classification model (EGC). By ablation studies, we analyze the utility of transfer learning on different model architectures and the impact of data augmentations on model performance. This EGC model will make geomorphic features identification in dredge pit environments quick and efficient which requires extensive experience and professional knowledge. The combination of SSS images and EGC model is a cost-effective and valuable toolkit for hazards monitoring in marine dredge pit environment. The SPDP SSS images dataset, especially the feature of pit wall without rotational slump, is also valuable for other machine learning modelers.

High-power laser facilities necessitate predicting incremental damage to final optics to identify evolving damage trends. In this study, we propose a surface damage detection method utilizing image segmentation employing ResNet-18, and a damage area estimation network employing U-Net++. Paired sets of online and offline images of optics obtained from a large laser facility is used to train the network. The trends of varying damage could be identified by incorporating additional experimental parameters. A key advantage of the proposed method is that the network can be trained end-to-end on small samples, eliminating the need for manual labeling or feature extraction. The software developed based on these models can facilitate the daily inspection and maintenance of optics in large laser facilities.

The Ebola virus disease (EVD) is an extremely contagious and fatal illness caused by the Ebola virus. Recently, Uganda witnessed an outbreak of EVD, which generated a lot of attention on various social media platforms. To ensure effective communication and implementation of targeted health interventions, it is crucial for stakeholders to comprehend the sentiments expressed in the posts and discussions on these online platforms. In this study, we used deep learning techniques to analyze the sentiments expressed in Ebola-related tweets during the outbreak. We explored the application of three deep learning techniques to classify the sentiments in 8,395 tweets as positive, neutral, or negative. The techniques examined included a 6-layer convolutional neural network (CNN), a 6-layer long-short-term memory model (LSTM), and an 8-layer Bidirectional Encoder Representations from Transformers (BERT) model. The study found that the BERT model outperformed both the CNN and LSTM-based models across all the evaluation metrics, achieving a remarkable classification accuracy of 95\%. These findings confirm the reported effectiveness of transformer-based architectures in tasks related to natural language processing, such as sentiment analysis.

Despite significant advances in tumor biology and clinical therapeutics, metastasis remains the primary cause of cancer-related deaths. While RNA-seq technology has been used extensively to study metastatic cancer characteristics, challenges persist in acquiring adequate transcriptomic data. To overcome this challenge, we propose MetGen, a generative contrastive learning based on deep learning model. MetGen generates synthetic metastatic cancer expression profiles using primary cancer and normal tissue expression data. Our results demonstrate that MetGen generates comparable samples to actual metastatic cancer samples, and we discuss the learning mechanism of MetGen. Additionally, we demonstrate MetGen's interpretability using metastatic prostate cancer and metastatic breast cancer. MetGen has learned highly relevant signatures in cancer, tissue, and tumor microenvironment, such as immune response and the metastasis process, which potentially fosters a more comprehensive understanding of metastatic cancer biology. The development of MetGen represents a significant step toward the study of metastatic cancer biology by providing a generative model that identifies candidate therapeutic targets for the treatment of metastatic cancer.

The incessant evolution of online platforms has ushered in a multitude of shopping modalities. Within the food industry, however, assessing the delectability of meals can only be tentatively determined based on consumer feedback encompassing aspects such as taste, pricing, packaging, service quality, delivery timeliness, hygiene standards, and environmental considerations. Traditional text data mining techniques primarily focus on consumers' emotional traits, disregarding pertinent information pertaining to the online products themselves. In light of these aforementioned issues in current research methodologies, this paper introduces the Bert BiGRU Softmax model combined with multimodal features to enhance the efficacy of sentiment classification in data analysis. Comparative experiments conducted using existing data demonstrate that the accuracy rate of the model employed in this study reaches 90.9%. In comparison to single models or combinations of three models with the highest accuracy rate of 7.7%, the proposed model exhibits superior accuracy and proves highly applicable to online reviews.

In the era of Artificial Intelligence (AI), comprehending and responding to non-verbal communication is increasingly vital. This research extends AI's reach in bridging communication gaps, notably benefiting American Sign Language (ASL) and Taiwan Sign Language (TSL) communities. It focuses on employing various AI models, especially the Hierarchical Vision Transformer with Shifted Windows (Swin), for recognizing diverse sign language datasets. The study assesses Swin architecture's adaptability to different sign languages, aiming to create a universal platform for Unvoiced communities. Utilizing deep learning and transformer technologies, hybrid application prototypes have been developed for ASL-to-English translations and vice versa, with plans to expand this to multiple sign languages. The Swin models, trained on varied dataset sizes, show considerable accuracy, indicating their flexibility and effectiveness. This research underscores major advancements in sign language recognition and underlines a commitment to inclusive communication in the digital era. Future work will focus on enhancing these models and broadening their scope to include more sign languages, integrating multimodality and Large Language Models (LLMs), thereby fostering global inclusivity.

Background: Silent MRA has shown promising results in evaluating the stents used for intracranial aneurysm treatment. A deep learning-based algorithm was recently introduced by GE. The purpose of this study was to compare the performance of several MRA techniques in lumen visibility in silicone models with flow diverter stents. Methods: Two Surpass Evolve stents of different sizes were implanted in two silicone tubes. The tubes were placed in separate boxes in straight position and in two different curve configurations and connected to a pulsatile pump to construct a flow loop. Using a GE 3.0T scanner, TOF and silent MRA images were acquired, and deep learning reconstruction was applied to the silent MRA dataset. Intra-luminal signal intensity in the stent (SIin-stent), in the tube outside the stent (SIvessel) and of the background (SIbg) were measured for each scan. Results: The SIin-stent/SIbg and SIin-stent/SIv ratio were higher on silent scans and DL-based reconstructions than on TOF images. The stent tips created severe artefacts on TOF images, which could not be observed on silent scans. Conclusions: Our study demonstrated that the DL algorithm improved the quality of the silent technique in evaluating the flow diverter stent patency.

Document image binarization is a challenging task, especially when it comes to text segmentation in degraded document images. The binarization, as a pre-processing step of optical character recognition (OCR), is one of the most fundamental and commonly used segmentation methods. It separates the foreground text from the background of the document image to facilitate subsequent image processing. In view of the different degradation degree of document image, researchers have proposed a variety of solutions. This paper reviews the main binarization techniques, including both traditional algorithms and deep learning-based algorithms. We also summarize some difficulties and challenges in the field of document image binarization. Here, we evaluate various image binarization techniques to identify shortcomings in current methods and provide some help for future research.

Vulnerabilities in smart contracts may trigger serious security events, and the detection of smart contract vulnerabilities has become a significant problem. In this paper, by using the multi-scale cascade encoder architecture as the backbone, we propose a novel Multi-scale Encoder Vulnerability Detection (MEVD) approach to detect well-known high-risk vulnerabilities in smart contracts. Firstly, we use the gating mechanism to design a unique Surface Feature Encoder (SFE) to enrich the semantic information of code features. Then, by combining a Base Transformer Encoder (BTE) and a Detail CNN Encoder (DCE), we introduce a dual-branch encoder to capture the global structure and local detail features of the smart contract code, respectively. Finally, to focus the model's attention on vulnerability-related characteristics, we employ the Deep Residual Shrinkage Network (DRSN). Experimental results on three types of high-risk vulnerability datasets demonstrate performance compared to state-of-the-art methods, and our method achieves an average detection accuracy of 90%.

This paper presents an approach to enhancing the clarity and intelligibility of speech in digital communications compromised by various background noises. Utilizing deep learning techniques, specifically a Variational Autoencoder (VAE) with 2D convolutional filters, we aim to suppress background noise in audio signals. Our method focuses on four simulated environmental noise scenarios: storms, wind, traffic, and aircraft. Training dataset has been obtained from public sources (TED-LIUM 3 dataset, which includes audio recordings from the popular TED-TALK series) combining with these background noises. The audio signals were transformed into 2D power spectrograms, upon which our VAE model was trained to filter out the noise and reconstruct clean audio. Our results demonstrate that the model outperforms existing state-of-the-art solutions in noise sup-pression. Although differences in noise types were observed, it was challenging to definitively conclude which background noise most adversely affects speech quality. Results have been assessed with objective methods (mathematical metrics) and subjective (listening to a set of audios by humans). Notably, wind noise showed the smallest deviation between the noisy and cleaned audio, perceived subjectively as the most improved scenario. Future work involves refining the phase calculation of the cleaned audio and creating a more balanced dataset to minimize differences in audio quality across scenarios. Additionally, practical ap-plications of the model in real-time streaming audio are envisaged. This research contributes significantly to the field of audio signal processing by offering a deep learning solution tailored to various noise conditions, enhancing digital communication quality.

With the rapid development of space programs in various countries, the number of satellites in space is increasing, resulting in an increasingly complex space environment. Therefore, improving space object identification technology has become highly important. We proposes a method of applying deep learning to intelligent detection of space object. We utilize 49 authentic 3D satellite models including 16 scenarios to generate a dataset comprising 17,942 images, which contains over 500 actual satellite photos. Additionally, we acquired a substantial amount of annotated data using a semi-automatic labeling method, which resulted in significant labor cost savings, and obtained a total of 39,000 labels. We validate the feasibility of the dataset using YOLOv3 and YOLOv7 models. What's more, we optimize the YOLOv7 model by integrating deformable convolution RepPoint into the YOLOv7 backbone to obtain the YOLOv7-R model. Through training with these two models, experimental results show that YOLOv3 achieves an accuracy of 0.927, YOLOv7 reaches an accuracy of 0.964, and YOLOv7-R achieves the highest accuracy at 0.983. This provides an effective solution for intelligent space object detection.

In the realm of autonomous vehicle environment perception, the primary objective of point cloud target detection is to swiftly and accurately identify three-dimensional objects from point cloud data. To meet this requirement, the prevalent network architecture employed in the industry is the voxel-based PointPillars model. Nonetheless, this model faces challenges in maintaining detection accuracy when objects are obscured or diminutive in size. In response to this issue, we introduce AGPNet, a novel model that seamlessly integrates four key modules: Data Augmentation, Dynamic Graph CNN, Pillar Feature Net, and Detection Head (SSD). The Data Augmentation module enhances the adaptability of point cloud data to complex and ever-changing real-world environments. The Dynamic Graph CNN module endows the network structure with geometric features, which encapsulate not only the point itself but also its adjacent points. The Pillar Feature Net module translates three-dimensional point cloud data into pseudo-image data through the utilization of voxels. Subsequently, the Detection Head (SSD) module leverages this pseudo-image data to conduct target detection of three-dimensional objects. Our experiments, conducted on the KITTI dataset, demonstrate that our proposed method boosts object detection accuracy by 6-7 percentage points compared to the PointPillars model, while maintaining similar detection times.

In this paper, we introduce an innovative approach to distinguish Gliosarcoma (GSM) from Glioblastoma (GBM). Our method combines causal fuzzy logic rules with the Big Bird architecture, a Transformer-based Deep Learning algorithm. Unlike prior research, which often relied on statistical models to reduce dataset dimensions before causal analysis, our approach harnesses the complete dataset in tandem with our causal fuzzy Big Bird architecture. Additionally, we benchmark our results not only against previous Gliosarcoma/Glioblastoma studies but also against GPT-2 for a comprehensive evaluation.

CagY is the largest and most complex protein from Helicobacter pylori's type IV secretion system (T4SS) and may participate in the modulation of gastric tissue inflammation. A three-dimensional structure has been reported for only two segments of the protein. To build a more complete model, particularly the region that spans between the outer membrane (OM) and the inner membrane (IM), we employed different approaches, including homology modeling, ab initio, and deep learning techniques. For the long-middle repeat region (MRR), modeling was performed using deep learning techniques and Molecular Dynamics. The modeled segments were assembled into a chain of 1595 aa, and a 14-chain CagY multimer structure was composed by structural alignment. The final multimer structure correlated with previously published struc-tures and allows to show how the multimer may form the T4SS channel through which CagA and other molecules are translocated to gastric epithelial cells. The model further confirmed that MRR, the most polymorphic and complex region of CagY, presents numerous cysteine residues forming disulfide bonds that stabilize the protein and suggest this domain probably functions as a contractile region that may play an essential role in the modulatory activity of CagY on tissue inflammation.

All kinds of vessels consist of dozens of complex machineries with rotating parts and electric motors that operate continuously in a harsh environment with excess temperature and humidity, vibration, fatigue and load. A breakdown or malfunction in one of these machineries can significantly impact the vessel’s operation and safety and consequently, the safety of the crew and the environment. To maintain operational efficiency and seaworthiness, the shipping industry invests substantial resources in preventive maintenance and repairs. This research presents the economic and technical benefits of predictive maintenance over to traditional preventive maintenance, and repair by replacement approaches in the maritime domain. By leveraging modern technology and Artificial Intelligence, we can analyze real-time operating conditions of machinery, enabling early detection of potential damages and allowing for effective planning of future maintenance and repair activities. In this paper, we propose and develop a Convolutional Neural Network that is fed with raw vibration measurements acquired in a laboratory environment from the ball bearings of a motor. Then, we investigate whether the proposed network can accurately detect the functional state of ball bearings and categorize any possible failures present, contributing to improved maintenance practices in the shipping industry.

Digital Microfluidic Biochips (DMFBs), used in various kinds of fields like DNA analysis, clinical diagnosis, and PCR testing, have made biochemical experiments more compact, efficient, and user-friendly than previous ways. However, their reliability is often compromised by their inability to adapt to all kinds of errors. All errors in biochips can be categorized into two types: known errors and unknown errors. Known errors are detectable before the start of the routing process through sensors or cameras. Unknown errors, in contrast, become apparent only during the routing process and remain undetected by sensors or cameras, which is the biggest issue to unexpectedly stop the routing process and diminishes the reliability of biochips. This paper introduces a deep reinforcement learning-based routing algorithm designed to manage not only known errors but also unknown errors. Our experiments demonstrate that our algorithm outperforms previous ones in terms of the success rate of the routing in the scenario including both known errors and unknown errors. Additionally, our algorithm contributes to detecting unknown errors during the routing process and identifying the most efficient routing path with high probability.

Vehicle re-identification research under surveillance cameras has yielded impressive results. However, the challenge of Unmanned Aerial Vehicle (UAV)-based vehicle re-identification (ReID) presents a high degree of flexibility, mainly due to complicated shooting angles, occlusions, low discrimination of top-down features, and significant changes in vehicle scales. To address this, we propose a novel Dual Mixing Attention Network (DMANet) to extract discriminative features robust to variations in viewpoint. Specifically, we first present a plug-and-play Dual Mixing Attention Module (DMAM) to capture pixel-level pairwise relationships and channel dependencies, where DMAM is composed of Spatial Mixing Attention (SMA) and Channel Mixing Attention (CMA). First, the original feature is divided according to the dimensions of spatial and channel to obtain multiple subspaces. Then, a learnable weight is applied to capture the dependencies between local features in the mixture space. Finally, the features extracted from all subspaces are aggregated to promote their comprehensive feature interaction. Moreover, the DMAM can be readily inserted into backbone networks at any depth to improve vehicle discrimination. The experiments show that the proposed structure gains a better performance compared with the representative methods in the UAV-based vehicle ReID task. Our code and models will be publicly released.

Chlorophyll-a (Chla) is a crucial pigment in phytoplankton, playing a vital role in determining phytoplankton biomass and water nutrient status. However, in optically complex water bodies, Chla concentration is no longer the primary factor influencing remote sensing spectral reflectance signals, leading to significant errors in traditional Chla concentration estimation methods. With advancements in in-situ measurements, synchronized satellite data, and computer technology, machine learning algorithms have become popular in Chla concentration retrieval. Nevertheless, when using machine learning methods to estimate Chla concentration, abrupt changes in Chla values can disrupt the spatiotemporal smoothness of the retrieval results. Therefore, this study proposes a two-stage approach to enhance the accuracy of Chla concentration estimation in optically complex water bodies. In the first stage, a one-dimensional convolutional neural network (1DCNN) is employed for precise Chla retrieval, and in the second stage, the regression layer of the 1DCNN is replaced with Support Vector Regression (SVR). The research findings are as follows: (1) In the first stage, the performance metrics (R², RMSE, RMLSE, Bias, MAE) of the 1DCNN outperform state-of-the-art algorithms (OCI, SVR, RFR) on the test dataset. (2) After the second stage, the performance further improves, with the metrics achieving values of 0.892, 11.243, 0.052, 1.056, and 1.444, respectively. (3) In mid-to-high latitude regions, the inversion performance of 1DCNN\SVR is superior to other algorithms, exhibiting richer details and higher noise tolerance in nearshore areas. (4) 1DCNN\SVR demonstrates high inversion capabilities in water bodies with medium to high nutrient levels.

Deep reinforcement learning is one of the research hotspots in artificial intelligence and has been successfully applied in many research areas, however, the low training efficiency and high demand for samples are problems that limit the application To address these problems, a hierarchical episodic control model extending episodic memory to the domain of hierarchical reinforcement learning is proposed in this paper. The model is theoretically justified and employs a hierarchical implicit memory planning approach for counterfactual trajectory value estimation. Starting from the final step and recursively moving back along the trajectory, a hidden plan is formed within the episodic memory. Experience is aggregated both along trajectories and across trajectories, and the model is updated using a multi-headed backpropagation similar to bootstrapped neural networks. This model extends the parameterized episodic memory framework to the realm of hierarchical reinforcement learning and is theoretically analyzed to demonstrate its convergence and effectiveness. Experiments conducted in Four Room, Mujoco, and UE4-based active tracking , highlight that the hierarchical episodic control model effectively enhances training efficiency. It demonstrates notable improvements in both low-dimensional and high-dimensional environments, even in cases of sparse rewards.

This paper explores the potential of using the SAM segmentator to enhance the segmentation capability of known methods. SAM is a promptable segmentation system that offers zero-shot generalization to unfamiliar objects and images, eliminating the need for additional training. The open-source nature of SAM on GitHub allows for easy access and implementation. In our experiments, we aim to improve the segmentation performance by providing SAM with checkpoints extracted from the masks produced by DeepLabv3+, then merging the segmentation masks provided by these two networks. Additionally, we examine the \enquote{oracle} method (as upper bound baseline performance), where segmentation masks are inferred only by SAM with checkpoints extracted from ground truth. In addition, we tested in the CAMO datasets an ensemble of PVTv2 transformers; combining the ensemble and SAM yields state-of-the-art performance in that dataset. The results of our study provide valuable insights into the potential of incorporating the SAM segmentator into existing segmentation techniques. We release with this paper the open-source implementation of our method.

Fractures of the talar neck and body are associated with spine fractures and scoliosis deformity, which affect cosmetic appearance and cause difficulty in ambulation. The implant design for talus surgery is thriving as a functional alternative in case of severe talar destruction, focusing on segmentation and reconstruction of the talus’s shape. However, manual segmentation of the talus is time-consuming and subjective. In this study we exploited the automatic segmentation framework to efficiently train a deep learning-based model to accurately segment the talus based on computed tomography imaging. We developed three model configurations with nnU-Net and investigated their Dice similarity coefficients (DSC) and 95% Hausdorff distances (HD95) for talus segmentation on a CT image dataset. The three configurations performed well (DSC > 0.95, HD95 < 0.6). When tested on the same samples, one of the configurations was more efficient while ensuring higher accuracy. We propose to focus on talus anatomic variations with increasing age based on this framework and apply it to clinical trials at the next stage.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

GNSS time series prediction plays a significant role in monitoring crustal plate motion, landslide detection, and maintenance of the global coordinate framework. Long Short-Term Memory (LSTM), a deep learning model has been widely applied in the field of high-precision time series prediction especially when combined with Variational Mode Decomposition (VMD) to form the VMD-LSTM hybrid model. To further improve the prediction accuracy of the VMD-LSTM model, this paper proposes a dual variational modal decomposition long short-term memory (DVMD-LSTM) model to effectively handle the noise in GNSS time series prediction. This model extracts fluctuation features from the residual terms obtained after VMD decomposition to reduce the prediction errors associated with residual terms in the VMD-LSTM model. Daily E, N, and U coordinate data recorded at multiple GNSS stations between 2000 and 2022 are used to validate the performance of the proposed DVMD-LSTM model. The experimental results demonstrate that compared to the VMD-LSTM model, the DVMD-LSTM model achieves significant improvements in prediction performance across all measurement stations. The average RMSE is reduced by 9.86%, and the average MAE is reduced by 9.44%. Furthermore, the average accuracy of the optimal noise model for the predicted results is improved by 36.50%, and the average speed accuracy of the predicted results is enhanced by 33.02%. These findings collectively attest to the superior predictive capabilities of the DVMD-LSTM model, thereby enhancing the reliability of the predicted results.

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

Sentiment analysis of public opinion expressed in social networks has been developed into various applications, especially in English. Hybrid approaches are potential models for reducing sentiment errors on increasingly complex training data. This paper aims to test some hybrid deep learning models' reliability in some domains' Vietnamese language. Our research questions are to determine whether it is possible to produce hybrid models that outperform the Vietnamese language. Hybrid deep sentiment-analysis learning models are built and tested on reviews and feedback of the Vietnamese language. The hybrid models outperformed the accuracy of Vietnamese sentiment analysis on Vietnamese datasets. It contributes to the growing body of research on Vietnamese NLP, providing insights and directions for future studies in this area.

The ability to handle spatiotemporal information makes contribution for improving the prediction performance of machine RUL. However, most existing models for spatiotemporal information processing are not only complex in structure but also lack adaptive feature extraction capabilities. Therefore, a lightweight operator with adaptive spatiotemporal information extraction ability named Involution GRU (Inv-GRU) is proposed for aero-engine RUL prediction. Involution, the adaptive feature extraction operator, is replaced by the information connection in the gated recurrent unit for obtaining the adaptively spatiotemporal information extraction ability and reducing the parameters. Thus, Inv-GRU can well extract the degradation information the of aero-engine. Then for RUL prediction task, the Inv-GRU based deep learning (DL) framework is firstly constructed, where features extracted by Inv-GRU and several human-made features are separately processed to generate the health indicators (HIs) from multi-raw data of aero-engines. Finally, fully connection layers are adopted are adopted to reduce dimension and regress RUL based on the generated HIs. By applying the Inv-GRU based DL framework to the Commercial Modular Aero Propulsion System Simulation (C-MAPSS) datasets, successful predictions of aero-engines RUL have been achieved. Comparative analysis reveals that the proposed model exhibits superior overall prediction performance compared to recent public methods.

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

Computer vision methods have shown to be effective in classifying garbage into recycling categories for waste processing, existing methods are costly, imprecise, and unclear. To tackle this issue, we introduce MWaste, a mobile application that uses computer vision and deep learning techniques to classify waste materials as trash, plastic, paper, metal, glass or cardboard. Its effectiveness was tested on various neural network architectures and real world images, achieving an average precision of 92% on the test set. This app can help combat climate change by enabling efficient waste processing and reducing the generation of greenhouse gases caused by incorrect waste disposal.

Auto-labeling is one of the main challenges in 3D vehicle detection. Auto-labeled datasets can be used to identify objects in LiDAR data, which is a challenging task due to the large size of the dataset. In this work, we propose a novel methodology to generate new 3D based auto-labeling datasets with a different point of view setup than the one used in the most recognized datasets (KITTI, WAYMO, etc.). The performance of the methodology has been further demonstrated with the development of our own dataset with the auto-generated labels and tested under boundary conditions on a bridge in a fixed position. The proposed methodology is based on the YOLO model trained with the KITTI dataset. From a camera-LiDAR sensory fusion, it is intended to auto-label new datasets while maintaining the consistency of the Ground Truth. The main contribution of this work is a novel methodology to auto-label autonomous driving datasets using YOLO as the main labelling system. The performance of this approach is measured retraining the contrast models of the KITTI benchmark.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Pulsed thermography is a vital technique in the nondestructive evaluation field. However, its data analysis can be complex and requires skilled experts. Advances in deep learning have yielded exceptional results, including image segmentation. Therefore, many efforts have been made to apply deep learning methods to data processing for nondestructive evaluation. Despite this, there is currently no public Pulsed thermographic dataset available for evaluating various spatial-temporal deep methods of segmenting pulsed thermographic data. This article aims to provide such a dataset and assess the performance of commonly used deep learning-based instance segmentation models on it. Additionally, the impact of the number of frames and data transformations on model performance is examined. The findings suggest that suitable preprocessing methods can effectively reduce the data size without compromising the deep models’ performance.

One of the most common forms of dementia is Alzheimer’s disease (AD), which leads to progressive mental deterioration. Unfortunately, there is no definitive diagnosis and cure that can stop the condition progressing. The diagnosis is often performed based on the clinical history and neuropsychological data, including magnetic resonance imaging (MRI). Deep neural networks (DNN) algorithms are gaining popularity for medical diagnosis, and have been used widely for the analysis of MRI data. DNNs can extract hidden features from thousands of training images automatically. However, they cannot judge how confident they are about their predictions. To use DNNs in safety-critical applications such as medical diagnosis, uncertainty quantification of DNNs predictions is crucial. For this purpose, Monte Carlo dropout (MCD) has been widely used, however, it may lead to overconfident and miss calibrated results. This paper proposes a framework in which the MCD algorithm’s hyper-parameters are optimized during training using Bayesian optimization for the first time. The conducted optimization leads to assigning high predictive entropy to erroneous predictions and making it possible to recognize risky predictions. The proposed framework is used for AD diagnosis, which has not been done before. We compare our method with some existing methods in the literature based on different uncertainty quantification criteria. The results of comprehensive experiments on the Kaggle dataset using a deep model pre-trained on the ImageNet dataset show that the proposed algorithm can quantify uncertainty much better than the existing methods.

MicroRNAs (miRNAs) are small non-coding RNAs that play a central role in the post-transcriptional regulation of biological processes. miRNAs regulate transcripts by direct binding involving the Argonaute protein family. The exact rules of binding are not known, and several in silico miRNA target prediction methods have been developed to date. Deep Learning has recently revolutionized miRNA target prediction. However, the higher predictive power comes with decreased ability to interpret increasingly complex models. Here, we present a novel interpretation technique, called attribution sequence alignment, for miRNA target site prediction models that can interpret such Deep Learning models on a two-dimensional representation of miRNA and putative target sequence. Our method produces a human readable visual representation of miRNA:target interactions and can be used as a proxy for further interpretation of biological concepts learned by the neural network. We demonstrate applications of this method in clustering of experimental data into binding classes, as well as using the method to narrow down predicted miRNA binding sites on long transcript sequences. Importantly, the presented method works with any neural network model trained on a two-dimensional representation of interactions and can be easily extended to further domains such as protein-protein interactions.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..