Brain metastasis is a severe and complicated cancer that requires timely screening and follow-up approaches using precise segmentation techniques for effective surgical intervention, radiation therapy, or monitoring the disease progression. In this study, we explore the efficacy of transfer learning in improving the automatic segmentation of brain metastases on Magnetic Resonance Imaging scans with the subsequent possibility of using it in clinical practice for preventive examinations and remote diagnostics. We train three deep learning models on a public dataset from the Brain Tumor Segmentation 2024 Challenge, then fine-tune these pretrained models on a small private dataset and compare them to models trained on private data from scratch. The results indicate that models utilizing transfer learning achieve superior accuracy and generalization in segmenting brain metastases. We also observed that the custom loss function significantly enhances performance compared to the default configuration. This study highlights the importance of leveraging transfer learning in medical imaging to address challenges associated with small, specialized datasets.

In this paper, we propose methods for brain tumor detection in MRI images based on ensemble learning. We build upon prior research on ensemble methods by testing the concatenation of pre-trained models: features extracted via transfer learning are merged and segmented by classification algorithms or a stacked ensemble of those algorithms. The proposed approach achieved accuracy scores of 0.98 , outperforming a benchmark VGG-16 model. Considerations to granular computing are given in the paper as well.

Convolutional Neural Networks (CNNs) have gained prominence in the research literature on image classification over the last decade. One shortcoming of CNNs, however, is their lack of generalizability and tendency to overfit when presented with small training sets. Augmentation directly confronts this problem by generating new data points providing additional information. In this paper, we investigate the performance of more than ten different sets of data augmentation methods, with two novel approaches proposed here: one based on the Discrete Wavelet Transform and the other on the Constant-Q Gabor transform. Pretrained ResNet50 networks are finetuned on each augmentation method. Combinations of these networks are evaluated and compared across three benchmark data sets of images representing diverse problems and collected by instruments that capture information at different scales: a virus data set, a bark data set, and a LIGO glitches data set. Experiments demonstrate the superiority of this approach. The best ensemble proposed in this work achieves state-of-the-art performance across all three data sets. This result shows that varying data augmentation is a feasible way for building an ensemble of classifiers for image classification (code available at https://github.com/LorisNanni).

The makeup of human microbiota has been linked to a number of autoimmune disorders. Recent developments in whole metagenome sequencing and 16S rRNA sequencing technology have considerably aided research into the microbiome and its relationship to disease. Due to the inherent high dimensionality and complexity of data generated by high-throughput platforms, conventional bioinformatics techniques could only provide an inadequate explanation for the most relevant changes and seldom provide correct predictions. Machine learning, on the other hand, is a subset of artificial intelligence applications that enable the untangling of high-dimensional systems and intricate knots in correlation by learning complex patterns and improving automatically from training data without being explicitly programmed. Machine learning is increasingly being utilized to research the influence of microbes on the onset of illness and other clinical features since computer power has increased dramatically in the last few decades. In this review paper, we focused on emerging methodological approaches of supervised machine learning algorithms for identification of autoimmune disorders utilizing metagenomics data, as well as the potential benefits and limitations of machine learning models in clinical applications.

In this review we summarize existing trends of flow control used to improve the aerodynamic efficiency of wings. We first discuss active methods to control turbulence, starting with flat-plate geometries and building towards the more complicated flow around wings. Then, we discuss active approaches to control separation, a crucial aspect towards achieving high aerodynamic efficiency. Furthermore, we highlight methods relying on turbulence simulation, and discuss various levels of modelling. Finally, we thoroughly revise data-driven methods, their application to flow control, and focus on deep reinforcement learning (DRL). We conclude that this methodology has the potential to discover novel control strategies in complex turbulent flows of aerodynamic relevance.

Big data-driven machine learning and artificial intelligence (ML/AI) is not all computational social sciences (CSS) have. Agent-based modeling (ABM) or multi-agent system (MAS) is another fundamentally different but equally useful approach in CSS. In fact, the two approaches start from very different orientations and their differences have deeper root in ontology. ML/AI aims to imitate and then surpass human capacities, from sensing to perceiving, reasoning, calculating, and acting. In contrast, ABM seeks to simulate how social outcomes emerge from the complex interactions of agents’ actions within a specific environment. Yet, precisely because these two technologies are different, they can be complementary to each other. There is a bright future for integrating ABM with ML/AI for tackling real world challenges.

A key component for the proper functioning, availability, and reliability of power grids is the power trans- former. Although these are very reliable assets, the early detection of incipient degradation mechanisms are very important to prevent failures that may shorten their lifetime. In this work a review and comparative analysis, of classical Machine Learning algorithms (such as single and ensemble classification algorithms) and two automatic machine learning classifiers, are presented for the fault diagnosis of power transformers. The goal is to determine whether fully automated ML approaches are worse or better than traditional ML frameworks that require a human in the loop (such as a data scientist) to identify transformer faults from oil-dissolved gases data. The methodology uses a DB compiled from published and proprietary transformer fault samples. Faults data is obtained from the literature, the Duval pentagon method, and user-expert knowledge. The parameters from, either single or ensemble classifiers, were optimized through standard machine learning procedures. The results showed that the best performing algorithm is a robust automatic machine learning classifiers model followed by classical algorithms such as neural networks and stacking ensembles. These results highlight the ability of a robust automatic machine learning model for, handling imbalanced power transformers faults datasets with high accuracy, using the minimum tuning effort by the electrical experts. By providing the most probable transformer fault condition will reduce the time required to find and solve the fault.

Energy demand forecasting is a fundamental aspect of modern energy management. It impacts resource planning, economic stability, environmental sustainability, and energy security. This importance is making it critical for countries worldwide, particularly in cases like Türkiye, where the energy dependency ratio is notably high. The goal of this study is to propose ensemble machine learning methods such as boosting, bagging, blending, and stacking with hyperparameter tuning and k-fold cross-validation, and investigate the application of these methods for predicting Türkiye's energy demand. This study utilizes population, GDP per capita, imports and exports as input parameters based on historical data from 1979 to 2021 in Türkiye. Eleven combinations of all predictor variables were analyzed, and the best one was selected. It was observed that a very high correlation exists among population, GDP, imports, exports, and energy demand. In the first phase, the preliminary performance was investigated of 19 different machine learning algorithms using 5-fold cross-validation and measured their performance using five different metrics: MSE, RMSE, MAE, R-squared, and MAPE. Secondly, ensemble models were constructed by utilizing individual machine learning algorithms, and the performance of these ensemble models was compared with both each other and the best-performing individual machine learning algorithm. The analysis of the results revealed that placing Ridge as the meta-learner and using ET, RF and Ridge as the base learners in the stacking ensemble model produced superior results compared to the other models across performance metrics. It is anticipated that the findings of this research can be applied globally and prove valuable for energy policy planning in any country. The results obtained not only highlight the accuracy and effectiveness of our predictive model but also underscore the broader implications of this study within the framework of the United Nations' Sustainable Development Goals (SDGs).

Long noncoding RNA (lncRNA) are implicated in various genetic diseases and cancer, attributed to their critical role in gene regulation. RNA sequencing is used to capture their transcripts from certain cell types or conditions. For some studies, lncRNA interactions with other biomolecules have also been captured, which can give clues to their mechanisms of action. Complementary \textit{in silico} methods have been proposed to predict non-coding nature of transcripts and to analyze available RNA interaction data. Here we provide a critical review of such methods and identify associated challenges. Broadly, these can be categorized as reference-based and reference-free or \textit{ab initio}, with the former category of methods requiring a comprehensive annotated reference. The \textit{ab initio} methods can make use of machine learning classifiers that are trained on features extracted from sequences, making them suitable to predict novel transcripts, especially in non-model species. Machine learning approaches such as Logistic Regression, Support Vector Machines, Random Forest, and Deep Learning are commonly used. Initial approaches relied on basic sequential features to train the model, whereas the use of secondary structural features appears to be a promising approach for functional annotation. However, adding secondary features will result in model complexities, thus demanding an algorithm that can handle it and furthermore, considerably increasing the utilization of computation resources. Computational strategies combining identification and functional annotation which can be easily customized are currently lacking. These can be of immense value to accelerate research in this class of RNAs.

This paper addresses the development of knowledge and assessment-centered learning approaches within a reflective learning framework in a first year physics class in a university faculty. The quality of students’ reflections was scored using a Self-reporting Reflective Learning Appraisal Questionnaire at the end of each learning approach. The results showed the differences between the approaches based on reflections on the learning control through self-knowledge, by connecting experience and knowledge, as well as through self-reflection and self-regulation. Assessment-centered activities fundamentally help students identify aspects of their attitudes towards, as well as regulate, their sustainability learning education.

The microbiome, by virtue of its interactions with the host, is implicated in various host functions including its influence on inflammation, nutrition, and homeostasis. Although driven by a complex combination of intrinsic and extrinsic factors, many chronic diseases such as diabetes, cancer, Inflammatory Bowel Disease among others are characterized by a disruption of microbial communities in at least one biological niche/organ system. Various molecular mechanisms between microbial and host components such as proteins, RNAs, metabolites etc have recently been elucidated, thus filling many gaps in our understanding of how the microbiome modulates host processes. Concurrently, high throughput technologies have enabled the profiling of heterogeneous datasets capturing community level changes in the microbiome as well as the host responses. However, due to pragmatic limitations with respect to parallel sampling and analytical procedures, big gaps still exist in terms of how the microbiome mechanistically influences host functions at a systems and community level. In the past decade, various computational biology and machine learning methodologies and approaches have been developed with an aim to fill these existing gaps. Due to the agnostic nature of the tools, they have been applied in various disease contexts to analyze and infer the interactions between the microbiome and host molecular components, and in the case of a few selected tools, on downstream host processes. Generally, most of the tools are enabled by frameworks to statistically or mechanistically integrate different types of -omic and meta -omic datasets followed by functional/biological interpretation. In this review, we provide an overview of the landscape of computational approaches for investigating mechanistic microbiome-host interactions and their potential benefit for basic and clinical research. These could include but are not limited to the development of activity and mechanism based biomarkers, uncovering mechanisms for therapeutic interventions and generating integrated signatures to stratify patients.

The sense of uncertainty and fragility due to the effects and magnitude of global challenges we are facing (from pandemic circumstances to climate change impacts) requires – much more than in the past – the capacity to generate a visionary and forefront design approach in the young gen-erations aiming at stimulating their reaction attitude rather than providing consolidated tools from past conditions that no longer exist or will rapidly evolve. Within this general framework, we have investigated the effectiveness and impacts of experienced-based methods of learning and innovative educational tools in architecture aimed at shaping expertise in which the environ-mental dimension and the climate-change challenge dialogues with the context's complexity in terms of socio-cultural dynamics, real potentialities and constrains, addressing their transdisci-plinary trajectories. The paper analyses 5 international pioneering teaching experiences that provide the opportunity to understand the outcomes of collaborative and experiential learning processes in which the educational activities leverage a dialogue between diverse communities (academia-citizens-policymakers-practitioners). The study outcomes show that shifting the pedagogical paradigm towards in-field-experience-based models can improve the awareness of future practitioners for climate implications of architectural design, implement their analysis and project skills while triggering processes of knowledge transfer and co-production at community level, and allow them to better address the societal and cultural issues involved within decision making.

This article presents a low-cost insurance system developed for small-hold farms in disaster-prone regions, primarily using free Earth Observation (EO) data and Free Open Source Software (FOSS) – collectively termed sustainable geoinformatics - with a proprietary mobile phone app that enables verification. The study examined 30 farms in Risaralda department, Colombia. A Digital Elevation Model (12.5m pixels) from the ALOS PALSAR satellite sensor was used with a Geographical Information System (GIS) to map the terrain, drainage and geohazards of each farming district. Google Earth Engine (GEE) was used to carry out Time Series Analysis of 15 EO and weather datasets for 1998 to 2020. This analysis enabled the levels of risk from hydrometeorological hazards to be determined for each farm of the study, providing key data for the setting of insurance premiums. A parametric insurance product was piloted using GPS-tagged, time-stamped mobile phone photos to verify crop health. Key features of this insurance system are its low operational cost and rapid damage verification, relative to conventional approaches to farm insurance. It is an affordable form of insurance for small-scale farmers, with the rapid verification and payment of claims. This relatively fast, low-cost and affordable approach to insurance for small-scale farming enhances sustainable development by enabling policy-holder farmers to recover more quickly from disasters.

The spread of high-performance personal computers, frequently equipped with powerful Graphic Processing Units (GPU), raised the interest on a set of techniques able to extract models of electromagnetic phenomena (and devices) directly from available examples of the desired behavior. Such approaches are collectively referred to as Machine Learning (ML). A typical representative ML approach is the so called “Neural Network” (NN). Using such data-driven models allows evaluating the output in a much shorter time when a theoretical model is available, or allows predicting the behavior of the systems and devices when no theoretical model is available. With reference to a simple yet representative benchmark electromagnetic problem, some of the possibilities and the pitfalls of the use of NN for the interpretation of measurements (inverse problem) or to obtain the required measurements (optimal design problem) are discussed. The investigated aspects include the choice of the NN model; the generation of the dataset(s); the selection of hyperparameters (hidden layers, training paradigm). Finally, the capabilities in the handling of ill-posed problems are critically revised.

Malware detection is a crucial pillar of cybersecurity and aims to identify and neutralize malware threats. This study investigates how three deep learning algorithms - Convolutional Neural Net-works with One-Dimensional Architecture (CNN1D), Neural Networks (NN), and a hybrid model of one dimensional convolutional neural networks (CNN1D) and Long Short-Term Memory (LSTM) - help detect malware in Portable Executable working (.exe) files. Using a large dataset of tagged malware and benign samples, the effectiveness of these algorithms in distinguishing dangerous from harmless executables is extensively tested. In addition, the study evaluates the computational efficiency of the proposed methods for a variety of hardware configurations, including Central Processing Units (CPU), Graphics Processing Units (GPU), Raspberry Pi (IoT device), and Tensor Processing Units (TPU). Performance metrics provide insight into the scalability and effectiveness of the model across different hardware configurations. The results of this study have significant impact on the development of malware detection, particularly in the context of IoT security. By demonstrating the capabilities and limitations of CNN1D, Neural Networks, and CNN1D with LSTM models, the study provides practitioners with efficient and scalable solutions to real-world malware detection difficulties. In addition, insights from performance tests on various hardware platforms provide important assistance in developing robust security measures in IoT contexts, strengthening cybersecurity defenses in an ever-changing digital landscape.

Oral drug absorption is the primary route for drug administration. However, this process hinges on multiple factors, including the drug’s physicochemical properties, formulation characteristics, and gastrointestinal physiology. Given its intricacy and the exorbitant costs associated with experimentation, the trial-and-error method proves prohibitively expensive. Theoretical models have emerged as a cost-effective alternative by assimilating data from diverse experiments and theoretical considerations. These models fall into three categories: data-driven models, encompassing classical pharmacokinetics, quantitative-structure models (QSAR), and machine/deep learning. Mechanism-based models include quasi-equilibrium, steady-state, and physiologically based pharmacokinetics, alongside first principles such as molecular dynamics and continuum models. This review provides an overview of recent modeling endeavors across these categories, evaluating their respective advantages and limitations. Additionally, a primer on partial differential equations and their numerical solutions is included in the supplementary materials, recognizing their utility in modeling physiological systems despite their mathematical complexity limiting their widespread application in this field.

Early diagnosis, prioritization, screening, clustering and tracking of COVID-19 patients, and production of drugs and vaccines are some of the applications that have made it necessary to use a new style of technology to involve, to manage and deal with this epidemic. Strategies backed by artificial intelligence (AI) and the Internet of Things (IoT) have been undeniable to understand how the virus works and try to prevent it from spreading. Accordingly, the main aim of this survey article is to highlight the methods of ML, IoT and the integration of IoT and ML-based techniques in the applications related to COVID-19 from the diagnosis of the disease to the prediction of its outbreak. According to the main findings, IoT provided a prompt and efficient approach of following the disease spread. Most of the studies developed by ML-based techniques for handling COVID-19 based dataset provided performance criteria. The most popular performance criteria, is related to accuracy factor. It can be employed for comparing the ML-based methods with different datasets. According to the results, CNN with SVM classifier, Genetic CNN and pre-trained CNN followed by ResNet, provided highest accuracy values. On the other hand, the lowest accuracy was related to single CNN followed by XGboost and KNN methods.

Recent studies have shown correlations between the microbiota's composition and various health conditions. Machine learning (ML) techniques are essential for analyzing complex biological data, particularly in microbiome research. ML methods help analyze large datasets to uncover microbiota patterns and understand how these patterns affect human health. This study introduces a novel approach combining statistical physics with the Monte Carlo (MC) methods to characterize bacterial species in the human microbiota. We assess the significance of bacterial species in different age groups by using notions of statistical distances to evaluate species prevalence and abundance across age groups and employing MC simulations based on statistical mechanics principles. Our findings show that the microbiota composition experiences a significant transition from early childhood to adulthood. Species such as Bifidobacterium breve and Veillonella parvula decrease with age, while others like Agathobaculum butyriciproducens and Eubacterium rectale increase. Additionally, low-prevalence species may hold significant importance in characterizing age groups. Finally, we propose an overall species ranking by integrating the methods proposed here in a multicriteria classification strategy. Our research provides a comprehensive tool for microbiota analysis using statistical notions, ML techniques, and MC simulations.

N-shot learning has emerge in recent year as potential learning approach to solve the problem of data scarcity by learning underlying pattern from a few training sample. Despite recent state-of-the-art research on model-agnostic metal learning, transfer learning, and optimization strategy to rapidly learn valid information from few sample, there remains a big challenge on an actual out-of-distribution zero-day without any similarity to previously known malware family or new variant of an existing malware family. This ultimately questions the effectiveness of current state-of-the-art few-shot learning approach. In this research, we did an in-depth investigation into the performance of state-of-the-art Zero-shot, Single-shot, and few-shot learning approaches on zero-day out-of-distribution malware attack detection based on their static properties using Malimg and Malevis malware dataset. We ensure our model was aware of an out-of-distribution class during training while varying the number of samples in the out-of-distribution class accordingly zero-shot(no sample), single-shot (1 sample), few-shot(5 samples) while using confusion matrix to get the actual number of correct prediction on out-of-distribution malware validation samples. we assert that the model should be smart enough to detect and classify previously unseen data into an empty family as an out-of-distribution considering that the model was made to be aware of the existence of such distribution during training. Result shows 0, 0, and 3 correct out-of-distribution predictions on Zero-shot, single-shot, and few-shot experiments respectively, thereby showing limitation of the current state-of-the-art N-shot approaches on out-of-distribution attack.

Background: Over the past few years there has been immense evolution in various areas particularly in the areas of digital technologies wherein the pace of change is very high. Industrial areas such as operations and supply chain management together with advanced technologies such as machine learning, big data analytics, artificial intelligence, as well as the Internet of Things, create completely different forms of operational models for various industries. In the area of healthcare too, these emerging computational sophistication is introduced to revolutionise the approaches to prevent, diagnose and treat diverse diseases and illnesses. Objective: The objective of this study is to provide an extensive review of the contemporary approaches utilizing data to cope with significant mental disorders. From over 60 relevant scholarly articles published between 2011 and 2023, it discusses how tools such as predictive modelling, social media analysis, data from smartphones, and chatbots help with issues such as early detection, telemonitoring, provision of psychological support, and individualised prevention. Method: An initial literature review to analyse over 60 research articles, which include empirical studies that were conducted between 2011 and 2023. The research assessed implemented novel digital approaches to mental health interventions including big data analytics for predicting condition status, machine learning for examining social media content, behaviour monitoring through smartphone sensors, and using conversational agents or chatbots. The following is an overview of general conclusions from experimental and descriptive secondary research studies published in professional outlets concerning possible advantages and disadvantages of data science applied to important concerns in mental health. Results: Research reveals that integrating subtle e-health tools in tandem with typical treatment approaches holds the potential to expand mental health services to more or less integrate them into clients’ day-to-day lives, and practically individualize effective treatments accordingly. Technological solutions for instance allow remote risk assessment, symptom monitoring and determination of treatment compliance. New lines of virtualized paradigm solve social challenges that interfere with the conventional provision and consumption of care. However, questions of privacy and the long-term effects as well as clinical adoption are yet to be solved in a analytically distinct manner.

Skin cancer is an exquisite disease globally nowadays. Because of the poor contrast and apparent resemblance between skin and lesions, automatic identification of skin cancer is complicated. The rate of human death can be massively reduced if melanoma skin cancer can be detected quickly using dermoscopy images. In this research, an anisotropic diffusion filtering method is used on dermoscopy images to remove multiplicative speckle noise and the fast-bounding box (FBB) method is applied to segment the skin cancer region. Furthermore, the paper consists of two feature extractor parts. One of the two features extractor parts is the hybrid feature extractor (HFE) part and another is the convolutional neural network VGG19 based CNN feature extractor part. The HFE portion combines three feature extraction approaches into a single fused feature vector: Histogram-Oriented Gradient (HOG), Local Binary Pattern (LBP), and Speed Up Robust Feature (SURF). The CNN method also is used to extract additional features from test and training datasets. This two-feature vector is fused to design the classification model. This classifier performs the classification of dermoscopy images whether it is melanoma or non-melanoma skin cancer. The proposed methodology is performed on two ordinary datasets and achieved the accuracy 99.85%, sensitivity 91.65%, and specificity 95.70%, which makes it more successful than previous machine learning algorithms.

In the last few decades, glaucoma became the second biggest leading cause of irreversible vision loss. Because of its asymptotic growth, it is not properly diagnosed until the relatively late stage. To stop the severe damage by glaucoma it is needed to detect glaucoma in its early stages. Surprisingly diabetes also be the greatest cause of glaucoma. In the modern era, artificial intelligence makes great progress in the medical image processing field. Image analysis based on machine learning gives a huge success in diagnosis glaucoma without any misdiagnosis. The aim of this proposed paper is to create an automated process that can detect glaucoma and diabetic retinopathy. Here various Machine Learning models are used and results of these methods are presented.

3D human pose estimation has made significant advancements through the integration of deep learning techniques. This survey provides a comprehensive review of recent 3D human pose estimation methods, with a focus on monocular images, videos, and multi-view cameras. Our approach stands out through a systematic literature review methodology, ensuring an up-to-date and meticulous overview. Unlike many existing surveys that categorize approaches based on learning paradigms, our survey offers a fresh perspective, delving deeper into the subject. For image-based approaches, we not only follow existing categorizations but also introduce and compare significant 2D models. Additionally, we provide a comparative analysis of these methods, enhancing the understanding of image-based pose estimation techniques. In the realm of video-based approaches, we categorize them based on the types of models used to capture inter-frame information. Furthermore, in the context of multi-person pose estimation, our survey uniquely differentiates between approaches focusing on relative poses and those addressing absolute poses. Our survey aims to serve as a pivotal resource for researchers, highlighting state-of-the-art deep learning strategies and identifying promising directions for future exploration in 3D human pose estimation.

Auxins are chemical compounds of wide interest, mostly due to their role in plant metabolism and development. Since the latter half of the XX century, synthetic auxins have been used as herbicides, presenting notable advantages, such as low toxicity in humans. As of today, extensive descriptions of syntetic and natural auxins have been made; yet studies centered on the molecular recognition process of auxins are scarce. Herein, we present a comprehensive in silico characterization of auxin receptor TIR1, using structure based methods to aid de novo design of putative ligands. In addition, we conducted binding site characterization using cosolvent molecular dynamics and enhanced sampling simulations with reference ligands. We also present a database of putative auxins and decoy compounds which can aid further studies focusing on synthetic auxin design. To the best of our knowledge, this study is the first of its kind focusing on TIR1.

One of the most prevalent brain diseases, epilepsy is characterized by recurring seizures that happen quite frequently. During seizures, a patient suffers uncontrollable muscle contractions that cause loss of motion and balance, which could lead to harm or even death. Establishing an automatic method for warning patients about impending seizures requires extensive research. It is possible to anticipate seizures by analyzing the Electroencephalogram (EEG) signal from the scalp region of the human brain. Time domain-based features such as Hurst exponent (Hur), Tsallis Entropy (TsEn), improved permutation entropy (impe), and amplitude-aware permutation entropy (AAPE) were extracted from EEG signals. In order to diagnose epileptic seizure children from normal children automatically, this study conducted two sessions, in the first session, the extracted features from the EEG dataset were classified using three machine learning (ML)-based models including support vector machine (SVM), K nearest neighbor (KNN), or decision tree (DT), while in the second session, the dataset was classified using three deep learning (DL)-based recurrent neural network (RNN) classifiers including a gated recurrent unit (GRU), long short-term memory (LSTM), and bidirectional (BiLSTM). The EEG dataset obtained from the Neurology Clinic at the Ibn-Rushd Training Hospital. In this regard, detailed explanations and research from the time domain and entropy characteristics show that using GRU, LSTM, and BiLSTM RNN deep learning classifiers on the All−time−entropy fusion feature improves the final classification results.

Stroke constitutes a significant public health concern due to its impact on mortality and morbidity. This study investigates the utility of machine learning algorithms in predicting stroke and identifying key risk factors using data from the Suita study, comprising 7,389 participants and 53 variables. Initially, unsupervised K-prototype clustering categorized participants into risk clusters, while five supervised models including Logistic Regression (LR), Random Forest (RF), Support Vector Machine (SVM), eXtreme Gradient Boosting (XGBoost), and Light Gradient Boosted Machine (Light-GBM) were employed to predict stroke outcomes. Stroke incidence disparities among identified risk clusters using the unsupervised K-prototype clustering method are substantial, according to the findings. Supervised learning, particularly RF was a preferable option because of the higher levels of performance metrics. The Shapley Additive Explanations (SHAP) method identified age, systolic blood pressure, hypertension, estimated glomerular filtration rate, metabolic syndrome, and blood glucose level as key predictors of stroke, aligning with findings from the unsupervised clustering approach in high-risk groups. Additionally, previously unidentified risk factors such as elbow joint thickness, fructosamine, hemoglobin, and calcium level demonstrate potential for stroke prediction. In conclusion, machine learning facilitated accurate stroke risk predictions and highlighted potential biomarkers, offering a data-driven framework for risk assessment and biomarker discovery.

Tight gas, a category of Deep Green Energy Resources, rely on advanced intelligent monitoring methods for their extraction. Conventional logging for reservoir evaluation relies on logging data and the manual setting of evaluation criteria to classify reservoirs. However, the complexity and heterogeneity of tight reservoirs pose challenges in accurately identifying target layers by using traditional well-logging techniques. Machine learning may hold the key to solving this problem, as it enables computers to learn without being explicitly programmed and manually added rules. Therefore, it is possible to make reservoir evaluation via using machine learning methods. In this paper, the reservoir quality index (RQI) and porous geometric parameters obtained from the optimized inversion of the spherical-tubular model are adopted to evaluate the reservoir. Then, three different machine learning approaches, the random forest (RF) algorithm, support vector machine (SVM) algorithm, and extreme gradient boosting (XGB) algorithm, are utilized for reservoir classification. The selected dataset covers more than 7,000 samples from five wells. The data from four wells are arranged as the training dataset, and the data of the remaining one well is designed as the testing dataset to calculate the prediction accuracies of different machine learning algorithms. Among them, accuracies of RF, SVM, and XGB are all higher than 90%, and XGB owns the highest result by reaching 97%. Machine learning based approaches can greatly assist reservoir prediction by implementing the well-logging data. The research highlights the application of reservoir classification with a higher prediction accuracy by combining machine learning algorithms with NMR logging based pore structure characterization, which can provide a guideline for sweet spot identification within the tight formation. This not only optimizes resource extraction but also aligns with the global shift towards clean and renewable energy sources, promoting sustainability and reducing the carbon footprint associated with conventional energy production. In summary, the fusion of machine learning and NMR logging based reservoir evaluation plays a crucial role in advancing both energy efficiency and the transition to cleaner energy sources.

Cancer metastasis accounts for approximately 90% of cancer deaths, and elucidating markers in metastasis is the first step in its prevention. To characterize metastasis marker genes of breast cancer (MGs), XGBoost models that classify metastasis status were trained with gene expression profiles from TCGA. Then, a metastasis score (MS) was assigned to each gene by calculating the inner product between the feature importance and AUC performance of the models. As a result, the 54, 202, and 357 genes with the highest MS were characterized as MGs by empirical P-value cutoffs of 0.001, 0.005, and 0.01, respectively. The three sets of MGs were compared with those from existing metastasis marker databases, which provided significant results in most comparisons. We noticed that the set of MGs with the median EP cutoff showed better performance than the other two sets, suggesting the importance of the cutoff used in determining MGs. They were also significantly enriched in biological processes associated to breast cancer metastasis. The MGs that could not be identified by statistical analysis (e.g., GOLM1, ELAVL1, UBP1, and AZGP1) as well as the MGs with the highest MS (e.g., ZNF676, FAM163B, LDOC2, IRF1, and STK40) were verified via the literature. Additionally, we checked how close the MGs are located to each other in the protein–protein interaction networks. We expect that the characterized markers will help understand and prevent breast cancer metastasis.

Microgrids are becoming popular nowadays because they provide clean, efficient, and low-cost energy. To use the stored energy in times of emergency or peak loads, microgrids require bulk storage capacity. Since microgrids are the future of renewable energy, the energy storage technology employed should be optimized to generate electricity. Batteries play a variety of essential roles in daily life and are used at peak hours and during a time of emergency. There are different types of batteries i.e., lion batteries, lead-acid batteries, etc. Optimal battery sizing of microgrids is a challenging problem, that limits modern technologies such as electric vehicles, etc. It is important to know different battery features such as battery life, battery throughput, and battery autonomy to get optimal battery sizing for microgrids. Mixed-integer linear programming (MILP) is an established technique for the integration and optimization of different energy sources and parameters for optimal battery sizing. A new MILP based dataset is introduced in this work. Support vector machine (SVM) is the machine learning application used to estimate the optimum battery size. The impact of feature selection algorithms on the proposed machine learning-based model is evaluated. The performance of the six best-performing feature selection algorithms is analyzed. The experimental results show that the feature selection algorithms improve the performance of the proposed methodology. Ranker search shows the best performance with a Spearman’s rank-ordered correlation constant of 0.9756, linear correlation constant of 0.9452, Kendall correlation constant of 0.8488 and root mean squared error of 0.0525.

The recent rise of deep learning (DL) and its promising capabilities in capturing non-explicit detail from large datasets have attracted substantial research attention in the field of medical image processing. DL provides ground for technology development for computer-aided diagnosis and segmentation in radiology and radiation oncology. Amongst the anatomical locations where recent auto-segmentation algorithms have been employed, the pelvis remains one of the most challenging due to large intra- and inter-patient soft-tissue variabilities. This review provides a comprehensive and clinically-oriented overview of DL-based segmentation studies for bladder, prostate, cervical and rectal cancers, highlighting the key findings, challenges and limitations.

Background: This study focuses on different manual handling methods and their effect on psychomotor skills concerning physical measurements (height, weight, age) and pinch strength. Objective: To assess the effects of three manual handling techniques on psychomotor skills and to establish the prediction of pinch strength by physical measurements. Methods: Three manual handling methods were tested: handling with a 90-degree elbow angle, handling with one hand, and handling with both hands. Psychomotor skills were quantified through handgrip strength, dexterity tests, and perceived exertion scales. Linear and random forest regression models were used to predict pinch strength from physical measurements. Results: Handling with a 90-degree elbow angle significantly increased perceived exertion and error rates while decreasing post-task handgrip strength. The one-hand method showed the least negative effect on psychomotor abilities. Weight emerged as the most influential predictor of pinch strength, followed by height and age. The random forest regression model outperformed the linear regression model, indicating its suitability for capturing complex non-linear relationships among variables. The Random Forest Regression model excelled in predicting weight with a high R² score of 0.78, showing strong predictive power. It was moderately effective for height with an R² score of 0.42. However, it performed poorly for age prediction, with an R² score of 0.01, indicating ineffective features for predicting age. Conclusion: The results emphasize the importance of ergonomic interventions and training programs to optimize manual handling practices, aiming to reduce physical strain and enhance worker productivity and safety. Maintaining muscle strength is crucial in older age groups due to the decline in pinch strength with age. These findings can inform intervention studies and the modification of occupational health and safety practices. Future research should aim to validate these results across diverse populations and explore additional factors influencing handgrip strength.

: Cybersecurity has become a critical area in the digital field in recent years. The expansion of networks has revolutionised the way network structures are organised and managed. However, with increased connectivity and the growing complexity of modern networks, the threat of cyber-attacks has become more intense. As technology continues to advance, it brings both opportunities and challenges. One of the major challenges is the need to secure networks and sensitive data from various malicious activities. Traditional networks have evolved to include Software Defined Network (SDN), which offers a more flexible and programmable framework. Researchers should focus on detecting attacks in SDN because SDN networks are becoming more popular and attractive targets for clients due to their programmability and dynamic nature. The centralised controller, known as the backbone of an SDN, becomes a single point of failure and a potential target for attackers if not properly secured. Researchers need to emphasise the detection of attacks in SDN in order to mitigate these risks. By understanding the potential vulnerabilities and attack methods specific to SDN, researchers can develop effective detection approaches and propose countermeasures. This methodology helps protect the network from potential threats and minimises the impact of successful attacks. Therefore, this survey paper provides a review of Intrusion Detection Systems (IDSs) in Software-Defined Networks (SDN) to provide a thorough understanding of SDN security issues.

This paper investigates the applicability of deep learning models for predicting the severity of forest wildfires, utilizing an innovative benchmark dataset called EO4WildFires. EO4WildFires integrates multispectral imagery from Sentinel-2, SAR data from Sentinel-1 and meteorological data from NASA Power annotated with EFFIS data for forest fire detection and size estimation. Resulting in a coverage of 45 countries (Figure \ref{Figure1-events}) with a total of 31730 wildfire events from 2018 to 2022. All these various sources of data are archived into data cubes, with the intention of assessing wildfire severity by considering both current and historical forest conditions, utilizing a broad range of data including temperature, precipitation, and soil moisture. The experimental setup has been arranged to test different deep learning architectures’ effectiveness in predicting the size and shape of wildfire burned areas. The study incorporates both Image Segmentation networks and Visual Transformers, employing a consistent experimental design across various models to ensure comparability of results. Adjustments were made to the training data, such as the exclusion of empty labels and very small events, to refine the focus on more significant wildfire events and potentially improve prediction accuracy. The models’ performance was evaluated using metrics like F1 Score, IoU Score, and Average Percentage Difference (aPD). These metrics offer a multi-faceted view of model performance, assessing aspects such as precision, sensitivity, and the accuracy of the burned area estimation. Through extensive testing with Image Segmentation networks and Visual Transformers, the research not only aims at enhancing the accuracy of estimating the burned area but also underscores the significance of quality training data and the comparative effectiveness of traditional segmentation methods over transformer-based models for this specific application. The dataset is published with an Open Access license and is hosted at: \url{10.5281/zenodo.7762564}.

Since the Sustainable Development Goals (SDGs) came into effect, both UNESCO and other international organisations recommend empowering youth to implement the SDGs in universities. Getting started with the SDGs at university level is of special relevance in pre-service teacher training since future teachers are powerful agents of change in the lives of young people. Future teachers need to acquire competencies in sustainability to be able to promote meaningful changes in sustainable behaviour. To that end, holistic approaches to facilitate their acquirement need to be developed. The aim of this study is to explore which teaching methodologies are suitable for the development of competencies in sustainability in Higher Education (HE) and how to empower students to take a leading role in implementing the SDGs in universities. The participants in the study are a group of 23 students in pre-service teacher training. The experimental educational model used for the development of sustainable competencies consists of a methodological sequence of Project-Oriented Learning (POL) and a Cross-disciplinary Workshop on Sustainable Food. This study provides evidence that a holistic approach is appropriate for developing sustainable competencies and contributes to empowering students to implement SDG 12 at their university.

We have proposed a data-driven approach for designing mesoscale porous structures of Li-ion battery electrode with three-dimensional virtual structures and machine learning techniques. Over 2,000 artificial 3D structures assuming positive electrode composed of random packed spheres as active material particles are generated, and charge/discharge resistance has been evaluated using simplified Physico-chemical model. In this model, resistance from Li diffusion in active material particles (diffusion resistance), transfer resistance of Li+ in electrolyte (electrolyte resistance) and reaction resistance on the interface between active material and electrolyte are simulated based on mass balance of Li, Ohm’s law in and linearized Butler-Volmer equation, respectively. Using these simulation results, regression models via Artificial Neural Network (ANN) have been created in order to predict charge/discharge resistance from porous structure features. In this study, porosity, active material particle size and volume fraction, pressure in the compaction process, electrolyte conductivity, and binder volume fraction are adopted as features, associated with controllable process parameters for manufacturing battery electrode. As results, the predicted electrode resistance by ANN regression model is good agreement with the simulated values. Furthermore, sensitivity analysis and optimization of the process parameters have been carried out. The proposed data-driven approach could be a solution as a guiding principle for manufacturing battery electrode.

COVID-19 vaccine hesitancy is considered responsible for the lower rate of acceptance of vaccines in many parts of the world. However, sources of this hesitancy are rooted in many social, political, and economic factors. This paper strives to find the most important variables in predicting the COVID-19 vaccination uptake. We introduce an explainable machine learning (ML) framework to understand the COVID-19 vaccination uptake around the world. To predict vaccination uptake, we have trained a random forest (RF) regression model using a number of sociodemographic and socioeconomic data. The traditional decision tree (DT) regression model is also implemented as the baseline model. We found that the RF model performed better than the DT model since RF is more robust to handle nonlinearity and multi-collinearity. Also, we have presented feature importance based on impurity measure, permutation, and Shapley values to provide the most significant unbiased features. It is found that electrification coverage and Gross Domestic Product are the strongest predictors for higher vaccination uptake, whereas the Fragile state index (FI) contributed to lower vaccination uptake. These findings suggest addressing issues that are found responsible for lower vaccination uptake to combat any future public health crisis.

The valorization and dissolution of lignin using ionic liquids (ILs) is critical for developing sustainable biorefineries and a circular bioeconomy. This review aims to critically assess the current state of computational and machine learning methods for understanding and optimizing IL-based lignin dissolution and valorization processes reported since 2022. The paper examines various computational approaches, from quantum chemistry to machine learning, highlighting their strengths, limitations, and recent advances in predicting and optimizing lignin-IL interactions. Key themes include the challenges in accurately modeling lignin’s complex structure, the development of efficient screening methodologies for ionic liquids to enhance lignin dissolution and valorization processes, and the integration of machine learning with quantum calculations. These computational advances will drive progress in IL-based lignin valorization by providing deeper molecular-level insights and facilitating the rapid screening of novel IL-lignin systems.

To secure computers and information systems from attackers taking advantage of vulnerabilities in the system to commit cybercrime, several methods have been proposed for real-time detection of vulnerabilities to improve security around information systems. Of all the proposed methods, machine learning had been the most effective method in securing a system with capabilities ranging from early detection of software vulnerabilities to real-time detection of ongoing compromise in a system. As there are different types of cyberattacks, each of the existing state-of-the-art machine learning models depends on different algorithms for training which also impact their suitability for detection of a particular type of cyberattack. In this research, we analyzed each of the current state-of-theart machine learning models for different types of cyberattack detection from the past 10 years with a major emphasis on the most recent works for comparative study to identify the knowledge gap where work is still needed to be done with regard to detection of each category of cyberattack

Defects in pre-mRNA splicing are frequently a cause of Mendelian disease. Despite the advent of next-generation sequencing, allowing a deeper insight into a patient’s variant landscape, the ability to characterize variants causing splicing defects has not progressed with the same speed. To address this, recent years have seen a sharp spike in the number of splice prediction tools leveraging machine learning approaches, leaving clinical geneticists with a plethora of choices for in silico analysis. In this Review, some basic principles of machine learning are introduced in the context of genomics and splicing analysis. A critical comparative approach is then used to describe seven recent machine learning-based splice prediction tools, revealing highly diverse approaches and common caveats. We find that, although great progress has been made in producing specific and sensitive tools, there is still much scope for personalized approaches to prediction of variant impact on splicing. Such approaches may increase diagnostic yields and underpin improvements to patient care.

Recently, interest in STEM education has grown among researchers and educators, also considering the skills required to address the challenges of the 21st century. Supporting learning in STEM subjects is an open challenge, especially during secondary education, which is reflected in the implementation of innovative pedagogical practices, including approaches focused on Game-Based Learning (GBL). This study analyzed the main issues addressed by research on game-based educational approaches applied to STEM teaching and learning in secondary school and their evolving trends. A text analysis of abstracts published in the past decade was conducted using T-lab software. The “Word Analysis” function was used for preliminary visual mapping; then the “Specificity Analysis” and “Thematic Analysis of Elementary Contexts” functions were applied to explore changes in research directions and to map the themes covered by the most recent studies. The results showed that the implementation of games in STEM disciplines is a promising area of inquiry. A shift in research directions also emerged, currently more focused on studying how GBL can foster engagement and the emotional component of learning. Adapting to rapidly changing technology and integrating essential skills such as coding and computational thinking are additional challenges that the research community is facing.

Learning programming is a complex and challenging task for many students. It in-volves both understanding theoretical concepts and acquiring practical skills. Hence, analyzing learners’ data from online learning environments alone fails to capture the full breadth of stu-dents’ actions if part of their learning process takes place elsewhere. Moreover, existing studies on learning analytics applied to programming education have mainly relied on frequency analysis to classify students according to their approach to programming or to predict academic achieve-ment. However, frequency analysis provides limited insights into the individual time-related characteristics of the learning process. The current study examines students’ strategies when learning programming, combining data from the learning management system and from an au-tomated assessment tool. To gain an in-depth understanding of students’ learning process as well as of the types of learners, we used learning analytics methods that account for the temporal order of learning actions. Our results show that students have special preferences for specific learning resources when learning programming, namely slides that support search, and copy and paste. We also found that videos are relatively less consumed by students, especially while working on programming assignments. Lastly, students resort to course forums to seek help only when they struggle.

Automatic milking systems (AMSs) are among the earliest Precision Livestock Farming developments that have transformed dairy farming worldwide. This review aims to gather, evaluate, and summarize papers that focus on the use of modeling approaches in the context of AMS. We provided a review of 60 articles with a specific focus on cows’ health, production, and behavior/management. The most used modeling approach was Machine Learning (ML, present in 63% of the studies), followed by statistical analysis (14%), fuzzy algorithms (9%), deterministic mod-els (7%), and detection algorithms (7%). Most of the reviewed studies (82%) focused on the detection of cows' health, specifically mastitis, while only 11% were concerned with milk production. Accurate forecasting of dairy cow milk yield and knowledge on the deviation between expected and observed milk yields of individual cows would be beneficial in dairy cow management. Likewise, the study of cows’ behavior and the herd management in AMSs is under-explored (7%). Despite the increasing use of ML techniques in this field there is still a lack of a robust methodology for their application. In particular, we identified a significant gap in the systematic balancing of positive and negative classes for health prediction models.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

Smart home and building systems are popular solution that support maintaining comfort, safety and improving energy efficiency in buildings. However, dynamically developing distributed network technologies, in particular the Internet of Things, are increasingly entering the above-mentioned application areas of building automation, offering new functional possibilities. The result of these processes is the emergence of many different solutions that mix technologies of field-level and ICT networks in various configurations and architectures. New paradigms are also emerging, such as edge and fog computing, providing support for local monitoring and control networks in the implementation of advanced functions and algorithms, including machine learning and artificial intelligence mechanisms. This paper collects state-of-the-art information in these areas, along with a systematic review of the literature, case-studies and an analysis of selected development trends. The author systematized this information in the context of the potential development of building automation systems. Based on the conclusions of this analysis and discussion, a framework for the development of the Generic IoT paradigm in smart home and building applications has been proposed, along with a SWOT analysis of its usability. Future works are proposed as well.

Detailed built-up area information is valuable for mapping complex urban environments. Although a large number of classification algorithms about built-up areas have been developed, they are rarely tested from the perspective of feature engineering and feature learning. Therefore we launched a unique investigation to provide a full test of the OLI imagery for 15-m resolution built-up area classification in 2015, in Beijing, China. Training a classifier requires many sample points, and we propose a method based on the ESA's 38-meter global built-up area data of 2014, Open Street Map and MOD13Q1-NDVI to achieve rapid and automatic generation of a large number of sample points. Our aim is to examine the influence of a single pixel and image patch under traditional feature engineering and modern feature learning strategies. In feature engineering, we consider spectra, shape and texture as the input features, and SVM, random forest (RF) and AdaBoost as the classification algorithms. In feature learning, the convolution neural network (CNN) is used as the classification algorithm. In total, 26 built-up land cover maps were produced. Experimental results show that: (1) the approaches based on feature learning are generally better than those based on feature engineering in terms of classification accuracy, and the performance of ensemble classifiers e.g., RF, is comparable to that of CNN. Two dimensional CNN and the 7 neighborhood RF have the highest classification accuracy of nearly 91%. (2) Overall, the classification effect and accuracy based on image patches are better than those based on single pixels. The features that can highlight the information of the target category (for example, PanTex and EMBI) can help improve classification accuracy.

A low-cost machine learning (ML) algorithm is proposed and discussed for spatial tracking of unknown, correlated signals in localized, ad-hoc wireless sensor networks. Each sensor is modeled as one neuron and a selected subset of these neurons are called to identify the spatial signal. The algorithm is implemented in two phases of spatial modeling and spatial tracking. The spatial signal is modeled using its M iso-contour lines at levels {ℓj}j=1M and those sensors that their sensor observations are in Δ margin of any of these levels report their sensor observations to the fusion center (FC) for spatial signal reconstruction. In spatial modeling phase, the number of these contour lines, their levels and a proper Δ are identified. In this phase, the algorithm may either use adaptive-weight stochastic gradient or scaled stochastic gradient method to select a proper Δ. Additive white Gaussian noise (AWGN) with zero mean is assumed along with the sensor observations. To reduce the observation noise’s effect, each sensor applies moving average filter on its observation to drastically reduce the effect of noise. The modeling performance, the cost and the convergence of the algorithm are discussed based on extensive computer simulations and reasoning. The algorithm is proposed for environmental monitoring. In this paper, the percentage of the communication attempts of wireless sensors is assumed as cost. Performance evaluation results show that the proposed spatial tracking approach is low cost and can model the spatial signal over time with the same performance as that of spatial modeling.

In neuroendocrine neoplasms (NENs), the use of new radiopharmaceuticals has improved the accuracy of diagnosis and staging, refined surveillance approaches, and introduced specific and personalized radiation therapies. Nuclear medicine has therefore acquired a crucial role in the management of NENs patients by improving their risk stratification and personalized therapies. Artificial intelligence (AI) and radiomics can enable physicians to further improve the overall efficiency and accuracy of the use of these tools in both di-agnostic and therapeutic settings by improving the prediction of tumor grade, differential diagnosis from other malignancies, assessment of tumor behavior and aggressiveness, and prediction of treatment response. This systematic review aims to describe the state-of-the-art on AI and radiomics applications in molecular imaging of NENs.

Buildings are rapidly becoming more digitized, to a large extent due to developments in IoT. This will provide many opportunities but also a number of challenges. One of the central challenges in the process of digitizing buildings is the ability to monitor the building’s status effectively. This monitoring is essential for various services that rely on information about the presence and activities of individuals within different areas of the building. Occupancy information, including people counting, occupancy detection, location tracking, and activity detection, plays a vital role in the management of smart buildings. In this article, our primary focus is on the use of Passive Infrared (PIR) sensors for gathering occupancy information. PIR sensors are among the most widely used sensors for this purpose due to their consideration of privacy concerns, cost-effectiveness, and low processing complexity compared to many others. Despite numerous literature review articles in the field of occupancy information, there currently isn’t a specialized literature review dedicated to occupancy information derived specifically from PIR sensors.Therefore, this study analyzes articles that specifically explore the application of PIR sensors for occupancy information. This article provides a comprehensive literature review of PIR sensor technology from 2015 to 2023, with a focus on applications in people counting, activity detection, and localization (traking and location). It consolidates findings from a number of articles that have explored and enhanced the capabilities of PIR sensors in these interconnected domains. This review thoroughly examines the application of various techniques, machine learning algorithms, and configurations for PIR sensors in indoor building environments, emphasizing not only the data processing aspects but also their advantages, limitations, and efficacy in producing accurate occupancy information.These developments are crucial for improving building management systems in terms of energy efficiency, security, and user comfort, among other operational aspects.These developments are crucial for improving building management systems in terms of energy efficiency, security, and user comfort, among other operational aspects. The paper seeks to offer a thorough analysis of the present state and potential future advancements of PIR sensor technology in efficiently monitoring and understanding occupancy information by classifying and analyzing improvements in these domains.

Rift Valley Fever (RVF), is a viral zoonotic disease predominant in East Africa and transmitted by Aedes mosquitoes carrying the virus. Using the systematic literature review approach, the present study evaluated machine learning techniques and time series approaches to find literature on the impact of climatic changes on RVF outbreaks published between 1930 and 2024. The literature search involved databases including PubMed, PLOS ONE, JSTOR, Web of Science, Google Scholar, and SCOPUS (Kenmoe et al., 2023).The results show that most of the articles were published between 2018 and 2022, and most of the articles were from United States, France, and Kenya. We conducted a detailed review of the articles using the PRISMA 2020 flow chart, screening and qualifying 10,015 articles. Some articles revealed significant gaps in both internal and external validation. Therefore, future research should focus on developing multi-disciplinary models that incorporate climatic condition, geographical, biological, and social factors.

This study aims to provide analyses of the levels of airborne particulate matter (PM) using a two-pronged approach that combines data from in situ Internet of Things (IoT) sensor networks with remotely sensed aerosol optical depth (AOD). Our approach involved setting up a network of custom-designed PM sensors that could be powered by the electrical grid or solar panels. These sensors were strategically placed throughout densely populated areas of North Texas to collect data on PM levels, weather conditions, and other gases from September 2021 to June 2023. The collected data was then used to create models that predict PM concentrations in different size categories, demonstrating high accuracy with correlation coefficients greater than 0.9. This highlights the importance of collecting hyperlocal data with precise geographic and temporal alignment for PM analysis. Furthermore, we expanded our analysis to a national scale by developing machine learning models that estimate hourly PM2.5 levels throughout the continental United States. These models used high-resolution data from the Geostationary Operational Environmental Satellites (GOES-16) Aerosol Optical Depth (AOD) dataset, along with meteorological data from the European Center for Medium-Range Weather Forecasting (ECMWF), AOD reanalysis, and air pollutant information from the MERRA-2 database, covering the period from January 2020 to June 2023. Our models were refined using ground truth data from our IoT sensor network, the OpenAQ network, and the National Environmental Protection Agency (EPA) network, enhancing the accuracy of our remote sensing PM estimates. The findings demonstrate that the combination of AOD data with meteorological analyses and additional data sets can effectively model PM2.5 concentrations, achieving a significant correlation coefficient of 0.849. The reconstructed PM2.5 surfaces created in this study are invaluable for monitoring pollution events and performing detailed PM2.5 analyzes. These results were further validated through real-world observations from two in situ MINTS sensors located in Joppa (South Dallas) and Austin, confirming the effectiveness of our comprehensive approach to PM analysis. The US Environmental Protection Agency (EPA) recently updated the national standard for PM2.5 to 9 μg/m3, a move aimed at significantly reducing air pollution and protecting public health by lowering the allowable concentration of harmful fine particles in the air. Using our analysis approach to reconstruct the fine-time resolution PM2.5 distribution across the entire United States for our study period, we found that the entire nation encountered PM2.5 levels that exceeded 9 μg/m3 for more than 20% of the time of our analysis period, with the eastern United States and California experiencing concentrations exceeding 9 μg/m3 for over 50% of the time, highlighting the importance of regulatory efforts to maintain annual PM2.5 concentrations below 9 μg/m3.

Dengue fever remains one of the most significant public health challenges globally, particularly in tropical and subtropical regions. Traditional early warning systems (EWS) for dengue outbreaks, based on retrospective epidemiological data, suffer from delays and limited predictive accuracy. Modern systems, leveraging real-time data, artificial intelligence (AI), and machine learning (ML), improve accuracy but can be costly and difficult to implement in resource-constrained settings. This paper proposes a novel hybrid model that integrates the strengths of both traditional and modern EWS, with real-world examples from Brazil, and Malaysia. The hybrid model balances accuracy, scalability, and cost-effectiveness, making it a feasible option for low- and middle-income countries.

The rising occurrence of chronic kidney disease represents a significant health concern, impacting over 10% of individuals. Magnetic Resonance Imaging (MRI) biomarkers identify pathological alterations, are non-invasive, and can help lessen biopsy requirements and complications in chronic kidney disease patients. Total volume is the most assessed metric in autosomal dominant polycystic kidney disease patients, assisting in tracking chronic kidney disease progression. Kidney segmentation is essential for evaluating renal volume. Nevertheless, it often relies on manual segmentation, which is time-consuming and highly subjective. However, Deep Learning (DL) techniques have led to creating algorithms that provide accurate, cost-effective, and user-independent outcomes. Therefore, this study explores DL-based strategies for kidney segmentation, particularly U-Net and Attention U-Net. Both architectures were assessed with the standard cross-entropy loss function and a focal cross-entropy loss function. Ultimately, the proposed methods were used for both 2-class and 3-class segmentation to improve the segmentation of border regions. The highest Dice coefficient achieved on the testing set was 0.966.

Single particle tracking is a powerful technique to investigate the motion of molecules or particles. Here we review methods for analyzing the reconstructed trajectories, step needed for deciphering the underlying mechanisms driving the motion. First, we review the traditional analysis based on the mean square displacement (MSD), highlighting sometimes-neglected factors potentially affecting results accuracy. We then report methods that exploit distributions of parameters other than displacements, e.g. angles, velocities, and times and probabilities of reaching a target, discussing how they are more sensitive in characterizing heterogeneities and transient behaviors masked in MSD analysis. Hidden Markov Models are also used for this purpose, and these allow identifying different states, their populations and the switching kinetics. Finally, we discuss a rapidly expanding field: trajectory analysis based on machine learning. Various approaches, from random forest to deep learning, are used to classify trajectory motions, which can be identified by motion models or by model-free sets of trajectory features, either previously defined or automatically identified by the algorithms. We also review free software available for some of the analysis methods. We emphasize that approaches based on combined different methods, including classical statistics and machine learning, may be the way to obtain the most informative and accurate results.

This study challenges the prevailing belief in the necessity of complex models for accurate forecasting by demonstrating the effectiveness of parsimonious econometric models, namely ARCH(1) and GARCH(1,1), over deep learning robust approaches, such as LSTM and 1D-CNN neural networks, in modeling historical volatility within pre-emerging stock markets, specifically the Moroccan and Bahraini stock markets. The findings suggest reevaluating the balance between model complexity and predictive accuracy. Future research directions include investigating the potential existence of threshold effects in market capitalization for optimal model performance. This research contributes to a deeper understanding of volatility dynamics and enhances forecasting models’ effectiveness in diverse market conditions.

In recent years, the widespread use of drones in daily life and large public events has raised serious safety concerns, especially due to incidents, both intentional and accidental. One of the most important aspects to prevent these risks is the ability to detect and accurately predict the distance of UAVs (Unmanned Aerial Vehicles) from people and restricted areas. One of the pressing issues is to develop systems to monitor their flights in restricted areas and predict suspicious movements in cases where suspicious drone flights are detected, which may be launched for video reconnaissance and information theft purposes. The advancement of acoustic-based recognition systems is growing with the development of deep learning. This study explores deep learning model architectures for the task of predicting UAV distances based on their flight sounds. The objective of this study is to determine whether sound-based classification can effectively predict drone movements at different distances from acoustic sensor points as they move from one area to another. Our experimental tests tried to predict the movement of UAVs based on the classification into 3 main zones. The results showed that drone sounds could be reliably detected in the movements between zones with an average recognition accuracy of 90 % using the hybrid CNN-BiLSTM model. Moreover, the implementation of such advanced acoustic sensor systems for UAV detection can improve the accuracy of real-time prediction, especially when integrated into a multimodal system with multi-sensor fusion methods.

Background/Aim: Performing emergency surgery for bowel obstruction continues to place a significant strain on the healthcare system. Conventional assessment methods for outcomes in bowel obstruction cases often concentrate on isolated factors, and the evaluation of results for individuals with bowel obstruction remains poorly studied. This study aimed to examine the risk factors associated with major postoperative complications. Methods: We retrospectively analyzed 99 patients undergoing surgery from 2015 to 2022. We divided the patients into two groups: 1) benign related obstruction (n=68), 2) cancer related obstruction (n=31). We used logistic regression, KNN and XGBOOST. We calculated the receiver operating characteristic curve, and accuracy of the model. Results: Colon obstructions were more frequent in the cancer group (p=0.005). Operative time, intestinal resection and stoma were significantly more frequent in the cancer group. Major complications were 41% for the cancer group vs. 20 in the benign group (p=0.03). Uni-and multivariate analysis shows that significant risk factors for major complication were cancer related obstruction and CRP. The best model was KNN with an accuracy of 0.82. Conclusion. Colonic obstruction is associated with a tumor-related blockage. Malignant cancer and an increase in C-reactive protein (CRP) are significant risk factors for patients who have undergone emergency surgery due to major complications. KNN could improve the process of counseling and the perioperative management of patients with intestinal obstruction in emergency settings.

Use of fingerprints found at a crime scene is a common practice for identifying suspects in criminal investigations. Over the past two decades, attempts have been made to obtain additional information from fingerprints, beyond locating suspects as part of an investigation. This includes gender, age and nationality. Researchers demonstrated 75%-90% accuracy in gender classification based on fingerprint images. Nonetheless, despite promising results, these studies have several significant shortcomings with respect to their practical feasibility. First, they ignore the low quality and quantity of fingerprints collected from the crime scene since typically the scene of a crime has only one fingerprint collected, and the fingerprint might be partially or of poor quality as well. Second, as most results are based on a single database, public or private, it is difficult to generalize the most suitable method. Third, studies miss the untapped potential of Data-Centric AI (DCAI) approaches for improving results. The aim of this study was to compare, for the first time, the gender classification from a fingerprint using several datasets and with varying fingerprint image quality. The results from four databases are compared, three public and one internal private database. In addition, we utilize the latest Data-Centric AI (DCAI) approaches for improving classification results. The results demonstrate that a conservative Convolutional Neural Networks (CNN) such as VGG is sufficient for this task. Classification accuracy ranges from 80% to 95% depending on the quality of the fingerprint, with DCAI approaches adding 1%-4% improvement. For partially or low-quality fingerprint images, the periphery of a fingerprint is the most significant area for determining gender. The source code is also provided here for practical application.

Diabetes is a significant global health issue impacting millions. Approximately 26 million diabetics experience foot ulcers, with 20% leading to amputations, resulting in high morbidity, mortality, and costs. Plantar pressure screening shows potential for the early detection of Diabetic Foot Ulcers (DFUs). Although foot ulcers often occur due to excessive pressure on the soles during dynamic activities, most studies focus on static pressure measurements. This study’s primary objective is to apply wireless plantar pressure sensor-embedded insoles to classify and detect diabetic feet from healthy ones based on dynamic plantar pressure. The secondary objective is to compare statistical-based and Machine Learning (ML) classification methods. Data from 150 subjects were collected using the insoles during walking, revealing that diabetic feet have higher plantar pressure than healthy feet, consistent with prior research. The Adaptive Boosting (AdaBoost) ML model achieved the highest accuracy of 0.85, outperforming the statistical method, which had an accuracy of 0.67. These findings suggest that ML models, combined with pressure sensor-embedded insoles, can effectively classify healthy and diabetic feet using plantar pressure features. Future research will focus on using these insoles with ML to classify various stages of diabetic neuropathy, aiming for early prediction of foot ulcers in home settings.

Growth models of uneven-aged forests on the diameter class level can support silvicultural decision making. Machine learning brings added value to the modeling of dynamics at the stand or individual tree level based on data from permanent plots. The objective of this study is to explore the potential of machine learning for modeling growth dynamics in uneven-aged forests at the diameter class level based on inventory data from practice. Two main modeling approaches are conducted and compared: i) fine-tuned linear models differentiated per diameter class, ii) an artificial neural network (multilayer perceptron) trained on all diameter classes. The models are trained on the inventory data of the Canton of Neuchâtel (Switzerland), which are area-wide data without individual tree-level growth monitoring. Both approaches produce convincing results for predicting future diameter distributions. The linear models perform better at the individual diameter class level with test R2 typically between 50 and 70% for predicting increments in the numbers of stems at the diameter class level. From a methodological perspective, the multilayer perceptron implementation is much simpler than the fine-tuning of linear models. The linear models developed in this study achieve sufficient performance for practical decision support.

Latent Tuberculosis Infection (LTBI) poses a significant public health challenge, especially in populations with high HIV prevalence and limited healthcare access. Early detection and targeted interventions are essential to prevent the progression of active tuberculosis. This study develops predictive models for LTBI outcomes using logistic regression and machine learning approaches and evaluates strategies to improve LTBI awareness and testing. Data from rural areas in the Eastern Cape, South Africa, were analyzed to identify key demographic, health, and knowledge-related factors influencing LTBI outcomes. Logistic regression was employed to pre-dict LTBI positivity based on factors such as age, education, and HIV status. Machine learning models, including decision trees and random forests, were also applied to compare predictive accuracy. A knowledge diffusion model was used to assess the impact of educational interventions on increasing LTBI awareness and testing rates. Logistic regression achieved an accuracy of 66.67% with high precision (80%) but low recall (33%) for LTBI-positive cases, identifying age, HIV status, and LTBI awareness as significant predictors. The random forest model outperformed logistic regression in accuracy (59.26%) and F1-score (0.63), providing a better balance between precision and recall. Feature importance analysis revealed that age, occupation, and knowledge of LTBI symptoms were the most critical factors across both models. The knowledge diffusion model demonstrated that targeted interventions significantly increased LTBI awareness and testing, particularly in high-risk groups. While logistic regression offers more interpretable results for public health interventions, machine learning models like random forests provide enhanced predictive power by capturing complex relationships between demographics and health factors. These findings highlight the need for targeted educational campaigns and increased LTBI testing in high-risk populations, particularly those with limited awareness of LTBI symptoms.

Deep learning is an emerging area of machine learning (ML) research. It comprises multiple hidden layers of artificial neural networks. The deep learn- ing methodology applies nonlinear transformations and model abstractions of high level in large databases. The recent advancements in deep learning architec- tures within numerous fields have already provided significant contributions in artificial intelligence. This article presents a state of the art survey on the contri- butions and the novel applications of deep learning. The following review chron- ologically presents how and in what major applications deep learning algorithms have been utilized. Furthermore, the superior and beneficial of the deep learning methodology and its hierarchy in layers and nonlinear operations are presented and compared with the more conventional algorithms in the common applica- tions. The state of the art survey further provides a general overview on the novel concept and the ever-increasing advantages and popularity of deep learning.

The use of drones for various applications has become increasingly popular in recent years, and machine learning has played a significant role in this trend. In this paper, we provide a comprehensive survey of the classification and application of machine learning in drones. The paper begins with an overview of the different types of machine learning algorithms and their applications in drones, including supervised learning, unsupervised learning, and reinforcement learning. Next, we present a detailed analysis of various real-world applications of machine learning in drones, such as object recognition, route planning, obstacle avoidance, search area optimization, and autonomous search. The paper also discusses the challenges and limitations of using machine learning in drones, such as data privacy, data quality, and computational requirements. Finally, the paper concludes with a discussion of the future directions of machine learning in drones and its potential impact on various industries and fields. This paper provides a valuable resource for researchers, practitioners, and students interested in the intersection of machine learning and drones.

Federated learning techniques aim to train and build machine learning models based on distributed datasets across multiple devices, avoiding data leakage. The main idea is to perform training on remote devices or isolated data centers without transferring data to centralized repositories, thus mitigating privacy risks. Data analytics in education, in particular learning analytics, is a promising scenario to apply this approach to address the legal and ethical issues related to processing sensitive data. Indeed, given the nature of the data to be studied (personal data, educational outcomes, data concerning minors), it is essential to ensure that the conduct of these studies and the publication of the results provide the necessary guarantees to protect the privacy of the individuals involved and the protection of their data. In addition, the application of quantitative techniques based on the exploitation of data on the use of educational platforms, student performance, use of devices, etc., can account for educational problems such as the determination of user profiles, personalized learning trajectories, or early dropout indicators and alerts, among others. This paper presents the application of federated learning techniques to two learning analytics problems: dropout prediction and unsupervised student classification. The experiments allow us to conclude that the proposed solutions achieve comparable results from the performance point of view with the centralized versions, avoiding centralizing the data for training the models.

We study the brain segmentation by dividing the brain into multiple tissues. Given possible brain segmentation by deep, machine learning can be efficiently exploited to expedite the segmentation process in the clinical practice. To accomplish segmentation process, a MRI and tissues transfer using generative adversarial networks is proposed. Given the better result, we propose the transfer model using GAN. For the case of the brain tissues, white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF) are segmented. Empirical results show that this proposed model significantly improved segmentation results compared to the stat-of-the-art results. Furthermore, a dice coefficient (DC) metric is used to evaluate the model performance.

The article addresses the problem of course development in virtual teaching and learning spaces by teachers to support blended learning in the Ecuadorian unified baccalaureate. For this purpose, a documentary analysis of 465 papers selected by a search in Scopus and Google Scholar about blended learning and 145 papers selected by a search in Scopus and Google Scholar about development of virtual courses was carried out. The definition of the first concept is qualitatively different from the previous ones by analysing it as a form of organisation and assessing the configuration of face-to-face and distance learning depending on the educational objective. The second concept defined presents the unrepeatable and unique character of each course given by the configuration of its digital resources, the characteristics of these resources and the new qualities that are conferred on them. Subsequently, based on them, the methodology that contributed to the development of courses in virtual spaces as a support to blended learning is proposed. Unlike other methodologies, the proposal explicitly states its conceptual apparatus and the necessary requirements for its introduction in an educational organization. It incorporates important actions that do not appear in other methodologies such as cross-cutting processes including quality assurance with its corresponding metrics, maintenance, recall and evaluation of previous actions.

Class Incremental Learning (CIL) has emerged as a vital machine learning paradigm, particularly suited for environments with continuous data streams, such as those encountered in the financial industry. CIL enables models to progressively acquire and accumulate new knowledge without retraining the entire dataset, making it highly efficient for dynamic financial markets. In this paper, we explore the application of CIL to financial data streams, where high-frequency, high-dimensional data, such as stock prices and cryptocurrency transactions, evolve rapidly. The challenges inherent in CIL, including catastrophic forgetting—where the model loses previously learned knowledge—and intransigence—where it resists learning new classes—are addressed through both regularization-based techniques and dynamic architecture expansion. We present a comprehensive analysis of the algorithms designed to mitigate these challenges and highlight their relevance in financial applications like algorithmic trading, portfolio management, risk assessment, and fraud detection. By demonstrating how CIL enables models to adapt to new market conditions and asset classes while retaining past knowledge, we illustrate its critical role in advancing real-time financial decision-making. Through a detailed examination of the methodologies and their applications, this paper aims to provide insights into the future of adaptive financial models using Class Incremental Learning. We have also summarized methodologies into a model optimization-based class and a data focused class.

In recent years, online learning has become one of the most popular methods of educational delivery due to advances in technology, which has been made even more evident in the COVID-19 lockdown period. Online education has evolved into a distinct field of study within the educational system over the last few years. It is also important to note that parallel with the growth in this field, there has also been an increase in the number of scholarly journals that regularly publish research in this field, reflecting the importance of this field in the modern day. In spite of the fact that online learning offers a wide range of educational options, from short courses to full-time degrees, as well as being accessible, flexible, environmentally friendly, and affordable, there are also certain challenges associated with this educational approach. These challenges include the lack of social interaction, technical errors, a lack of hands-on training, and difficulties in assessing students. It is, therefore, imperative to ask the crucial question of whether online learning can replace traditional classroom learning or whether it can supplement it in hybrid models with it, as well as what factors and conditions are likely to determine this in the short- and long-term, as well as how it will be blended together in the future. The purpose of this commentary is to provide a brief summary of the current status of both learning models, as well as their pros and cons, in order to answer the question that was posed above.

The popularity of deep reinforcement learning (DRL) methods in economics have been exponentially increased. DRL through a wide range of capabilities from reinforcement learning (RL) and deep learning (DL) for handling sophisticated dynamic business environments offers vast opportunities. DRL is characterized by scalability with the potential to be applied to high-dimensional problems in conjunction with noisy and nonlinear patterns of economic data. In this work, we first consider a brief review of DL, RL, and deep RL methods in diverse applications in economics providing an in-depth insight into the state of the art. Furthermore, the architecture of DRL applied to economic applications is investigated in order to highlight the complexity, robustness, accuracy, performance, computational tasks, risk constraints, and profitability. The survey results indicate that DRL can provide better performance and higher accuracy as compared to the traditional algorithms while facing real economic problems at the presence of risk parameters and the ever-increasing uncertainties.

Self-supervised learning is a method that learns general representation from unlabeled data. Masked image modeling (MIM), one of the generative self-supervised learning methods, has drawn attention showing state-of-the-art performance on various downstream tasks, though showing poor linear separability resulting from the token-level approach. In this paper, we propose a contrastive learning-based multi-view masked autoencoder for MIM, exploiting an image-level approach by learning common features from two different augmented views. We strengthen MIM by learning long-range global patterns from contrastive loss. Our framework adopts simple encoder-decoder architecture, learning rich and general representation by following a simple process: 1) two different views are generated from an input image with random masking and by contrastive loss, we can learn semantic distance of the representations generated by an encoder. By applying a high mask ratio, 80%, it works as strong augmentation and alleviates the representation collapse problem. 2) With reconstruction loss, decoder learns to reconstruct an original image from the masked image. We assess our framework by several experiments on benchmark datasets of image classification, object detection, and semantic segmentation. We achieve 84.3% fine-tuning accuracy on ImageNet-1K classification and 76.7% in linear probing, exceeding previous studies and show promising results on other downstream tasks. Experimental results demonstrate that our work can learn rich and general image representation by applying contrastive loss to masked image modeling.

Continual learning, a crucial facet of machine learning, involves the perpetual acquisition of valuable insights from incoming data, sans the necessity for full dataset access. Esteemed as a fundamental goal in artificial intelligence, continual learning grapples with an enduring challenge—catastrophic forgetting. A proficient model must exhibit adaptability for new data assimilation and robustness to retain existing knowledge. Class-incremental learning (CIL) aids the gradual integration of knowledge from newly introduced classes, forming a universal classifier. However, directly training the model with fresh class instances triggers a problem—forgetting distinguishing features of prior classes, causing a performance decline. Addressing such issues in machine learning, this survey aims to delineate significant challenges, outcomes, and recent advancements, including our contributions to CIL techniques, especially in image classification.

In the fourth industrial revolution, artificial intelligence (AI) and machine learning (ML) have increasingly been applied to manufacturing, particularly additive manufacturing (AM), to enhance processes and production. This study provides a comprehensive review of the state-of-the-art achievements in this domain, highlighting not only the widely discussed supervised learning but also the emerging applications of semi-supervised learning and reinforcement learning (RL). These advanced ML techniques have recently garnered significant attention due to their potential to further optimize and automate AM processes. The review aims to offer insights into various ML technologies employed in current research projects and to promote the diverse applications of ML in AM. By exploring the latest advancements and trends, this study seeks to foster a deeper understanding of ML’s transformative role in AM, paving the way for future innovations and improvements in manufacturing practices.

There is only a very short reaction time for people to find the best way out of a building in a fire outbreak. Software applications can be used to assist the rapid evacuation of victims; however, this is an arduous task, which requires an understanding of advanced technologies. Since well-known pathway algorithms (such as, Dijkstra, Bellman-Ford and A*) can lead to serious problems over performance, we decided to make use of deep reinforcement learning techniques. A wide range of strategies including a random initialization of replay buffer and transfer learning were assessed in three projects involving schools of different sizes. The results showed the proposal was viable and that in most cases the performance of transfer learning was superior. In addition, the study raised challenges that had to be faced in the future.

Sparse reward long horizon task is a major challenge for deep reinforcement learning algorithm. One of the key barriers is data-inefficiency. Even in the simulation environment, it usually takes weeks to training the agent. In this study, a data-efficiency training framework is proposed, where a curriculum learning is design for the agent in the simulation scenario. Different distributions of the initial state are set for the agent to get more informative reward during the whole training process. A fine-tuning of the parameters in the output layer of the neural network for value function is conduct to bridge the gap between sim-to-real. An experiment of UAV maneuver control is conducted in the proposed training framework to verify the method more efficient. We demonstrate that data-efficiency is different for the same data in different training stages.

This paper presents the redesign process of FLIC, a web application developed for creating personal learning pathways in higher education, now adapted for primary and secondary education as FLIC-IPAFLEX. This redesign addresses the need to personalise learning through flexible pathways and supports teachers in designing learning situations (LS) in accordance with the criteria established by the new Education Law (LOMLOE). The SCRUM model, integrated into Design-Based Research (DBR), was employed, implementing several iterative cycles involving teachers to validate the tool's utility. The platform facilitates the creation, publication, and reuse of LS by enabling the filtering of competencies, evaluation criteria, and basic knowledge, as well as integrating with Google Classroom, an application widely used by teachers. The results show a positive user evaluation, highlighting its ease of use and capacity to foster collaboration among teachers, thereby promoting the co-design of flexible and adaptive LS. FLIC-IPAFLEX aims to contribute to the field of learning design technologies, aligning with the demands of compulsory education and supporting collaborative processes within the educational environment.

This article discusses the comparison between digital and traditional face-to-face coaching within the scope of shadow education institutions. While analyzing the differences and similarities between the two educational models, both their advantages and disadvantages are thoroughly discussed. In this context, interviews were conducted with students and teachers who receive education in both face-to-face and digital coaching, and the positive and negative aspects of both institutions, suitable and unsuitable courses, the future situation, and the effects on students' academic achievements were revealed. According to the results obtained from the research, it is noteworthy that students who do not receive education in digital coaching have prejudices against digitalization. Additionally, no significant difference was found between the academic achievements of students receiving education in digital coaching and those receiving education in face-to-face coaching.

The emergence of few-shot learning as a potential approach to address the problem of data scarcity by learning underlying pattern from a few training sample had so far given a mix-result especially on the suitability of model-agnostic meta learning, transfer learning, and optimization strategy to rapidly learn valid information from few sample. In this research, we did an in-depth evaluation of meta- learning to determine their plausibility and suitability for previously unknown cyberattack detection by first retrieving the original research artifacts of current state of the art meta learning to repeat the experiment with original dataset before replicating the experiment with two different malware dataset which had not been previously done with meta-transfer learning. On each of the experiments, meta-transfer learning gave good results on digital character recognition dataset but abysmal result on Malimg and Malevis malware images datasets thereby indicating its unreliability for detecting cyberattacks and the need for an improvement to the state-of-the-art meta transfer learning towards a better attack detection. Transfer learning performance is independent on imbalance and hence does not influence its performance since both malware dataset used for this experiment result in high validation loss and balancing the dataset doesn't result in reduced validation loss,the successful learning transfer seen on digital character recognition dataset is not unconnected to the fact that several languages have similar characters and digits thereby enhancing the successful learning transfer unlike malware datasets, and more importantly the finding that current meta-learning transfer approach doesn't generalize well on malware dataset and hence not suitable for detecting previously unseen out-of-distribution attack.

Despite the importance of few-shot learning, the lack of labeled training data in the real world, makes it extremely challenging for existing machine learning methods as this limited data set does not represent the data variance well. In this research, we suggest employing a generative approach using variational autoencoders (VAEs), which can be used specifically to optimize few-shot learning tasks by generating new samples with more intra-class variations. The purpose of our research is to increase the size of the training data set using various methods to improve the accuracy and robustness of the few-shot face recognition. Specifically, we employ the VAE generator to increase the size of the training data set, including the basic and the novel sets while utilizing transfer learning as the backend. Based on extensive experimental research, we analyze various data augmentation methods to observe how each method affects the accuracy of face recognition. We conclude that the face generation method we proposed can effectively improve the recognition accuracy rate to 96.47% using both the base and the novel sets.

Sugarcane is the primary crop in the global sugar industry, yet it remains highly susceptible to a wide range of diseases that significantly impact its yield and quality. An effective solution is required to solve the issues given by manual identification of plant diseases, which is time-consuming and wasteful, as well as low detection accuracy. This paper proposes the development of a robust deep ensemble convolutional neural network (DECNN) model for the accurate detection of sugarcane leaf diseases. Initially, several transfer learning (TL) models, including EfficientNetB0, MobileNetV2, DenseNet121, NASNetMobile, and EfficientNetV2B0, were enhanced through the addition of specific layers. A comparative study was then conducted on the improved dataset. The application of data augmentation, along with the addition of dense layers, batchnormalization layers, and dropout layers, led to improved detection accuracy, precision, recall, and F1 score for each model. Among the five enhanced transfer learning models, the modified EfficientNetB0 model demonstrated the highest detection accuracy, ranging from 97.08% to 98.54%. In conclusion, the DECNN model was developed by integrating the modified EfficientNetB0, MobileNetV2, and DenseNet121 models using a distinctive performance-based custom weighted ensemble method, with weight optimization carried out using the Tree-structured Parzen Estimator (TPE) technique. This resulted in a model that achieved a detection accuracy of 99.17%, outperforming the individual performances of the modified EfficientNetB0, MobileNetV2, and DenseNet121 models in detecting sugarcane leaf diseases.

In conventional Federated Learning (FL), clients work together to train a model managed by a central server, intending to speed up the learning process. However, this approach imposes significant computational and communication burdens on clients, particularly with complex models. Additionally, while FL strives to protect client privacy, the server's access to local and global models raises security concerns. To address these challenges, Split Learning (SL) separates the model into parts handled by the client and the server, though it suffers from inefficiencies due to sequential client participation. To overcome these issues, SplitFed Learning (SFL) was proposed, which combines the parallelism of FL with the model-splitting strategy of SL, enabling simultaneous training by multiple clients. Our main contribution is the theoretical analysis of SFL, which, for the first time, includes non-i.i.d. datasets, non-convex loss functions, and both full and partial client participation. We provide convergence proofs for a state-of-the-art SFL algorithm based on conventional convergence analysis assumptions for FL. Our results prove that we can recover the linear convergence rate of conventional FL for the SFL algorithm with the distinction that increasing the number of local steps or clients may not speed up the convergence in SFL.

Classifiers face a myriad of challenges in today’s data-driven world, ranging from overfitting and high computational costs to low accuracy, imbalanced training datasets, and the notorious black box effect. Furthermore, many traditional classifiers struggle with the robust handling of noisy and missing feature values. In response to these hurdles, we present classification methods that leverage the power of feature partitioning learning and outranking measures. Our classification algorithms offer an innovative approach, eliminating the need for prior domain knowledge by automatically discerning feature intervals directly from the data. These intervals capture essential patterns and characteristics within the dataset, empowering our classifiers with newfound adaptability and insight. In addition, we employ outranking measures to mitigate the influence of noise and uncertainty in the data. Through pairwise comparisons of alternatives on each feature, we enhance the robustness and reliability of our classification outcomes. The developed classifiers are empirically evaluated on several data sets from UCI repository and are compared with well-known classifiers including k Nearest Neighbors (K-NN), Support Vector Machine (SVM), Random Forest (RF), Neural Network (NN), Naive Bayesian (NB) and Nearest Centroid (NC). The experiments result demonstrate that the classifiers based on feature interval learning and outranking approaches are robust to imbalanced data and to irrelevant features and achieve comparably and even better performances than the well-known classifiers in some cases. Moreover, our proposed classifiers produce more explainable models whilst preserving high predictive performance levels.

Globalization, knowledge economy, information technology advancements, and the rise of learning societies contribute to the concept of a learning city. The study examines the economic indicators of Yazd city, Iran, in the context of learning city development. A descriptive-analytical approach with a survey method and cluster sampling was employed. Data analysis involved Kolmogorov-Smirnov normality test, single-sample T-test, simple linear regression, and Kendall's W test. The normality test confirmed data normality. The T-test indicated that experts perceived the current state of most variables in Yazd as undesirable. Regression analysis revealed a significant positive association between the economic index and independent variables. Kendall's W test prioritized areas based on economic indicators, with the top 7 and bottom 5 areas identified for focused interventions. The study emphasizes the need to prioritize areas within Yazd based on their economic indicators. This prioritization informs strategies for enhancing social and legal aspects of Yazd's transformation into a learning city. Further research should explore effective methods to cultivate a full-fledged learning environment in the city.

Multimodal remote sensing data classification can enhance the model’s ability to distinguish land features through multimodal data fusion. In this context, how to help models understand the relationship between multimodal data and target tasks is the focus of researchers. Inspired by human feedback learning mechanisms, causal reasoning mechanisms, and knowledge induction mechanisms, this paper integrates causal learning, reinforcement learning, and meta learning into a unified remote sensing data classification framework and proposed the causal meta-reinforcement learning (CMRL). First, based on feedback learning mechanisms, we have overcome the limitations of traditional implicit optimization of fusion features and customized a reinforcement learning environment for multimodal remote sensing data classification tasks. Through feedback interactive learning between agents and the environment, we help them understand the complex relationships between multimodal data and labels, thereby achieving full mining of multimodal complementary information. Second, based on the causal inference mechanism we designed causal distribution prediction action, classification reward, and causal intervention reward, capturing pure causal factors in multimodal data and cutting off false statistical associations between non-causal factors and class labels. Finally, based on the knowledge induction mechanism, we designed a bi-layer optimization mechanism based on meta-learning. By constructing a meta training task and meta validation task simulation model in the generalization scenario of unseen data, we helped the model induce cross-task shared knowledge, thereby improving its generalization ability for unseen multimodal data. The experimental results on multiple sets of multimodal datasets show that the proposed method achieved state-of-the-art performance in multimodal remote sensing data classification tasks.

Online learning is gaining massive popularity with time. The e-learning platforms operate differently from traditional educational institutions and hence need different strategy for course recommendations. This survey aims to cover the major emerging research areas in e-learning recommender systems. Our study covers different areas of research including graph-based methodologies, ITS, query optimization, content-based, and collaborative filtering, big data, and association rules mining. This survey aimed to explore all major emerging directions of recommender systems in education. This study analyzed existing literature in all of the areas mentioned before and performed objective-based analysis. A brief performance analysis was also done for the researches where the values were comparable. Limitations of existing researches were also identified and studied to shed some light on future directions.

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and improved performance. Despite the increasing interest in GNNs and their use cases, there is little research on their transferability. This research demonstrates that transfer learning is effective with GNNs, and describes how source tasks and the choice of GNN impact the ability to learn generalisable knowledge. We perform experiments using real-world and synthetic data within the contexts of node classification and graph classification. To this end, we also provide a general methodology for transfer learning experimentation and present a novel algorithm for generating synthetic graph classification tasks. We compare the performance of GCN, GraphSAGE and GIN across both the synthetic and real-world datasets. Our results demonstrate empirically that GNNs with inductive operations yield statistically significantly improved transfer. Further we show that similarity in community structure between source and target tasks support statistically significant improvements in transfer over and above the use of only the node attributes.

Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today's Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals.

During the COVID-19 outbreak, most university courses have been offered on online platforms. A sudden shift from face-to-face classroom learning to online formats could influence the learning effectiveness of classes. This study aims to investigate differences in the learning effectiveness of online and face-to-face lecture courses. It also explores factors that impact the effectiveness of online instruction. These factors include interactions among learners, interactions between learners and the instructor, the quality of online platforms, learners’ ability to use devices and follow instructions, and learners’ situational challenges. The study participants were 261 university students at King Mongkut’s University of Technology Thonburi in Bangkok, Thailand. All participants were enrolled in at least one lecture course, such as history, humans and the environment, the environment and development, or general philosophy, during the 2019 academic year. A questionnaire was distributed to participants after they completed these courses in May 2020. Paired simple t-test analyses were used to compare the effectiveness of online and face-to-face classes, and a multiple regression analysis was used to identify factors that impact the learning effectiveness of online classes. The results show that online classes are less effective than face-to-face courses. The multiple regression analysis also revealed that the effectiveness of online learning was significantly impacted by learners’ ability to interact with classmates during class, their ability to interact with instructors after the class, the quality of online platforms, and disturbances or distractions in learners’ environments.

Generic text embeddings have demonstrated considerable success across a multitude of applications. However, these embeddings are typically derived by modeling the co-occurrence patterns within text-only corpora, which can limit their ability to generalize effectively across diverse contexts. In this study, we investigate methodologies that incorporate visual information into textual representations to overcome these limitations. Through extensive ablation studies, we introduce a novel and straightforward architecture named VisualText Fusion Network (VTFN). This architecture not only surpasses existing multimodal approaches on a range of well-established benchmark datasets but also achieves state-of-the-art performance on image-related textual datasets while utilizing significantly less training data. Our findings underscore the potential of integrating visual modalities to substantially enhance the robustness and applicability of text embeddings, paving the way for more nuanced and contextually rich semantic representations.

Recommender systems in education are becoming more widespread, typically focusing on recommending courses or study materials. This study proposes a machine learning approach to recommend a university degree based on high school and university standardised test results, incorporating students' socioeconomic information as input variables. The objective is to develop a tool for students’ decision-making, supporting the sustainable development goal of Quality Education by providing a data schema to maximise the likelihood of a successful match between the student's profile and the academic program. With its focus on equity in education, this study provides a data-driven approach to assist students in selecting suitable university degrees, aiming to improve educational outcomes and inspire a more equitable education system.

We study how abstract representations emerge in a Deep Belief Network (DBN) trained on benchmark datasets. Our analysis targets the principles of learning in the early stages of information processing, starting from the “primordial soup" of the under-sampling regime. As the data is processed by deeper and deeper layers, features are detected and removed, transferring more and more “context-invariant” information to deeper layers. We show that the representation approaches an universal model – the Hierarchical Feature Model (HFM) – determined by the principle of maximal relevance. Relevance quantifies the uncertainty on the model of the data, thus suggesting that “meaning" – i.e. syntactic information – is that part of the data which is not yet captured by a model. Our analysis shows that shallow layers are well described by pairwise Ising models, which provide a representation of the data in terms of generic, low order features. We also show that plasticity increases with depth, in a similar way as it does in the brain. These findings suggest that DBNs are capable of extracting a hierarchy of features from the data which is consistent with the principle of maximal relevance.

Fruit quality is a critical factor in the produce industry, affecting producers, distributors, consumers, and the economy. High-quality fruits are more appealing, nutritious, and safe, boosting consumer satisfaction and revenue for producers. Artificial Intelligence can aid in assessing the quality of the fruit using images. This paper presents a general machine-learning model for assessing fruit quality using deep image features. The model leverages the learning capabilities of the recent successful networks for image classification called Vision Transformers (ViT). The ViT model is built and trained with a combination of various fruit datasets and learned to distinguish between good and rotten fruit images. The general model demonstrated impressive results in accurately identifying the quality of various fruits such as Apples (with a 99.50% accuracy), Cucumbers (99%), Grapes (100%), Kakis (99.50%), Oranges (99.50%), Papayas (98%), Peaches (98%), Tomatoes (99.50%), and Watermelons (98%). However, it showed slightly lower performance in identifying Guavas (97%), Lemons (97%), Limes (97.50%), mangoes (97.50%), Pears (97%), and Pomegranates (97%).

Modelling both long and short-term user interests from historical data is crucial for accurate recommendations. However, unifying these metrics across multiple application domains can be challenging, and existing approaches often rely on complex, intertwined models which can be difficult to interpret. To address this issue, we propose a lightweight, plug-and-play interest enhancement module that fuses interest vectors from two independent models. After analyzing the dataset, we identify deviations in the recommendation performance of long and short-term interest models. To compensate for these differences, we use feature enhancement and loss correction during training. In the fusion process, we explicitly split long-term interest features with longer duration into multiple local features. We then use a shared attention mechanism to fuse multiple local features with short-term interest features to obtain interaction features. To correct for bias between models, we introduce a comparison learning task that monitors the similarity between local features, short-term features, and interaction features. This adaptively reduces the distance between similar features. Our proposed module combines and compares multiple independent long-term and short-term interest models on multiple domain datasets. As a result, it not only accelerates the convergence of the models but also achieves outstanding performance in challenging recommendation scenarios.

Over the past decade, research in the field of Deep Learning has brought about novel improvements in image generation and feature learning; one such example being a Generative Adversarial Network. However, these improvements have been coupled with an increasing demand on mathematical literacy and previous knowledge in the field. Therefore, in this literature review, I seek to introduce Generative Adversarial Networks (GANs) to a broader audience by explaining their background and intuition at a more foundational level. I begin by discussing the mathematical background of this architecture, specifically topics in linear algebra and probability theory. I then proceed to introduce GANs in a more theoretical framework, along with some of the literature on GANs, including their architectural improvements and image-generation capabilities. Finally, I cover state-of-the-art image generation through style-based methods, as well as their implications on society.

This study evaluated the using of machine vision in combination with deep learning to identify weeds in real-time for wheat production system. PMAS-Arid Agriculture university research farm were selected for collection of images (6000 total images) of weeds and wheat crops under different weather condition. During growing season, the database was constructed to identify the weeds. For this study two framework were used TensorFlow and PyTorch under CNNs and Deep learning. Deep learning perfromed better with in PyTourch value as compared to another model in Tensorflow. comparing with other networks such as YOLOv4, we concluded that our network reaches a better result between speed and accuracy. Specifically, the maximum precision of weed and wheat plants were 0.89 and 0.91 respectively with 9.43 ms and 12.38 ms inference time per image (640 × 640) NVIDIA RTX2070 GPU.

Tremendous progress has been witnessed in artificial intelligence within the domain of neural network backed deep learning systems and its applications. As we approach the post Moore’s Law era, the limit of semiconductor fabrication technology along with a rapid increase in data generation rates have lead to an impending growing challenge of tackling newer and more modern machine learning problems. In parallel, quantum computing has exhibited rapid development in recent years. Due to the potential of a quantum speedup, quantum based learning applications have become an area of significant interest, in hopes that we can leverage quantum systems to solve classical problems. In this work, we propose a quantum deep learning architecture; we demonstrate our quantum neural network architecture on tasks ranging from binary and multi-class classification to generative modelling. Powered by a modified quantum differentiation function along with a hybrid quantum-classic design, our architecture encodes the data with a reduced number of qubits and generates a quantum circuit, loading it onto a quantum platform where the model learns the optimal states iteratively. We conduct intensive experiments on both the local computing environment and IBM-Q quantum platform. The evaluation results demonstrate that our architecture is able to outperform Tensorflow-Quantum by up to 12.51% and 11.71% for a comparable classic deep neural network on the task of classification trained with the same network settings. Furthermore, our GAN architecture runs the discriminator and the generator purely on quantum hardware and utilizes the swap test on qubits to calculate the values of loss functions. In comparing our quantum GAN, we note our architecture is able to achieve similar performance with 98.5% reduction on the parameter set when compared to classical GANs. With the same number of parameters, additionally, QuGAN outperforms other quantum based GANs in the literature for up to 125.0% in terms of similarity between generated distributions and original data sets.

The conventional machine learning (ML) algorithms are continuously advancing and evolving at a fast-paced by introducing the novel learning algorithms. ML models are continually improving using hybridization and ensemble techniques to empower computation, functionality, robustness, and accuracy aspects of modeling. Currently, numerous hybrid and ensemble ML models have been introduced. However, they have not been surveyed in a comprehensive manner. This paper presents the state of the art of novel ML models and their performance and application domains through a novel taxonomy.

This paper presents a new method : HIVEC to learn latent vector representations of graphs in a manner that captures the semantic dependencies of sub-structures. The representations can then be used in machine learning algorithms for tasks such as graph classification, clustering etcetera. The method proposed is unsupervised and uses the information of co-occurrence of sub-structures. It introduces a notion of hierarchical embeddings that allows us to avoid repetitive learning of sub-structures for every new graph. As an alternative to deep learning methods, the edit distance similarity between sub-structures is also used to learn vector representations. We compare the performance of these methods against previous work.

We investigate soccer analytics from supervised learning, unsupervised learning, and reinforcement learning perspectives. With the increasing availability of player tracking data and event logs, machine learning techniques have become essential for uncovering patterns in player and team performance. In this paper, we examine how supervised learning models are applied to tasks such as match outcome prediction and player rating systems, while unsupervised learning is utilized for player clustering, tactical analysis, and the discovery of hidden patterns in game data. Reinforcement learning, on the other hand, plays a key role in optimizing decision-making during matches by learning optimal strategies and tactics through trial and error. By providing a comprehensive overview of these approaches, we aim to highlight the transformative potential of machine learning in modern soccer analytics and how it continues to shape the sport. We also provide summary of other soccer analytics research in this work.

Undergraduate learning is a multifaceted concept that many researchers have investigated to promote student engagement, academic performance, etc. Exploring factors promoting learning among undergraduates in FYW programs, which are required for undergraduates might potentially contribute to sustainable, cross-disciplinary undergraduate education. This study used the 10-year longitudinal grade and survey data at San José State University (SJSU) and the data was collected from Academic Years (AYs) 2015 to 2020, and five student surveys constituted the sample size of 18,101 students. In 2016, SJSU changed the remedial writing course to college writing courses. Since then, students need to complete an online module course before placing themselves into a one-semester or two-semester writing course. The previous study showed that students with higher writing comfort and confidence tend to place themselves into a semester-long class. Regression analysis was applied to examine the relationships among factors promoting learning among those students. University admitted students from various diversity and backgrounds, the results of this study suggested that what students chose and persisted in were more important in advancing their academic success rather than prior learning experience or psychological factors before the class.

The COVID-19 pandemic has led to the growth of hybrid and online learning environments and the trend to introduce more technology into the classroom. One such change would be the use of smart synchronous hybrid learning environments (SSHLE), which are settings with both in-person and online students concurrently, and in which technology plays a key role in sensing, analyzing, and reacting throughout the teaching and learning process. These changing environments and the incorporation of new technologies can place a greater orchestration load on participants and a reduction in teacher agency. In this context, the aim of this paper is to analyse the orchestration load and teacher agency in different SSHLEs. The NASA-TLX model was used to measure the orchestration load in several scenarios. Questionnaires and interviews were used to measure teacher agency. The results obtained indicate that the orchestration load of the teacher tends to be high (between 60 and 70 points out of 100 of the NASA-TLX workload), especially when they lack experience in synchronous hybrid learning environments, and the orchestration load of the students tends to have average values (between 50 and 60) in the SSHLEs analysed. Meanwhile, the teacher agency does not appear to be altered but shows potential for improvement.

A common challenge in real-world classification scenarios with sequentially appending target domain data is insufficient training datasets during the training phase. Therefore, conventional deep learning and transfer learning classifiers are not applicable especially when individual classes are not represented or are severely underrepresented at the outset. Domain Generalization approaches reach their limits when domain shifts become too large, making them occasionally unsuitable as well. In many (technical) domains, however, it is only the defect/ worn/ reject classes that are insufficiently represented, while the non-defect class is often available from the beginning. The proposed classification approach addresses such conditions and is based on a CNN encoder. Following a contrastive learning approach, it is trained with a modified triplet loss function using two datasets: Besides the non-defective target domain class (= 1st dataset), a state-of-the-art labeled source domain dataset that contains highly related classes (e.g., a related manufacturing error or wear defect) but originates from a (highly) different domain (e.g., different product, material, or appearance) (= 2nd dataset) is utilized. The approach learns the classification features from the source domain dataset while at the same time learning the differences between the source and the target domain in a single training step, aiming to transfer the relevant features to the target domain. The classifier becomes sensitive to the classification features and – by architecture – robust against the highly domain-specific context. The approach is benchmarked in a technical and a non-technical domain and shows convincing classification results. In particular, it is shown that the domain generalization capabilities and classification results are improved by the proposed architecture, allowing for larger domain shifts between source and target domains.