Artificial intelligence (AI), deep learning (DL) or machine learning (ML) is the ability of computer systems, machines and enginery to work devise procedures like humans. These technologies provide opportunities and possibilities to advance diagnostics and in planning also in the field of human medicine and dentistry. The purpose of this literature review was to ascertain the applicability and significance of AI, as well as to highlight its uses in maxillofacial surgery. The primary inclusion criterion for this publication was an original paper written in English focusing on the use of AI, DL or ML in maxillofacial surgery. The sources of information were PubMed, Scopus and Web of Science, and the queries were made on 31st of December 2023. The search strings used were “artificial intelligence maxillofacial surgery”, “machine learning maxillofacial surgery” and “deep learning maxillofacial surgery”. Following the removal of duplicates, all remaining publications that were returned by the searches and were screened by three independent operators to minimize the risk of bias. The analysis of publications from 1992 to 2023 identified certain records, of which 324 were finally selected. These were calculated according to the year of publication with a continuous increase (excluding 2012 and 2013) of R2 = 0.9295. Generally, in orthognathic dentistry and maxillofacial surgery, artificial intelligence and machine learning have gained popularity over the past few decades. When we included the keywords "planning in maxillofacial surgery" and "planning in orthognathic surgery", the set of published papers significantly increased to the number of 7535 publications. The first publication appeared in 1965, with an increasing trend (excluding 2014-2018), with an R2 value of 0.8642. These tools have been found useful for diagnosis, treatment planning in head and neck surgical oncology, cosmetic and aesthetic surgery, and in oral pathology. In orthognathic surgery, they have been utilised for diagnosis, treatment planning, assessment of treatment needs, cephalometric analyses, and orthognathic surgeries, among other applications. The review confirms that the current use of artificial intelligence and machine learning in maxillofacial surgery is focused mainly on the evaluation of digital diagnostic methods especially radiology, treatment plans and postoperative results. However, as these technologies are integrated in maxillofacial surgery and robotic surgery in head and neck region, it is expected that in the future they will be gradually utilized to plan and comprehensively evaluate the success of maxillofacial surgeries.

Non-neural Machine Learning (ML) and Deep Learning (DL) are used to predict system failures in industrial maintenance. However, only a few studies have assessed the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three data sets of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously and (3) a nitrogen generator working continuously. A binary classification task assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM and Transformers) are compared using multivariate time series. The dimension of the prediction windows plays a crucial role and the results highlight the effectiveness of DL approaches in classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches in classifying similar and repetitive patterns preceding a failure.

This research introduces a pioneering solution to the challenges posed by gastrointestinal tract (GI) cancer in radiation therapy, focusing on the imperative task of precise organ segmentation for minimizing radiation-induced damage. GI imaging has historically used manual demarcation, which is laborious and uncomfortable for patients. We address this by introducing the ResECA-U-Net deep learning model, a novel combination of the UNet and ResNet34 architectures. Furthermore, we further augment its functionality by incorporating the Efficient Channel Attention (ECA-Net) methodology. By utilizing data from the UW-Madison Carbone Cancer Centre, we carefully investigate several image processing techniques designed to capture critical local characteristics. With its foundation in computer vision concepts, the ResECA-U-Net model is excellent at extracting fine details from GI images. Sophisticated metrics such as intersection over union (IoU) and the dice coefficient are used to evaluate performance. Our study's outcomes demonstrate the effectiveness of the suggested method, yielding an impressive 96.27% Dice coefficient and 91.48% IoU. These results highlight the significant contribution that our strategy has made to the advancement of cancer therapy. Beyond its scientific merits, this work has the potential to significantly enhance cancer patients' quality of life and provide better long-term outcomes. Our work is a significant step towards automating and optimizing the segmentation process, which can potentially change how GI cancer is treated completely.

With the popularity of solar energy in the electricity market, demand arises for data such as precise locations of solar panels for efficient energy planning, management, and distribution. However, this data is not easily accessible and in some cases, information such as precise locations does not exist. Furthermore, existing data sets for training semantic segmentation models of PV installations are limited, and their annotation is time-consuming and labor-intensive. Therefore, for additional remote sensing (RS) data creation, the pix2pix generative adversarial network (GAN) is utilized, enriching the original resampled training data of varying GSDs without compromising its integrity. Experiments done with the DeepLabV3 model, ResNet-50 backbone, and pix2pix GAN architecture were conducted to find the optimal configuration for an accurate RS imagery segmentation model. The result is a fine-tuned solar panel semantic segmentation model, trained using transfer learning and utilizing an optimal amount – 60% of generated RS imagery for additional training data, increasing model accuracy. The findings demonstrate the benefits of using GAN-generated images as additional training data, increasing the size of small data sets, and improving the capabilities of the segmentation model for solar panel detection in RS images.

With the widespread Application of Virtual Reality (VR) in education, optimizing foreign language learning in VR has become a focal point of research. This paper introduces a comprehensive theoretical framework (VR-CCL) based on constructivism and cognitive load theory to enhance foreign language learning in VR. Through a literature review, we explore the applications of VR in education, foreign language learning theories, and prior works on technology-assisted language learning. We further detail the three main components of the VR-CCL framework and validate its effectiveness through two case studies: Duolingo VR and Rosetta Stone VR. Finally, we discuss the strengths and limitations of the framework and its implications for educators and developers.

An accurate, economical, and reliable device for detecting falls in persons ambulating with the assistance of an orthopedic walker is crucially important for the elderly and patients with limited mobility. Existing wearable devices such as wristbands are not designed for walker users, and patients may not wear them at all times. This research proposes a novel idea of attaching an internet-of-things (IoT) device with an inertial measurement unit (IMU) sensor directly to an orthopedic walker to perform real-time fall detection as well as activity logging. A dataset is collected and labeled for walker users in four activities, including idle, motion, step, and fall. Classic machine learning algorithms are evaluated using the dataset by comparing their classification performance. Deep learning with convolutional neural network (CNN) is also explored. Furthermore, the hardware prototype is designed by integrating a low-power microcontroller for onboard machine learning, an IMU sensor, a rechargeable battery, and Bluetooth wireless connectivity. The research results show the promise of improved safety and well-being of walker users.

Requirements Engineering (RE) is an important step in the whole software development lifecycle. The problem in RE is to determine the class of the software requirements as functional and non-functional. Proper and early identification of these requirements is vital for the entire development cycle. On the other hand, manual government of requirement classes is a timewasting task, and it needs intensive effort. Automatic requirement classification techniques through advanced Machine Learning (ML) strategies are started to be developed to address this problem. Basically, software requirements are generated as natural language explanations and therefore requirement classification may be handled as a particular Natural Language Processing (NLP) problem. From ML point of view, classification strategies require dataset to be used in the training/learning phase. For this goal, we generated a unique Turkish dataset having collected the requiremenst from real-world software projects with 4600 samples. Of these requirements, 3000 and 1600 were labeled as functional and non-functional, respectively. The data set has been evaluated using (i) traditional machine learning algorithms, (ii) deep learning algorithms, and (iii) transformer models respectively. As a result BERTurk was found to be the most successful algorithm to discriminate functional and non-functional requirements in terms of 95% f-score metric.

This paper presents a two-stage hierarchical neural network using image classification and object detection algorithms as key building blocks for a system that automatically detects a potential design right infringement. This neural network is trained to return the Top-N original design right records that highly resemble the input image of a counterfeit. Design rights specify the unique aesthetic characteristics of a product. Due to the rapid change of trends, new design rights are continuously generated. This work proposes an Ensemble Neural Network (ENN), an artificial neural network model that aims to deal with a large amount of counterfeit data and design right records that are frequently added and deleted. At first, we performed image classification and objection detection learning per design right using the existing models with a proven track record of high accuracy. The distributed models form the backbone of the ENN and yield intermediate results aggregated at a master neural network. This master neural network is a deep residual network paired with a fully connected network. This ensemble layer is trained to determine the sub-models that return the best result for a given input image of a product. In the final stage, the ENN model multiples the inferred similarity coefficients to the weighted input vectors produced by the individual sub-models to assess the similarity between the test input image and the existing product design rights to see any sign of violation. Given 84 design rights and the sample product images taken meticulously under various conditions, our ENN model achieved average Top-1 and Top-3 accuracies of 98.409% and 99.460%, respectively. Upon introducing new design rights data, a partial update of the inference model was done an order of magnitude faster than the single model. ENN maintained a high level of accuracy as it scaled out to handle more design rights. Therefore, the ENN model is expected to offer practical help to the inspectors in the field, such as the customs at the border that deal with a swarm of products.

Data Extraction is a technique is called as clustering which is used to retrieve data either from the files or data bases or both. This paper focuses on the performance evaluation parameters of the clustering algorithms based on different parameters or conditions or constraints and parameters which are used to perform the clustering process to get the clusters on the data sets. Therefore best clusters are retrieved when best parameters or conditions or constraints or preferences which are applied on the data sources for the clustering process. These parameters or conditions or constraints are opted by the user called as user preferences.

Agriculture is one of the indispensable fields for the survival of mankind. Potatoes also have a significant role in the field of agriculture. The quality and quantity of potatoes are significantly impacted by several diseases, such as early blight and late blight, and manual interpretation of these leaf diseases is time-consuming and inconvenient. Fortunately, leaf appearance is used to detect diseases in potato plants. Productivity will considerably rise if the infections are detected early. Different types of image processing methods and machine learning methods are used for early recognition of those diseases from leaf images so that the product losses are decreased significantly. For the incredible and marvelous performance of CNN, it is the most popular deep learning method that is used immensely for the recognition of leaf diseases from images. Several pretrained deep learning models, such as VGG16, ResNet50, InceptionV3, MobileNetV2, Xception, and a deep learning model developed using CNN, are employed for potato leaf disease classification and recognition on the same dataset. The transfer learning technique is applied to the pretrained model and the data augmentation technique is applied to the Proposed CNN model for potato disease classification from leaf samples. Compared to pretrained models, the proposed CNN model offers the lowest loss and highest accuracy for potato leaf disease detection while using fewer parameters and layers. It achieves the best performance with a test accuracy of 99.33% compared to other Pretrained models used in the diagnosis of potato leaf disease.

Aiming at the problem of hypersonic morphing vehicle avoiding no-fly zones and reaching the target, an improved predictor-corrector guidance method is proposed. Firstly, the aircraft motion model and the constraint model are established. Then, the basic algorithm is given, the Q-learning method is used to design the attack angle and sweep angle scheme to ensure that the aircraft can fly over the low-altitude zones. The B-spline curve is used to design the location of flight path points and the bank angle scheme is designed according to the predictor-corrector method, so that the aircraft can fly around to avoid high-altitude zones. Next, Monte Carlo reinforcement learning(MCRL) method is used to improve predictor-corrector method and Deep Neural Network(DNN) is used to fit reward function. The improved method can generate trajectory with better performance. Simulation results verify the effectiveness of the proposed algorithm.

Financial markets require a great deal of decision making from the investors and market makers. One metric that can help ease the process of decision making is investment risk which can be measured in two parts; systematic risk and idiosyncratic risk. Clear understanding of the volatilities in each risk component can be a powerful signal in recognizing the right assets to maximize the investment returns. In this paper, we focus on the idiosyncratic volatility values and pre-calculate the idiosyncratic volatility values for 31,198 members of NYSE, Amex and Nasdaq markets for the trades occurring between January 1963 and December 2019. Utilizing a subset of dataset, limited to Nasdaq100 index, we consider the application of machine learning techniques in predicting the idiosyncratic volatility values using the raw trade data to explore a data extension option for the future market trade records that have not yet occurred. We offer a deep learning based regression model and compare it with traditional tree-based methods on a small subset of our per-calculated idiosyncratic volatility dataset. Our analytical results show that the performance of the deep learning techniques is much more robust in comparison to that of the traditional tree-based baselines.

This study investigates how digital alchemy can enhance literature and language teaching through a combination of online and face-to-face learning. It uses constructivist learning theory and the SAMR model to examine how digital tools and resources can transform learner engagement, critical thinking, and creativity. The study gathered data from interviews, focus groups, and document analysis with 30 participants from private HEI schools. The results show that digital alchemy through blended learning allows learners to personalize and collaborate in their exploration of various literary texts. However, the study also identifies some challenges related to resource availability and educator training. The study emphasizes the importance of using digital alchemy in literature and language teaching and suggests some ways for educators, administrators, and policymakers to effectively use digital tools and resources for student-centered teaching methods in the digital era.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

In today's business world, many companies have realized that consumer feedback evaluations play a crucial part in shaping the company's future activities. The hotel and tourism industries are well-known examples where the user feedback has become crucial. Even though most accommodations want their clients to express their opinions about their services, these reviews are nevertheless carefully reviewed by them. This manual approach is time demanding and error prone, the level of expertise of the individual analyzing the evaluations determines the quality of the manual analysis. This research focuses on the development of a tool-based support system that analyzes text-based customer evaluations and then highlights the maintenance issues identified in the reviews, removing the need to manually evaluate and analyze the customer reviews. The process includes data preparation, sentiment analysis, and a fully trained deep learning model to extract critical insights. Using sentiment analysis techniques after data preprocessing and trained deep learning model, an accuracy of 96\% was achieved, and this paper discusses how this technology helps to meet the needs of accommodation management by completing activities efficiently. This might save management time and helps to save money without losing clients, allowing them to enhance their additional sales.

Hepatocellular carcinoma is the most common primary malignant hepatic tumor and occurs most often in the setting of chronic liver disease. Liver transplantation is a curative treatment option and is an ideal solution because it solves the chronic underlying liver disorder while removing the malignant lesion. Because of organ shortages this treatment can only be applied to carefully selected patients according to clinical guidelines to minimize risk of recurrence. Artificial intelligence is an emerging technology with multiple applications in medicine with a predilection for domains that work with medical imaging like radiology. With the help of these technologies laborious tasks like segmentation can be automated and workflow in radiology departments can be improved. Other roles include in depth pixel-wise analysis of lesions by radiomics or deep learning in order to find new imaging criteria that allow better prediction of treatment response or risk of recurrence. Liver transplant is an ideal treatment for patients with hepatocellular carcinoma in the setting of chronic liver disease and artificial intelligence could provide solutions for improving the management of liver transplant candidates to improve survival.

In tunnel excavation with boring machines, the tunnel face is supported to avoid collapse and minimise settlement. This article proposes the use of reinforcement learning, specifically the Deep Q-Network algorithm, to predict the face support pressure. The approach is tested both analytically and numerically. By using the soil properties ahead of the tunnel face and the overburden depth as the input, the algorithm is capable of predicting the optimal tunnel face support pressure, adapting to changes in geological and geometrical conditions.

Machine Learning (ML) methods have become important to enhance the performance of decision-support predictive models. However, class imbalance is one of the main challenges for developing ML models, because it limits the generalization of these models, and biases the learning algorithms. In this paper, we consider oversampling methods for generating synthetic categorical clinical data aiming to improve the predictive performance in ML models, and the identification of risk factors for cardiovascular diseases (CVDs). We performed a comparative study of several categorical synthetic data generation methods, including Generative Adversarial Networks (GANs). Then, we assessed the impact of combining oversampling strategies and linear and nonlinear supervised ML methods. Lastly, we conducted a post-hoc model interpretability based on the importance of the risk factors. Experimental results show the potential of GAN-based models for generating high-quality categorical synthetic data, yielding probability mass functions that are highly close to real data, maintaining relevant insights, and contributing to increase the predictive performance. The GAN-based model and a linear classifier outperforms other oversampling techniques, improving 2\% the area under the curve. These results demonstrate the capability of synthetic data to help both in determining risk factors and building models for CVD prediction.

Every month teachers face the dilemma of what exercises should their students practice, and what their consequences are on long-term learning. Since teachers prefer to pose their own exercises, this generates a large number of questions, each one attempted by a small number of students. Thus, we couldn’t use models based on big data such as deep learning. Instead, we developed a simple to understand state-space model that predicts end-of-year national test scores. We used 2,386 online fourth-grade mathematic questions designed by teachers and each attempted by some of the 500 students in 24 low socioeconomic schools. We found that the state-space model predictions improved month-by-month and that in most months it outperformed linear regression models. Moreover, the state-space estimator provides for each month a direct mechanism to simulate different practice strategies and compute their impact on the end-of-year standardized national test. We built iso-impact curves based on two critical variables: the number of questions solved correctly in the first attempt and the total number of exercises attempted. This allows the teacher to visualize the trade-off between asking students to do exercises more carefully or doing more exercises. To the best of our knowledge, this model is the first of its kind in education. It is a novel tool that supports teachers drive whole classes to achieve long-term learning targets.

Freezing of Gait (FOG) is an impairment that affects the majority of patients in the advanced stages of Parkinson’s Disease (PD). FOG can lead to sudden falls and injuries, negatively impacting the quality of life for the patients and their families. Rhythmic Auditory Stimulation (RAS) can be used to help patients recover from FOG and resume normal gait. RAS might be ineffective due to the latency between the start of a FOG event, it’s detection and initialization of RAS. We propose a system capable of both FOG prediction and detection using signals from tri-axial accelerometer sensors that will be useful in initializing RAS with minimal latency. We compared the performance of several time frequency analysis techniques, including moving windows extracted from the signals, handcrafted features, Recurrence Plots (RP), Short Time Fourier Transform (STFT), Discreet Wavelet Transform (DWT) and Pseudo Wigner Ville Distribution (PWVD) with Deep Learning (DL) based Long Short Term Memory (LSTM) and Convolutional Neural Networks (CNN). We also propose three Ensemble Network Architectures that combine all the time frequency representations and DL architectures. Experimental results show that our ensemble architectures significantly improve the performance compared with existing techniques. We also present the results of applying our method trained on publicly available dataset to data collected from patients using wearable sensors in collaboration with A.T. Still University.

Language learners often face communication problems when they need to express themselves and do not have this ability. On the other hand, continuous advances in technology create new opportunities to improve second language (L2) acquisition through context-aware ubiquitous learning (CAUL) technology. Since vocabulary is the foundation of all language acquisition, this article presents the ULearnEnglish, an open-source system to allow ubiquitous English learning focused on incidental vocabulary acquisition. To evaluate the proposal, 15 learners used the system developed, and 10 answered a survey based on the Technology Acceptance Model (TAM). Results indicate a favorable response to the use of the learner context to assist them in their learning. The ULearnEnglish achieved an acceptance of 78.66% for the perception of the utility, 96% for the perception of ease of use, 86% for user context assessment, and 88% for ubiquity. This study presented a positive response in using the location of users to assist their learning. Among the main contributions, this study demonstrates an opportunity for ubiquity use in future research in language learning. Also, furthers studies can use the source available to evolve the model and system.

This paper reviews non-intrusive load monitoring (NILM) approaches that employ deep neural networks to disaggregate appliances from low frequency data, i.e. data with sampling rates lower than the AC base frequency. We first review the many degrees of freedom of these approaches, what has already been done in literature, and compile the main characteristics of the reviewed publications in an extensive overview table. The second part of the paper discusses selected aspects of the literature and corresponding research gaps. In particular, we do a performance comparison with respect to reported MAE and F$_1$-scores and observe different recurring elements in the best performing approaches, namely data sampling intervals below 10\,s, a large field of view, the usage of GAN losses, multi-task learning, and post-processing. Subsequently, multiple input features, multi-task learning and related research gaps are discussed, the need for comparative studies is highlighted, and finally, missing elements for a successful deployment of NILM approaches based on deep neural networks are pointed out. We conclude the review with an outlook on possible future scenarios.

Now when the whole world is still under COVID-19 pandemic, many schools have transferred the teaching from physical classroom to online platforms. It is highly important for schools and online learning platforms to investigate the feedback to get valuable insights about online teaching process so that both platforms and teachers are able to learn which aspect they can improve to achieve better teaching performance. But handling reviews expressed by students would be a pretty laborious work if they were handled manually as well as it is unrealistic to handle large-scale feedback from e-learning platform. In order to address this problem, both machine learning algorithms and deep learning models are used in recent research to automatically process students' review getting the opinion, sentiment and attitudes expressed by the students. Such studies may play a crucial role in improving various interactive online learning platforms by incorporating automatic analysis of feedback. Therefore, we conduct an overview study of sentiment analysis in educational field presented in recent research, to help people grasp an overall understanding of the sentiment analysis research. Besides, according to the literature review, we identify three future directions that researchers can focus on in automatically feedback processing: high-level entity extraction, multi-lingual sentiment analysis, and handling of figurative language.

The COVID-19 pandemic forced the transition to emergency online learning without prior preparation or guidelines. This transition has been particularly challenging in developing countries and low-resource contexts and hindered student engagement. We aim to identify the engagement strategies which students, engaging in emergency online learning in low-resource contexts, perceive to be effective. We conducted a sequential mixed-methods study based on Moore’s interaction framework for distance education. First, we conducted a literature review and interviewed ten teachers and ten students to identify a list of engagement strategies. Then, we designed a questionnaire that examines student perceptions of these strategies. We administered the questionnaire to 313 students engaging in emergency online learning in low-resource contexts. Our analysis results showed that student-content engagement strategies, e.g. screen sharing, summaries, and class recordings, are perceived as the most effective, closely followed by student-teacher strategies, e.g. Q&A sessions and reminders. Student-student strategies, e.g. group chat and collaborative work, are perceived as the least effective. The perceived effectiveness of engagement strategies depends on the context and the students’ characteristics, e.g. gender, major, and technology access. To support instructors, instructional designers, and researchers we propose a ten-level guide for engaging students during emergency online classes in low-resource contexts.

Genome sequencing is enabling precision medicine—tailoring treatment to the unique constellation of variants in an individual’s genome. The impact of recurrent pathogenic variants is often understood, leaving a long tail of rare genetic variants that are uncharacterized. The problem of uncharacterized rare variation is especially acute when it occurs in genes of known clinical importance with functionally consequent frequent variants and associated mechanisms. Variants of unknown significance (VUS) in these genes are discovered at a rate that outpaces current ability to classify them using databases of previous cases, experimental evaluation, and computational predictors. Clinicians are thus left without guidance about the significance of variants that may have actionable consequences. Computational prediction of the impact of rare genetic variation is increasingly becoming an important capability. In this paper, we review the technical and ethical challenges of interpreting the function of rare variants in two settings: inborn errors of metabolism in newborns, and pharmacogenomics. We propose a framework for a genomic learning healthcare system with an initial focus on early-onset treatable disease in newborns and actionable pharmacogenomics. We argue that (1) a genomic learning healthcare system must allow for continuous collection and assessment of rare variants, (2) emerging machine learning methods will enable algorithms to predict the clinical impact of rare variants on protein function, and (3) ethical considerations must inform the construction and deployment of all rare-variation triage strategies, particularly with respect to health disparities arising from unbalanced ancestry representation.

Several studies suggest that COVID-19 may be accompanied by symptoms such as a dry cough, muscle aches, sore throat, and mild to moderate respiratory illness. The symptoms of this disease indicate the fact that COVID-19 causes noticeable negative effects on the lungs. Therefore, considering the health status of the lungs using X-rays and CT scans of the chest can significantly help diagnose COVID-19 infection. Due to the fact that most of the methods that have been proposed to COVID-19 diagnose deal with the lengthy testing time and also might give more false positive and false negative results, this paper aims to review and implement artificial intelligence (AI) image-based diagnosis methods in order to detect coronavirus infection with zero or near to zero false positives and false negatives rates. Besides the already existing AI image-based medical diagnosis method for the other well-known disease, this study aims on finding the most accurate COVID-19 detection method among AI methods such as machine learning (ML) and artificial neural network (ANN), ensemble learning (EL) methods.

The outbreak of novel Coronavirus (SARS-COV-2 ) disease (COVID-19) in Wuhan has attracted worldwide attention. SARS-COV-2 known to share a similar clinical manifestation that includes various symptoms such as pneumonia, fever, breathing difficulty, and in particular, SARS-COV-2 also causes a severe in ammation state that leads to death. Consequently, massive and rapid research growth has been observed across the globe to elucidate the mechanisms of infections and disease progression in genotype and phenotype scale. Data Science is playing a pivotal role in in-silico analysis to draw hidden and novel insights about the SARS-COV-2 origin, pathogenesis, COVID-19 outbreak forecasting, medical diagnosis, and drug discovery. With the availability of multi-omics, radiological, biomolecular, and medical data urges to develop novel exploratory and predictive models or customise exiting learning models to t the current problem domain. The presence of many approaches generates the need for the systematic surveys to guide both data scientists and medical practitioners. We perform an elaborate study on the state-of-the-art data science method ologies in action to tackle the current pandemic scenario. We consider various active COVID-19 data analytics domains such as phylogeny analysis, SARS-COV-2 genome identi cation, protein structure prediction, host-viral protein interactomics, clinical imaging, epidemiological analysis, and most importantly (existing) drug discovery. We highlight types of data, their generation pipeline, and the data science models in use. We believe that the current study will give a detailed sketch of the road map towards handling COVID-19 like situation by leveraging data science in the future. We summarise our review focusing on prime challenges and possible future research directions .

Breast cancer is the leading cause of cancer deaths worldwide in women. This aggressive tumour can be categorized into two main groups: in situ and infiltrative, with the latter being the most common malignant lesions. The current use of Magnetic Resonance Imaging (MRI) was shown to provide highest sensitivity in the detection and discrimination between benign vs. malignant lesions, when interpreted by expert radiologists. In this article, we present the prototype of a Computer-Aided Detection/Diagnosis (CAD) system that could provide valuable assistance to the radiologist for the discrimination between in situ and infiltrating tumours. The system consists of two main processing levels: 1) Localization of possibly tumoral regions of interest (ROIs) through an iterative procedure based on intensity values (ROI Hunter) followed by a deep-feature extraction and classification method for false-positive rejection; 2) Characterization of the selected ROIs and discrimination between in situ and invasive tumour, consisting of Radiomics feature extraction and classification through a machine-learning algorithm. The CAD system was developed and evaluated using a DCE-MRI image database, containing at least one confirmed mass per image, as diagnosed by an expert radiologist. When evaluating the accuracy of the ROI Hunter procedure with respect to the radiologist-drawn boundaries, sensitivity to mass detection was found to be 75%. The AUC of the ROC curve for discrimination between in situ and infiltrative tumors was 0.70.

Metabolomics analysis generates vast arrays of data, necessitating comprehensive workflows involving expertise in analytics, biochemistry and bioinformatics, in order to provide coherent and high-quality data that enables discovery of robust and biologically significant metabolic findings. In this protocol article, we introduce NoTaMe, an analytical workflow for non-targeted metabolic profiling approaches utilizing liquid chromatography–mass spectrometry analysis. We provide an overview of lab protocols and statistical methods that we commonly practice for the analysis of nutritional metabolomics data. The paper is divided into three main sections: the first and second sections introducing the background and the study designs available for metabolomics research, and the third section describing in detail the steps of the main methods and protocols used to produce, preprocess and statistically analyze metabolomics data, and finally to identify and interpret the compounds that have emerged as interesting.

This study assesses the development of professional skills in university students using serious games (SG), from a sustainability perspective. The Sustainable Development Goals (SDGs) were set by the United Nations’ 2030 Agenda for Sustainable Development. Universities are strategic agents in the transformation process towards sustainability. This way, they should be committed to promoting such sustainable values in the students through curricular sustainability, implementing active methodologies and SG for that purpose. Transversal skills are essential for the development of future graduates. The objective of this study was to assess which professional skills should be developed through the SG called The Island, to improve the degree of student satisfaction with the incorporation of a sustainable curriculum. The data were obtained using a questionnaire, and then analysed using linear regression models, with their inference estimated through the goodness of fit and ANOVA. The first results indicated that the implementation of the SG promoted a strengthening of the students' sustainable curriculum through the development of those skills. It was concluded that the key to success in education for sustainable development is improving the development of strategic thinking, collaborative thinking, and self-awareness, in addition to encouraging systemic, critical, and problem-solving thinking.

Artificial intelligence methods and application have recently shown great contribution in modeling and prediction of the hydrological processes, climate change, and earth systems. Among them, deep learning and machine learning methods mainly have reported being essential for achieving higher accuracy, robustness, efficiency, computation cost, and overall model performance. This paper presents the state of the art of machine learning and deep learning methods and applications in this realm and the current state, and future trends are discussed. The survey of the advances in machine learning and deep learning are presented through a novel classification of methods. The paper concludes that deep learning is still in the first stages of development, and the research is still progressing. On the other hand, machine learning methods are already established in the fields, and novel methods with higher performance are emerging through ensemble techniques and hybridization.

Deforestation through land-use conversion, illegal logging, and timber trafficking is believed to cause ~10% of the annual human carbon dioxide emissions at the global level. Given the large contribution, local and national policies have been set in place in the effort to reduce deforestation and support reforestation. However, accurate assessment of forest carbon stock is expensive and challenging in remote areas and on large geographical scales. To improve carbon stock monitoring and evaluation of fine-scale forest loss, we developed a rapid, automatic, scalable, and cost-efficient generalized deep learning framework that uses diverse remote sensing data and satellite imagery to derive aboveground carbon density from accurate estimates of tree canopy heights at fine-grained resolution (30x30 meters) in remote tropical rainforests. The remote sensing data is composed of Landsat-8, Sentinel-1, land cover, digital elevation model, and NASA CMS airborne LiDAR, as well as vegetation indices, texture metrics, and climatic data. Data sources were compiled into a data pipeline which produced >300 features and 2 million observations over forests in Indonesian Borneo. Using LiDAR swath data on canopy forest high for ~100,000 hectares in Indonesian Borneo to create a training and validation datasets, our neural network model produced aboveground carbon density estimates with R2 of 0.82, which is a significant improvement from comparable works by using Random Forest (R2 of 0.3-0.5). This deep learning framework can be used to facilitate further carbon stock modeling in other forest regions (e.g., Brazil) as well as for the general purpose of climate change mitigation.

In this short communication, a concept has been presented to model geographical data to predict future temperature of Tabuk, region. Machine learning has been applied to the weather station data to develop a prediction model. The preliminary results are promising and encouraging and are envisaging to further this research towards the determination of unknown temperature rise in the region. This is important to mention here, that the problem has been formulated as a Regression problem, NOT as a classification problem. Hence, applying Convolutional neural networks is not possible, due to the non-existence of classes or converting the temperature values to classes does not make any sense. Hence, this is defined as a regression problem which achieved encouraging desirable results.

An Oscillating Water Column device, specifically a Savonius turbine, underwent comprehensive testing within an air duct to evaluate its performance under varying rotational speeds, flow directions, and the presence of power augmenters positioned both in front of and behind the device. The experimental setup involved the utilization of load cells and pressure transducers, with their data utilized to calculate pressure differentials across the turbine and torque. Subsequently, a predictive model based on decision trees was developed using Machine Learning. This model was then used to analyze the influence of various features on predicting the pressure difference, considered as the output. The results of the validation (10-fold cross-validation) and test phases were thoroughly investigated. Moreover, obtaining a predictive model allows for the exploration of different scenarios without relying solely on physical experimentation, thereby broadening the scope for further testing.

In this study, a comprehensive review on production scheduling based on reinforcement learning (RL) techniques using bibliometric analysis has been carried out. The aim of this work is, among other things, to point out the growing interest in this domain and to outline the influence of RL as a type of machine learning on production scheduling. To achieve this, the paper explores production scheduling using RL by investigating the descriptive metadata of all pertinent publications contained in the Web of Science database. The study focuses on a wide spectrum of publications spanning the years between 1998 and 2023. The findings and recommendations of this study can serve as new insights for future research endeavors in the realm of production scheduling using RL techniques.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

The purpose of this paper is to propose a novel transfer learning regularization method based on knowledge distillation. Recently, transfer learning methods have been used in various fields. However, the problems such as knowledge loss still occur during the process of transfer learning to a new target dataset. To solve these problems, there are various regularization methods based on knowledge distillation techniques. In this paper, we propose a transfer learning regularization method based on feature map alignment used in the field of knowledge distillation. The proposed method is composed of two attention based submodules: self-pixel attention (SPA) and global channel attention (GCA). The self-pixel attention submodule utilizes both the feature maps of the source and target models, so that it provides an opportunity to jointly consider the features of the target and the knowledge of the source. The global channel attention submodule determines the importance of channels through all layers, unlike the existing methods that calculate these only within a single layer. Accordingly, transfer learning regularization is performed by considering both the internal of each single layer and the depth of the entire layer. Consequently, the proposed method using both of these submodules showed overall improved classification accuracy than the existing methods in classification experiments on commonly used dataset.

This paper proposes an enhanced Quantum Key Distribution (QKD) protocol by incorporating a Three-Dimensional Angular Momentum Representation (3D AMR) to address vulnerabilities inherent in traditional two-dimensional polarization states-based systems. The 3D AMR method expands the state space, potentially increasing security against sophisticated quantum attacks. We present a theoretical and computational framework that transitions from the conventional two-dimensional polarization to a three-dimensional angular momentum space, which inherently increases the complexity and security of the quantum states used in QKD.

The importance of knowing the advance time in drip irrigation lines lies in its precision, as this influences the proper management of water and nutrients delivery. The mathematical calculation to determine the advance time is based on the general hydraulic flow equation, which relates the fluid velocity and the cross-sectional area of the pipe to the volume of water flowing through it. However, in irrigation pipes, where the flow is a mixture of dripper properties, its pressure, the approach to solving the advance time is different, as it is the sum of individual advance times for each segment. To address this issue, Python 3.11 was used along with various libraries such as Pandas, NumPy, Matplotlib, Seaborn, and Scikit-learn to create a modeling environment and run algorithms that could predict outcomes. A program was developed that calculates the advance time for each segment of the drip line using partial velocities, and a dataset was generated that was used to train and test machine learning models. Several machine learning algorithms such as Linear Regression, Support Vector Machines (SVM), K-Nearest Neighbors (KNN), Decision Trees, and Random Forests were implemented to predict the advance time. Additionally, SciPy optimize was used to obtain multivariable equations that describe the advance time in drip irrigation lines. Results showed that the dripper flow has the greatest influence on the advance time, followed by the diameter and distance. Decision Tree and SVM models had the best accuracy with scores above 98%. Equations were found to calculate the advance time in the complete drip line and in 95% of its length, with coefficients of determination close to 99.33%. This study demonstrated the importance of understanding the relationship between dripper parameters and travel time in drip irrigation, as well as the utility of machine learning and optimization tools for predicting and modeling this phenomenon.

The flux of opinions in newsletters and social media platforms significantly influences market perceptions regarding corporate entities and their financial instruments. This paper introduces an advanced model, the Sentiment Dynamics Analyzer (SDA), which leverages a refined hierarchical architecture of Transformers to effectively discern the sentiment embedded within financial texts, ranging from news headlines to microblogs. We have enhanced a RoBERTa model with specialized sentiment lexicons and an augmented layer of Transformer models tailored for nuanced sentence-level sentiment detection, aiming to assign a sentiment score from -1 to +1. Our evaluations demonstrate that SDA not only surpasses the previous best methods but also exhibits superior performance over robust baseline models. This success underscores the utility of integrating tailored contextual analyses with sector-specific sentiment insights in improving predictive accuracy.

In higher education, the cultivation of research competency is pivotal for students’ critical thinking development and their subsequent transition into the professional workforce. While statistics plays a fundamental role in supporting the completion of a research project, it is often perceived as challenging, particularly by students in majors outside mathematics or statistics. The connection between students’ statistical proficiency and their research competency remains unexplored despite its significance. To address this gap, we utilized the supervised machine learning approach to predict students’ research competency, as represented by their performance in a research methods class, with predictors of students’ proficiency in statistical topics. Predictors relating to students’ learning behavior in a statistics course such as assignment completion and academic dishonesty are also included as auxiliary variables. Results indicate that the three primary categories of statistical skills—namely, understanding of statistical concepts, proficiency in selecting appropriate statistical methods, and statistics interpretation skills— can be used to predict students’ research competency, as demonstrated by their final course scores and letter grades. This study advocates for strategic emphasis on the identified influential topics to enhance efficiency in developing students’ research competency. Findings could inform instructors in adopting a strategic approach to teaching the statistical component of research for enhanced efficiency.

Auxins are chemical compounds of wide interest, mostly due to their role in plant metabolism and development. Since the latter half of the XX century, synthetic auxins have been used as herbicides, presenting notable advantages, such as low toxicity in humans. As of today, extensive descriptions of syntetic and natural auxins have been made; yet studies centered on the molecular recognition process of auxins are scarce. Herein, we present a comprehensive in silico characterization of auxin receptor TIR1, using structure based methods to aid de novo design of putative ligands. In addition, we conducted binding site characterization using cosolvent molecular dynamics and enhanced sampling simulations with reference ligands. We also present a database of putative auxins and decoy compounds which can aid further studies focusing on synthetic auxin design. To the best of our knowledge, this study is the first of its kind focusing on TIR1.

Ideas about Artificial Intelligence appeared about half a century ago, but only now is it becoming an essential element of everyday life. The data provided is getting bigger and bigger and, in this case, we need artificial intelligence that helps us with superhuman powers. The interaction with medicine is getting closer and closer, medicine being a field that continues to be perfected. Machine learning, deep learning, neural networks, computer vision are some of the mechanisms that are already applied in medicine, becoming a trend in healthcare worldwide. Artificial intelligence will be the thing that will change contemporary medicine. Developed countries such as Japan, France, Germany have already implemented artificial intelligence in their medical systems. The help is in medical diagnosis, patient monitoring, personalized therapy, and workflow optimization. Artificial intelligence will help surgeons to perfect their skills, to standardize techniques, to choose the best surgical technique. The goal is to predict complications, reduce diagnostic time, diagnose complex pathologies, guide the surgeon intraoperatively and reduce medical errors. We are at the beginning but the potential is enormous.

The problem addressed in this article consists of the motion control of a quadrotor, comprising model disturbances and uncertainties. In order to tackle model uncertainty, adaptive control based on reinforcement learning is used. The distinctive feature of this article, in comparison with other works on quadrotor control using reinforcement learning is the exploration of the underlying optimal control problem in which a quadratic cost and a linear dynamics allow an algorithm that runs in real time. Instead of identifying a plant model, adaptation is obtained by approximating the performance index given by the Q-function using directional forgetting recursive least squares that rely on a linear regressor build from quadratic functions of input/output data. The adaptive algorithm proposed is tested in simulation in a cascade control structure that drives a quadrotor. Simulations show the improvement in performance that results when the proposed algorithm is turned on.

In this paper we describe a method which combines sentiment analysis with machine learning techniques and/or multivariate statistical analysis. By applying this methodology it is possible to classify a collection of texts into two or more groups or clusters. On the basis of a number of previously defined clusters, the novelty of the outlined approach is the use of the sentiment analysis results as input to the machine learning model or multivariate statistical analysis. Once the classifier has been obtained, we can assign a given text into one of the pre-established clusters. The groups or clusters can represent different time periods, classes of texts transcribed from different conversations, etc. The method is illustrated through an example taken from one of the two studies in which we have applied this methodology. In one of the studies, the method was used to classify press news of a volcanic eruption, while in the other study it was used to classify the conversations recorded between a chatbot with different kinds of speakers (humans or chatbots). This last study was the seminal work in which we introduced this methodology.

With the increased emphasis on competition in academic settings, anxiety is becoming more common, which inevitably has some impact on students’ learning process and result. This study aimed to explore how competition-induced anxiety influences the subjective cognitive load (SCL), attention level and test score. Meanwhile, we investigated the mediating role of the behavioral inhibition system/behavioral activation system (BIS/BAS) in those processes. A total of 101 college students were recruited in Study 1 to learn five micro-lectures from massive open online courses (MOOC) under with and without competitive conditions. The results showed that participants’ state anxiety (SA) scores were higher after the experiment, participants in the competition condition had higher test scores, and the relationship between SA/ trait anxiety (TA) and SCL could be mediated by the BIS. To obtain more objective data on learning processes (attention levels), we conducted Study 2, which collected behavioral and EEG data from 42 college students during the online learning. The results showed that the competition group had higher SA, lower attention levels, and worse test scores, and the relationship between SA/TA and attention levels could be mediated through the BIS. The present study not only expands previous research by finding that BIS functioning plays an important role in the effects of anxiety on cognitive load and attention, but also offers implications for using competitive strategies to motivate students according to their aptitude.

In recent years the field of computer science has experienced great changes, due to the incredible advances in the field of artificial intelligence. Deep Learning models are responsible for most of them since the biggest milestones occurred in 2012 when AlexNet won the image classification challenge called ImageNet. These models have demonstrated great performances in different types of complex tasks like image restoration, medical diagnosis or object recognition. Their disadvantages are related to their high data dependency, which forces experts in the field to follow a precise methodology to obtain accurate models. In this paper, we describe a complete workflow that begins with the management of the raw data until the in-depth interpretation of the performance of the models. This should be taken as a high-level consultation document describing good practices that should be applied. Apart from the step-by-step methodology, we present different use cases that correspond to the two main problems of the field: classification and regression.

Heart failure is a prevalent cardiovascular condition with significant health implications, necessitating effective diagnostic strategies for timely intervention. This study explores the potential of continuous monitoring of non-invasive signals, specifically integrating Photoplethysmogram (PPG) and Electrocardiogram (ECG), for enhancing early detection and diagnosis of heart failure. Leveraging a dataset from the MIMIC-III database, encompassing 682 heart failure patients and 954 controls. Feature selection techniques were used to systematically select key features which were identified for their clinical relevance and significance in capturing cardiovascular dynamics and to reduce computational complexity and to decrease the chance of overfitting the ML algorithms. These features are then utilized to train and evaluate machine learning algorithms, resulting in a model with an impressive accuracy of 98%, sensitivity of 97.60%, specificity of 96.90%, and precision of 97.20%. The integrated approach outperforms single-signal strategies, showcas-ng its potential for early, precise, and non-invasive heart failure diagnosis. Furthermore, the study underscores the significance of continuous monitoring through wearables, emphasizing the benefits of integrating multiple signals for a comprehensive evaluation of cardiovascular health. The proposed approach holds promise for implementation in hardware systems to enable continuous monitoring, aiding in early detection and prevention of critical health conditions.

The term artificial intelligence refers to the field of computer science that deals with the design and implementation of computer systems that mimic elements of human behavior that imply basic intelligence: learning, adaptability, inference, contextual understanding, and problem solving among others. Artificial intelligence is a point of intersection between multiple sciences such as computer science, psychology, philosophy, neurology, linguistics and engineering science, with the aim of synthesizing intelligent behavior, with elements of reasoning, learning and adaptation to the environment, while it is usually applied to specially made machines or computers.

Remote sensing-based models usually have difficulty in generating spatio-temporally continuous terrestrial evapotranspiration (ET) due to cloud cover and model failures. To overcome this problem, machine learning methods have been widely used to reconstruct ET. However, studies comparing and evaluating the accuracy and effectiveness of reconstruction among different machine learning methods remain scarce. In this study, four popular machine learning methods (deep forest, deep neural network, random forest, extreme gradient boosting) were used to reconstruct the ET product, addressing gaps resulting from cloud cover and model failure. The ET reconstructed by four methods were evaluated and compared in Heihe River Basin. The results showed that four methods performed well in the Heihe River Basin, but the RF method was particularly robust. It not only performed well compared with ground measurement (R = 0.73), but also reconstructed ET throughout the basin. Validation based on ground measurement showed that DNN and XGB models performed well (R > 0.70). However, few gaps still existed in the desert after reconstruction, especially for the XGB model. The DF model filled these gaps throughout the basin, but the model had lower consistency compared with ground measurement (R = 0.66) and yielded many low values. The results of this study suggested that machine learning methods had considerable potential in reconstruction of ET at regional scale.

Neurodegenerative illnesses, such as Parkinson’s disease (PD), have a substantial impact on the overall well-being of those who are affected. This study investigates and contrasts the capabilities of convolutional neural networks (CNN) in detecting Parkinson’s disease (PD) by utilising hand-drawn images alongside wave and spiral images as input data. This study employs pre-trained CNN models, specifically MobileNet, ResNet50, EfficientNet-B1, and InceptionV3, to classify Parkinson’s disease (PD). The findings demonstrate that MobileNet surpasses other architectural designs, as evidenced by the F1-Score of the four classes: Spiral Normal (0.87), Spiral Parkinson (0.86), Wave Normal (0.97), and Wave Parkinson (0.97). MobileNet has also shown a remarkable accuracy of 0.92 in diagnosing Parkinson’s disease. The result demonstrates the efficacy of MobileNet in extracting features from images. The results of this study enhance the application of deep learning methods in the early detection of PD, as well as help indicate the effectiveness of patient therapy and exercise, promising better patient outcomes through timely intervention and treatment.

This work develops a new method for vector data augmentation. The proposed method applies the Principal Component Analysis (PCA) and determines the Eigenvectors of a set of training vectors for a Machine Learning (ML) method and uses them to generate the distilled vectors. The training and the PCA distilled vectors have the same dimension. The user chooses the number of vectors to be distilled and augmented to the set of training vectors. A statistical approach determines the lowest number of vectors to be distilled such that when augmented to the original vectors the extended set trains a ML classifier to achieve a required accuracy. Hence, the novelty of this study is, the distillation of vectors with the PCA method and their use to augment the original set of vectors. The advantage that comes from the novelty is that it increases the statistics of ML classifiers. To validate the advantage, we conducted experiments with four public databases and applied four classifiers: Neural Network, Logistic Regression, Support Vector Machine with linear and polynomial kernels. For the purpose of augmentation, we conduct several distillations including nested (double distillation). The latter notion means that new vectors were distilled from already distilled vectors. We train the classifiers with three sets of vectors: original vectors; original augmented with vectors distilled by PCA; original augmented with distilled and double distilled, by PCA, vectors. The experimental results are presented in the paper, and they confirm the advantage that the PCA distilled vectors increase the classification statistics of ML methods, if the distilled vectors augment the original training vectors.

In federated learning (FL), clients train models locally without sharing raw data, ensuring data privacy. In particular, federated distillation transfers knowledge to clients regardless of the model architecture. However, when groups of clients with different data distributions exist, sharing the same knowledge among all clients becomes impractical. To address this issue, this paper presents an approach that clusters clients based on the output of a client model trained using their own data. The clients are clustered based on the predictions of their models for each label on a public dataset. Prior knowledge of the number of groups is not required. Evaluations on the MNIST dataset showed that our method accurately identified these group structures and improved accuracy by 15–75% compared with traditional federated distillation algorithms when distinct group structures were present. Additionally, we observed significant performance improvements in smaller client groups, bringing us closer to fair FL.

A remarkable strengths of deep neural networks lies in their ability to discover patterns and representations from complex data. Deep learning models can learn and refine features at different levels of abstraction, enabling them to handle complex tasks in computer vision recognition, natural language processing, and speech recognition. The ability to generalize from examples, coupled with the capacity to process vast amounts of data, empowers deep learning to achieve state-of-the-art results across a wide spectrum of applications. An argument for this ability is based on similarities between deep neural networks and the nervous system. In this report, we argue that despite the remarkable performance of deep learning, there are still gaps between deep learning and the nervous system that needs to be closed to enable deep learning doing tasks that currently only the nervous system can perform

Recent SDN advances address traditional network management challenges through centralized control and plane separation. SDN prevents breaches using a centralized controller but introduces risks. The controller can be a single point of failure. Thus, an OpenFlow Controller's flow-based anomaly detection enhances SDN security. Our research explored two OpenFlow intrusion detection methods. The first employed machine learning, NSL-KDD dataset, and feature selection, yielding 82% accuracy with random forest. The second combined deep neural networks with GRU-LSTM, achieving 88% accuracy using ANOVA F-Test and feature elimination. Experiments highlighted deep learning as superior for OpenFlow intrusion detection.

Regular inspections during construction work verify that the work completed is consistent with the plans and specifications and ensure that it is within the planned time and budget. This requires frequent physical site observations to independently measure and verify the completion percentage of the construction progress performed over periods of time. The current computer vision-based (CV) techniques for the measurement of as-built elements, predominantly use 3D laser scanning or 3D Photogrammetry modelling to determine the geometrical properties of as-built elements on construction sites. Both techniques require data acquisition from several positions and angles to generate sufficient information about the element’s coordinates making the deployment of these techniques on dynamic construction project sites a challenging task. In this paper, we propose a pipeline for automating the measurement of as-built components using artificial intelligence (AI) and computer vision (CV) techniques. The pipeline requires a single image obtained with a stereo-camera system to measure the size of selected objects or as-built components. We demonstrate our approach by measuring the size of concrete walls and columns. The novelty of this work is attributed to the fully automated CV-based method for measuring any given element using a single image only. The proposed solution is suitable for use in measuring the sizes of as-built components of built assets. It has the potential to be further developed and integrated with BIM models for use on construction projects for progress monitoring.

Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user’s voice, and can be used through methods, such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. however, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors, such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into 3 classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy. As a result, the conventional method achieved 92.94% accuracy and proposed method achieved 98.16% accuracy.

Estimating precipitation is of critical importance to climate systems and decision-making processes. This paper presents Espresso, a deep learning model designed for estimating precipitation from satellite observations on a global scale. Conventional methods, like ground-based radars, are limited in terms of spatial coverage. Satellite observations, on the other hand, allow global coverage. Combined with deep learning methods these observations offer the opportunity to address the challenge of estimating precicpation on a global scale. This research paper presents the development of a deep learning model using geostationary satellite data as input and generating instantaneous rainfall rates, calibrated using data from the Global Precipitation Measurement Core Observatory (GPMCO). The performance impact of various input data configurations on Espresso was investigated. These configurations include a sequence of four images from geostationary satellites and the optimal selection of channels. Additional descriptive features were explored to enhance the model’s robustness for global aplications. When evaluated against the GPMCO test set, Espresso demonstrated highly accurate precipitation estimation, especially within equatorial regions. A comparison against six other operational products using multiple metrics indicated its competitive performance. The model’s superior storm localization and intensity estimation were further confirmed through visual comparisons in case studies. Espresso has been incorporated as an operational product at Météo-France, delivering high-quality, real-time global precipitation estimates every 30 minutes.

The leachate discharges generated in sanitary landfills contain many pollutants that are harmful to the environment; treatments are scarce and should be carried out better. The use of coagulation-flocculation processes has been one of the most widely used, but that; Due to the complexity of the characterization of the leachate, the dosing strategy of coagulants and biopolymers needs to be clarified. Therefore, the present study is carried out to determine the doses of coagulants and biopolymers suitable for coagulation-flocculation processes in the treatment of leachates by using computational models of machine learning techniques such as Artificial Neural Networks (ANN); these allow to decrease the operations of the tests of jars in the laboratory; optimizing resources. Through laboratory experimentation, there are real results of the effectiveness of applying biopolymers in leachate treatments at different concentration levels. The laboratory results were taken as input variables for the algorithms used; after the validation and calibration process, we proceeded to estimate predicted data with the computational model, obtaining predictions of optimal doses for treatment with high statistical adjustment indicators. It is verified that the applied coagulation-flocculation treatments reduce the turbidity values in the leachate and contaminants associated with suspended solids. In this way, the jar tests are optimized so that the operational costs decrease without affecting the results of adequate dosing.

Research in brain stroke prediction is very crucial as it can lead to the development of early detection techniques and interventions that can enhance the prognosis for stroke victims. Early detection and intervention can help to minimise the damage caused by a stroke, reduce the risk of long-term complications, and enhance the general quality of life for people who have survived a stroke. Additionally, research in stroke prediction can help to identify risk factors and improve understanding of the underlying causes of stroke, which can lead to the development of better prevention strategies. Research on brain stroke prediction is ongoing and has led to the development of various models and tools for predicting the risk of stroke and detecting it early. However, the implementation and use of these tools in clinical practise vary depending on several factors, such as the availability of resources, the specific healthcare system, and the level of awareness and acceptance of these tools among healthcare providers and patients. In general, risk prediction models may be used to quickly identify individuals at high risk of stroke and target them for preventive interventions, such as lifestyle changes, medication management, and screenings. Early detection tools can be used to quickly identify stroke symptoms and initiate appropriate treatment, which can improve outcomes for stroke patients. However, it is important to note that research and development of these models and tools are ongoing, and their use in clinical practise is constantly evaluated and updated. It may take time for these tools to be widely adopted in clinical practise and to see their real-world impact. This research paper focuses on predicting brain stroke occurrence using a range of machine learning algorithms such as Logistic Regression (LR), Decision Tree (DT), Random Forest (RF), Support Vector Machine (SVM), K-Nearest Neighbor (KNN), Gaussian Naive Bayes (GNB), Bernoulli Naive Bayes (BNB), and a Voting Classifier. The main emphasis of this research was to compare the effectiveness of oversampling techniques, as the data was significantly imbalanced. We have used evaluation metrics in this research to assess the accuracy, precision, recall, and other key performance indicators of a model's predictions. Area under the Receiver Operating Characteristics Curve (AUC), minority class accuracy, and majority class accuracy were used to assess the approaches.

In Taiwan, peanuts are classified by hand. The kernel quality is judged based on the appearance of peanuts. The identification takes considerable time and labor. Fatigue can induce misrecogni-tion or grade cognition instability due. Peanut defects are generally divided into health, underde-velopment, insect bite, and rupture. This study employed two imaging methods push-boom FX10 and Snapshot. Deep learning was used to detect peanut defects. A push-broom instrument was used for testing. There were 1,560 peanuts, including 240 good and 240 bad ones. There were a total of 1,080 good peanuts and bad peanuts in the test set data, the band selection was used, and a CNN model was built. Based on the results from three methods, 3DCNN could classify with 97%accuracy. The Snapshot was used to achieve the real-time design of a lightweight CNN model. Finally, five bands were selected using PCA, and the screening could be accurate and efficient. The maximum overall accuracy was about 98.5%. Kappa was 97.3% with real-time recognition. This will be a major advantage in the future practical application and commercialization processes. This technique can reduce labor costs, achieve intelligent detection and intelligent grading, and bring breakthroughs to smart agriculture for other crops as well.

In the study, it was aimed to develop a valid and reliable scale in order to determine the self-efficacy perceptions of classroom teachers in the field of mathematics learning difficulties. In the development process of the scale, the basic resources and the scale development studies in the literature were examined. First, a pool of substances was created. Content validity was ensured by taking the opinions of 21 expert participants in the 24 question areas determined in the item pool. Content validity index was used in content validity. In this analysis, two questions were removed from the scale. Preliminary application was made with 44 participating teachers who are experts in their fields and exploratory factor analysis was started. For exploratory factor analysis, 359 people consisting of classroom teachers in Sakarya province were studied. In the explanatory factor analysis, 5 items were removed from the scale by looking at the factor load. The factor loadings for the 17 items in the scale vary between 0.508 and 0.976. Among the comparative fit indices obtained as a result of confirmatory factor analysis, RMSEA=0.067 and Cmin/DF=1.568 were calculated. The Cronbach alpha reliability coefficient of the measurements is 0.970. The data obtained were analyzed with statistical methods using SPSS 25, AMOS 24 and Microsoft Excel programs. The validity and reliability criteria of the scale developed within the scope of the study were met.

Endometriosis is a complex chronic condition characteristic of chronic pelvic pain, dysmenorrhea, anxiety and fatigue. This can often lead to multimorbidity which is defined by the presence of two or more long term conditions. Delayed diagnosis of endometriosis is a crucial issue that leads to poor quality of life and clinical management. There are a variety of limitations linked to conducting endometriosis research including lack of dedicated funding. Additionally, accessing existing electronic healthcare records can be challenging due to governance and regulatory restrictions. Missing data issues are another concern that has been commonly identified among real-world studies. Considering these challenges, data science technique could provide a solution by way of using synthetic datasets that could be generated using known characteristics of endometriosis to explore the possibility of predicting multimorbidity. This study aimed to develop an exploratory machine learning model that can predict multimorbidity among women with endometriosis using real-world and synthetic data. A sample size of 1012 was used from two endometriosis specialized centres in the UK. In addition, 1000 synthetic data records per centre were generated using the widely used Synthetic Data Vault’s Gaussian Copula model based on patients’ records’ characteristics. Three standard classification models, Logistic Regression (LR), Support Vector Machine (SVM), and Random Forest (RF), were used for classification. The average accuracies for all three models (LR, SVM and RF), given as “model accuracy-centre1: accuracy-centre2” were found to be: LR 64.26%:69.04%, SVM 67.35%:68.61%, and RF 58.67%:73.76% on real-world data, and LR 69.9%:72.29%, SVM 69.39%:70.13, and RF 68.88%:74.62 on synthetic data, respectively. The findings of this report show machine learning models trained on synthetic data performed better than models trained on real-world data. Our findings suggest synthetic data holds great promise for shows value to conduct clinical epidemiology and clinical trials that could devise better precision treatments and possibly reduce the burden of multimorbidity.

Plant-based protein sources derived from microalgae offer promise as low-carbon emission and nutrient-dense sources for human consumption. The current management of microalgae cultivation relies heavily on manual microscopic examination in order to identify desired and competing species, as well as predators. In this study, we trained and tested a transfer learning model modified from EfficientNetV2 B3 on 434 and 161 prospectively acquired images of the preferred Nannochloropsis sp microalgae and competitor Spirulina, respectively, and achieved >98% classification for both species on tenfold cross-validation. The model was further enhanced with gradient-weighted class activation mapping, which allowed visualization of regions of the input images that were relevant to the classification, thereby improving its explainability. In this paper, we demonstrate that a simple deep transfer learning model can be used to identify microalgae species. The application addresses the practical need for robust automated monitoring of microalgae populations on industrial microalgae farms.

Intestinal parasitic infections pose a grave threat to human health, particularly in tropical and subtropical regions. The traditional manual microscopy system of intestinal parasites detection remains the golden standard procedure for the diagnosis of parasites cyst or eggs, but this approach is costly time-consuming (30min/sample), highly tedious, and also required specialist. However, computer vision based on deep learning has made great stride in recent time. Despite the significant advances in deep convolutional neural network-based architectures, little research has been conducted to explore the potential of these techniques in the field of parasitology, specifically for intestinal parasites. Therefore, the goal of this research is to evaluate the performance of proposed state-of-the-art transfer learning architecture for detecting and classifying intestinal parasite eggs from images. We would ensure that patients receive prompt treatment while also relieving experts of extra work if we used such an architecture. Here, in stage first, we applied image pre-processing and augmentation to the dataset, and in stage second, we utilized the YOLOv5 algorithms for detection and classification and then compared their performance based on different parameters. Our algorithms achieved a mean average precision of 97% approximatiely and 8.5 ms detection time per sample for 5,393 intestinal parasite images. Thus, this approach may form a solid theoretical basis for real-time detection and classification in routine clinical examinations while accelerating the process to satisfy increasing demand.

The field of anesthesia has always been at the forefront of innovation and technology, and the integration of Artificial Intelligence (AI) represents the next frontier in anesthesia care. The use of AI and its subtypes such as machine learning has the potential to improve efficiency, reduce costs, and improve patient outcomes. AI can assist with decision-making, but its primary advantage lies in empowering anesthesiologists to adopt a proactive approach to address clinical issues. However, further research and validation are needed to fully understand the benefits and limitations of these applications in clinical practice. Moreover, the ethical implications of AI in anesthesia must also be considered to ensure that patient safety and privacy are not compromised. This paper aims to provide a comprehensive overview of AI in anesthesia, including its current and potential applications, and the ethical considerations that must be considered to ensure the safe and effective use of the technology.

Vaccines trigger a complicated immunological response that includes B and T cells, with B cells producing antibodies. SARS-CoV-2 immunity weakens over time after vaccination. Discovering key changes in antigen-reactive antibodies over time after vaccination could help improve vaccine efficiency. In this study, we collected data on blood antibody levels in a cohort of healthcare workers vaccinated for COVID-19 and obtained 73 antigens in samples from four groups according to the duration after vaccination, including 104 unvaccinated healthcare workers, 534 healthcare workers within 60 days after vaccination, 594 healthcare workers between 60 and 180 days after vaccination, and 141 healthcare workers over 180 days after vaccination. An efficient machine learning based framework containing four feature selection methods (least absolute shrinkage and selection operator, light gradient boosting machine, Monte Carlo feature selection, and maximum relevance minimum redundancy) and four classification algorithms (decision tree, k-nearest neighbor, random forest, and support vector machine) was designed to screen out essential antigens. Several efficient classifiers with weighted F1 value around 0.75 were constructed. This study revealed that S1+S2, S1.mFcTag, S1.HisTag, S1, S2, Spike.RBD.His.Bac, Spike.RBD.rFc, and S1.RBD.mFc were most highly ranked among all features, where S1 and S2 are the subunits of Spike, and the suffixes represent the tagging information of different recombinant proteins. Meanwhile, the classification rules were extracted from the optimal decision tree to explain quantitatively the roles of antigens in the classification. This study identified antibodies associated with decreased clinical immunity based on populations with different time spans after vaccination. These antibodies have important implications for maintaining long-term immunity to SARS-CoV-2.

In this work we introduce an end-to-end multi-modal neural network to segment the Gross Tumor Volume (GTV) from 3D-CBCT’s during radiotherapy. We improve the tumor segmentation by using a U-net which takes additional information such as the tumor mask generated at the planning phase along with the CBCT volume. The mask contains relevant information about the tumor’s location and can guide the model to use this knowledge appropriately to give a better prediction. This technique could become an alternative to produce segmentation masks of GTV in CBCT automatically during radiotherapy as in the traditional RT-pipeline, they are not segmented. We have evaluated our model on a dataset of 82 patients who have undergone radiotherapy. We compare the results of registered target volumes from planning CT as mask seed with 2 different types of multi-modal architectures. Our model shows a DSC of 0.706±0.002 with Late Fusion and 0.702±0.015 with Early Fusion using the GTV Mask. The performance of the two models on this mask is similar, so we perform further experiments with different types of masks which suggest that Late Fusion model produces a better segmentation of the tumor than the Early Fusion model. We also provide an ablation study consisting of a single modality U-net and a metric based on the Planning CT mask registration. It indicates a clear advantage of using our model to produce segmentation for this type of imaging.

Federated Distillation (FD) has recently attracted increasing attention for its efficiency in aggregating multiple diverse local models trained from statistically heterogeneous data of distributed clients. Existing FD methods generally treat these models equally by merely computing the average of their output soft predictions for some given input distillation sample, which does not take the diversity across all local models into account, thus leading to degraded performance of the aggregated model, especially when some local models learn little knowledge about the sample. In this paper, we propose a new perspective that treats the local data in each client as a specific domain and design a novel domain knowledge aware federated distillation method, dubbed DaFKD, that can discern the importance of each model to the distillation sample, and thus is able to optimize the ensemble of soft predictions from diverse models. Specifically, we employ a domain discriminator for each client, which is trained to identify the correlation factor between the sample and the corresponding domain. Then, to facilitate the training of the domain discriminator while saving communication costs, we propose sharing its partial parameters with the classification model. Extensive experiments on various datasets and settings show that the proposed method can improve the model accuracy by up to $6.02\%$ compared to state-of-the-art baselines.

IKEA is a massive international conglomerate company, and the purpose of this exploratory qualitative research is to investigate how the burgeoning academic field known as "artificial intelligence" (AI) could assist IKEA in resolving some of the challenges that it is currently dealing with in relation to its efforts to source sustainable materials. According to the conclusions of this study, artificial intelligence has the potential to aid in the resolution of at least some of the issues associated with sustainable sourcing, at least to some degree. This was developed by mapping the issues, analyzing the potential for adopting artificial intelligence as a solution, and defining the components that are required for efficient adoption of the technology. A number of prerequisites need to be satisfied by businesses before artificial intelligence may be used in the area of sustainable sourcing. In addition, a number of artificial intelligence's constraints need to be addressed before the technology can be put into practice by the same businesses. In conclusion, the findings of this study offer some management implications and ideas for businesses that have the goal of sourcing in a way that is less harmful to the environment by making use of technological breakthroughs such as artificial intelligence. This can be accomplished through the utilization of innovative technologies.

Advancements in Machine Learning techniques, availability of more data-sets, and increased computing power have enabled a significant growth in a number research areas. Predicting, detecting and classifying complex events in earth systems which by nature are difficult to model is one of such areas. In this work, we investigate the application of different machine learning techniques for detecting and identifying extreme rainfall events in a sub-catchment within Pangani River Basin, found in Northern Tanzania. Identification and prediction of extreme rainfall event is a preliminary crucial task towards success in predicting rainfall-induced river floods. To identify a rain condition in the selected sub-catchment, we use data from five weather stations which have been labeled for the whole sub-catchment. In order to assess which Machine Learning technique suits better for rainfall identification, we apply five different algorithms in a historical dataset for the period of 1979 to 2014. We evaluate the performance of the models in terms of precision and recall, reporting Random Forest and XGBoost as the ones with best overall performance. However, since the class distribution is imbalanced, the generic Multi-layer Perceptron performs best when identifying the heavy rainfall events, which are eventually the main cause of rainfall-induced river floods in the Pangani River Basin

Objective: To investigate commonalities and variations in the learning outcomes, curriculum content, assessment methods and competencies in undergraduate orthodontic curricula globally. Methods: This scoping review followed the updated methodological guidance proposed by the Joanna Briggs Institute and reported in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR). A search on electronic databases PubMed, Scopus and Embase was conducted for the last 25 years. Google Scholar was used to identify eligible unpublished and grey literature. Results: The total number of reports identified was 231. After removal of 62 duplicates, 169 reports were included in the title and abstract screening. Finally, 17 studies were included in the review which included 13 cross-sectional surveys, three expert panel proceedings and one discussion paper. Marked variations were reported in undergraduate orthodontic curricula and competency assessments at the level of individual countries, regionally as well as globally. The challenges of imparting competency in orthodontic treatment during undergraduate dental education are also acknowledged. Conclusion: Lack of consistency in undergraduate orthodontic education is evidenced by several Delphi studies to develop consensus on orthodontic teaching in undergraduate programs. A common message emanating from the available studies on undergraduate orthodontic education seems to emphasize a focus on assessment and diagnosis of orthodontic treatment needs of patients and a basic understanding of contemporary treatment options to facilitate patient referral.

The emergence of unmanned aerial vehicles (UAVs) raised multiple concerns, given their potential for malicious misuse in unlawful acts Vision-based counter-UAV applications offer a reliable solution compared to acoustic and radio frequency-based solutions because of their high detection accuracy in diverse weather conditions. The existing solutions work well on trained datasets, but their accuracy is relatively low for real-time detection. In this paper, we model deep learning-empowered solutions to improve the multi-class UAV's classification performance using single-shot object detection algorithms YOLOv5 and YOLOv7. The transfer learning is employed for performance improvement and rapid training with improved results. We customized a multi-class dataset containing multi-rotor, fixed-wing, and single-rotor UAVs in challenging weather conditions. Experiments show that the integration of transfer learning has achieved good results, with an overall best average-classification precision of 94\%, an average recall of 93.1\%, a mAP$@$0.5 average of 95.3\%, and an average F1 score of 92.33\%. The dataset and code are available as an open source: https://github.com/ZeeshanKaleem/YOLOV5-Large-vs-YOLOV7.git

Hand gesture recognition has many valuable applications in engineering and health care. This study proposes a novel model which can accurately distinguish hand gestures using forearm muscles' surface electromyogram (sEMG) signals. A deep learning algorithm with hyper parameters impacting the final model’s accuracy and a convolutional neural network (CNN) were employed in the recognition stage. The number of convolutional layers, kernels per layer, and neurons in the dense layer were selected for optimization, while the remaining parameters, such as the learning rate, batch size, and number of epochs, were chosen based on trial and error and prior knowledge. The optimal values for the selected hyperparameters were obtained using a genetic algorithm to achieve maximum recognition accuracy. The UC2018 Dual-Myo database was used for training and testing the model based on EMG signals characterizing the activity of eight different hand gestures. The final structure of the model consisted of two convolutional layers with 131 and 28 kernels, a dense layer with 111 neurons, and a softmax layer with eight neurons. Upon optimizing the hyperparameters using the genetic algorithm, the accuracy of the proposed model increased from 91.86% to 96.4% at best and 95.3% on average in real-time applications and 99.6% in an offline mode. Future work is warranted towards improving the architecture and the computational cost.

Child sexual abuse inflicts lifelong devastating consequences for victims and is an ongoing social concern. In most countries, child sexual abuse material (CSAM) distribution is illegal. As a result, there are many research papers in the literature which proposed technologies to detect and investigate CSAM. In this survey, a comprehensive search of the peer-reviewed journal and conference paper databases (including preprints) is conducted to identify high-quality literature. We use the PRISMA methodology to refine our search space to 2,761 papers published by Springer, Elsevier, IEEE and ACM. After iterative reviews of title, abstract and full text for relevance to our topics, 43 papers are included for full review. Our paper provides a comprehensive synthesis of the tasks of the current research and how the papers use techniques and datasets to solve their tasks and evaluate their models. To the best of our knowledge, we are the first to focus exclusively on online CSAM detection and prevention with no geographic boundaries, and the first survey to review papers published after 2018. It can be used by researchers to identify gaps in knowledge and relevant publicly available datasets that may be useful for their research.

Real estate has the dual characteristics of consumption and investment. Under the inherent concept of "where there is land, there is wealth", real estate has become the investment target of the main asset. In addition to the supply and demand of the market will affect the price of real estate, many general economic factors will also have a certain impact on the price of real estate. This paper pays a special focus on the effects of MRT on housing prices, finding the closer a house is to an MRT station, the higher its price. In addition, convenience stores are very popularized, and this research report is also interested in whether the number of convenience stores within walking distance will affect the house price. In a word, these two factors do affect housing prices significantly.

This article addresses a challenge modeling novices face in model conceptualization: the recognition of behavior modes. Despite behavior modes being at the heart of system dynamics modeling, there is no unifying taxonomy for them, making them harder to learn for beginners. The article proposes criteria a taxonomy should satisfy, critically reviews previous taxonomies in the literature, and then introduces a new consistent taxonomy based on slope and curvature with mode names that refer only to visual cues and free of references to prior mathematical or domain-specific knowledge. Evidence from an exploratory experiment suggests that novices actually have difficulties classifying curves when using previous taxonomies. Links from these elementary modes to analogous terms in other taxonomies in diverse disciplines allow this taxonomy to be related to other ones. The article concludes by mentioning relevant limitations and future steps.

Mechanistic models have been used for centuries to describe complex interconnected processes, including biological ones. As the scope of these models has widened, so have their computational demands. This complexity can limit their suitability when running many simulations or when real-time results are required. Surrogate machine learning models can be used to approximate the behaviour of complex mechanistic models, and once built, their computational demands are several orders of magnitude lower. This paper provides an overview of the relevant literature, both from an applicability and a theoretical perspective. For the latter, the paper focuses on the design and training of the underlying machine learning models. Application-wise, we show how machine learning surrogates have been used to approximate different mechanistic models. We present a perspective on how these approaches can be applied to models representing biological processes with potential industrial applications (e.g., metabolism and whole-cell modelling) and show why surrogate machine learning models may hold the key to making the simulation of complex biological models possible using a typical desktop computer.

To support the decision making process of new investors, this paper aims to implement Machine Learning algorithms to generate investment indications. Three artificial intelligence techniques were implemented, namely: Multilayer Perceptron, Logistic Regression and Decision Tree, which performed the classification of investments. The results of the different algorithms were compared to each other using the metrics: accuracy, precision, recall, and F1-score. The Decision Tree was the algorithm that obtained the best classification metrics and an accuracy of 77%.

To solve two key problems in the identification of people who are infected with COVID-19: the first problem is that the identification accuracy is not high enough. The second problem is that present identification method such as nucleic acid testing is expensive in many countries. Methods: So, I decided to design a fast identification method for COVID-19 patients which is based on deep learning. After the model (CoughNet) learns more than 6,000 cough spectrograms of both COVID-19 patients and normal people, the accuracy rate of identification of COVID-19 patients and normal people is higher than 99% in the test set. Structure: This paper is mainly divided into three parts: the first part introduces the main background and research status of the research; The second part introduces the research methods; The third part introduces the specific process of the experiment.

Cyber-threat is now a global concern to all internet users, as the rate of crimes has tremendously changed from physical to virtual. Implementing awareness programs at various organization levels is required, Also there is a need to know the methodologies used in measuring cybersecurity awareness program effectiveness. The paper aims to review and explore the previous methodologies applied, target organizations, and application of Machine Learning techniques in the assessment of awareness programs. Systematic literature review techniques were used to conduct the search using pre-defined keywords and published papers from 2006 to 2019, the information was used in providing an answer to the research questions. The finding shows questionnaire was widely used as a method of evaluating cybersecurity awareness and also organizations implement more awareness programs, the gap found is the lack of using ML in assessing the effectiveness of design, and implemented cybersecurity awareness programs

The pervasiveness of cardiovascular disease and physician misdiagnosis creates the urgent need for artificial intelligence models to improve diagnosis accuracy. The first objective of this study was to train machine learning models on publicly available data sets containing simple medical information of patients to diagnose cardiovascular disease. The Multilayer Perceptron (MLP) assembled for this task performed optimally with an F1 score of 0.8968. This prompted the creation of an open-source, automated cardiovascular disease diagnosis tool, powered by the MLP. The second objective of this study was to employ a meta-learning methodology called Local Interpretable Model-Agnostic Explanations (LIME) to understand the impact of different features on the model's diagnosis in the form of marginal probabilities. K-Means Clustering was employed to segment the data into ten clusters, after which each data example was passed through LIME. The resulting histograms depict the complex relationship between feature, cluster, and impact on diagnosis. A series of P-values with contrasting orders of magnitude shows the nuances in the MLP's understanding of patients from different clusters. The results of meta-learning analysis reveal that the most important features for cardiovascular disease diagnosis are fasting blood sugar, type of chest pain, and slope of the ST segment on an electrocardiogram. Future experiments should replicate the novel methodology introduced in this study on data sets containing more specialized medical features in order to gain practical medical insights about different types of cardiovascular disease represented by each cluster. Finally, feature engineering pathways should be explored with consideration of these results to create versatile diagnosis models not only for cardiovascular disease, but adaptable to other diseases as well.

Introduction: Academic success is primary goal of every student. It is described as the extent to which a student has successfully achieved his or her short and long-term educational goals. Several factors have been established to predict academic performance of students. Machine learning techniques have been employed in predicting students’ performance, but it has not been prevalent in developing countries like Nigeria and most studies did not consider class teachers’ end-of-the-year rating. Aim: The aim of this work is to develop a Radial Basis Function Neural Network (RBFNN) for prediction of secondary school students’ performance. Materials and Methods: We obtained data from school repository containing students’ raw score and classteachers’ rating from year one to year six. The data was labelled into pass or fail given the actual outcome of their examinations. Subjects were categorized into Mathematics, English and major, depending on the student’s specialization. Class-teachers’ ratings were also included in the dataset. The preprocessed dataset was used to train the RBFNN model. The impact of Principal Component Analysis (PCA) was also measured. Results: We set up four experiments in order to achieve our aim. The best result gave the sensitivity of 93.49%, specificity of 75%, accuracy of 86.59% and an AUC score of 94%. Other experiments gave a relatively low performance. Conclusion: This study helps students to get a projection of academic success even before sitting for the examination. This will also help parents and counsellors in knowing the direction of their counseling to each student. Teachers and parents should pay attention to class teacher ratings of the students as this is discovered to affect the prediction accuracy of their examination success.

A hybrid smart process and material design system for nanoimprinting is proposed, which combines with a learning system based on experimental and numerical simulation results. Instead of carrying out extensive learning experiments for various condition, the simulation learning results are partially complimented where the results can be theoretically predicted by numerical simulation. In other word, the lacking data in experimental learning are complimented by simulation-based learning results. Therefore, the prediction of nanoimprint results under various conditions without experimental learning could be realized even for unknown materials. In this study, material and process design for a low-temperature nanoimprint process using glycerol-containing polyvinyl alcohol are demonstrated. Experimental results under limited conditions are learned to investigate optimum Glycerol concentrations and process temperatures. On the other hand, simulation-based learning is used to predict the dependence on press pressure and shape parameters. The prediction results for unknown Glycerol concentrations agreed well with the follow-up experiments.

The Covid-19 also known as the Coronavirus is a viral disease from the SARS-CoV-2 family of virus, as at December 2019 the first case of this virus infection was identified at Wuhan, China, this seemingly isolated case soon became a global pandemic, whose effect was felt globally which also had colossal effects on both health, economic and politics . As at the time of this research about 4.5 million people have died of the Coronavirus and over 215 million people already infected by it. This pandemic stood out not just for its scale but for how social media was a major contribution to its spread as well as to curbing it. The power of social media was used to spread misinformation as well as to spread awareness on the subject, with both having massive impact on the people. In this paper we will be running a sentimental analysis on twitter under the keyword “Covid-19 and Coronavirus”, twitter is a powerful social media tool that is known for its ability to keep trends in the form of tweets, we will be drawing correlations between the peaks of tweet with the peak of infection. We will also be analyzing to know what the impact of these tweets are having on the rate of the infection and vice versa. We will also be analyzing what people are tweeting most about, what are the talking points, comparing both real time and past tweets with real time infection and death rates using deep different learning methods to access what information can be derived from it.

Daytime napping offers benefits for motor memory learning and is used as habitual countermeasure to improve daytime functioning. A single napping is shown to ameliorate motor memory learning, although the effect of consecutive napping on motor memory consolidation remains unclear. This study aimed to explore the effect of daytime napping over multiple days on motor memory learning. Twenty university students were divided into the napping group and no-nap (awake) group. Napping group performed motor adaption tasks before and after napping for three consecutive days, whereas no-nap group performed the task on the similar time schedule as the napping group. In addition, a subsequent retest was conducted one week after the end of the intervention. The speed to complete the task of the napping group was significantly shorter than that of the awake group in the retention test. No significant difference was confirmed for trajectory length to complete the task. Thus, consecutive napping may facilitate motor learning and motor memory consolidation in the long term.

Sentiment analysis is a process of extracting opinions into the positive, negative, or neutral categories from a pool of text using Natural Language Processing (NLP). In the recent era, our society is swiftly moving towards virtual platforms by joining virtual communities. Social media such as Facebook, Twitter, WhatsApp, etc are playing a very vital role in developing virtual communities. A pandemic situation like COVID-19 accelerated people's involvement in social sites to express their concerns or views regarding crucial issues. Mining public sentiment from these social sites especially from Twitter will help various organizations to understand the people's thoughts about the COVID-19 pandemic and to take necessary steps as well. To analyze the public sentiment from COVID-19 tweets is the main objective of our study. We proposed a deep learning architecture based on Bidirectional Gated Recurrent Unit (BiGRU) to accomplish our objective. We developed two different corpora from unlabelled and labeled COVID-19 tweets and use the unlabelled corpus to build an improved labeled corpus. Our proposed architecture draws a better accuracy of 87% on the improved labeled corpus for mining public sentiment from COVID-19 tweets.

According to the World Health Organization (WHO), dementia is the seventh leading reason of death among all illnesses and one of the leading causes of disability among the world’s elderly people. Day by day the number of Alzheimer’s patients is raising. Considering the increasing rate and the dangers, Alzheimer’s disease should be diagnosed carefully. Machine learning is a potential technique for Alzheimer’s diagnosis but general users do not trust machine learning models due to the black-box nature. Even, some of those models do not provide the best performance because of using only neuroimaging data. To solve these issues, this paper proposes a novel explainable Alzheimer’s disease prediction model using a multimodal dataset. This approach performs a data-level fusion using clinical data, Freesurfer MRI segmentation data, and psychological data. For Alzheimer’s disease vs cognitively normal prediction, the random forest classifier provides 100% accuracy. Furthermore, Alzheimer’s disease and non-Alzheimer’s dementia should be classified properly because their symptoms are similar. To the best of our knowledge, we are the first to present a three-class classification on Alzheimer’s disease vs cognitively normal vs non-Alzheimer’s dementia and achieved 99.86% accuracy using an ensemble model. Besides, a novel Alzheimer’s patient management architecture is also proposed in this work..

This paper explores the tuning and results of two-part models on rich datasets provided through the Casualty Actuarial Society (CAS). These data sets include BI (bodily injury), PD (property damage) and COLL (collision) coverage, each documenting policy characteristics and claims across a four year period. The datasets are explored, including summaries of all variables, then the methods for modeling are set forth. Models are tuned and the tuning results are displayed, after which we train the final models and seek to explain select predictions. All of the code will be made available on GitHub. Data was provided by a private insurance carrier to the CAS after anonymizing the data set. This data is available to actuarial researchers for well-defined research projects that have universal benefit to the insurance industry and the public. Our hope is that the methods demonstrated here can be a good foundation for future ratemaking models to be developed and tested more efficiently.

The eyes serve as a window into underlying physical and cognitive processes. Although factors such as pupil size have been studied extensively, a less explored yet potentially informative aspect is blinking. Given its novelty, blink detection techniques are far less available compared to eye-tracking and pupil size estimation tools. In this work, we present a new unsupervised machine learning blink detection strategy using existing eye-tracking technology. The method is compared to two existing techniques. All three algorithms make use of eye aspect ratio values for blink detection. Accurate and rapid blink detection complements existing eye-tracking research and may provide a new informative index of physical and mental status.

Introduction: Dental segmentation in panoramic radiograph has become very relevant in dentistry, since it allows health professionals to carry out their assessments more clearly and helps them to define the best possible treatment plan for their patients. Objectives: In this work, a comparative study is carried out with four segmentation algorithms (U-Net, DCU-Net, DoubleU-Net and Nano-Net) that are prominent in the medical literature on segmentation and we evaluate their results with the current state of the art of dental segmentation in panoramic radiograph. Methods: These algorithms were tested with a dataset consisting of 1,500 images, considering experiment scenarios with and without augmentation data. Results: DoubleU-Net was the model that presented the best results among the analyzed models, reaching 96.591% accuracy and 92.886% Dice using the dataset with data augmentation. Another model that stood out was Nano-Net using the dataset without data augmentation; this model achieved results close to that of the literature with only 235 thousand trainable parameters, while the literature model (TSASNet) contains 78 million. Conclusions: The results obtained in this work are satisfactory and present paths for a better and more effective dental segmentation process.

Smartphones are prone to SMS phishing due to the rapid growth in the availability of smart mobile technologies driven by Internet connections. Also, detecting phishing SMS is a challenging task due to the unstructured nature of SMS text data with non-linear complex correlations. In this concern, considering the recent advancements in the domain of cybersecurity, we have proposed a hybrid deep learning framework that extracts robust features from SMS texts followed by an automatic detection of Phishing SMS. Due to combining the potential capability of individual models into one hybrid framework, it has outperformed various other individual machine learning and deep learning models. The proposed Phishing Detection framework is an effective hybrid combination of pretrained transformer model, MPNet (Masked and Permuted Language Modeling), with supervised ConvNets (CNN) and Bi-directional Gated Recurrent Units (GRU). It is intended to successfully detect unstructured short phishing text messages that contain complex patterns.

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge sources. Such systems are designed to cater the most prominent answer from this giant knowledge source to the user’s query using natural language understanding (NLU) and thus eminently depends on the Question-answering(QA) field. Question answering involves but not limited to the steps like mapping of user’s question to pertinent query, retrieval of relevant information, finding the best suitable answer from the retrieved information etc. The current improvement of deep learning models evince compelling performance improvement in all these tasks. In this review work, the research directions of QA field are analyzed based on the type of question, answer type, source of evidence-answer, and modeling approach. This detailing followed by open challenges of the field like automatic question generation, similarity detection and, low resource availability for a language. In the end, a survey of available datasets and evaluation measures is presented.

Malaria remains an important cause of death, especially in sub-Saharan Africa with about 228 million malaria cases worldwide and an estimated 405,000 deaths in 2019. Currently, malaria is diagnosed in the health facility using a microscope (BS) or rapid malaria diagnostic test (MRDT) and with area where these tools are inadequate the presumptive treatment is performed. Apart from that self-diagnosis and treatment is also practiced in some of the households. With the high-rate self-medication on malaria drugs, this study aimed at computing the most significant features using feature selection methods for best prediction of malaria in Tanzania that can be used in developing a machine learning model for malaria diagnosis. A malaria symptoms and clinical diagnosis dataset were extracted from patients’ files from four (4) identified health facilities in the regions of Kilimanjaro and Morogoro. These regions were selected to represent the high endemic areas (Morogoro) and low endemic areas (Kilimanjaro) in the country. The dataset contained 2556 instances and 36 variables. The random forest classifier a tree based was used to select the most important features for malaria prediction. Regional based features were obtained to facilitate accurate prediction. The feature ranking as indicated that fever is universally the most influential feature for predicting malaria followed by general body malaise, vomiting and headache. However, these features are ranked differently across the regional datasets. Subsequently, six predictive models, using important features selected by feature selection method, were used to evaluate the features performance. The features identified complies with malaria diagnosis and treatment guideline provided with WHO and Tanzania Mainland. The compliance is observed so as to produce a prediction model that will fit in the current health care provision system in Tanzania.

Beyond semantic segmentation,3D instance segmentation(a process to delineate objects of interest and also classifying the objects into a set of categories) is gaining more and more interest among researchers since numerous computer vision applications need accurate segmentation processes(autonomous driving, indoor navigation, and even virtual or augmented reality systems…) This paper gives an overview and a technical comparison of the existing deep learning architectures in handling unstructured Euclidean data for the rapidly developing 3D instance segmentation. First, the authors divide the 3D point clouds based instance segmentation techniques into two major categories which are proposal based methods and proposal free methods. Then, they also introduce and compare the most used datasets with regard to 3D instance segmentation. Furthermore, they compare and analyze these techniques performance (speed, accuracy, response to noise…). Finally, this paper provides a review of the possible future directions of deep learning for 3D sensor-based information and provides insight into the most promising areas for prospective research.

The huge advancement of Internet web facilities as well as the progress in computing and algorithm development, along with current innovations regarding high-throughput techniques enables the scientific community to gain access to biological datasets, clinical data, and several databases containing billions of information concerning scientific knowledge. Consequently, during the last decade the system for managing, analyzing, processing and extrapolating information from scientific data has been considerably modified in several fields including the medical one. As a consequence of the mentioned scenario, scientific vocabulary was enriched by novel lexicons such as Machine Learning (ML)/Deep Learning (DL) and overall Artificial Intelligence (AI). Beyond the terminology, these computational techniques are revolutionizing the scientific research in drug discovery pitch, from the preclinical studies to clinical investigation. Interestingly, between preclinical and clinical research, the translational research is benefitting from computer-based approaches, transforming the design and execution of the translational research, resulting in breakthroughs for advancing human health. Accordingly, in this review article, we analyze the most advanced applications of AI in translational medicine, providing an up-to-date outlook regarding this emerging field.

For personalized recommender systems,matrix factorization and its variants have become mainstream in collaborative filtering.However,the dot product in matrix factorization does not satisfy the triangle inequality and therefore fails to capture fine-grained information. Metric learning-based models have been shown to be better at capturing fine-grained information than matrix factorization. Nevertheless,most of these models only focus on rating data and social information, which are not sufficient for dealing with the challenges of data sparsity. In this paper,we propose a metric learning-based social recommendation model called SRMC.SRMC exploits users' co-occurrence pattern to discover their potentially similar or dissimilar users with symmetric relationships and change their relative positions to achieve better recommendations.Experiments on three public datasets show that our model is more effective than the compared models.

Edible mushrooms have been recognized as highly nutritional food for a long time, due to their specific flavor, texture and also for therapeutic effects. This study proposes a new simple approach, based on FT-IR analysis, followed by statistical methods, in order to differentiate three wild mushrooms species from Romanian spontaneous flora, namely Armillaria mellea, Boletus edulis and Cantharellus cibarius. The preliminary data treatment consisted of data set reduction with principal component analysis (PCA), which provided scores for the next methods. Linear discriminant analysis (LDA) manage to 100% classify the three species and the cross validation step of the method returned 97.4% of correctly classified samples. Only one A. mellea sample overlapped on B. edulis group. When kNN was used in the same manner as LDA, the overall percent of correctly classified samples from the training step was 86.21%, while for holdout set the percent raised at 94.74%. The lowered values obtained for the training set was due to one C. cibarius sample, two B. edulis and five A. mellea, which were placed to other species. Anyway, for holdout sample set, only one sample from B. edulis was misclassified. The fuzzy c-means clustering (FCM) analysis successfully classified investigated mushroom samples according to their species, meaning that in every partition the predominant specie had the biggest DOMs, while samples belonging to other specie had lower DOMs.

(1) Purpose: This work aims at developing a generalizable MRI reconstruction model in the meta-learning framework. The standard benchmarks in meta-learning are challenged by learning on diverse task distributions. The proposed network learns the regularization function in a variational model and reconstructs MR images with various under-sampling ratios or patterns that may or may not be seen in the training data by leveraging a heterogeneous dataset. (2) Methods: We propose an unrolling network induced by learnable optimization algorithms (LOA) for solving our nonconvex nonsmooth variational model for MRI reconstruction. In this model, the learnable regularization function contains a task-invariant common feature encoder and task-specific learner represented by a shallow network. To train the network we split the training data into two parts: training and validation, and introduce a bilevel optimization algorithm. The lower-level optimization trains task-invariant parameters for the feature encoder with fixed parameters of the task-specific learner on the training dataset, and the upper-level optimizes the parameters of the task-specific learner on the validation dataset. (3) Results: The PSNR increases 1.5 dB on average compared to the network trained through conventional supervised learning on the seen CS ratios. We test the result of quick adaption on the unseen tasks after meta-training, the average PSNR arises 1.22 dB compared to the conventional learning procedure that is directly trained on the unseen CS ratios in the meanwhile saving half of the training time. The average PSNR arises 1.87 dB for unseen sampling patterns comparing to conventional learning; (4) Conclusion: We proposed a meta-learning framework consisting of the base network architecture, design of regularization, and bi-level optimization-based training. The network inherits the convergence property of the LOA and interpretation of the variational model. The generalization ability is improved by the designated regularization and bilevel optimization-based training algorithm.

Autonomous image recognition has numerous potential applications in the field of planetary science and geology. For instance, having the ability to classify images of rocks would allow geologists to have immediate feedback without having to bring back samples to the laboratory. Also, planetary rovers could classify rocks in remote places and even in other planets without needing human intervention. Shu et al. classified 9 different types of rock images using a Support Vector Machine (SVM) with the image features extracted autonomously. Through this method, the authors achieved a test accuracy of 96.71%. In this research, Convolutional Neural Networks(CNN) have been used to classify the same set of rock images. Results show that a 3-layer network obtains an average accuracy of 99.60% across 10 trials on the test set. A version of Self-taught Learning was also implemented to prove the generalizability of the features extracted by the CNN. Finally, one model has been chosen to be deployed on a mobile device to demonstrate practicality and portability. The deployed model achieves a perfect classification accuracy on the test set, while taking only 0.068 seconds to make a prediction, equivalent to about 14 frames per second.