The pervasiveness of cardiovascular disease and physician misdiagnosis creates the urgent need for artificial intelligence models to improve diagnosis accuracy. The first objective of this study was to train machine learning models on publicly available data sets containing simple medical information of patients to diagnose cardiovascular disease. The Multilayer Perceptron (MLP) assembled for this task performed optimally with an F1 score of 0.8968. This prompted the creation of an open-source, automated cardiovascular disease diagnosis tool, powered by the MLP. The second objective of this study was to employ a meta-learning methodology called Local Interpretable Model-Agnostic Explanations (LIME) to understand the impact of different features on the model's diagnosis in the form of marginal probabilities. K-Means Clustering was employed to segment the data into ten clusters, after which each data example was passed through LIME. The resulting histograms depict the complex relationship between feature, cluster, and impact on diagnosis. A series of P-values with contrasting orders of magnitude shows the nuances in the MLP's understanding of patients from different clusters. The results of meta-learning analysis reveal that the most important features for cardiovascular disease diagnosis are fasting blood sugar, type of chest pain, and slope of the ST segment on an electrocardiogram. Future experiments should replicate the novel methodology introduced in this study on data sets containing more specialized medical features in order to gain practical medical insights about different types of cardiovascular disease represented by each cluster. Finally, feature engineering pathways should be explored with consideration of these results to create versatile diagnosis models not only for cardiovascular disease, but adaptable to other diseases as well.

Melanoma is considered the most serious and aggressive type of skin cancer, and metastasis appears to be the most important factor in prognosticating this type of cancer. With the emergence of new therapeutic strategies for metastatic melanoma that have shown improvement in patient survival, we developed a transfer learning-based biomarker discovery model that could help in the diagnosis and prognosis of this disease. After applying it to the ensemble machine learning model, results reveal that the genes we found show consistency with other methodologies previously applied to the same TCGA (The Cancer Genome Atlas) data set, and our methods found novel biomarker genes as well. Our ensemble model achieved Area Under the Receiver Operating Characteristic (AUC) of 0.9861, an accuracy of 91.05, and an F1 score of 90.60 using an independent validation data set. This study was able to identify potential genes for diagnostic classification (C7 and GRIK5) and diagnostic and prognostic biomarkers (S100A7, S100A7, KRT14, KRT17, KRT6B, KRTDAP, SERPINB4, TSHR, PVRL4, WFDC5, IL20RB). We also assessed the potential sources of bias for our model and confirmed some of them by the model's performance.

River flood routing computes changes in shape of a flood wave over time as it travels downstream along a river. Conventional flood routing models, especially hydrodynamic models require high quality and quantity of input data such as measured hydrologic time series, geometric data, hydraulic structures and hydrological parameters. Unlike physically based models, machine learning algorithms, which are data driven models, do not require much knowledge about underlying physical processes and can identify complex nonlinearity between inputs and outputs. Due to the higher performance, less complexity, and low computation cost, novel machine learning methods as a single application or hybrid application were introduced by researchers to achieve more accurate and efficient flood routing. This paper reviews the recent application of machine learning methods in river flood routing.

The realm of natural language processing has always been fascinated by the intricacies of sentence semantics. The emergence of context-aware word representations, especially from pre-trained models like ELMO and BERT, has revolutionized several semantic tasks including but not limited to, question answering, text categorization, and sentiment analysis. Despite these advancements, the integration of supplementary knowledge, particularly syntactic, to augment semantic comprehension in models remains an area ripe for exploration. This paper introduces the Syntactic Enhancement Network (SEN), a pioneering method for synergizing syntactic elements with established pre-trained language models. Our approach encompasses a dual-phase evaluation: initially, we delve into the syntactic augmentation of both RNN-based and Transformer-based language models; subsequently, we test our SEN's proficiency in two specific domains: the task of sentence completion and the extraction of biological relationships. The results are striking, with SEN achieving a stellar 91.2% accuracy in sentence completion—surpassing baseline models by a substantial 37.8%. In the context of biological relation extraction, SEN demonstrates competitive prowess with a 75.1% F1 score.

Biology is so complex that it has to be studied in different ways and focuses on processes. Self-regulation skills in learning are important metacognitive skills for students in studying Biology. Learning models that train strategic students in learning are a must so that they gain meaningful learning experiences through the process of exploration, analysis of new information carried out in learning by applying self-questioning strategies to monitor why new information can be trusted. The results of the synthesis between old knowledge and new knowledge are enhanced through peer coaching in class. This research was conducted to develop an EAQD-PC learning model (exploring, analyzing, questioning, defining peer coaching) and tools that are valid, practical, and effective. The model development procedure includes the preliminary research stage, the prototype stage, and the assessment stage. Model validation data was collected using expert validation instruments. While the practicality of the model components is measured by the implementation observation sheet. The effectiveness of the model was measured using a metacognitive skill test and a questionnaire. This model is applied to students majoring in Biology Education at Muhammadiyah University of Bone, even semester 2019/2020. The results showed that the components of the EAQD-PC model (a) with a value of 3.87, and valid learning model supporting tools with a value of 3.83, (b) practicality with a value of 3.89 and (c) effectiveness with a value of 3, 97 . This study proves that the EAQD-PC model is practical and effective for training students' metacognitive skills.

Cervical injuries from athletic activities are rare; they can have severe consequences if not diagnosed and managed promptly. The choice of diagnostic imaging modality is pivotal in ensuring timely and accurate diagnosis. We detail the case of a 19-year-old female athlete who sustained a C2 Durel Type II Subclass C fracture during a short-track speed skating championship. Initial evaluation using X-ray imaging at the athletic center medical facility did not detect the injury, allowing her to continue competing. Persistent pain led to further evaluation at our institution, where MRI and CT scans confirmed the fracture. Approximately 45 days post-injury, the patient underwent a successful surgical intervention utilizing O-arm CBCT navigation for C1-C2 dorsal fusion. Post-surgery, she embarked on a comprehensive rehabilitation program and fully recovered within 12 weeks. This case underscores the limitations of relying solely on X-ray imaging for diagnosing cervical fractures post-trauma. Our findings advocate prioritizing CT scans as a primary diagnostic tool in such scenarios, emphasizing the need for a robust diagnostic approach to ensure athlete safety and well.

A novel machine learning approach is presented in this paper, based on extracting latent information and using it to assist decision making on ambulance attendance and conveyance to a hospital. The approach includes two steps: in the first, a forward model analyzes the clinical and, possibly, non-clinical factors (explanatory variables), predicting whether positive decisions (response variables) should be given to the ambulance call, or not; in the second, a backward model analyzes the latent variables extracted from the forward model to infer the decision making procedure. The forward model is implemented through a machine, or deep learning technique, whilst the backward model is implemented through unsupervised learning. An experimental study is presented, which illustrates the obtained results, by investigating emergency ambulance calls to people in nursing and residential care homes, over a one-year period, using an anonymized data set provided by East Midlands Ambulance Service in United Kingdom.

This article analyzes the perspectives of professional training of the public administration staff, from the viewpoint of the sustainability criteria, starting from the experiences of the online courses run in the last two years. In order to understand the nature, type and magnitude of the changes caused by the Covid-19 pandemic in the field of professional training for public administration, we performed a survey among public institution employees, by applying a questionnaire. The instrument included qualitative elements, to allow the framing of statistical results. The article is grounded on the hypothesis that the professional training activities in the last two years were organized preponderantly online and it aims to analyze the sustainability of the new teaching systems/methods. The limitations of the study are given by the fact that each administrative system has structure particularities and its own legal framework regarding the professional training of public administration staff, what makes that the model proposed cannot be applied in all countries. The study provides a model of online professional training for public administration staff, sustainable, based on the experience accumulated in the last two years.

We study the problem of predicting time series data using the autoregressive integrated moving average (ARIMA) model in an online manner. Existing algorithms require model selection, which is time consuming and inapt for the setting of online learning. Using adaptive online learning techniques, we develop algorithms for fitting ARIMA models with fewest possible hyperparameters. We analyse the regret bound of the proposed algorithms and examine their performance using experiments on both synthetic and real world datasets

The purpose of this paper is to develop a theoretical predictive model for LNG shipping routes selection process. Strategic decisions about shipping costs could be improved if a deeper knowledge about products economic value is provided. Developments made on the extraction and industrial processes related to this fossil fuel are driving the natural gas sector towards a unique globalised market. Moreover, data analytics applications as well as machine learning are topics presented as perfect catalysers for achieving an unprecedented natural gas globalised market. Additionally, this paper aims at showing the state of the art of new techniques used in transportation engineering that might have synergies with other industries (eg. commodities cost reduction, energy supply…). Finally, this paper aims to provide foundation for further research and development using more sophisticated data and algorithms that will help to close the gap between theoretical and practical scope of this techniques.

At the beginning of 2020, with the onset of the pandemic, the traditional learning environment for learners drastically changed globally. Since then, most students/teachers have started and practiced distance and virtual learning/teaching. Thus, a technological breakthrough in virtual learning has followed. In connection with this, many countries worldwide have commenced allocating additional financing and funds for educational institutions' technological improvement and development. The long-term stay in distance learning has revealed and highlighted new problems students face: their knowledge level has decreased, they lack socialization skills, and they face psychological and physical health problems. Due to this negative impact on students, a need to research and evaluate how much the EU countries allocated to solve the distance learning-caused problems and what programs or models they prepared has emerged and encouraged further studies. The research has found that many countries increased their allocations very minimally, e.g., 0.0.1%, but some increased their available budgets to 32%. Notably, most countries did not separate distance learning exit funding from distance learning preparation funding. Based on the problems the countries saw, only a few states identified withdrawal from distance learning as a problem. Considering this, we set ourselves the goal to evaluate exit models from distance learning and allocated funding amounts. The following objectives were planned to achieve the goal: · to evaluate the global practice of exit from distance learning; · to determine the scope of funding for pandemic management; · to evaluate the amounts of funding allocated to manage pandemic-caused consequences and the GDP ratio. Research methods: mathematical-statistical analysis, empirical analysis, and analysis of scientific literature.

Mechanistic models have been used for centuries to describe complex interconnected processes, including biological ones. As the scope of these models has widened, so have their computational demands. This complexity can limit their suitability when running many simulations or when real-time results are required. Surrogate machine learning models can be used to approximate the behaviour of complex mechanistic models, and once built, their computational demands are several orders of magnitude lower. This paper provides an overview of the relevant literature, both from an applicability and a theoretical perspective. For the latter, the paper focuses on the design and training of the underlying machine learning models. Application-wise, we show how machine learning surrogates have been used to approximate different mechanistic models. We present a perspective on how these approaches can be applied to models representing biological processes with potential industrial applications (e.g., metabolism and whole-cell modelling) and show why surrogate machine learning models may hold the key to making the simulation of complex biological models possible using a typical desktop computer.

Landscapes evolve due to climatic conditions, tectonic activity, geological features, biological activity, and sedimentary dynamics. These processes link geological processes at depth to surface features. Consequently, the study of landscapes can reveal essential information about the geochemical footprint of ore deposits at depth. Advances in satellite imaging and computing power have enabled the creation of large geospatial datasets, the sheer size of which necessitates automated processing. We describe a methodology to enable the automated mapping of landscape pattern domains using machine learning (ML) algorithms. From a freely available Digital Elevation Model, derived data, and sample landclass boundaries provided by domain experts, our algorithm produces a dense map of the model region in Western Australia. Both random forest and support vector machine classification achieve about 98\% classification accuracy with reasonable runtime of 48 minutes on a single core. We discuss computational resources and study the effect of grid resolution. Larger tiles result in a more contiguous map, while smaller tiles result in a more detailed, and at some point, noisy map. Diversity and distribution of landscapes mapped in this study support previous results. In addition, our results are consistent with the geological trends and main basement features in the region.

Surrogate model based optimization method is widely-used to accelerate the design and optimization process~\cite{marler2004survey}. The input of regression model used in the surrogate model are numbers, which requires users to parametrize the geometries. In this paper, a new parameterization-free surrogate model is introduced and its corresponding uncertainty quantification and sensitivity analysis method are discussed. The input of new surrogate model methods is surface mesh of simulation domain. \Gls{gnns} is used to extract geometric information, and \Gls{cnns} is used to predict contours. This framework bypasses parameterization,as a consequence, uncertainties introduced by manual parameterization is reduced. However, such changes compared with conventional surrogate model methods impose great challenge on uncertainties quantification and sensitivity analysis. Uncertainties quantification in this paper means the error bar of prediction results, which is calculated by Gaussian Process Regression method in current surrogate method. In this paper, a new quantification method achieved by Kullback-Leibler divergence (KLD) is introduced. And the sensitivity analysis is conducted by Automatic Differentiation, which gives a Jacobian matrix of inputs. The method and analysis mentioned above are demonstrated by a low-pressure steam turbine rotator and its exhaust system.

Climate change and environmental degradation are major threats to sustainable agricultural development in Southern Africa. Thus, the concept of sustainable intensification (SI) i.e. getting more output from less input using certain practices such as agroforestry, organic fertilizer, sustainable water management etc. has become an important topic among researchers and policy makers in the region in the last three decades. A comprehensive review of literatures on the adoption of SI in the region identify nine relevant drivers of adoption of SI among (smallholder) farmers. These drivers include (i) age, (ii) size of arable land, (iii) education, (iv) extension services, (v) gender, (vi) household size, (vii) income, (viii) membership in farming organization and (ix) access to credit. We present the results of a meta-analysis of 21 papers on the impact of these determinants on SI adoption among (smallholder) farmers in Southern African Development Community (SADC) using random-effects estimation techniques for the true effect size. While our result suggests that variables such as extension services, education, age, and household size may influence the adoption of SI in SADC, factors such as access to credit is also of great importance. Decision-makers should therefore concentrate efforts on these factors in promoting SI across the SADC. This includes increasing the efficiency of public extension service as well as involvement of private sector in extension service. Furthermore, both public and private agriculture financing models should consider sustainability indicators in their assessment process.

Users on the social networking platform have the freedom to express themselves freely. Towards the same time, this has created a forum for disagreement and hate directed at someone, society, racism, sexual orientation, and so on. Identifying hate online is a challenging task. Researchers from all around the world have contributed major methods for detecting hate speech, but owing to the issue's complexity, there are still many unresolved issues. In this research, we offer a multi-model learning strategy for detecting hate speech on Twitter. We utilised the Kaggle TwitterHate dataset, which had 31962 tweets categorised as binary hate or non-hate, to evaluate our technique. The suggested method is tested using commonly used machine learning classifiers with multi-model technique. Using TF-IDF features, we acquired detection results of 96.29 %, precision of 96%, recall of 96%, and f1-score of 96%.

This is an article or technical note which is intended to provides an insight journey of Machine Learning Systems (MLS) testing, its evolution, current paradigm and future work. Machine Learning Models, used in critical applications such as healthcare industry[1], Automobile [2], [3] and Air Traffic control, Share Trading etc., and failure of ML Model can lead to severe consequences in terms of loss of life or property. To remediate this, developers, scientists, and ML community around the world, must build a highly reliable test architecture for critical ML application. At the very foundation layer, any test model must satisfy the core testing attributes such as test properties and its components. This attribute comes from the software engineering [5], [6], but the same cannot be applied in as-is form to the ML testing and we will tell you “why”.

Although learning analytics (LA) holds great potential to improve teaching and learning, LA research and practice are currently riddled with limitations that impact every stage of the LA life cycle. The present paper offers an overview of these challenges before proposing strategies to overcome them and exploring how the recent innovations brought forth by language models can improve LA research and practice. In particular, we encourage the empowerment of teachers during LA development, as this would strengthen the theoretical foundation of LA solutions and increase their interpretability and usability. Furthermore, we provide examples of how process data can be used to understand learning processes and generate more interpretable LA insights. Furthermore, we explore how LLMs could come into play in LA to generate interpretable insights, timely and actionable feedback, increase personalization, and support teachers’ tasks more broadly.

The new Post Accelerating Data and Knowledge Online Society, or ‘Padkos’ requires a new model of decision making. This introductory paper proposes a model where decision making and learning are a single symbiotic process, incorporating man and machine, as well as the AADD (ánthrōpos, apparatus, decider, doctrina) diamond model of individual and organizational decision-making and learning processes. The learning is incorporated by using a newly proposed quadruple loop learning model. This model allows for controlled changes of identity, the process of creating and the sense making of new mental models and assumption, and reflections. The model also incorporates the recently proposed model of quantum decision-making, where time collapse of the opted past and the anticipated future (explicitly including its time horizon) into the present play a key role in the process, leveraging decision-making and learning by human as well as Artificial Intelligence (AI) and Machine Learning (ML) algorithms. The paper closes with conclusions.

Several outbreak prediction models for COVID-19 are being used by officials around the world to make informed-decisions and enforce relevant control measures. Among the standard models for COVID-19 global pandemic prediction, simple epidemiological and statistical models have received more attention by authorities, and they are popular in the media. Due to a high level of uncertainty and lack of essential data, standard models have shown low accuracy for long-term prediction. Although the literature includes several attempts to address this issue, the essential generalization and robustness abilities of existing models need to be improved. This paper presents a comparative analysis of machine learning and soft computing models to predict the COVID-19 outbreak. Among a wide range of machine learning models investigated, two models showed promising results (i.e., multi-layered perceptron, MLP, and adaptive network-based fuzzy inference system, ANFIS). Based on the results reported here, and due to the highly complex nature of the COVID-19 outbreak and variation in its behavior from nation-to-nation, this study suggests machine learning as an effective tool to model the outbreak.

Modeling is essential to understand better the generative mechanisms responsible for experimental observations gathered from complex systems. In this work, we are using such an approach to analyze the electrocardiogram (ECG). We present a systematic framework to decompose ECG signals into sums of overlapping lognormal components. We used reinforcement learning to train a deep neural network to estimate the modeling parameters from ECG recorded in babies of 1 to 24 months of age. We demonstrate this model-driven approach by showing how the extracted parameters vary with age. After correction for multiple tests, 10 of 24 modeling parameters showed statistical significance below the 0.01 threshold, with absolute Kendall rank correlation coefficients in the [0.27, 0.51] range. We presented a model-driven approach to the analysis of ECG. The impact of this framework on fundamental science and clinical applications is likely to be increased by further refining the modeling of the physiological mechanisms generating the ECG. By improving the physiological interpretability, this approach can provide a window into latent variables important for understanding the heart-beating process and its control by the autonomous nervous system.

Artificial intelligence methods and application have recently shown great contribution in modeling and prediction of the hydrological processes, climate change, and earth systems. Among them, deep learning and machine learning methods mainly have reported being essential for achieving higher accuracy, robustness, efficiency, computation cost, and overall model performance. This paper presents the state of the art of machine learning and deep learning methods and applications in this realm and the current state, and future trends are discussed. The survey of the advances in machine learning and deep learning are presented through a novel classification of methods. The paper concludes that deep learning is still in the first stages of development, and the research is still progressing. On the other hand, machine learning methods are already established in the fields, and novel methods with higher performance are emerging through ensemble techniques and hybridization.

Ankylosing spondylitis (AS) is a chronic inflammatory disorder with unknown etiology and hard to early diagnose. It’s imperative to investigate the changes in AS patients’ peripheral blood, which may contribute to the diagnosis and further understanding of AS. Common differential expressed genes between normal and AS patients in GSE73754 and GSE25101 were screened by machine learning algorithms. IL2RB and ZDHHC18 were hubgenes screened and a diagnostic model was established. C-indexes and calibration analyses suggested high prediction accuracy of the model in training and validation cohorts. The AUC values of the model in GSE73754, GSE25101, GSE18781 and GSE11886 were 0.86, 0.84, 0.85 and 0.89 respectively. Decision curve analyses suggested high net benefit by the model. Functional analysis of the differential expressed genes indicated that they were mainly clustered in processes related to immune response. Immune microenvironment analysis revealed that neutrophils were expanded and activated in AS, while some T cells were decreased. IL2RB and ZDHHC18 were potential blood biomarkers for AS and might be used for early diagnosis and a supplementary diagnostic tool to the existing methods. Our study deepened the insight into the pathogenesis of AS.

Globally, seagrass meadows provide critical ecosystem services. However, seagrasses are globally degraded at an accelerated rate. The lack of information on seagrass spatial distribution and seagrass health status seriously hinders seagrass conservation and management. Therefore, this study proposes to combine remote sensing big data with a new hybrid machine learning model (RF-SWOA) to predict potential seagrass habitats. The multivariate remote sensing data is used to train the machine learning model, which can improve the prediction accuracy of the model. This study shows that a hybrid machine learning model (RF-SWOA) can predict potential seagrass habitats more accurately and effectively than traditional models. At the same time, it has been shown that the most important factors influencing the potential habitat of seagrass in the Hainan region were the distance from land (38.2%) and the depth of the ocean (25.9%). This paper provides a more accurate machine learning model approach for predicting the distribution of marine species, which can help develop seagrass conservation strategies to restore healthy seagrass ecosystems.

Abstract Background and Objective: Medical Microwave Radiometry (MWR) is used to capture the thermal properties of internal tissues and has usages in breast cancer detection. Our goal in this paper is to improve classification performance and investigate automated neural architecture search methods. Methods: We investigate optimizing the weights of a weight agnostic neural network using bi-population covariance matrix adaptation evolution strategy (BIPOP-CMA-ES) once the topology is found. We compare it against a weight agnostic and cascade correlation neural network. Results: The experiments are conducted on a breast cancer dataset of 4912 patients. Our proposed weight agnostic BIPOP-CMA-ES model achieved the best performance. It obtained an F1-score of 0.9225, accuracy of 0.9219, precision of 0.9228, recall of 0.9217 and topology of 153 connections. Conclusions: The results are an indication of the potential of MWR utilizing a neural network-based diagnostic tool for cancer detection. By separating the tasks of topology search and weight training, we are able to improve the overall performance.

In the realm of smart transportation and mobility, delivery organizations are continuously refining their strategies, harnessing resources and advanced analytical techniques to streamline operations, aiming to achieve optimal solutions in terms of both efficiency and cost-effectiveness. However, a persistent challenge faced by these delivery companies revolves around the effective assignment of delivery personnel to customer orders, often grappling with suboptimal assignments that lead to inefficiencies and delays. To address this issue, we propose an architecture that uses the Munkres algorithm to optimize the task assignment problem for delivery personnel with pending orders, employing different cost functions obtained with deterministic and machine learning techniques. We compared the performance of linear and polynomial regression methods to construct different cost functions represented by matrices with orders and delivery people information. Subsequently, we applied the Munkres optimization algorithm to solve the assignment problem, which optimally assigns delivery people and orders. The results demonstrate that linear regression, used to estimate distance information, can reduce estimation errors by up to 568.52 km (1.51%) for our dataset compared to other methods. Conversely, polynomial regression proves effective in constructing a superior cost function based on time information, reducing estimation errors by up to 17,143.41 minutes (11.59%) compared to alternative methods. The proposed approach aims to enhance delivery personnel allocation within the delivery sector, optimizing the efficiency of this process.

This article examines the wavelet transforms and the machine learning methods in accelerating large eddy simulations of turbulent flows. An overarching challenge of large eddy simulations is to accurately represent the cascade of kinetic energy across the cut-off length scale. Taylor hypothesis suggests that the energy cascade occurs through the process of vortex stretching. However, Richardson hypothesis assumes the self-amplification of the strain field and a hierarchical break down of large eddies lead the energy cascade. The large eddy simulations typically employs the self-amplification of the strain in formulating subgrid models. However, several studies also proposed subgrid models based on vortex stretching. The wavelet-based coherent vortex simulation of turbulence directly accounts for vortex stretching in overall forward scatter of energy, while allowing local backscatter. The wavelet-based large eddy simulation adapts the grid to capture the creation of small-scale eddies, while adopting subgrid models based on the self-amplification of strain. The advancement of artificial intelligence in turbulence modelling is currently evolving around accelerating the numerical simulations of turbulent flow. However, there is a clear connection between the application of wavelet transfroms and neural networks for directly solving the Navier-Stokes equation, indicating some potential benefits of wavelet methods over the neural networks.

The article takes the case of the adoption of machine learning in a steel manufacturing process through a platform provided by a novel Canadian startup, Canvass Analytics. This way the steel company could optimize the process in a blast furnace. The content of the paper includes a conceptual framework on key factors around steel manufacturing and machine learning. Method: The article takes the case of the adoption of machine learning in a steel manufacturing process through a platform provided by a novel Canadian startup, Canvass Analytics. This way the steel company could optimize the process in a blast furnace. The content of the paper includes a conceptual framework on key factors around steel manufacturing and machine learning. Results: This case is relevant for the authors by the way the business model proposed by the startup attempts to democratize Artificial Intelligence and Machine Learning in industrial environments. This way the startup delivers value to facilitate traditional industries to obtain better operational results, and contribute to a better use of resources. Conclusion: This work is focused on opportunities that arise around Artificial Intelligence as a driver for new business and operating models. Besides the paper looks into the framework of the adoption of Artificial Intelligence and Machine Learning in a traditional industrial environment towards a smart manufacturing approach.

Object recognition is an essential element of machine intelligence tasks. However, one model cannot practically be trained to identify all the possible objects it encounters. An ensemble of models may be needed to cater to a broader range of objects. Building a mathematical understanding of the relationship between various objects that share comparable outlined features is envisaged as an effective method of improving the model ensemble through a pre-processing stage, where these objects' features are grouped under a broader classification umbrella. This paper proposes a mechanism to train an ensemble of recognition models coupled with a model selection scheme to scale-up object recognition in a multi-model system. An algorithmic relationship between the learnt parameters of a trained classification model and the features of input images is presented in the paper for the system to learn the model selection scheme. The multiple models are built with a CNN structure, whereas the image features are extracted using a CNN/VGG16 architecture. Based on the models' excitation weights, a neural network model selection algorithm, which links a new object with the models and decides how close the features of the object are to the trained models for selecting a particular model for object recognition is developed and tested on a five-model neural network platform. The experiment results show the proposed model selection scheme is highly effective and accurate in selecting an appropriate model for a network of multiple models.

Magnesium matrix composites have attracted significant attention due to their lightweight nature and impressive mechanical properties. However, the fabrication process for these alloy compo-sites is often time-consuming, expensive, and labor-intensive. To overcome these challenges, this study employed machine learning (ML) techniques to predict the mechanical properties of magnesium matrix composites. Regression models were utilized to forecast the yield strength of magnesium alloy composites reinforced with various materials. The study incorporated previous research on matrix type, reinforcement type, heat treatment, and mechanical working. The re-gression models employed in this study included decision tree regression, random forest re-gression, extra tree regression, and XGBoost regression. Model performance was assessed using metrics such as RMSE and R2. The XGBoost Regression model out-performed others, exhibiting an R2 value of 0.94 and the lowest error rate. Feature importance analysis indicated that the rein-forcement particle form had the greatest influence on the mechanical properties. The study iden-tified the optimized parameters for achieving the highest yield strength, which was 186.99 MPa. Overall, this study successfully demonstrates the effectiveness of ML as a valuable tool for opti-mizing the production parameters of magnesium matrix composites.

Advancing models for accurate estimation of food production is essential for policymaking and managing national plans of action for food security. This research proposes two machine learning models for the prediction of food production. The adaptive network-based fuzzy inference system (ANFIS) and multilayer perceptron (MLP) methods are used to advance the prediction models. In the present study, two variables of livestock production and agricultural production were considered as the source of food production. Three variables were used to evaluate livestock production, namely livestock yield, live animals, and animal slaughtered, and two variables were used to assess agricultural production, namely agricultural production yields and losses. Iran was selected as the case study of the current study. Therefore, time-series data related to livestock and agricultural productions in Iran from 1961 to 2017 have been collected from the FAOSTAT database. First, 70% of this data was used to train ANFIS and MLP, and the remaining 30% of the data was used to test the models. The results disclosed that the ANFIS model with Generalized bell-shaped (Gbell) built-in membership functions has the lowest error level in predicting food production. The findings of this study provide a suitable tool for policymakers who can use this model and predict the future of food production to provide a proper plan for the future of food security and food supply for the next generations.

Training supervised machine learning models requires labeled examples. A judicious choice of examples is helpful when there is a significant cost associated with assigning labels. This article improves upon a promising extant method – Batch-mode Expected Model Change Maximization (B-EMCM) method – for selecting examples to be labeled for regression problems. Specifically, it develops and evaluates alternate strategies for adaptively selecting batch size in B-EMCM. By determining the cumulative error that occurs from the estimation of the stochastic gradient descent, a stop criteria for each iteration of the batch can be specified to ensure that selected candidates are the most beneficial to model learning. This new methodology is compared to B-EMCM via mean absolute error and root mean square error over ten iterations benchmarked against machine learning data sets. Using multiple data sets and metrics across all methods, one variation of AB-EMCM, the max bound of the accumulated error (AB-EMCM Max), showed the best results for an adaptive batch approach. It achieved better root mean squared error (RMSE) and mean absolute error (MAE) than the other adaptive and non-adaptive batch methods while reaching the result in nearly the same number of iterations as the non-adaptive batch methods.

Based on orbital angular momentum (OAM) properties of Laguerre Gaussian beams LG(p,ℓ), a robust optical encoding model for efficient data transmission applications is designed. This paper presents an optical encoding model based on intensity profile generated by a coherent superposition of two OAM-carrying Laguerre-Gaussian modes and Machine-learning detection method. In the encoding process, the intensity profile for data encoding is generated based on selection of p and ℓ indices, while the decoding process is performed using support vector machine (SVM) algorithm. Two different decoding models based on SVM algorithm are tested to verify the robustness of optical encoding model, finding a BER =10−9 for 10.2dB of signal-to-noise ratio in one of the SVM models.

Exploiting the existing optical fiber network’s terrestrial infrastructure offers unexpected solutions to global challenges. We aim to expand the current network by incorporating a streaming telemetry system to integrate earthquake early detection. The purpose is to analyze and interpret alteration of light’s polarization induced by seismic events, particularly Primary earthquake waves that precede destructive Surface waves. This analysis facilitates the development of an early warning system and implementation of earthquakes countermeasures to mitigate humanitarian and economic impact. Consequently, we have developed a Python-based Waveplate Model designed to monitor light’s polarization changes within optical fibers buried underground. The model incorporates real ground displacement data from a 4.9 magnitude earthquake that struck in Marradi region, central Italy. We propose a novel approach of a smart sensing grid of optical network empowered by machine learning, trained on a large number of polarization evolution extracted from two distinct sensing fibers to identify the pattern of polarization change occurring during Marradi earthquake. Test Results demonstrate that this method can detect Primary waves within one second time-frame, achieving an accuracy rate of 99.5%. This system therefore affords nearby regions 52 seconds to take emergency response, and an extended margin of 62 seconds in more distant areas.

The sudden pervasive of severe acute respiratory syndrome Covid-19 has been leading the universe into a prominent crisis. It has influenced each zone, for example, industrial area, horticultural zone, Public transportation, economic zone, and so on. So as to see how Covid-19 affected the globe, we conducted an investigation characterizing the effects of the pandemic over the world using Machine Learning (ML) method. Prediction is a typical data science exercise that helps the administration with function planning, objective setting, and anomaly detection. We propose an additive regression model with interpretable parameters that can be naturally balanced by experts with domain intuition about the time series. We focus on global data beginning from 22^nd January 2020, till 26^th April 2020 and performed dynamic map visualization of Covid-19 expansion globally by date wise and predicting the spread of virus on all countries and continents. The major advantages of this work include accurate analysis of country-wise as well as province/state-wise confirmed cases, recovered cases, deaths, prediction of pandemic viral attack and how far it is expanding globally.

Attackers are perpetually modifying their tactics to avoid detection and frequently leverage legitimate credentials with trusted tools already deployed in a network environment, making it difficult for organizations to proactively identify critical security risks. Network traffic analysis products have emerged in response to attackers’ relentless innovation, offering organizations a realistic path forward for combatting creative attackers. Additionally, thanks to the widespread adoption of cloud computing, Device Operators (DevOps) processes, and the Internet of Things (IoT), maintaining effective network visibility has become a highly complex and overwhelming process. What makes network traffic analysis technology particularly meaningful is its ability to combine its core capabilities to deliver malicious intent detection. In this paper, we propose a novel darknet traffic analysis and network management framework to real-time automating the malicious intent detection process, using a weight agnostic neural networks architecture. It is an effective and accurate computational intelligent forensics tool for network traffic analysis, the demystification of malware traffic, and encrypted traffic identification in real-time. Based on Weight Agnostic Neural Networks (WANNs) methodology, we propose an automated searching neural net architectures strategy that can perform various tasks such as identify zero-day attacks. By automating the malicious intent detection process from the darknet, the advanced proposed solution is reducing the skills and effort barrier that prevents many organizations from effectively protecting their most critical assets.

Panoramic and periapical radiograph tools help dentists diagnose the most common dental diseases. Generally, dentists identify dental caries manually by inspecting X-ray images. However, due to their heavy workload, or poor image quality, dentists may sometimes overlook some unnoticeable dental caries, which may ultimately hinder the patient treatment. The purpose of this study was to develop an algorithm that classifies the teeth X-Ray images into three categories of “Normal”, “Caries”, and “Filled”. Our study used a dataset of 116 patients and 3712 single teeth images for training, validation and testing. Images were pre-processed using a sharpening filter and an intensity color map. We used a pre-trained transfer learning model, the NASNetMobile, which served as the feature extractor and the Convolutional Neural Network (CNN) model served as the classifier. The training dataset had a “Recall” of 0.92, 0.90 and 0.91 for “Normal”, “Caries” and “Filled” respectively and the test dataset had a “Recall” of 0.86, 0.81 and 0.85 for “Normal”, “Caries” and “Filled” respectively. The classification of the teeth X-Rays was successful and can be valuable for dentist as the artificial intelligence algorithm can serve as a decision support tool to aid dentists when they need to diagnose dental treatment.

Skin cancer is an uncommon but serious malignancy. Dermoscopic images examination and biopsy are required for cancer detection. Deep learning (DL) is extremely effective in learning characteristics and predicting malignancies. However, DL requires a large number of images to train. Image augmentation and transferring learning were employed to overcome the lack of images issue. In this study we divided images into two categories: benign and malignant. To train and test our models, we used the public ISIC 2020 database. Melanoma is classified as malignant in the ISIC 2020 dataset. Along with categorization, the dataset was studied to demonstrate variation. The performance of three top pretrained models was then benchmarked in terms of training and validation accuracy. Three optimizers were employed to optimize the loss: RMSProp, SGD, and ADAM. Using ResNet, VGG16, and MobileNetV2, we obtained training accuracy of 98.73%, 99.12%, and 99.76%, respectively. Using these three pretrained models, we attained a validation accuracy of 98.39%.

Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and explain the results of deep learning algorithms by depicting the anatomical areas which influence the decision of the algorithm most. Moreover, this research presents a unified framework, TorchEsegeta, for applying various interpretability and explainability techniques for deep learning models and generate visual interpretations and explanations for clinicians to corroborate their clinical findings. In addition, this will aid in gaining confidence in such methods. The framework builds on existing interpretability and explainability techniques that are currently focusing on classification models, extending them to segmentation tasks. In addition, these methods have been adapted to 3D models for volumetric analysis. The proposed framework provides methods to quantitatively compare visual explanations using infidelity and sensitivity metrics. This framework can be used by data scientists to perform post-hoc interpretations and explanations of their models, develop more explainable tools and present the findings to clinicians to increase their faith in such models. The proposed framework was evaluated based on a use case scenario of vessel segmentation models trained on Time-of-fight (TOF) Magnetic Resonance Angiogram (MRA) images of the human brain. Quantitative and qualitative results of a comparative study of different models and interpretability methods are presented. Furthermore, this paper provides an extensive overview of several existing interpretability and explainability methods.

A regularization approach to model selection, within a generalized HJM framework, is introduced which learns the closest arbitrage-free model to a prespecified factor model. This optimization problem is represented as the limit of a one-parameter family of computationally tractable penalized model selection tasks. General theoretical results are derived and then specialized to affine term-structure models where new types of arbitrage-free machine learning models for the forward-rate curve are estimated numerically and compared to classical short-rate and the dynamic Nelson-Siegel factor models.

As a new distributed machine learning (ML) approach, federated learning (FL) shows the great potential to preserve data privacy by enabling distributed data owners to collaboratively build a global model without sharing their raw data. However, the heterogeneity in terms of data distribution and hardware configurations make it hard to select participants from the thousands of nodes. In this paper, we propose a multi-objective node selection approach to improve time-to-accuracy performance while resisting malicious nodes. We firstly design a deep reinforcement learning assisted FL framework. Then the problem of multi-objective node selection under this framework is formulated as a Markov decision process (MDP), which aims to reduce the training time and improve model accuracy simultaneously. Finally, a deep Q-netwok (DQN) based algorithm is proposed to efficiently solve the optimal set of participants for each iteration. Simulation results show that the proposed method not only significantly improves the accuracy and training speed of FL, but has stronger robustness to resist malicious nodes.

Smart devices such as smartphones, smartwatches, etc. are promising platforms that are being used for automatic recognition of human activities. However, it is difficult to accurately monitor complex human activities due to inter-class pattern similarity, which occurs when different human activities exhibit similar signal patterns or characteristics. Current smartphone-based recognition systems depend on the traditional sensors such as accelerometer and gyroscope, which are inbuilt in these devices. Therefore, apart from using information from the traditional sensors, these systems lack contextual information to support automatic activity recognition. In this article, we explore environment contexts such as illumination(light conditions) and noise level to support sensory data obtained from the traditional sensors using a hybrid of Convolutional Neural Networks and Long Short Time Memory(CNN_LSTM) learning models. The models performed sensor fusion by augmenting the low-level sensor signals with rich contextual data to improve recognition and generalisation ability of the proposed solution. Two sets of experiments were performed to validate the proposed solution. The first set of experiments used inertial sensing data whilst the second set of extensive experiments combined inertial signals with contextual information from environment sensing data. Obtained results demonstrate that contextual information such as environment noise level and illumination using hybrid deep learning models achieved better recognition accuracy than the traditional activity recognition models without contextual information.

Today, there is a time series analysis that has gained significant popularity across various industries to provide effective solutions for any specific challenges. Artificial intelligence logic is generally used to solve time-series problems with the help of various frameworks that are available for the development of AI-based applications. Currently, there is a significant framework in Python that is driven by its comprehensive libraries and their practical implementations. Time series analysis can be built with the help of some specific models that give results to differentiate the efficiency and domains of great work. This paper focuses on three diverse libraries of Python to predict the Gulf stock exchange market. These libraries are prediction models that are helpful in predicting future values. These models utilized include SARIMA (Seasonal Auto-Regressive Integrated Moving Average), Neural Prophet Model, and Fb Prophet model. Each model is trained using the provided datasets, which are followed by evaluation parameters such as MSE, RMSE, recall, MDAPE, accuracy, precision, etc. The main purpose of using these three models for stock market prediction is to find the better-suited models. In the past few decades, the stock market industry has seemed to have promising growth after 2022 onwards. This paper will help us make a significant decision about model usage for addressing such complex challenges. Especially, the research findings indicate that all three models demonstrate in different domains. SARIMA can perform well in overall prediction tasks, while the Prophet model works great with smaller datasets that contain seasonality trends.

Digital Elevation Model (DEM) is a representation of elevation data that represent terrain with or without overlaying objects of the Earth. It is the ideal and most widely used method for determining topography. DEMs are generated from various techniques such as traditional Surveying, Photogrammetry, InSAR, LiDAR, Clinometry and radargrammetry. It has been observed that mostly LiDAR-generated DEMs provide the best accuracy. The unavailability of LiDAR data in most of the region restricts global researchers from high-resolution and accurate DEMs. The recent launch of ICESat-2 with a 13m beam footprint and 0.7m pulse interval, promises elevations at high orbital precision. Its accuracy is of the order of few centimeters in complex topography, because of this ICESat-2 proves to be a good source to generate high-accuracy DEMs. ICESat-2 provides discrete photon data with elevations of points on the Earth’s surface. Traditional interpolation techniques tend to over-smooth the estimated space and still are unable to justify the complicated continuity in the topographical data. Machine learning algorithms are widely being used to extract patterns and spatial extent in geographic data. To estimate a DEM from ICESat-2 LiDAR point data, machine learning regression algorithms are implemented in this study. The present study has been performed for a plain region of Ghaziabad, Uttar Pradesh, India. Studies have shown that Cartosat-1 DEM V3 R1 product provides an accuracy of the order of 2m in predominantly plain regions, hence taken for this region. Current work focuses on comparing various regression-based machine-learning techniques to interpolate DEM from ICESat-2 data The RMSE of the interpolated DEM resulted from the Gradient Boosting Regressor, Random Forest Regressor, Decision Tree Regressor, and Multi-Layer Perceptron Regressor was 7.13m, 7.01m, 7.15m, and 3.76m, respectively when evaluated against the TANDEM-X DEM of the same region. The MLP Regressor is found to perform the best among the four algorithms tested.

Several epidemiological models are being used around the world to project the number of infected individuals and the mortality rates of the COVID-19 outbreak. Advancing accurate prediction models is of utmost importance to take proper actions. Due to a high level of uncertainty or even lack of essential data, the standard epidemiological models have been challenged regarding the delivery of higher accuracy for long-term prediction. As an alternative to the susceptible-infected-resistant (SIR)-based models, this study proposes a hybrid machine learning approach to predict the COVID-19 and we exemplify its potential using data from Hungary. The hybrid machine learning methods of adaptive network-based fuzzy inference system (ANFIS) and multi-layered perceptron-imperialist competitive algorithm (MLP-ICA) are used to predict time series of infected individuals and mortality rate. The models predict that by late May, the outbreak and the total morality will drop substantially. The validation is performed for nine days with promising results, which confirms the model accuracy. It is expected that the model maintains its accuracy as long as no significant interruption occurs. Based on the results reported here, and due to the complex nature of the COVID-19 outbreak and variation in its behavior from nation-to-nation, this study suggests machine learning as an effective tool to model the outbreak. This paper provides an initial benchmarking to demonstrate the potential of machine learning for future research.

Dyadic data which is also called co-occurrence data (COD) contains co-occurrences of objects. Searching for statistical models to represent dyadic data is necessary. Fortunately, finite mixture model is a solid statistical model to learn and make inference on dyadic data because mixture model is built smoothly and reliably by expectation maximization (EM) algorithm which is suitable to inherent spareness of dyadic data. This research summarizes mixture models for dyadic data. When each co-occurrence in dyadic data is associated with a value, there are many unaccomplished values because a lot of co-occurrences are inexistent. In this research, these unaccomplished values are estimated as mean (expectation) of random variable given partial probabilistic distributions inside dyadic mixture model.

Machine Learning is increasingly and ubiquitously being used in the medical domain. Evaluation metrics like accuracy, precision, and recall may indicate the performance of the models but not necessarily the reliability of their outcomes. This paper assesses the effectiveness of a number of machine learning algorithms applied to an important dataset in the medical domain, specifically, mental health, by employing explainability methodologies. Using multiple machine learning algorithms and model explainability techniques, the project provides insights into the model workings to help determine the reliability of the machine learning algorithm predictions. The results are not intuitive. It was found that the models were focusing significantly on less relevant features and at times, unsound ranking of the features to make the predictions. The paper therefore argues that it is important for research in applied machine learning to provide insights into explainability of the models in addition to other performance metrics like accuracy. This is particularly important for applications in critical domains such as healthcare. A future direction is to investigate methods to quantify the effectiveness of the machine learning models in terms of the insights from their explainability.

Deep reinforcement learning (DRL) has achieved significant results in many Machine Learning (ML) benchmarks. In this short survey we provide an overview of DRL applied to trading on financial markets, including a short meta-analysis using Google Scholar, with an emphasis on using hierarchy for dividing the problem space as well as using model-based RL to learn a world model of the trading environment which can be used for prediction. In addition, multiple risk measures are defined and discussed, which not only provide a way of quantifying the performance of various algorithms, but they can also act as (dense) reward-shaping mechanisms for the agent. We discuss in detail the various state representations used for financial markets, which we consider critical for the success and efficiency of such DRL agents. The market in focus for this survey is the cryptocurrency market.

The main purpose of this paper is to propose a novel optimization model with a new machine learning approach in the first section to achieve the best results in financial institutions in the second section. Since the constancy of efficacy derived from parametric and non-parametric is not significant, this paper provides a scientific assessment at the optimization section and proposes a novel combined parametric and non-parametric model which will be a new experiment in literature perception. A scientific assessment of banks based on a combination of the efficiency measurement method of CCR(Charnes, Cooper and Rhodes model) or CRS(Constant Return to Scale) BCC(Banker, Charnes, and Cooper model) or VRS (Variable Return to Scale) in Data Envelopment Analysis (DEA), as well as Stochastic Frontier Approach (SFA) for 65 banks during Feb to July 2020, are introduced. For analyzing the performance of the parametric and non-parametric approaches we have considered the linear regression and Unreplicated Linear Functional Relationship (ULFR). At the machine learning section, a novel four-layers data mining filtering pre-processes for selected supervised classification as well as unsupervised clustering algorithms to increase the accuracy and to remove unrelated attributes and data are applied. For the four kinds of preprocessing approaches of unsupervised attributes, supervised attributes, supervised instances, and unsupervised instances, we have chosen discretization, attribute selection, stratified remove folds, and resample filters respectively. Based on the nature of the suggested financial institution's dataset and attributes, the most appropriate preprocessing filter in each layer to achieve the highest performance is suggested. Finally, the superior bank, best performance model, and the most accurate algorithm are introduced. The results indicate that the bank number 56 is the superior bank. Among the proposed techniques, the novel recommended CVS compared with CCR-BCC and SFA models, has a more positive correlation with profit risk, and show a higher coefficient of determination values. Sequential Minimal Optimization(SMO) algorithm receives the highest accuracy in all four suggested filtering layers.

Herein, we examined the effects of weather parameters and individual clinicodemographic risk factors on hemorrhagic stroke (HS) incidence, severity on admission, and disability at discharge in a harsh desert climate. In a retrospective design we studied patients admitted to a stroke unit in Arab Emirates in 2016-2019. With a distributed lag nonlinear model we explored immediate and delayed effects of weather on stroke incidence. Supervised machine learning was used to build models predictive of scores in NIHSS and mRS scales. We assessed model performance by calculating ROC AUC, F1 scores, specificity, and sensitivity. HS risk increased after a significant change in any weather parameter. The risk was reduced below baseline after 1-week adjustment to environmental changes. Climate input from the previous 3 days yielded reliable classification models. Humidex was a better predictor of severity than air temperature, whereas body mass index, age, and time of day at stroke onset were the strongest clinical predictors. Weather parameters before admission were stronger predictors of disease severity than individual clinical factors. We addressed limitations of previous studies by analyzing a full set of climate parameters: ambient temperature, relative humidity, humidex, atmospheric pressure, and wind speed. Predictive models may help to optimize patient management and develop preventative strategies.

Audio classification using deep learning models, essential for applications like voice assistants and music analysis, faces challenges when deployed on edge devices due to their limited computational resources and memory. Achieving a balance between performance, efficiency, and accuracy is a significant obstacle in optimizing these models for such constrained environments. In this investigation, we evaluate diverse deep learning architectures, including Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM), for audio classification tasks on the ESC 50, UrbanSound8k, and Audio Set datasets. Our empirical findings indicate that Mel Spectrograms outperform raw audio data, attributing this enhancement to their synergistic alignment with advanced image classification algorithms and their congruence with human auditory perception. To address the constraints of model size, we apply model compression techniques, notably magnitude pruning, Taylor Pruning, and 8-bit quantization. The research demonstrates that a hybrid pruned model achieves a commendable accuracy rate of 89 percent, which, although marginally lower than the 92 percent accuracy of the uncompressed CNN, strikingly illustrates an equilibrium between efficiency and performance. Subsequently, we deploy the optimized model on Raspberry Pi 4 and NVIDIA Jetson Nano platforms for audio classification tasks. These findings highlight the significant potential of model compression strategies in enabling effective deep learning applications on resource-limited devices, with minimal compromise on accuracy.

Capsizing accidents are regarded as marine accidents with a high rate of casualties per accident. Approximately 89% of all such accidents occur in small ships (vessels with gross tonnage less than 10 tons). Stability calculations are critical for assessing the risk of capsizing incidents and evaluating a ship's seaworthiness. Despite the high frequency of capsizing accidents involving small ships, they are generally exempt from adhering to stability regulations, thus remaining systemically exposed to the risk of capsizing. Moreover, the absence of essential design documents complicates direct ship stability calculations. This study utilizes hull form feature data—obtained from the general arrangement of small ships—as input for a deep learning model. The model is structured as a multilayer neural network and aims to infer hydrostatic curves, which is required data for stability calculations.

Calculating hydrocarbon components solubility of natural gases is known as one of the important issues for operational works in petroleum and chemical engineering. In this work, a novel solubility estimation tool has been proposed for hydrocarbon gases including methane, ethane, propane and butane in aqueous electrolyte solutions based on extreme learning machine (ELM) algorithm. Comparing the ELM outputs with a comprehensive real databank which has 1175 solubility points concluded to R-squared values of 0.985 and 0.987 for training and testing phases respectively. Furthermore, the visual comparison of estimated and actual hydrocarbon solubility leaded to confirm the ability of proposed solubility model. Additionally, sensitivity analysis has been employed on the input variables of model to identify their impacts on hydrocarbon solubility. Such a comprehensive and reliable study can help engineers and scientists to successfully determine the important thermodynamic properties which are key factors in optimizing and designing different industrial units such as refineries and petrochemical plants.

In a super-aged society, maintaining healthy aging, preventing death, and enabling a continua-tion of economic activities are crucial. This study sought to develop a model for predicting the survival time in community-dwelling older individuals by using a deep learning method, and to identify the level of influence of various risk factors on the survival period, so that older in-dividuals can manage their own health. This study used the Korean National Health Insurance Service claims data. We observed community-dwelling older people, aged 66 years, for 11 years and developed a survival time prediction model. Of the 189,697 individuals enrolled at baseline, 180,235 (95.0%) survived from 2009 to 2019, while 9,462 (5.0%) died. Using deep learning based models (C statistics = 0.7011), we identified Charlson’s comorbidity index; the frailty index; long-term care benefit grade; disability grade; income level; a combination of diabetes mellitus, hypertension, and dyslipidemia; sex; smoking status; and alcohol consumption habit as factors impacting survival. In particular, Charlson’s comorbidity index (SHAP value: 0.0445) and frailty index (SHAP value: 0.0443) were strong predictors of survival time. Older individuals should rec-ognize modifiable risk factors that affect survival period in order to manage their own health.

The most common index for representing structural condition of the pavement is the structural number. The current procedure for determining structural numbers involves utilizing falling weight deflectometer and ground-penetrating radar tests, recording pavement surface deflections, and analyzing recorded deflections by back-calculation manners. This procedure has two drawbacks: 1. falling weight deflectometer and ground-penetrating radar are expensive tests, 2. back-calculation ways has some inherent shortcomings compared to exact methods as they adopt a trial and error approach. In this study, three machine learning methods entitled Gaussian process regression, m5p model tree, and random forest used for the prediction of structural numbers in flexible pavements. Dataset of this paper is related to 759 flexible pavement sections at Semnan and Khuzestan provinces in Iran and includes “structural number” as output and “surface deflections and surface temperature” as inputs. The accuracy of results was examined based on three criteria of R, MAE, and RMSE. Among the methods employed in this paper, random forest is the most accurate as it yields the best values for above criteria (R=0.841, MAE=0.592, and RMSE=0.760). The proposed method does not require to use ground penetrating radar test, which in turn reduce costs and work difficulty. Using machine learning methods instead of back-calculation improves the calculation process quality and accuracy.

In cotton cultivars, an insect that causes irreversible damage is the Spodoptera frugiperda, known as the fall armyworm. Since the visual detection of plants is a burdensome task for human inspection, the spectral information related to plant damage, registered on a spectral scale, can be useful. These measurements, associated with machine learning techniques, produce useful information for a rapid and non-invasive inspection method development. To contribute to this gap fulfillment, this paper proposes a machine learning framework to model the spectral response of cotton plants under the attack of the fall armyworm. Additionally, a theoretical model is presented, built from the results of the machine learning analysis, to infer this damage with up-to-date orbital sensors. The data was composed of the reflectance measurements collected at a cotton field with control plants and plants submitted to Spodoptera frugiperda damage. Their spectral response was recorded with a hand-held spectroradiometer ranging from 350 to 2,500 nm, for eight consecutive days. Different machine learning models were evaluated and the overall best model was defined by accuracies comparisons on a testing-set. A ranking approach was adopted based on the model accuracy, returning the most contributive wavelengths for the classification. Sequentially, an unsupervised neural network (Self-Organizing Map - SOM) was implemented to reduce data-dimensionality and assist in the definition of important spectral regions. The regions were associated with the spectral bands of the two sensors (OLI and MSI) and a theoretical model using a band simulation process with the overall best machine learning model was proposed. The results indicated that the Random Forest (RF) algorithm is the most suitable to predict cotton-plants damaged by insects and that the last day of analysis (8th day) was better to separate it, with F-measure equals 0.912. The ranking approach combined with the SOM method indicated the spectral regions at the red to near-infrared (650 to 1,350 nm) and shortwave infrared (1,570 to 1,640 nm) as the most important regions to the analysis. The proposed theoretical model simulated with the OLI and MSI sensor-bands returned an F-Measure of 0.865 and 0.886, respectively. In conclusion, this framework can be used to map cotton-plants under insect-attack. The theoretical model presents high accuracy to infer the insect-damaged on cotton plants based on multispectral bands from other sensors, being a useful tool for future research that intends to evaluate it in other areas and at different field scales.

This article presents a study on brain tumor detection using the VGG-16 model, a convolutional neural network known for its performance in computer vision tasks. The aim of the study is to classify magnetic resonance imaging (MRI) images and accurately identify the presence of brain tumors. The dataset used consists of brain tumor MRI images, categorized into two classes: "NO" (no tumor) and "YES" (tumor). The methodology involves setting up the environment, importing and preprocessing the data, building the VGG-16 model, and evaluating its performance using metrics such as accuracy, precision, and recall. The results demonstrate an accuracy of approximately 88% on the validation set and 80% on the test set, indicating the potential of the VGG-16 model in supporting healthcare professionals in diagnosing brain tumors. The study contributes to the field of medical image analysis and offers insights into the application of deep learning for brain tumor detection.

Modular steel buildings (MSBs) interlocking inter-module connections (IMCs) have piqued researchers’ interest. However, the existing literature has not yet studied the optimisation of its plate thicknesses. This paper, therefore, focuses on optimising interlocking (IMCs) plate thickness in (MSBs), leveraging previous experimental and numerical simulation methodologies. Various numerical models for four MSBs interlocking (IMCs) with plate thicknesses (4 mm, 6 mm, 10 mm, and 12 mm) were developed under compression loading conditions. The study’s novelty lay in its comprehensive parametric analysis, which evaluated the slip phenomenon in (MSBs) connections and introduced a slip prediction model validated against empirical data. Further innovative machine learning approach was utilised to predict slip values based on applied force through a random forest regression model trained using the 'Treebagger' function. Sensitivity analysis and comparisons with alternative methods were utilised to underscore the reliability and applicability of the findings. The results showed that 11.03 mm was the optimal plate thickness for interlocking (IMCs) in modular steel buildings, with up to 8.08% reduced material costs. Increasing plate thickness boosts its deformation resistance by up to 50.75%. ‘TreeBagger’ random forest for anomaly detection and machine learning improves slip prediction up to 7% at higher force levels.

Tight gas, a category of Deep Green Energy Resources, rely on advanced intelligent monitoring methods for their extraction. Conventional logging for reservoir evaluation relies on logging data and the manual setting of evaluation criteria to classify reservoirs. However, the complexity and heterogeneity of tight reservoirs pose challenges in accurately identifying target layers by using traditional well-logging techniques. Machine learning may hold the key to solving this problem, as it enables computers to learn without being explicitly programmed and manually added rules. Therefore, it is possible to make reservoir evaluation via using machine learning methods. In this paper, the reservoir quality index (RQI) and porous geometric parameters obtained from the optimized inversion of the spherical-tubular model are adopted to evaluate the reservoir. Then, three different machine learning approaches, the random forest (RF) algorithm, support vector machine (SVM) algorithm, and extreme gradient boosting (XGB) algorithm, are utilized for reservoir classification. The selected dataset covers more than 7,000 samples from five wells. The data from four wells are arranged as the training dataset, and the data of the remaining one well is designed as the testing dataset to calculate the prediction accuracies of different machine learning algorithms. Among them, accuracies of RF, SVM, and XGB are all higher than 90%, and XGB owns the highest result by reaching 97%. Machine learning based approaches can greatly assist reservoir prediction by implementing the well-logging data. The research highlights the application of reservoir classification with a higher prediction accuracy by combining machine learning algorithms with NMR logging based pore structure characterization, which can provide a guideline for sweet spot identification within the tight formation. This not only optimizes resource extraction but also aligns with the global shift towards clean and renewable energy sources, promoting sustainability and reducing the carbon footprint associated with conventional energy production. In summary, the fusion of machine learning and NMR logging based reservoir evaluation plays a crucial role in advancing both energy efficiency and the transition to cleaner energy sources.

In this perspective article, we ponder topographical enhancements of artificial neural networks. In our recent paper in JMLR, we proved a quasi-equivalence between the network width and depth and also discussed the power of intra-links, which can be viewed as network height. In 1982, Hopfield published a network to model human associative memory, which contains many loops for dynamic evolution toward fixed points. Based on noising-denoising loops, diffusion models are recently developed to enable Bayesian modeling and inference with big data. Furthermore, we envision development of multi-AI-agent systems through “netware” engineering as a quantum leap of software engineering for emergent behaviors and autonomous AI at individual and population levels. We believe that the novel use of links and loops in space and time via multi-scale coupling would catalyze the next-generation neural networks.

Deep learning (DL) algorithms have recently emerged from machine learning and soft computing techniques. Since then, several deep learning (DL) algorithms have been recently introduced to scientific communities and are applied in various application domains. Today the usage of DL has become essential due to their intelligence, efficient learning, accuracy and robustness in model building. However, in the scientific literature, a comprehensive list of DL algorithms has not been introduced yet. This paper provides a list of the most popular DL algorithms, along with their applications domains.

Aiming at the problem of model error and tracking dependence in the process of intelligent vehicle motion planning, an intelligent vehicle model transfer trajectory planning method based on deep reinforcement learning is proposed, which obtain an effective control action sequence directly. Firstly, an abstract model of the real environment is extracted. On this basis, Deep Deterministic Policy Gradient (DDPG) and vehicle dynamic model are adopted to jointly train a reinforcement learning model, and to decide the optimal intelligent driving maneuver. Secondly, the actual scene is transferred to equivalent virtual abstract scene by transfer model, furthermore, the control action and trajectory sequences are calculated according to trained deep reinforcement learning model. Thirdly, the optimal trajectory sequence is selected according to evaluation function in the real environment. Finally, the results demonstrate that the proposed method can deal with the problem of intelligent vehicle trajectory planning for continuous input and continuous output. The model transfer method improves the model generalization performance. Compared with the traditional trajectory planning, the proposed method output continuous rotation angle control sequence, meanwhile, the lateral control error is also reduced.

This paper presents an innovative multi-agent, data-driven reinforcement learning (RL) approach to develop and utilize the thermal equivalent network model that represents the motor's thermal dynamics. A multi-agent reinforcement learning is designed and trained to adjust the model parameters using data from several motor driving cycles. To ensure the incoming driving cycle matches the historical data before employing the pre-trained RL agents, offline statistical analysis and clustering techniques are developed and used. Numerical simulations highlighted the RL agent's ability to develop strategies that effectively address the variability of driving cycles. The proposed RL framework showed its capability to accurately reflect the motor's thermal behavior under various driving conditions.

Reliable quantification of pulmonary arterial pressure is essential in the diagnostic and prognostic assessment of a range of cardiovascular pathologies including rheumatic heart disease, yet an accurate and routinely available method for its quantification remains elusive. This work proposes an approach to infer pulmonary arterial pressure based on scientific machine learning techniques and non-invasive, clinically available measurements. A 0-D multicompartment model of the cardiovascular system was optimized using several optimization algorithms, subject to forward-mode automatic differentiation. Measurement data were synthesized from known parameters to represent the healthy, mitral regurgitant, aortic stenosed and combined valvular disease situations with and without pulmonary hypertension. Eleven model parameters were selected for optimization based on 95 % explained variation in mean pulmonary arterial pressure. A hybrid Adam and limited-memory Broyden-Fletcher-Goldfarb-Shanno optimizer yielded the best results with input data including valvular flow rates, heart chamber volume changes and systematic arterial pressure. Mean absolute percentage errors ranged from 1.8 % to 3.78 % over the simulated test cases. The model was able to capture pressure dynamics under hypertensive conditions with pulmonary arterial systole, diastole, and mean pressure average percentage errors of 1.12 %, 2.49 % and 2.14 %, respectively. The relatively low errors highlight the potential of the proposed model to recover pulmonary pressures for diseased heart valve and pulmonary hypertensive conditions.

This study determines the threshold for the computational rate of actuator motor controllers for unmanned underwater vehicles necessary to accurately follow discontinuous square wave commands. Motors must track challenging square-wave inputs, and identification of key computational rates permit application of deterministic artificial intelligence (D.A.I.) to achieve tracking to a machine-precision degree of accuracy in direct comparison to other state-of-art approaches. All modeling approaches are validated in MATLAB simulations where the motor process is discretized at varying step-sizes (inversely proportional to computational rate). At a large step-size (fast computational rate), discrete D.A.I. shows a mean error more than three times larger than that of a ubiquitous model-following approach. Yet, at a smaller step size (slower computational rate), the mean error decreases by a factor of 10, only three percent larger than that of continuous D.A.I. Hence, the performance of discrete D.A.I. is critically affected by the sampling period for discretization of the system equations and computational rate. Discrete D.A.I. should be avoided when small step-size discretization is unavailable. In fact, continuous D.A.I. has surpassed all modeling approaches which makes it the safest and most viable solution to future commercial applications in unmanned underwater vehicles.

This study investigates how digital alchemy can enhance literature and language teaching through a combination of online and face-to-face learning. It uses constructivist learning theory and the SAMR model to examine how digital tools and resources can transform learner engagement, critical thinking, and creativity. The study gathered data from interviews, focus groups, and document analysis with 30 participants from private HEI schools. The results show that digital alchemy through blended learning allows learners to personalize and collaborate in their exploration of various literary texts. However, the study also identifies some challenges related to resource availability and educator training. The study emphasizes the importance of using digital alchemy in literature and language teaching and suggests some ways for educators, administrators, and policymakers to effectively use digital tools and resources for student-centered teaching methods in the digital era.

Hypergravity accelerators are a type of large machinery used for gravity training or medical research. A failure of such large equipment can be a serious problem in terms of safety or costs. This paper proposes a prediction model that can proactively prevent failures that may occur in a hy-pergravity accelerator. The method proposed in this paper was to convert vibration signals to spectograms and perform classification training using a deep learning model. An experiment was conducted to evaluate the performance of the method proposed in this paper. A 4-channel accel-erometer was attached to the bearing housing, which is a rotor, and time-amplitude data were obtained from the measured values by sampling. The data were converted to a two-dimensional spectrogram, and classification training was performed using a deep learning model for four conditions of the equipment: Unbalance, Misalignment, Shaft Rubbing, and Normal. The ex-perimental results showed that the proposed method had a 99.5% F1-Score, which was up to 23% higher than the 76.25% for existing feature-based learning models.

Wildfire susceptibility maps display the wildfires occurrence probability, ranked from low to high, under a given environmental context. Current studies in this field often rely on expert knowledge, including or not statistical models allowing to assess the cause-effect correlation. Machine learning (ML) algorithms can perform very well and be more generalizable thanks to their capability of learning from and make predictions on data. Italy is highly affected by wildfires due to the high heterogeneity of the territory and to the predisposing meteorological conditions. The main objective of the present study is to elaborate a wildfire susceptibility map for Liguria region (Italy) by applying Random Forest, an ensemble ML algorithm based on decision trees. Susceptibility was assessed by evaluating the probability for an area to burn in the future considering where wildfires occurred in the past and which are the geo-environmental factors that favor their spread. Different models were compared, including or not the neighboring vegetation and using an increasing number of folds for the spatial-cross validation. Susceptibility maps for the two fire seasons were finally elaborated and validated and results critically discussed highlighting the capacity of the proposed approach to identify the efficiency of fire fighting activities.

Machine learning is an established and frequently used technique in industry and academia but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners have a need for guidance throughout the life cycle of a machine learning application to meet business expectations. We therefore propose a process model for the development of machine learning applications, that covers six phases from defining the scope to maintaining the deployed machine learning application. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications, as the risk of model degradation in a changing environment is eminent. With each task of the process, we propose quality assurance methodology that is suitable to address challenges in machine learning development that we identify in form of risks. The methodology is drawn from practical experience and scientific literature and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support but lacks to address machine learning specific tasks. Our work proposes an industry and application neutral process model tailored for machine learning applications with focus on technical tasks for quality assurance.

We have proposed a data-driven approach for designing mesoscale porous structures of Li-ion battery electrode with three-dimensional virtual structures and machine learning techniques. Over 2,000 artificial 3D structures assuming positive electrode composed of random packed spheres as active material particles are generated, and charge/discharge resistance has been evaluated using simplified Physico-chemical model. In this model, resistance from Li diffusion in active material particles (diffusion resistance), transfer resistance of Li+ in electrolyte (electrolyte resistance) and reaction resistance on the interface between active material and electrolyte are simulated based on mass balance of Li, Ohm’s law in and linearized Butler-Volmer equation, respectively. Using these simulation results, regression models via Artificial Neural Network (ANN) have been created in order to predict charge/discharge resistance from porous structure features. In this study, porosity, active material particle size and volume fraction, pressure in the compaction process, electrolyte conductivity, and binder volume fraction are adopted as features, associated with controllable process parameters for manufacturing battery electrode. As results, the predicted electrode resistance by ANN regression model is good agreement with the simulated values. Furthermore, sensitivity analysis and optimization of the process parameters have been carried out. The proposed data-driven approach could be a solution as a guiding principle for manufacturing battery electrode.

Fabry-Pérto (FP) cavity is the essential component of ultra-stable laser (USL) for gravitational wave detection, which couples multi-physic (Optical/Thermal/Mechanics) fields and requires ultra-high precision. To satisfy the requirements of precise and efficient design, a multi-physic coupling optimization method for fixing cubic FP cavity based on data learning is proposed. A multi-physic model for the cubic FP cavity is established and the performance is obtained by finite element analysis. The key performance indices (V, wF, wF) and key design variables (d, l, F) are determined considering the features of the FP cavity. The 49 sets of data by orthogonal experiment are acquired for the establishment and comparison of different data learning models (NN, RSF, KRG). The result turns out that the neural network has the best performance. Based on NSGA-II, the Pareto optimal front is obtained and the optimal combination of design variables is finally determined as {5,32,250}. The performance after optimization has proven to be a great improvement, of which the displacement under the fixing force and vibration test are decreased by more than 60%. The optimization strategy can not only help the design of the FP cavity but also enlighten other optimization fields.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

Machine learning (ML) has found increasing use in research on energy conversion and storage technologies, in particular, so-called sustainable technologies. While often ML is used to directly optimize the parameters or phenomena of interest in the space of features, in this perspective, we focus on using ML to construct objects and methods that help in or enable the modeling of the underlying phenomena. We highlight the need for machine learning from very sparse and unevenly distributed numeric data in multidimensional spaces in these applications. After a brief introduction of some common regression-type machine learning techniques, we will focus on more advanced ML techniques which use these known methods as building blocks of more complex schemes and thereby allow working with extremely sparse data and also allow generating insight. Specifically, we will highlight the utility of using representations with sub-dimensional functions by combining the high-dimensional model representation ansatz with machine learning methods like neural networks or Gaussian process regressions in applications ranging from heterogeneous catalysis to nuclear energy.

The quality prediction of quaternary structure models of a protein complex, in the absence of its true structure, is known as the Estimation of Model Accuracy (EMA). EMA is useful for ranking predicted protein complex structures and using them appropriately in biomedical research, such as protein-protein interaction studies, protein design, and drug discovery. With the advent of more accurate protein complex (multimer) prediction tools, such as AlphaFold2-Multimer and ESMFold, the estimation of the accuracy of protein complex structures has attracted increasing attention. Many deep learning methods have been developed to tackle this problem; however, there is a noticeable absence of a comprehensive overview of these methods to facilitate future development. Addressing this gap, we present a review of deep learning EMA methods for protein complex structures developed in the past several years, analyzing their methodologies and impacts. We also provide a prospective summary of some potential new developments for further improving the accuracy of the EMA methods.

Water depth estimation holds paramount importance in various domains including navigation, environmental monitoring, and resource management. Traditional depth measurement methods such as bathymetry can often be prohibitively expensive and time-consuming, especially in remote or inaccessible areas. This study delves into the application of machine learning techniques, with a specific focus on the Baidu Easy DL model, for water depth estimation leveraging satellite imagery. Utilizing Sentinel-2 satellite data over Rushikonda Beach in India and processing it into remote sensing reflectance using the ACOLITE software, the research compares the performance of several machine learning algorithms, including the Stumpf Model, Log-Linear Model, and the Baidu Easy DL Model, for accurate depth estimation. The results indicate that the Easy-DL model outperforms traditional methods, particularly excelling in the 0-11 meter depth range. This study showcases the substantial potential of machine learning in the realm of remote sensing, offering robust water depth estimates, even in complex coastal environments. Furthermore, it underscores the critical role of comprehensive training datasets and ensemble learning techniques in enhancing accuracy. This research not only opens avenues for further exploration of machine learning applications in remote sensing but also highlights the promising prospects of online model APIs in streamlining remote sensing data processing.

Heat metres are used to calculate the consumed energy in central heating systems. The subject of this article is to prepare a method of predicting a failure of a heat meter in the next settlement period. Predicting failures is essential to coordinate the process of exchanging the heat metres and to avoid inaccurate readings, incorrect billing and additional costs. The reliability analysis of heat metres was based on historical data collected over many years. Three independent models of machine learning were proposed, and they were applied to predict failures of metres. The efficiency of the models was confirmed and compared using the selected metrics. The optimisation of hyperparameters characteristics for each of models was successfully applied. The article shows that the diagnostics of devices does not have to rely only on newly collected information, but it is also possible to use the existing big data sets.

Motivation: It is essential for the diagnosis and treatment of renal cancers to segment kidney tumours precisely and effectively. In medical image segmentation tasks, deep learning models have demonstrated promising results, and the UNet model is widely employed in this field. However, optimising the UNet model for kidney tumour segmentation further can improve its efficacy and deployment feasibility. Related Works: Previous works have explored various techniques to improve the efficiency of deep learning models in medical image segmentation. Image partitioning methods divides the input image into smaller regions, enabling parallel processing and reducing memory requirements. Pruning techniques eliminates redundant or insignificant weights, neurons and connections, resulting in a more compact and efficient model architecture. However, the UNet model architecture and its complexity in the context of kidney tumor segmentation using UNet remains unexplored. Methodology: The proposed methodology consists of adaptive partitioning and weight pruning. Adaptive partitioning divides the UNet model into smaller sub-models, facilitating parallel processing and accelerating inference without compromising segmentation accuracy. Weight pruning techniques remove redundant or less significant weights from the UNet-P model, reducing complexity and improving inference time by eliminating unnecessary computations. The adaptive partitioning and weight pruning processes are seamlessly integrated within the UNet-P architecture, resulting in an optimized model for kidney tumor segmentation. Results: We performed experiments utilising a dataset of KiT 23 CT scan images containing images of kidney malignancies. Compared to the standard UNet model, the optimised UNet-PWP model with adaptive partitioning and weight pruning obtained significant efficiency gains. The adaptive partitioning permitted parallel computation of sub-models, which accelerated inference times. Weight pruning decreased the UNet-PWP model’s complexity without compromising segmentation accuracy, thereby enhancing efficiency. The results of our experiments demonstrated the efficacy of the proposed method with 98% accuracy, demonstrating its potential for deployment in health sector.

Abstract: Self-regulated Learning has become one of educational psychology's most critical research areas. Contemporary research indicates that student creativity is crucial to the success of arts education. However, there is limited research on creativity in arts education in Self-regulated Learning. Therefore, this study aims to define the creativity characteristics that determine the quality of students’ work. This study implemented a creative competition in painting and composition for first-year undergraduates. It evaluated the characteristics of creativity during the three main phases of the task: planning, execution, and completion. We discovered through semi-open questionnaires (n=178)，and using the content analysis method. According to the competition results, the students with the highest scores in Flow, Inspiration, and Idea Generation in the Performance phase had the best quality work. In the Forethought phase, Analogical Thinking and Idea Generation worked best for most students, while in the Performance phase, Flow Sense, Idea Generation, and Idea Manipulation worked best.Data on creativity characteristics at different work phases and final quality might adequately guide and organize educational procedures. These findings can serve as a theoretical foundation for quantifying the creativity phase in Self-regulated Learning and offer arts educators a reference for creativity instruction.

A novel educational platform called Shared Modeling and Simulation Environment (SMSE) was initiated in the ERASMUS+ “CybPhys” project. It integrates the Jupyter platform, including Ju-pyter Notebooks, for e-learning in the STEM field. A novel platform enhances e-learning by combining Moodle with Jupyter's capabilities to create virtual labs. A survey was conducted in the spring of 2023 among bachelor and master students of Chernihiv National Polytechnic Uni-versity aimed to gather feedback from students using SMSE in their e-learning process. Two student groups were involved: one of them consisted of students using SMSE in both the autumn and spring semesters and another represented the students starting with SMSE in the spring se-mester. The survey based on the adjusted Technology Acceptance Model (TAM) was conducted to understand the acceptance of this e-learning approach. A comprehensive analysis of students’ answers based on the TAM approach revealed the inside of the process of transformation of stu-dents’ perceptions during the acquisition of the SMSE platform. Our research demonstrates that SMSE effectively merges Moodle's online learning capabilities with Jupyter notebooks, provid-ing a flexible and interactive learning experience for both in-class and remote students. It pro-vides a web-based, multifunctional e-learning environment that combines a variety of tools and technologies, giving students the possibility to be involved in all sorts of teaching activities, such as lectures, exercises, simulations, etc., through the use of one single online environment.

Computer and Smart Device-assisted Learning (CSDL) has gained increasing attention from educational researchers and practitioners in recent years. However, it remains controversial whether student can benefit from CSDL and what moderator could affect the impact of CSDL. Within the specific context of Korea, where the interest in digital education is steadily increasing, the number of empirical studies exploring the causal effect of CSDL remains relatively scarce. The primary objective of this empirical study was to investigate the impact of CSDL on students' academic achievement in Korea. To achieve this objective, a two-way fixed effect model was employed, utilizing a panel dataset spanning three years derived from the 'Korean Education Longitudinal Study 2013'. The findings revealed a significant positive impact of CSDL on students’ Mathematics achievement. Notably, higher income levels, increased availability of computer resources provided by schools, and the implementation of more individualized education were identified as factors that moderate the effect of CSDL on students' achievement levels in Korean and English subjects. These findings underscore the need for an approach that optimizes the educational benefits of CSDL by considering subject-specific characteristics. Furthermore, this study highlights the importance of allocating educational resources, such as computers and smart devices, and integrating individualized educational activities within the classroom environment.

In the present paper, an aerodynamic investigation of a high-speed train is performed. In the first section of this article, a generic high-speed train against a turbulent flow is simulated, numerically. The Reynolds-Averaged Navier-Stokes (RANS) equations combined with the SST turbulence model are applied to solve incompressible turbulent flow around a high-speed train. Flow structure, velocity and pressure contours and streamlines at some typical wind directions are the most important results of this simulation. The maximum and minimum values are specified and discussed. Also, the pressure coefficient for some critical points on the train surface is evaluated. In the following, the wind direction influence the aerodynamic key parameters as drag, lift, and side forces at the mentioned wind directions are analyzed and compared. Moreover, the effects of velocity changes (50, 60, 70, 80 and 90 m/s) are estimated and compared on the above flow and aerodynamic parameters. In the second section of the paper, various data-driven methods including Gene Expression Programming (GEP), Gaussian Process Regression (GPR), and random forest (RF), are applied for predicting output parameters. So, drag, lift and side forces and also minimum and a maximum of pressure coefficients for mentioned wind directions and velocity are predicted and compared using statistical parameters. Obtained results indicated that RF in all coefficients of wind direction and most coefficients of free stream velocity provided the most accurate predictions. As a conclusion, RF may be recommended for the prediction of aerodynamic coefficients.

To contribute to small and medium enterprises (SMEs) sustainable transition into the circular economy, the study proposes the activation of organizational learning (OL) processes – denoted here as multi-level knowledge creation, transfer, and retention processes – as a key phase in introducing circular business models (CBMs) at SME and supply chain (SC) level. The research employs a mixed-method approach, using the focus group methodology to identify contextual elements impacting on CBM-related OL processes, and a survey-based evaluation to single out the most frequently used OL processes inside Italian construction SMEs. As main result, a CBM-oriented OL multi-level model offers a fine-grained understanding of contextual elements acting mutually as barriers and drivers for OL processes, as possible OL dynamics among them. The multi-level culture construct – composed of external stakeholders’, SC stakeholders’, and organizational culture – identify the key element to activate CBM-oriented OL processes. Main implications are related to the identification of cultural, structural, regulatory, and process contextual elements across the external, SC, and organizational levels, and their interrelation with applicable intraorganizational and interorganizational learning processes. The proposed model would contribute to an improved implementation of transitioning into the circular economy utilizing sustainable business models in the construction SMEs.

The combination of new-generation information technology and manufacturing technology has resulted in major and profound impact on future development paradigm of manufacturing. It is challenging for existing methods to conduct a multidimensional trend exploration related to machine tool domain, which is the basis of virtually everything in manufacturing. In this paper, we proposed an integrating approach framework combined topic models, bibliometric, trend analysis and patent analysis to mine insightful information about future development from multi-source data related to machine tool, such as papers, grants, patents and news. Specifically, papers and grants provided two different perspectives to explore the current focuses and future trends in machine tool research. Furthermore, the future technology development of machine tool was investigated through patents analysis. Finally, news related to machine tool industry in recent years was analyzed to analyze future machine tool business mode. The integration of the above various analytical methods and the multi-dimensional mining of literatures enabled the analysis of the future development of machine tool domain systematically from multi-perspectives which include research, technology development and industry. The conclusions obtained in this paper is beneficial to different communities of machine tool in terms of determining the research directions for researchers, identifying industry opportunities for corporations and developing reasonable industry policy for policy makers.

The global spread of COVID-19 led the World Health Organization to declare a pandemic on 11 March 2020. To decelerate this spread, countries have taken strict measures that affected the lifestyle and economy. Various studies have been focused on the identification of COVID-19 impact to mental health of children and adolescents via traditional statistical approaches. However, a machine learning methodology must be developed to explain the main factors that contribute to the change of mood state of children and adolescents during the first lockdown. Therefore, to this study an explainable machine learning pipeline is presented focusing on children and adolescents in Greece, where a strict lockdown was imposed. The target group consists of children and adolescents, recruited from children and adolescent mental health services, who present mental health problems diagnosed before the pandemic. The proposed methodology imposes: (i) data collection via questionnaires; (ii) a clustering process to identify the groups of subjects with amelioration, deterioration and stability to their mood state; (iii) a feature selection process to identify the most informative features that contribute to mood state prediction; (iv) a decision-making process based on an experimental evaluation among classifiers; (v) calibration of the best performing model and (v) a post-hoc interpretation of the features’ impact on the best performing model. The results showed that a blend of heterogeneous features from almost all feature categories is necessary to increase our understanding regarding the effect of COVID-19 pandemic on the mood state of children and adolescents.

This paper explores the application of machine learning (ML) algorithms in predicting trends in the fixed bond market, where traditional analytical methods have proven inadequate. Focusing on various ML techniques such as supervised and unsupervised learning, neural networks, and deep learning, the study evaluates their effectiveness in forecasting market movements. It details a series of experiments in which different ML models are rigorously trained and tested against historical bond market data. The findings reveal that models employing time series analysis and advanced deep learning show marked potential in accurately predicting bond market trends. Additionally, the paper delves into the challenges and limitations inherent in these ML approaches, including data requirements and the risk of model overfitting. Finally, it proposes directions for future research, emphasizing the integration of ML into broader financial market analysis.

This paper introduces a model-free, "on-the-fly" learning control strategy for arrays of energy converters with adjustable generator damping. The devices are arranged so that they are affected simultaneously by the energy medium. Each device uses a different control strategy, of which at least one has to be the machine learning approach presented in this paper. During operation all energy converters record the absorbed power and control output; the machine learning device gets the data from the converter with the highest power absorption and so learns the best performing control strategy for each state. Consequently, the overall network has a better overall performance than each individual strategy. This concept is evaluated for wave energy converter (WEC) with numerical simulations and experiments with physical scale models in a wave tank. In the first of two numerical simulations, the learnable WEC works in an array with four WECs applying a constant damping factor. In the second simulation, two learnable WECs were learning with each other. It showed that in the first test the WEC was able to absorb as much as the best constant damping WEC, while in the second run it could absorb even slightly more. During the physical model test, the ANN showed its ability to select the better of two possible damping coefficients based on real world input data.

Abstract: In recent years, the construction engineering sector has undergone a transformative shift towards the integration of machine learning (ML) techniques, particularly in predicting the properties of steel fiber-reinforced concrete (SFRC). Despite the theoretical sophistication of existing models, a persistent challenge remains – their opacity, lacking transparency and real-world relevance for practi-tioners. To address this gap and advance our current understanding, this study employs the extra gradient (XG) Boosting algorithm, crafting a comprehensive ap-proach. Grounded in a meticulously curated database drawn from 43 seminal pub-lications, encompassing 420 distinct records, this research focuses predominantly on three primary fiber types: crimped, hooked, and mil-cut. Complemented by hands-on experimentation involving 20 diverse SFRC mixtures, this empirical campaign is further illuminated through the strategic use of Partial Dependence Plots (PDPs), revealing intricate relationships between input parameters and con-sequent compressive strength. A pivotal revelation of this research lies in the identification of optimal SFRC formulations, offering tangible insights for real-world applications. The developed ML model stands out not only for its sophistication but also its tangible accuracy, evidenced by exemplary performance against inde-pendent datasets, boasting a commendable mean target-prediction ratio of 99%. To bridge the theory-practice gap, we introduce a user-friendly digital interface, thri-ughly designed to guide professionals in optimizing and accurately predicting the compressive strength of SFRC. This research thus contributes to the construction and civil engineering sectors by enhancing predictive capabilities and refining mix designs, fostering innovation, and addressing the evolving needs of the industry.

The Yellow River Basin (YRB) is a crucial ecological zone and an environmentally vulnerable re-gion in China. Understanding the temporal and spatial trends of terraced-field areas (TRAs) and the factors underlying them in the YRB is essential for improving land use, conserving water re-sources, promoting biodiversity, and preserving cultural heritage. In this study, we employed ma-chine learning on the Google Earth Engine (GEE) platform to obtain spatial distribution images of TRAs from 1990 to 2020 using Landsat 5 (1990－2010) and Landsat 8 (2015－2020) remote sens-ing data. The GeoDa software platform was used for spatial autocorrelation analysis, revealing distinct spatial clustering patterns. Mixed linear and random forest models were constructed to identify the driving force factors behind TRA changes. The research findings reveal that TRAs were primarily concentrated in the upper and middle reaches of the YRB, encompassing provinc-es such as Shaanxi, Shanxi, Qinghai, and Gansu, with areas exceeding 40,000 km2, whereas other provinces had TRAs of less than 30,000 km2 in total. The TRAs exhibited a relatively stable trend, with provinces such as Gansu, Qinghai, and Shaanxi showing an overall upward trajectory. Conversely, Shanxi and Inner Mongolia demonstrated an overall declining trend. When com-pared with other provinces, the variations in TRAs in Ningxia, Shandong, Sichuan, and Henan appeared to be more stable. The linear mixed model (LMM) revealed that farmland, shrubs, and grassland had significant positive effects on the TRA, explaining 41.6% of the variance. The ran-dom forest model also indicated positive effects for these factors, with high R² values of 0.983 and 0.86 for the training and testing sets, respectively, thus outperforming the LMM. The findings of this study can contribute to the restoration of the YRB's ecosystem and support sustainable devel-opment. The insights gained will be valuable for policymaking and decision support in soil and water conservation, agricultural planning, and environmental protection in the region.

We develop a machine learning (ML) approach for improving the accuracy of the horizontal dis-tribution of the aerosol optical depth (AOD) simulated by the CHIMERE chemistry-transport model over Northern Africa using Moderate-Resolution Imaging Spectroradiometer (MODIS) AOD satellite observations. These observations are used during the training phase of the ML method for deriving a regional bias correction of AODs simulated by CHIMERE. The results are daily maps of regional bias corrected AODs with full horizontal coverage over Northern Africa. We test four types of ML models: multiple linear regression (MLR), random forests (RF), gradi-ent boosting (XGB), and multiple layer perceptron networks (NN). We perform comparisons with satellite and independent ground-based observations of AOD that are not used in the training phase. They suggest that all models have overall comparable performances with a slight advantage of the RF model which expresses less spatial artifacts. While the method slightly underestimates the very high AODs, it significantly reduces biases and absolute errors, and clearly enhances linear correlations with respect to independent observations. This im-provement for deriving the AOD is particularly relevant for high dust pollution regions like the Sahara Desert, which dramatically lack ground-based measurements for validations of chemis-try-transport modeling which currently remains challenging and imprecise.

The main channel for disseminating information is now the Internet. Users have different expectations for the calibre of websites regarding the posted and presented content. The WEB site's quality is influenced by up to 120 factors, each represented by two to fifteen attributes. A major challenge is quantifying the features and evaluating the quality of a website based on the feature counts. One of the aspects that determines a website's quality is its completeness, which focuses on the existence of all the objects and their connections with one another. It isn’t easy to build an expert model based on feature counts to evaluate website quality, so this paper has focused on that challenge. Both a methodology for calculating a website's quality and a parser-based approach for measuring feature counts are offered. We provide a multi-layer perceptron model that is an expert model for forecasting website quality from the "Completeness" perspective. The accuracy of the predictions is 98%, whilst the accuracy of the nearest model is 87%.

Prediction models in mobility and transportation maintenance systems have been dramatically improved through using machine learning methods. This paper proposes novel machine learning models for an intelligent road inspection. The traditional road inspection systems based on the pavement condition index (PCI) are often associated with the critical safety, energy and cost issues. Alternatively, the proposed models utilize surface deflection data from falling weight deflectometer (FWD) tests to predict the PCI. Machine learning methods are the single multi-layer perceptron (MLP) and radial basis function (RBF) neural networks as well their hybrids, i.e., Levenberg-Marquardt (MLP-LM), scaled conjugate gradient (MLP-SCG), imperialist competitive (RBF-ICA), and genetic algorithms (RBF-GA). Furthermore, the committee machine intelligent systems (CMIS) method was adopted to combine the results and improve the accuracy of the modeling. The results of the analysis have been verified through using four criteria of average percent relative error (APRE), average absolute percent relative error (AAPRE), root mean square error (RMSE), and standard error (SD). The CMIS model outperforms other models with the promising results of APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.

This paper offers a comprehensive examination of the process involved in developing and automating supervised end-to-end machine learning workflows for forecasting and classification purposes. It offers a complete overview of the components (i.e. feature engineering, model selection, etc), principles (i.e. bias-variance decomposition, model complexity, overfitting, model sensitivity to feature assumptions and scaling, output interpretability, etc), models (i.e. neural networks, regression models, etc), methods (i.e. Cross-Validation, data augmentation, etc), metrics (i.e. Mean Squared Error, F1-score, etc) and tools that rule most supervised learning applications with numerical and categorical data, as well as their integration, automation, and deployment. The end goal and contribution of this paper is the education and guidance of the non-AI expert academic community over complete and rigorous machine learning pipelines and data science practices, from problem scoping to design and state-of-the-art automation tools, including basic principles and reasoning in the choice of methods. The paper delves into the critical stages of supervised machine learning workflow development, many of which are often omitted by researchers due to brevity, and covers foundational concepts essential for understanding and optimizing a functional machine learning workflow, thereby offering a holistic view of task-specific application development for applied researchers who are not AI experts.

The Oxford English Dictionary includes 17 definitions for the word “model” as a noun and other 11 as a verb. Therefore, context is necessary to understand the meaning of the word model. For in-stance, “model railways” refer to replicas of railways and trains at a smaller scale and a “model student” refers to an exemplar individual. In some cases, a specific context, like cancer research, may not be sufficient to provide one specific meaning of a model. Even if the context is narrowed, specifically to the research related to the tumour microenvironment, a “model” can be understood in a wide variety of ways, from an animal model, to a mathematical expression. This paper presents a review of the different “models” of the tumour microenvironment grouped by the different def-initions of the word into four categories: model organisms, in vitro models, mathematical models, and computational models. Then, the frequency of different meanings of the word “model” related to the tumour microenvironment is measured from the number of entries in the MEDLINE database of the United States National Library of Medicine at the National Institutes of Health. The frequency of the main components of the microenvironment and the organ-related cancers modelled are also assessed quantitatively with specific keywords. Whilst animal models, in particular xenografts and mouse models are the most common used “models”, the number of entries have been slowly de-creasing. Mathematical models, prognostic and risk models follow in frequency and these have been growing in use.

The sustainability of the planet and its inhabitants is in dire danger and is among the highest priorities on global agendas such as the Sustainable Development Goals (SDGs) of the United Nations (UN). Solar energy -- among other clean, renewable, and sustainable energies -- is seen as essential for environmental, social, and economic sustainability. Predicting solar energy accurately is critical to increasing reliability and stability, and reducing the risks and costs of the energy systems and markets. Researchers have come a long way in developing cutting-edge solar energy forecasting methods. However, these methods are far from optimal in terms of their accuracies, generalizability, benchmarking, and other requirements. Particularly, no single method performs well across all climates and weathers due to the large variations in meteorological data. This paper proposes SENERGY (an acronym for Sustainable Energy), a novel deep learning-based auto-selective approach and tool that, instead of generalising a specific model for all climates, predicts the best performing deep learning model for GHI forecasting in terms of forecasting error. The approach is based on carefully devised deep learning methods and feature sets through an extensive analysis of deep learning forecasting and classification methods using ten meteorological datasets from three continents. We analyse the tool in great detail through a range of metrics and methods for performance analysis, visualization, and comparison of solar forecasting methods. SENERGY outperforms existing methods in all performance metrics including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Forecast Skills (FS), Relative Forecasting Error, and the normalised versions of these metrics. The proposed auto-selective approach can be extended to other research problems such as wind energy forecasting and predict forecasting models based on different criteria (in addition to the minimum forecasting error used in this paper) such as the energy required or speed of model execution, different input features, different optimisations of the same models, or other user preferences.

The eruption of COVID-19 patients in 215 countries worldwide has urged for robust predictive methods that can detect as early as possible the size and duration of the contagious disease and also providing precision predictions. In much recent literature reported on COVID-19, one or more essential parts of such investigation were missed. One of the crucial elements for any predictive method is that such methods should fit simultaneously as much data as possible; these data could be total infected cases, daily hospitalized cases, cumulative recovered cases, and deceased cases, and so on. Other crucial elements include sensitivity and precision of such predictive methods on the amount of data as the contagious disease evolved day by day. To show the importance of these aspects, we have evaluated the standard SIRD model and a newly introduced Gaussian-SIRD model on the development of COVID-19 in Kuwait. It is observed that the SIRD model quickly picks up the main trends of COVID-19 development, but the Gaussian-SIRD model provides precise prediction a longer period of time.

In Model-Driven Development (MDD), the models, their generation, and imposing changes on them (model transformation) are used for the development of software. Models provide a framework to start from the imagination and abstraction to create and accomplish the final system. Models create a slow and steady transition from whatness to howness, i.e. from the natural path of the generation of software. For supporting this path, the Logic and Functionality of software must be changeable during its evolution. Here we provide a brief introduction to the concept of Model Driven Development.

Assuming a Winterberg model for space where the vacuum consists of a very stiff two component superfluid made up of positive and negative mass planckions, theory is the hypothesis, that Planck charge, , was created at the same time as Planck mass. Moreover, the repulsive force that like-mass planckions experience is, in reality, due to the electrostatic force of repulsion between like charges. These forces also give rise to what appears to be a gravitational force of attraction between two like planckions, but this is an illusion. In reality, gravity is electrostatic in origin if our model is correct. We determine the spring constant associated with planckion masses, and find that, , where equals Apery's constant, , and, , is the relaxed, i.e., , number density of the positive and negative mass planckions. In the present epoch, we estimate that, equals, , and the relaxed distance of separation between nearest neighbor positive, or negative, planckion pairs is, These values were determined using box quantization for the positive and negative mass planckions, and considering transitions between energy states, much like as in the hydrogen atom. For the cosmos as a whole, given a net smeared macroscopic gravitational field of, , due to all the ordinary, and bound, matter contained within the observable universe, an average displacement from equilibrium for the planckion masses is a mere , within the vacuum made up of these particles. On the surface of the earth, where, , the displacement amounts to, . All of these displacements are due to increased gravitational pressure within the vacuum, which in turn are caused by applied gravitational fields. The gravitational potential is also derived and directly related to gravitational pressure.

Stemming from the urgency of the actual situation, commercial banks need an effective credit risk management tool to limit risks. The authors went to survey, study and propose a set of factors affecting the ability of debt repayment of individual customers and conducting surveys. The topic uses data sets including 240 observation samples. Using the SPSS software to clean data and run the model based on Maddala's Binary logistics regression published in 1984 to find out the impact of each individual element of customers affecting their ability to repay such debts. Come on. The authors also specify the order of influence of each factor determining the ability to repay individual customers, thereby helping bank managers have a better visual view to make decisions for borrowing accurately, limiting risks.

Current numerical methods for simulating biophysical processes in aquatic environments are typically constructed in a grid-based Eulerian framework or as an individual-based model in a particle-based Lagrangian framework. Often, the biogeochemical processes and physical (hydrodynamic) processes occur at different time and space scales, and changes in biological processes do not affect the hydrodynamic conditions. Therefore, it is possible to develop an alternative strategy to grid-based approaches for linking hydrodynamic and biogeochemical models that can significantly improve computational efficiency for this type of linked biophysical model. In this work, we utilize a new technique which links hydrodynamic effects and biological processes through a property-carrying particle model (PCPM) in a Lagrangian/Eulerian framework. The model is tested in idealized cases and its utility is demonstrated in a practical application to Sandusky Bay. Results show the integration of Lagrangian and Eulerian approaches allows for a natural coupling of mass transport (represented by particle movements and random walk) and biological processes in water columns which is described by a nutrient-phytoplankton-zooplankton-detritus (NPZD) biological model. This method is far more efficient than traditional tracer based Eulerian biophysical models for 3-D simulation, particularly for a large domain and/or ensemble simulations.

The predictability of wind information in a given location is essential for the evaluation of a wind power project. Predicting wind speed accurately improves the planning of wind power generation, reducing costs and improving the use of resources. This paper seeks to predict the mean hourly wind speed in anemometric towers (at a height of 50 meters) at two locations: a coastal region and one with complex terrain characteristics. To this end, the Holt-Winters (HW), Artificial Neural Networks (ANN) and Hybrid time-series models were used. Observational data evaluated by the Modern-Era Retrospective analysis for Research and Applications-Version 2 (MERRA-2) reanalysis at the same height of the towers. The results show that the hybrid model had a better performance in relation to the others, including when compared to the evaluation with MERRA-2. For example, in terms of statistical residuals, RMSE and MAE were 0.91 and 0.62 m/s, respectively. As such, the hybrid models are a good method to forecast wind speed data for wind generation.