Despite the extensive literature on missing data theory and cautionary articles emphasizing the importance of realistic analysis for healthcare data, a critical gap persists in incorporating domain knowledge into missing data problem formulation, assumption specification, and method development. In this paper, we highlight the gap particularly for observational data from healthcare facilities. We address this gap by identifying ten fundamental missingness scenarios arising during data measurement, recording, and pre-processing in observational health data, influenced by physicians, patients, healthcare facilities, and data scientists. We analyze the effect of scenarios on estimand formulation, missing data identification, estimation, and sensitivity analysis. To emphasize how domain-informed analysis can improve method reliability, we conduct simulation studies under the influence of various missingness scenarios. We compare the results of three common methods in medical data analysis (complete-case analysis, Missforest imputation, and inverse probability weighting estimation) for two estimands (variable mean estimation and classification accuracy). We advocate for our analysis approach as a reference for the analysis of observational health data. Furthermore, we posit that the proposed analysis framework is applicable to other medical domains, including medical wearable data analysis.

An information-theoretic data mining method is employed to analyze categorical spatiotemporal Geographic Information System land use data. Reconstructability Analysis (RA) is a maximum-entropy-based data modeling methodology that works exclusively with discrete data such as those in the National Land Cover Database (NLCD). The NLCD are organized into a spatial (raster) grid, and are available in consistent format for every five years from 2001 to 2021. An NLCD tool reports how much change occurred for each category of land use; for the study area examined the most dynamic class is Evergreen Forest (EFO), so the presence or absence of EFO in 2021 was chosen as the dependent variable that our data modeling attempts to predict. RA predicts the outcome with approximately 80% accuracy using a sparse set of cells from a spacetime data cube consisting of neighboring lagged-time cells. When the predicting cells are all Shrubs & Grasses there is a high probability for a 2021 state of EFO, while when the predicting cells are all EFO, there is a high probability that the 2021 state will be not-EFO. These findings are interpreted as detecting forest clear-cut cycles that show up in the data, and explain why this class is so dynamic. This study introduces a new approach to analyzing GIS categorical data and expands the range of applications that this entropy-based methodology can successfully model.

Dynamic virtual testing by Hardware in the Loop (HIL) real time simulation systems is common to minimize physical tests to validate and verify control algorithms, logics and software, under normal and emergency conditions. The accurate but costly HIL models setup activities could have an extended use to simulate faulty conditions that are seldom observable in the real system, yet they must be detected in advance and recognized. Data driven diagnostic methods have reached a mature development, in various sectors, proving effective in early detecting slowly varying deviations from nominal patterns of signals, even without a priori knowledge of their nature and behavior. These methods rely on vast amount of data logged from real systems that are ever and ever richer of monitoring telemetries that are worth being exploited. However, due to the usually reliable and safe systems being managed, it is often difficult to collect enough data on anomalous situations to validate fault detection and isolation and limit false positives. HIL model-based simulations allow generating and observing operational domains or transients rarely observed in real operations. This allows identifying the signals that are most correlated to faults and that could be selected to setup data-based diagnostic models of parts or subsystems, which are more suitable than the whole HIL model for online diagnostics, as well as to identify the features and trends that are most symptomatic of anomalous conditions.

As the digital transformation accelerates in our society, open data is being increasingly recognized as a key resource for digital innovation in the public sector. This study explores the following two research questions: 1) Can a machine learning approach be appropriately used for measuring and evaluating open data utilization? 2) Should different machine learning models be applied for measuring open data utilization depending on open data attributes (field and usage type)? This study used single-model (Random Forest, XGBoost, LightGBM, CatBoost) and multi-model (Stacking Ensemble) machine learning methods. A key finding is that the best-performing models differed depending on open data attributes (field and type of use). The applicability of the machine learning approach for measuring and evaluating open data utilization in advance was also confirmed. This study contributes to open data utilization and to the application of its intrinsic value to society.

In the rapidly evolving field of real estate economics, the prediction of house prices continues to be a complex challenge, intricately tied to a multitude of socio-economic factors. However, traditional predictive models have often overlooked the spatial interdependencies that play a vital role in shaping housing prices. This study applies Graph Neural Networks (GNNs) on Open Statistics Knowledge Graphs to model spatial dependencies and predict house prices across Scotland’s 2011 data zones. To this end, integrated statistical indicators are retrieved from the official Scottish Open Government Data portal. The three representative GNN algorithms employed - ChebNet, GCN, and GraphSAGE - demonstrate higher prediction accuracy than traditional models, including the tabular-based XGBoost and a simple Multi-Layer Perceptron (MLP). In addition, local and global explainability are employed to increase transparency and trust in the predictions made by the most accurate GNN - GraphSAGE. The global feature importance is determined by a logistic regression surrogate model while the local, region-level understanding of the GNN predictions is achieved through the use of GNNExplainer. Explainaibility results are compared with those from a previous work that applied the XGBoost machine learning algorithm and the SHapley Additive exPlanations (SHAP) explainability framework on the same dataset. Interestingly, both global surrogate model and the SHAP approach underscored the Comparative Illness Factor, a health indicator, and the ratio of detached dwellings as the most crucial features in the global explainability. In the case of local explanations, while both methods showed similar results, the GNN approach provided a richer, more comprehensive understanding of the predictions for two specific data zones.

We generalize the point information gain (PIG) and derived quantities, i.e., point information gain entropy (PIE) and point information gain entropy density (PIED), for the case of the Rényi entropy and simulate the behavior of PIG for typical distributions. We also use these methods for the analysis of multidimensional datasets. We demonstrate the main properties of PIE/PIED spectra for the real data on the example of several images, and discuss further possible utilizations in other fields of data processing.

: In the realm of data management, data preservation stands as a critical undertaking aimed at preserving and upholding the integrity of data. Regardless of whether it concerns personal or enterprise data, the detrimental effects of malicious alterations implemented by attackers cannot be overlooked. Particularly in conventional industrial control environments, the prevalent practice involves the transmission of data from sensors to databases for storage purposes. However, it is essential to recognize that this process exposes the data to various vulnerabilities. Thus, to ensure the long-term security and reliability of the data, it becomes imperative to implement robust data preservation strategies within these industrial control systems. However, the reliance of these databases on physical hard disks introduces inherent vulnerabilities, including the potential for data loss due to disk damage or targeted malicious attacks. Consequently, it becomes imperative to prioritize the implementation of robust data preservation measures. These measures are crucial in mitigating the risk of disruptions and protecting critical data from compromise. By establishing effective data backup systems, employing advanced security protocols, and implementing proactive monitoring mechanisms, organizations can bolster their data preservation capabilities and safeguard against potential threats to data integrity and availability. As a result, many enterprises opt to store their data with third-party providers to ensure data integrity. However, this approach carries inherent risks. If the third-party service experiences an attack or if the data is tampered with, it becomes challenging to verify the integrity of the data. To address these concerns and ensure data preservation within the context of the Internet of Things (IoT), a growing number of individuals are integrating IoT with Distributed Ledger Technology (DLT). By leveraging DLT, the integrity of data can be ensured, reducing reliance on centralized third-party storage and enhancing security in the IoT ecosystem. In this article, IOTA is the DLT, which employs Directed Acyclic Graph (DAG) to store transaction information. Compared to Ethereum or other blockchain technologies, IOTA offers notable advantages in terms of transaction verification speed, making it highly suitable for real-time IoT environments. However, the conventional transmission path from sensors to IOTA nodes entails a complex route, involving multiple hardware devices before reaching the intended destination. This complexity poses challenges in ensuring data integrity during transmission and introduces vulnerabilities such as man-in-the-middle attacks or SQL injection attacks. To address these issues, we propose a method to streamline the transmission path between sensors and IOTA, specifically tailored for industrial fields with numerous IoT devices. Our approach involves preprocessing the data stored on the server using our method before uploading, ensuring data confidentiality, and leveraging IOTA to guarantee data integrity. To achieve the shortest path between IoT and DLT nodes, it becomes necessary to establish IOTA nodes on lower-level devices, such as Raspberry Pi or IoT controllers. By simplifying the transmission path, we can reduce the potential for tampering and enhance overall data security. Implementing our proposed method enables the assurance of data confidentiality and integrity during both transmission and storage on the server, strengthening the trustworthiness of the IoT, and IOTA integration.

Bio-molecular reagents like antibodies required in experimental biology are expensive and their effectiveness, among other things, is critical to the success of the experiment. Although such resources are sometimes donated by one investigator to another through personal communication between the two, there is no previous study to our knowledge on the extent of such donations, nor a central platform that directs resource seekers to donors. In this paper, we describe, to our knowledge, a first attempt at building a web-portal titled Bio-Resource Exchange that attempts to bridge this gap between resource seekers and donors in the domain of experimental biology. Users on this portal can request for or donate antibodies, cell-lines and DNA Constructs. This resource could also serve as a crowd-sourced database of resources for experimental biology. Further, in order to index donations outside of our portal, we mined scientific articles to find instances of donations of antibodies and attempted to extract information about these donations at the finest granularity. Specifically, we extracted the name of the donor, his/her affiliation and the name of the antibody for every donation by parsing the acknowledgements sections of articles. To extract annotations at this level, we propose two approaches – a rule based algorithm and a bootstrapped relation learning algorithm. The algorithms extracted donor names, affiliations and antibody names with average accuracies of 57% and 62% respectively. We also created a dataset of 50 expert-annotated acknowledgements sections that will serve as a gold standard dataset to evaluate extraction algorithms in the future. Contact: madhavi@pitt.edu, madhavi@cs.cmu.edu Database URL: http://tonks.dbmi.pitt.edu/brx Supplementary information: Supplementary data are available at Database online.

The comprehensibility of good predictive models learned from high-dimensional gene expression data is attractive because it can lead to biomarker discovery. Several good classifiers provide comparable predictive performance but differ in their abilities to summarize the observed data. We extend a Bayesian Rule Learning (BRL-GSS) algorithm, previously shown to be a significantly better predictor than other classical approaches in this domain. It searches a space of Bayesian networks using a decision tree representation of its parameters with global constraints, and infers a set of IF-THEN rules. The number of parameters and therefore the number of rules are combinatorial to the number of predictor variables in the model. We relax these global constraints to a more generalizable local structure (BRL-LSS). BRL-LSS entails more parsimonious set of rules because it does not have to generate all combinatorial rules. The search space of local structures is much richer than the space of global structures. We design the BRL-LSS with the same worst-case time-complexity as BRL-GSS while exploring a richer and more complex model space. We measure predictive performance using Area Under the ROC curve (AUC) and Accuracy. We measure model parsimony performance by noting the average number of rules and variables needed to describe the observed data. We evaluate the predictive and parsimony performance of BRL-GSS, BRL-LSS and the state-of-the-art C4.5 decision tree algorithm, across 10-fold cross-validation using ten microarray gene-expression diagnostic datasets. In these experiments, we observe that BRL-LSS is similar to BRL-GSS in terms of predictive performance, while generating a much more parsimonious set of rules to explain the same observed data. BRL-LSS also needs fewer variables than C4.5 to explain the data with similar predictive performance. We also conduct a feasibility study to demonstrate the general applicability of our BRL methods on the newer RNA sequencing gene-expression data.

This paper presents a new means to control the processes, which involve the electric energy conversion. Electric machines fed by electronic converters provide the useful power defined by the inner product of two generalized energetic variables: the effort and the speed. The novelty of the paper idea is to control the desired energetics variables by a direct Data Driven Control (DDC) law in terms of the pair effort, speed and corresponding voltage controls of the electronic converter. It must be mentioned that the same desired useful power might be obtained with different controls at different efficiencies. The regularization problem was solved by selecting from a knowledge database, the maximum efficiency operation points. Knowing a reasonable number of optimal efficiency operation points, an interpolative Radial Base Function (RBF) control was built up. The RBF algorithm can find by interpolation the optimal controls for any admissible operation points of the process. The control scheme developed for this purpose has an inner DDC loop, that perform the converter control based on measured speed and demanded torque by the outer loop which handles the speed. A comparison of the DDC with the Model Predictive Control (MPC) schemas highlights the advantages of the new proposed control.

This study established a relationship between computerized accounting information systems (CAISs) and performance of SMS business enterprises in Burao, Somaliland. The main three objectives of this study were; (1) to assess the impact of computerized accounting information System on the performance of SMS business enterprises in Burao. (2) To measure the role of CAIS in the control system and management performance of SMS business enterprises in Burao. (3) To measure the impact of CAIS on the financial and operational performances in SMS business enterprises in Burao. The research approach of the study was quantitative research approach. The data used in this study was primary data obtained from the results of questionnaire survey on respondents. It was also utilized secondary data from the national documents, reports, different books, published materials and websites on the topic under the study. Using Slovene's formula, a sample size of 150 was used to collect data from respondents at SMS business enterprises in Burao through purposive sampling techniques. The data was analyzed through use of descriptive and inferential statistics. Reliability test and Validity test were also employed to test consistency of the measure and validity of data collected. The research findings indicated that there is a positive relationship between CAIS and the Performance of SMS business enterprises in Burao. This study recommended that SMS business should take advantage of the excellent benefits derivable from the adaption of well-designed CAIS because this will help to achieve a high and acceptable standard of quality in the performance of their business operations. The Management of SMS business enterprises (using CAIS) will benefit from this study understanding the impact of CAIS on their business practices. The academic generation and researchers will also benefit from the study in terms of literature review in matters of computerized accounting systems. In other terms, this will act as a point of reference for other future researchers.

Deflectometry is a key component in the precise measurement of specular (mirrored) surfaces, however traditional methods often lack an end-to-end approach that performs 3D reconstruction in a single shot with high accuracy and generalizes across different free-form surfaces. This paper introduces a novel deep neural network (DNN)-based approach for end-to-end 3D reconstruction of free-form specular surfaces using single-shot deflectometry. Our proposed network, VUDNet, innovatively combines discriminative and generative components to accurately interpret orthogonal fringe patterns and generate high-fidelity 3D surface reconstructions. By leveraging a hybrid architecture integrating a Variational Autoencoder (VAE) and a modified U-Net, VUDNet excels in both depth estimation and detail refinement, achieving superior performance in challenging environments. Extensive data simulation using Blender, leading to a dataset which we are making available, ensures robust training and enables the network to generalize across diverse scenarios. Experimental results demonstrate the strong performance of VUDNet, setting a new standard for 3D surface reconstruction. The implementation of VUDNet is available on GitHub at https://github.com/hadious/VUDNet.

In the era of Big Data and the Internet of Things (IoT), ensuring the security and privacy of patient data within distributed health systems is paramount. This research delves into the challenges posed by these advancements and explores viable solutions, focusing notably on blockchain technology, data encryption methods, and access control mechanisms. Employing a comprehensive literature review approach, the study synthesizes current research findings, complemented by analyses of existing frameworks and case studies from healthcare organizations, offering practical insights. Interviews with cybersecurity experts and healthcare IT professionals provide nuanced perspectives on current security issues and emerging trends. Through qualitative and quantitative data analyses, the study generates recommendations aimed at enhancing patient data security. These include the adoption of new frameworks and innovative technologies to fortify healthcare data systems. By addressing these critical aspects, this research aims to significantly contribute to the advancement of a more secure and efficient healthcare ecosystem in today's digital landscape.

This paper presents an innovative data-centric paradigm for designing computational systems by introducing a new informatics domain model. The proposed model moves away from the conventional node-centric framework and focuses on data-centric categorization, using a multimodal approach that incorporates objects, events, concepts, and actions. By drawing on interdisciplinary research and establishing a foundational ontology based on these core elements, the model promotes semantic consistency and secure data handling across distributed ecosystems. We also explore the implementation of this model as an OWL 2 ontology, discuss its potential applications, and outline its scalability and future directions for research. This work aims to serve as a foundational guide for system designers and data architects in developing more secure, interoperable, and scalable data systems.

We present a novel method for interpolating univariate time series data. The proposed method combines multi-point fractional Brownian bridges, a genetic algorithm, and Takens’ theorem for reconstructing a phase space from univariate time series data. The basic idea is to first generate a population of different stochastically interpolated time series data, and secondly, to use a genetic algorithm to find the pieces in the population which generate the smoothest reconstructed phase space trajectory. A smooth trajectory curve is hereby found to have a low variance of second derivatives along the curve. For simplicity, we refer to the developed method as PhaSpaSto-interpolation, which is an abbreviation for phase-space-trajectory-smoothing stochastic interpolation. The proposed approach is tested and validated with a univariate time series of the Lorenz system, five non-model data sets and tested against a cubic spline interpolation and a linear linear interpolation. We find that the criterion for smoothness guarantees low errors on known model and non-model data. Finally, we interpolate the discussed non-model data sets, and show the corresponding improved phase space portraits. The proposed method is useful for interpolating low-sampled time series data sets for, e.g., machine learning, regression analysis, or time series prediction approaches.

Data privacy is a critical concern in health informatics, where the management of sensitive patient information requires robust and secure database systems. This study aims to explore the data privacy challenges faced in health informatics and conduct a comparative analysis of popular Database Management Systems (DBMS), including MySQL, MongoDB, PostgreSQL, and Oracle, with a focus on their effectiveness in safeguarding patient data. Through a review of existing literature, case studies, and interviews with database administrators, the research identifies common privacy threats such as data breaches and unauthorized access. It examines the security features of each DBMS, such as encryption methods, access controls, and user authentication mechanisms. The findings reveal variations in the privacy protection capabilities of different DBMS, highlighting the trade-offs between security, performance, and usability. The study provides recommendations for healthcare organizations in selecting a DBMS that balances privacy with operational needs and offers insights for policymakers to improve regulatory frameworks in health data security. This research contributes to the ongoing discourse on enhancing data privacy in health informatics and suggests directions for future studies to integrate emerging technologies for more secure health data management.

The concentration of data from multiple links to a single output is an essential task performed by High-Energy Physics (HEP) Data Acquisition Systems (DAQs). At high and varying data rates combined with the large width of the concentrator’s output interface, this task is non-trivial. This paper presents a concentrator based on the Beneš network, which provides efficient concentration without using a high-frequency clock internally. It warrants that empty data are eliminated and does not disturb the data time-ordering if the data rates significantly differ between inputs. Additionally, it is well suited to FPGA implementation. It is based on simple data-routing primitives and may be fully pipelined.

In recent years, Cloud Computing and Big Data have been considered the most attractive areas that are revolutionizing the IT world. Cloud Computing paradigm has recently appeared that allows running proprietary or difficult portable applications outside their original software environment on one or more virtual hardware platforms. Therefore, we are to developing such techniques which make it possible to secure communication between the communicating Cloud entities. These techniques must take into account several factors due to the data transmitted in this type of environment is proprietary and of significant size. Conventional data security techniques are not suitable for today's cloud usage. Hence, the main research of this thesis is to define an adaptable architecture with the aim to propose a scalable system that supports cloud services. We will define feasible security solutions dedicated to the Cloud computing context in order to robustly protect data stored in the Cloud. We are more precisely looking for working on NoSQL databases. We also intend to propose a secure solution based on the blockchain that has powerful features like decentralization, autonomy, security, reliability, and transparency.

The article provides detailed information about the new technologies based on cluster computing Hadoop and Apache Spark. The experimental task of processing logistic regression with the help of these technologies is considered. The findings on the comparison of the performance of cluster computing of Hadoop and Apache Spark are revealed and substantiated.

Although other methods exist to store and manage data in modern information technology, the standard solution are file systems. Therefore keeping well-organized file structures and file system layouts can be key to a sustainable research data management infrastructure. However, file structures alone are lacking several important capabilities for FAIR data management: The two most striking are insufficient visualization of data and inadequate possibilities for searching and getting an overview. Research data management systems (RDMS) can fill this gap, but many do not support the simultaneous use of the file system and the RDMS. This simultaneous use can have many benefits, but keeping data in the RDMS in synchrony with the file structure is challenging. Here, we present concepts that allow to keep file structures and semantic data models (in RDMS) synchronous. Furthermore, we propose a specification in yaml-format that allows for a structured and extensible declaration and implementation of a mapping between the file system and data models used in semantic research data management. Implementing these concepts will facilitate the re-use of specifications for multiple use cases. Furthermore, the specification can serve as a machine-readable and, at the same time, human-readable documentation of specific file system structures. We demonstrate our work using the Open Source RDMS CaosDB.

Studying concurrent systems is to sort the read/write and control events in the concurrent system according to the order, or in partial order, or in strict order. Because of the concurrency of events and the timeliness of writing events, there will be overlap between events, which requires interval order analysis. A single start and end sequence to represent the entire hierarchical order structure as well as all equivalent spaced order observations.a single sequence of beginnings and endings to represent the entire stratified order structures as well as all equivalent interval order observations. Mazurkiewicz traces and Comtracks are hierarchical traces, but they cannot describe interval traces. In a few sentences of this summary, we can tell the problems (petri interval traces with data), the previous work (Mazurkiewicz traces, Comtracks), the reasons that cannot be solved, and our own solutions (DPN: Petri nets with data, interval traces). This paper focuses on a BE (Beginnings and Endings) sequence representing an equivalent class of runs, or targets. Our goal is to have a BE sequence to represent the entire hierarchical order structure, that is, all equivalent observable interval orders.

The particulars of stimulus-response experiments done on dynamic biosystems clearly limit what one can learn and validate about their structural interconnectivity (topology), even when collected kinetic output data are perfect (noise-free). As always, available access ports and other data limitations rule. For linear systems, exponential modes, visible and hidden, play an important role in understanding data limitations, embodied in what we call dynamical signatures in the data. We show here how to circumscribe and analyze modal response data in compartmentalizing model structures – so that modal analysis can be used constructively in systems biology model building – for nonlinear (NL) as well as linear biosystems. We do this by developing and exploiting the modal basis for dynamical signatures in hypothetical (perfect) input-output data associated with a structural model – one that includes inputs and outputs explicitly – and for NL as well as linear biosystems. The methodology establishes model dimensionality (size, complexity) from particular data sets; helps select among multiple candidate models (model distinguishability); helps in designing new experiments to extract “hidden” structure; and helps to simplify (reduce) models to their essentials. For NL biosystems, results are not as comprehensive, similarly informative about their dominant dynamical properties, and unified with linear models on invariant 2-dimensional manifolds in phase space. Some automation of these highly technical aspects of biomodeling is also introduced.

This paper investigated building data from multispectral and single-photon Lidar systems. The multispectral datasets from the individual channels and fused channels were explored. The multispectral and single-photon Lidar data were compared across multiple aspects: the data acquisition geometry, number of echoes, intensity, density, resolution, data defects, noise level, and the absolute and relative accuracy. In addition, we explored the performance of the multispectral and single-photon data for roof plane detection for eight complex/stylish buildings to investigate the suitability of these data for 3D building reconstruction. The building data from the single-photon and multispectral Lidar systems were evaluated with respect to the reference building vector data with an accuracy of better than 5 cm. The advantages and disadvantages of both technologies and their applications in the urban building environment are discussed.

Intelligent Tutoring Systems (ITS) are increasingly popular for online learning. These systems use adaptive algorithms to recommend relevant content based on students' profiles. However, instructors need to periodically assess students' performance to ensure learning outcomes and adjust strategies accordingly. Our objective is to predict students' progress in advance, enabling teachers to make quicker decisions and facilitating the iterative process of adaptive algorithms. For this study, we collected a dataset from ALIN, an online learning platform, consisting of over 5,000 students' learning records and test results. Using this dataset, we conducted experiments employing various machine learning algorithms. The results indicate that learning behavior contributes to improving forecast performance, while students' progress strongly correlates with their previous test results. Additionally, we discovered that students' progress can be indirectly predicted by forecasting their scores. Furthermore, by breaking down overall scores into several distinct components and predicting individual scores for each component, the accuracy of the forecasts can be improved.

Historical and Endowment Properties are different from Heritage and cultural Properties, as Historical and Endowment properties are governed by a unique set of laws that Waqf recipients must abide by. Property that is entrusted is usually in the form of buildings, land or valuables which in preservation is not limited to time as long as the property can be utilized. Reliable information technology is needed to ensure data security both digitally and physically, while the rapid development of information technology demands information openness and this will be a challenge in itself. The objectives of this study include examining the collection of historical databases and endowments, the relationship between digital data and physical data and management organizations. The method of how to design a query model to display data is then analyzed whether the data conforms to the rules in waqf management. The results are expected to bring up accurate data between digital data and physical data and if there are differences into findings for the next analysis.

This paper explores the application of machine learning (ML) in predicting functional recovery in patients with ischemic stroke. As technology advances, ML shows significant potential in the field of stroke medicine, especially in the areas of big data analytics and personalized medicine. Studies have shown that ML algorithms can improve the accuracy of stroke image analysis, subtype classification, risk assessment, treatment guidance, and prognosis prediction. However, the widespread use of ML still faces challenges such as data standardization, model validation, privacy, and bias. This paper reviews the current application status of ML in the field of stroke, discusses the challenges faced, and looks forward to the future development direction, aiming to promote the practical application of ML technology in the diagnosis and treatment of stroke to improve the prognosis and quality of life of patients.

Coordinated sets of extremely numerous digital data, on a given social or economic event, are treated by Artificial Intelligence tools to obtain reasonably accurate, valuable predictions. The same approach, applied to biomedical issues, as how to choose the right drug to completely cure a given cancer patient, does not reach satisfactory results. It is the “organized biological complexity”, which requires a different systems approach, to integrate, in an Augmented Intelligence strategy, statistical computations of digital data, network construction of “omics” findings, well-designed mathematical models and new experiments in an iterative pathway to reconstruct the “logic” beneath the “organized complexity”, as shown here for Systems Metabolomics of cancer. On this basis new diagnostic approaches, able to identify precision drug treatments, as well as new discovery strategy for more effective anti-cancer drugs are described.

In today's world, wherein more than 80% of world trade is carried out by maritime routes, the safety and security of the seas where this trade takes place is of vast importance for nations and the in-ternational community. For this reason, ensuring the sustainable safety and security of the seas has become an integral part of the mission of all maritime-related entities. The utilization of big data extracted from the seas and maritime activities into meaningful information with artificial intelli-gence applications and developing applications that can be used in maritime surveillance will be of great importance for augmenting maritime safety and security. In this article, data sources which can be used by a maritime surveillance system based on big data and artificial intelligence tech-nologies and which can be established around sensitive sea areas and critical coastal facilities, are identified and a model proposal using this maritime big data is put forward.

Big data has revolutionised science and technology leading to the transformation of our societies. High Performance Computing (HPC) provides the necessary computational power for big data analysis using artificial intelligence and methods. Traditionally HPC and big data had focused on different problem domains and had grown into two different ecosystems. Efforts have been underway for the last few years on bringing the best of both paradigms into HPC and big converged architectures. Designing HPC and big data converged systems is a hard task requiring careful placement of data, analytics, and other computational tasks such that the desired performance is achieved with the least amount of resources. Energy efficiency has become the biggest hurdle in the realisation of HPC, big data, and converged systems capable of delivering exascale and beyond performance. Data locality is a key parameter of HPDA system design as moving even a byte costs heavily both in time and energy with an increase in the size of the system. Performance in terms of time and energy are the most important factors for users, particularly energy, due to it being the major hurdle in high performance system design and the increasing focus on green energy systems due to environmental sustainability. Data locality is a broad term that encapsulates different aspects including bringing computations to data, minimizing data movement by efficient exploitation of cache hierarchies, reducing intra- and inter-node communications, locality-aware process and thread mapping, and in-situ and in-transit data analysis. This paper provides an extensive review of the cutting-edge on data locality in HPC, big data, and converged systems. We review the literature on data locality in HPC, big data, and converged environments and discuss challenges, opportunities, and future directions. Subsequently, using the knowledge gained from this extensive review, we propose a system architecture for future HPC and big data converged systems. To the best of our knowledge, there is no such review on data locality in converged HPC and big data systems.

This article aims to analyze household energy data to predict electricity self-sufficiency and identify the key features that impact it. For this purpose, we use SHAP (Shapley Additive Explanations), LightGBM (Light Gradient Boosting Machine), and a correlation heatmap-based framework to analyze 12 months of energy and questionnaire survey data collected from over 200 smart houses in Kitakyushu, Japan. We use the SHAP summary plot to identify the impact-wise order of key features influencing the electricity self-sufficiency rate (ESSR). Using SHAP, we demonstrated that key features are; housing types, average monthly electricity bill, floor heating, electric capacity, number of washing and drying machines, fee plans, occupation of household head, total floor area, average monthly gas bill, cooking equipment, etc. Furthermore, we adopted the LightGBM classifier with $\ell^1$ regularization to extract the most significant features and predict the electricity self-sufficiency rate of households. This LightGBM-based model can also predict the electricity self-sufficiency rate of households that did not participate in the questionnaire survey. A heat map is also used to analyze the correlation among household variables. The findings discussed in this article offer valuable insights for energy policymakers to achieve the targets of energy self-sufficient houses.

This research explores the feasibility of a data-driven optimization algorithm for placing sparse arrays of artificial hair-cell airflow velocity sensors to enable agile and robust flight-by-feel control of unmanned aircraft. The Sparse Sensor Placement Optimization for Prediction (SSPOP) algorithm exploits the information-rich features of large flow datasets to find a near-optimal set of locations for flow sensors on a wing. The flow information from these sensors can be used to predict flight state parameters such as the angle of attack, mimicking the fly-by-feel control systems observed in nature. We evaluate the effectiveness of this approach for a blunt-edged 45∘ swept delta wing. Exploiting the information in the complex airflow patterns over this wing, the SSPOP algorithm selects a sensor location design point (DP) which reliably ranks within the top 1% of all possible DPs by root mean square error in angle of attack prediction. This performance was consistent across models of various artificial hair lengths, and one model with variable hair lengths. This bioinspired dimension-reducing method for sensor placement optimization exhibits reliability and flexibility benefits when compared with a conventional greedy search algorithm and gradient-based optimization using auto-differentiation. The successful application of SSPOP in complex 3D flows paves the way for experimental evaluation of data-driven sparse sensor placement optimization for artificial hair-cell airflow sensors and is a major step toward biomimetic flight-by-feel.

Fault line detection timely and accurately when single-phase-to-earth fault occurs in resonant grounding system is still a focus of research. This paper presents a new approach for fault detection based on data fusion and it has non-artificial setting. Firstly, the fault criterion for interphase difference energy ratio and time-frequency correlation coefficient of each line is proposed. Subsequently, the paper establish a coordinate system with the interphase difference energy ratio as X axis and the time-frequency correlation coefficient as Y axis, and it uses the Euclidean distance algorithm to get the characteristic distance of each line by fusing two-dimensional information. Finally, comparing the sound distance and the fault distance of each line to discriminate the fault line. Electromagnetic Transients Program (EMTP) simulation results and adaptability analysis have confirmed the effectiveness and reliability of the proposed scheme.

Energy supply interruptions or blackouts caused by faults in power distribution feeders entail several damages to power utilities and consumer units: financial losses, damage to power distribution reliability, power quality deterioration, etc. Most studies in the specialized literature concerning faults in power distribution systems present methodologies for detecting, classifying, and locating faults after their occurrence. In contrast, this study aims to prevent faults by estimating the city regions whose power grid is most vulnerable to them. This work incorporates the geographic space study to prevent faults in the distribution power grid through a spatial data analysis using local variables that increase the fault risk in feeders in some city regions. Geographically weighted spatial analysis is applied to data aggregated by regions to produce thematic maps with the city regions whose feeders are more vulnerable to failures. Spatial data analysis is developed in QGIS and R programming environments. It is applied in real data of electrical discharges in a medium-sized city with approximately 200,000 inhabitants. In this study, we highlight a moderate positive correlation between electrical discharge density and the percentage of faults in transformers by regions in the central and western areas of the city under study.

Energy storage systems (ESS) are penetrating into various sections of power system through different applications. ESS can be used either as a buffer for intermittent renewable energy sources or as a stand-alone distributed storage for load shifting. ESS use different types of storage devices such as lead-acid batteries, lithium ion batteries, flow batteries, and super-capacitors. Hybrid ESS consisting of few types of storage devices are also common in practice. Determining the load demand of such ESSs at various instances (charging profile) accurately is indispensable in most of the cases. Capacity loss is common phenomenon that occurs in all types of storage devices because of ageing. Capacity loss has to be accounted while determining the charging profile of storage devices for better accuracy. Data-driven modeling is an attractive approach for determining the load demand of ESS due to the availability of valuable data from smart grid technologies. In this paper, the application of different types of data-driven models to predict the current charging profile of the ESS based on previous charging profiles is examined. The proposed method can leverage on the existing data from smart grid and is a black box modeling approach.

With the rapid spread of built-in GPS handheld smart devices, the trajectory data from GPS sensors has grown explosively. Trajectory data has spatio-temporal characteristics and rich information. Using trajectory data processing techniques can mine the patterns of human activities and the moving patterns of vehicles in the intelligent transportation systems. A trajectory similarity measure is one of the most important issues in trajectory data mining (clustering, classification, frequent pattern mining, etc.). Unfortunately, the main similarity measure algorithms with the trajectory data have been found to be inaccurate, highly sensitive of sampling methods, and have low robustness for the noise data. To solve the above problems, three distances and their corresponding computation methods are proposed in this paper. The point-segment distance can decrease the sensitivity of the point sampling methods. The prediction distance optimizes the temporal distance with the features of trajectory data. The segment-segment distance introduces the trajectory shape factor into the similarity measurement to improve the accuracy. The three kinds of distance are integrated with the traditional dynamic time warping algorithm (DTW) algorithm to propose a new segment–based dynamic time warping algorithm (SDTW). The experimental results show that the SDTW algorithm can exhibit about 57%, 86%, and 31% better accuracy than the longest common subsequence algorithm (LCSS), and edit distance on real sequence algorithm (EDR) , and DTW, respectively, and that the sensitivity to the noise data is lower than that those algorithms.

Accurate Quantitative Precipitation Estimation (QPE) is fundamental for a large number of hydrometeorological applications, especially when addressing extreme rainfall phenomena. This paper presents a comprehensive comparison of various rainfall estimation methods, specifically those relying on weather radar data, rain gauge data, and their fusion. The study evaluates the accuracy and reliability of each method in estimating rainfall for a severe event that occurred in Tuscany, Italy. The obtained results indicate that merging radar and rain gauge data outperform both individual approaches by reducing errors and improving the overall reliability of precipitation estimates. The study highlights the importance of data fusion in enhancing the accuracy of QPE and also supports its application in operational contexts, providing evidence for the greater reliability of merging methods

Remanufacturing is a viable option to extend the useful life of an end-of-use product or its parts, ensuring sustainable competitive advantages under the current global economic climate. Challenges typical to remanufacturing still persist, despite its many benefits. According to the European Remanufacturing Network a key challenge is lack of accurate, timely and consistent product knowledge as highlighted in a 2015 survey of 188 European remanufacturers. With more data being produced by electric and hybrid vehicles, this adds to the information complexity challenge already experienced in remanufacturing. Therefore, it is difficult to implement real-time and accurate remanufacturing for the shop floor; there are no papers that focus on this within an electric and hybrid vehicle environment. To address this problem this paper attempts to (1) identify the required parameters/ variables needed for fuel cell remanufacturing by means of interviews (2) rank the variables by Pareto analysis (3) develop a casual loop diagram for the identified parameters/ variables to visualise its impact on remanufacturing (4) model a simple stock and flow diagram to simulate and understand data and information-driven schemes in remanufacturing.

This paper presents an approach to assess and improve the cybersecurity infras- tructure of developing countries. We have highlighted and addressed the critical gaps through a hybrid approach encompassing SWOT analysis, benchmarking using Data Envelopment Analysis (DEA) and, Root Cause Analysis (RCA). This approach has provided a strong basis for evaluating cybersecurity performance by combining qualitative insights with quantitative metrics. As a case study, we have compared an underdeveloped country’s (Pakistan) cybersecurity pos- ture to five highly developed countries (Lithuania, Estonia, Singapore, Spain,and Norway). Our analysis has identified cybersecurity shortcomings and pro- vided actionable recommendations within a flexible framework, applicable for all developing countries to identify and address vulnerabilities, and align their cybersecurity infrastructure with international standards.

This paper reveals some properties of the cumulative entropy of consecutive k-out-of-n:F system's lifetime. First, we introduce a method for calculating the cumulative entropy of their lifetime and explore its preservation properties using established stochastic orders. Ad- ditionally, we obtain useful bounds that can used in situations where the distribution function of the system's component lifetimes are complicated or systems have large components. To support practical applications, we present two nonparametric estimators for the cumulative entropy of these systems. The efficiency and performance of these estimators are illustrated with simulated datasets and further validated with real data sets.

This paper explores the application of machine learning (ML) in predicting functional recovery in patients with ischemic stroke. As technology advances, ML shows significant potential in the field of stroke medicine, especially in the areas of big data analytics and personalized medicine. Studies have shown that ML algorithms can improve the accuracy of stroke image analysis, subtype classification, risk assessment, treatment guidance, and prognosis prediction. However, the widespread use of ML still faces challenges such as data standardization, model validation, privacy, and bias. This paper reviews the current application status of ML in the field of stroke, discusses the challenges faced, and looks forward to the future development direction, aiming to promote the practical application of ML technology in the diagnosis and treatment of stroke to improve the prognosis and quality of life of patients.

Identifying groups that share common features among datasets through clustering analysis is a typical problem in many fields of science, particularly in post-omics and systems biology research. In respect of this, quantifying how a measure can cluster or organize intrinsic groups is important since currently there is no statistical evaluation of how ordered is, or how much noise is embedded in the resulting clustered vector. Many of the literature focuses on how well the clustering algorithm orders the data, with several measures regarding external and internal statistical measures; but none measure has been developed to statistically quantify the noise in an arranged vector posterior a clustering algorithm, i.e., how much of the clustering is due to randomness. Here, we present a quantitative methodology, based on autocorrelation, to assess this problem.

In an IoT system, the sheer volume of data generated by numerous sensing devices necessitates a well-designed scheme for storing and retrieving data efficiently, enabling streamlined data processing and analytics. One promising storage architecture involves utilizing solid-state drives (SSDs) to cache data from hard disk drives (HDDs), thereby creating an SSD-based caching storage system. To further enhance access performance, it is possible to employ readahead techniques to minimize data access latency. However, the existing Linux readahead scheme falls short in fully leveraging SSD-based caching storage systems. We address this limitation by introducing a novel cross-layered readahead architecture that effectively communicates with the VFS layer, the file system layer, and the block I/O layer. This communication facilitates the acquisition of readahead timing, readahead data continuity, and readahead data location, respectively. To guide prefetching decisions, our architecture analyzes the degree of data access sequentiality, the performance model of the target storage device, and the access patterns of the I/O workload on the corresponding storage device. The implementation of this new architecture in the Linux kernel yields promising experimental results, demonstrating its robustness by consistently outperforming the stock Linux kernel. Notably, our architecture reduces the total execution time of the stock Linux kernel by up to 49%, except in cases of random workloads where both the stock Linux kernel and our architecture exhibit similar performance.

As telecommunication networks continue to grow, the volume, variety, and velocity of such `big data' poses an immense challenge for security and service analysts. A primary data format in such networks are Call Detail Records (CDRs), and more recently, eXtended Detail Records (XDRs), that capture a variety of information such as caller, receiver, duration, carrier, datetime, amongst other attributes. In this short paper, we investigate the current research trends and challenges that exist within this data-rich domain. As part of this, we look at the domain-specific tasks that analysts will seek to address, we look at how machine learning has been utilised to date within this domain, and we present our current findings on open research problems that are ripe for further investigation.

The increasing importance of hydropower generation has led to the development of new smart technologies and the need for reliable and efficient equipment in this field. As long as hydropower power plants are more complex to build up than other power plants, the operation regimes and maintenance activities become essential for the hydropower companies to optimize their performance, such that including the data-driven approaches in the decision-making process represents a challenge. In the paper, a comprehensive and multi-task framework integrated into a Knowledge Discovery module based on Data Mining to support the decisions of the operators from the control rooms and facilitate the transition from the classical to smart Supervisory Control and Data Acquisition (SCADA) system in hydropower plants has been designed, developed, and tested. It integrates tasks related to detecting the outliers through advanced statistical procedures, identifying the operating regimes through the patterns associated with typical operating profiles, and developing strategies for loading the generation units that consider the number of operating hours and minimize the water amount used to satisfy the power required by the system. The proposed framework has been tested using the SCADA system's database of a hydropower plant belonging to the Romanian HydroPower Company. The framework can offer the operators from the control room comparative information for a time horizon longer than one year. The tests demonstrated the utility of a Knowledge Discovery module to ensure the transition toward smart SCADA systems that will help the decision-makers improve the management of the hydropower plants.

In this paper the authors present a method which facilitates computationally efficient parameter estimation of dynamical systems from a continuously growing set of measurement data. It is shown that the proposed method, which utilises Sequential Monte Carlo samplers, is guaranteed to be fully parallelisable (in contrast to Markov chain Monte Carlo methods) and can be applied to a wide variety of scenarios within structural dynamics. Its ability to allow convergence of one's parameter estimates, as more data is analysed, sets it apart from other sequential methods (such as the particle filter).

The present grievous situation of the tuberculosis disease can be improved by efficient case management and timely follow-up evaluations. With the advent of digital technology this can be achieved by quick summarization of the patient-centric data. The aim of our study was to assess the effectiveness of the ODK Scan paper-to-digital system during testing period of three months. A sequential, explanatory mixed-method research approach was employed to elucidate technology use. Training, smartphones, application and 3G enabled SIMs were provided to the four field workers. At the beginning, baseline measures of the data management aspects were recorded and compared with endline measures to see the impact of ODK Scan. Additionally, at the end, users’ feedback was collected regarding app usability, user interface design and workflow changes. 122 patients’ records were retrieved from the server and analysed for quality. It was found that ODK Scan recognized 99.2% of multiple choice bubble responses and 79.4% of numerical digit responses correctly. However, the overall quality of the digital data was decreased in comparison to manually entered data. Using ODK Scan, a significant time reduction is observed in data aggregation and data transfer activities, however, data verification and form filling activities took more time. Interviews revealed that field workers saw value in using ODK Scan, however, they were more concerned about the time consuming aspects of the use of ODK Scan. Therefore, it is concluded that minimal disturbance in the existing workflow, continuous feedback and value additions are the important considerations for the implementing organization to ensure technology adoption and workflow improvements.

Utilizing unmanned aerial vehicles (UAVs) to facilitate wireless communication has emerged as a viable and promising strategy aimed at enhancing both current and prospective wireless systems. This approach offers many advantages by establishing line-of-sight connections, optimizing operational efficiency, and enabling flexible deployment capabilities in various terrains. Thus, in this paper, we investigate UAV communication in a relaying network in which a UAV helps communication between a source and two destination users while flying to a location. To have a complete view of our proposed system, we consider both orthogonal multiple access as OFDM and non-orthogonal multiple access (NOMA) scenarios. Moreover, we apply successive convex optimization (SCO) and the Block-coordinate gradient descent (BCGD) for the sum-rate optimization problems to improve the system performance under constraints of total bandwidth and total power at the ground base station and UAV. The experimental results validate that the achievable secrecy rates are notably enhanced by using our proposed algorithms and show optimal trends for critical parameters, such as transmit powers, the flight trajectory and speed of UAV, and resource allocation of OFDM and NOMA.

A significant number and range of challenges besetting sustainability can be traced to the actions and interactions of multiple autonomous agents (people mostly) and the entities they create (e.g., institutions, policies, social network) in the corresponding social-environmental systems (SES). To address these challenges, we need to understand decisions made and actions taken by agents, the outcomes of their actions, including the feedbacks on the corresponding agents and environment. The science of Agent-based Complex Systems—ACS science—has a significant potential to handle such challenges. The advantages of ACS science for sustainability are addressed by way of identifying the key elements and challenges in sustainability science, the generic features of ACS, and the key advances and challenges in modeling ACS. Artificial intelligence and data science promise to improve understanding of agents’ behaviors, detect SES structures, and formulate SES mechanisms.

More and more works are using machine learning techniques while adopting supervisory control and data acquisition (SCADA) system for wind turbine anomaly or failure detection. While parameter selection is important for modelling a wind turbine’s health condition, only a few papers have been published focusing on this issue and in those papers interconnections among sub-components in a wind turbine are used to address this problem. However, merely the interconnections for decision making sometimes is too general to provide a parameter list considering the differences of each SCADA dataset. In this paper, a method is proposed to provide more detailed suggestions on parameter selection based on mutual information. Moreover, after proving that Copula, a multivariate probability distribution for which the marginal probability distribution of each variable is uniform is capable of simplifying the estimation of mutual information, an empirical copula based mutual information estimation method (ECMI) is introduced for an application. After that, a real SCADA dataset is adopted to test the method, and the results show the effectiveness of the ECMI in providing parameter selection suggestions when physical knowledge is not accurate enough.

For offshore wind power generation, accessibility is one of the main factors that has great impact on operation and maintenance due to constraints on weather conditions for marine transportation. This paper presents a framework to explore the accessibility of an offshore site. At first, several maintenance types are defined and taken into account. Next, a data visualization procedure is introduced to provide an insight into the distribution of access periods over time. Then, a rigorous mathematical method based on finite state Markov chain is proposed to assess the accessibility of an offshore site from the maintenance perspective. A five-year weather data of a marine site is used to demonstrate the applicability and the outcomes of the proposed method. The main findings show that the proposed framework is effective in investigating the accessibility for different time scales and is able to catch the patterns of the distribution of the access periods. Moreover, based on the developed Markov chain, the average waiting time for a certain access period can be estimated. With more information on the maintenance of an offshore wind farm, the expected production loss due to time delay can be calculated.

The interest on the use of renewable energy resources is increasing, especially towards wind and hydro powers, which should be efficiently converted into electric energy via suitable technology tools. To this aim, self--tuning control techniques represent viable strategies that can be employed for this purpose, due to the features of these nonlinear dynamic processes working over a wide range of operating conditions, driven by stochastic inputs, excitations and disturbances. Some of the considered methods were already verified on wind turbine systems, and important advantages may thus derive from the appropriate implementation of the same control schemes for hydroelectric plants. This represents the key point of the work, which provides some guidelines on the design and the application of these control strategies to these energy conversion systems. In fact, it seems that investigations related with both wind and hydraulic energies present a reduced number of common aspects, thus leading to little exchange and share of possible common points. This consideration is particularly valid with reference to the more established wind area when compared to hydroelectric systems. In this way, this work recalls the models of wind turbine and hydroelectric system, and investigates the application of different control solutions. The scope is to analyse common points in the control objectives and the achievable results from the application of different solutions. Another important point of this investigation regards the analysis of the exploited benchmark models, their control objectives, and the development of the control solutions. The working conditions of these energy conversion systems will be also taken into account in order to highlight the reliability and robustness characteristics of the developed control strategies, especially interesting for remote and relatively inaccessible location of many installations.

This paper presents a thermal runaway prognosis scheme based on the big-data platform and entropy method for battery systems in electric vehicles. It can simultaneously realize the diagnosis and prognosis of thermal runaway caused by the temperature fault through monitoring battery temperature during vehicular operations. A vast quantity of real-time voltage monitoring data was collected in the National Service and Management Center for Electric Vehicles (NSMC-EV) in Beijing to verify the effectiveness of the presented method. The results show that the proposed method can accurately forecast both the time and location of the temperature fault within battery packs. Furthermore, a temperature security management strategy for thermal runaway is proposed on the basis of the Z-score approach and the abnormity coefficient is set to make real-time precaution of temperature abnormity.

As a consequence of applying advanced maintenance practices, the theoretical probability of failures is relatively low. However, observation of low market intelligence and maintenance management has been reported. The experimental investigation is supported by findings from a survey targeting asset-intensive companies applying hydraulic power systems. Next, the study incorporates multidimensional data analysis using CA-AHC (Correspondance Analysis with Agglomerative Hierarchical Clustering) approach. The non-parametric machine learning models are used from generated feature subspace to extract features affecting maintenance performance indicators. The results support empirical evidence that equipment age increases the probability of failures. However, the novel findings show that number of maintenance personnel, equipment size measured by nominal working energy consumption, and activities dedicated to maintaining fluid cleanliness impact regression results of companies utilising hydraulic applications.

Artificial Intelligence (AI) is a leading technology of the current age of the Fourth Industrial Revolution (Industry 4.0 or 4IR), with the capability of incorporating human behavior and intelligence into machines or systems. Thus AI-based modeling is the key to building automated, intelligent, and smart systems according to today's needs. To solve real-world issues various types of AI such as analytical, functional, interactive, textual, and visual AI can be applied to enhance the intelligence and capabilities of an application. However, developing an effective AI model is a challenging task due to the dynamic nature and variation in real-world problems and data. In this paper, we present a comprehensive view on "AI-based Modeling" with the principles and capabilities of potential AI techniques that can play an important role in developing intelligent and smart systems in various real-world application areas including business, finance, healthcare, agriculture, smart cities, cybersecurity and many more. We also emphasize and highlight the research issues within the scope of our study. Overall, the goal of this paper is to provide a broad overview of AI-based modeling that can be used as a reference guide by academics and industry people as well as decision-makers in various real-world scenarios and application domains.

Eastern boundary upwelling systems feature strong zonal gradients of physical and biological ocean properties between cool, productive coastal oceans and warm, oligotrophic subtropical gyres. Zonal currents and jets (striations) are therefore likely to contribute to the transport of water properties between coastal and open oceanic regions. Multi-sensor satellite data are used to characterize the signatures of striations in sea surface temperature (SST), salinity (SSS), and chlorophyll-a (Chl-a) in subtropical eastern North/South Pacific (ENP/ESP) upwelling systems. In the ENP, tracers exhibit striated patterns extending up to ~2500 km offshore. Striations in SST and SSS are highly correlated with quasi-zonal jets, suggesting that these jets contribute to SST/SSS mesoscale patterns via zonal advection. Chl-a striations are collocated with sea surface height (SSH) bands, a possible result of mesoscale eddy trains trapping nutrients and forming striated signals. In the ESP, striations are only found in SST and coincide with SSH bands, consistently with quasi-zonal jets located outside major zonal tracer gradients. An interplay between large-scale SST/SSS advection by the quasi-zonal jets, mesoscale SST/SSS advection by the large-scale meridional flow and eddy advection may explain the persistent ENP hydrographic striations. These results underline the importance of quasi-zonal jets for surface tracer structuring at the mesoscale.

The home is becoming a key location for healthcare delivery, including the use of technology driven by autonomous systems (AS) to monitor and support healthcare plans. Using the example of a smart mirror, this paper describes the outcomes of focus groups with people with multiple sclerosis (MS; n=6) and people who have had a stroke (n=15) to understand their attitudes towards the use of AS for healthcare in the home. We thematic analysis to analyse the data. The results indicate that the use of such technology depends on the level of adaptability and responsiveness to the users’ specific circumstances, including their relationships with the healthcare system. A smart mirror would need to support manual entry, responsive goal setting, effective aggregation of data sources and integration with other technology, have a range of input methods, be supportive rather than prescriptive in messaging, and give the user full control of their data. Barriers to adoption include a perceived lack of portability and practicality, lack of accessibility and inclusivity, a sense of redundancy, being overwhelmed by multiple technological devices, and a lack of trust in data sharing. These results inform the development and deployment of future health technologies based on the lived experiences of people with health conditions who require ongoing care.

This paper presents a new information technology platform specially tailored for infrastructure asset management of urban water systems operated by water utilities of lower digital maturity level, developed in the scope of DECIdE research project. This platform aims at the integration of different data from the water utilities with several information systems and the assessment of the system performance, in terms of water losses, energy efficiency and quality of service by using developed tools (i.e., water and energy balances and key performance indicators). This platform was tested with data from five small to medium size Portuguese water utilities with different maturity levels in terms of technological and human resources. Obtained results are very promising since the platform allows to assess the systems performance periodically which constitute an important part of the infrastructure asset management for small and medium-sized water utilities

Artificial intelligence methods and application have recently shown great contribution in modeling and prediction of the hydrological processes, climate change, and earth systems. Among them, deep learning and machine learning methods mainly have reported being essential for achieving higher accuracy, robustness, efficiency, computation cost, and overall model performance. This paper presents the state of the art of machine learning and deep learning methods and applications in this realm and the current state, and future trends are discussed. The survey of the advances in machine learning and deep learning are presented through a novel classification of methods. The paper concludes that deep learning is still in the first stages of development, and the research is still progressing. On the other hand, machine learning methods are already established in the fields, and novel methods with higher performance are emerging through ensemble techniques and hybridization.

Monitoring seaweed growth rates and biomass is crucial for optimizing harvest strategies in aquaculture systems. While such a task can be performed manually on a small farm, such as the Integrated Multi-Trophic Aquaculture (IMTA) system at Harbor Branch Oceanographic Institute at Florida Atlantic University (HBOI), a commercial farm will have to rely on the automated sensor to perform such a task. This study introduces an advanced LSTM-based approach for forecasting seaweed growth and biomass. Utilizing a combination of real and synthetic data, LSTM models are trained and evaluated for their predictive performance. Synthetic sensor data was generated using mathematical equations that simulate realistic aquaculture conditions, with added noise to reflect sensor variability. Building on the foundation of the Pseudorandom Encoded Light for Evaluating Biomass (PEEB) sensor deployed at the seaweed tank in the HBOI IMTA system, we refine the process of biomass estimation by introducing non-linear regression models for predicting seaweed growth and biomass. The results showed that the LSTM model trained with a loss function under physics constraint, combining MSE and physical laws, outperformed models trained with MSE alone, achieving a significantly lower error in predicting seaweed growth. The variation trend of the predicted biomass from the network matched well with the sensor measurement after moving average preprocessing, demonstrating the robustness of the proposed technique in handling noisy sensor data. This study highlights the potential of integrating machine learning with physical models to optimize seaweed cultivation and support sustainable aquaculture practices.

The interest on the use of renewable energy resources is increasing, especially towards wind and hydro powers, which should be efficiently converted into electric energy via suitable technology tools. To this aim, data--driven control techniques represent viable strategies that can be employed for this purpose, due to the features of these nonlinear dynamic processes working over a wide range of operating conditions, driven by stochastic inputs, excitations and disturbances. Some of the considered methods, such as fuzzy and adaptive self--tuning controllers, were already verified on wind turbine systems, and similar advantages may thus derive from their appropriate implementation and application to hydroelectric plants. These issues represent the key features of the work, which provides some guidelines on the design and the application of these control strategies to these energy conversion systems. The working conditions of these systems will be also taken into account in order to highlight the reliability and robustness characteristics of the developed control strategies, especially interesting for remote and relatively inaccessible location of many installations.

Traffic Inspection (TI) work in this article is positioned as a specific module of road traffic with its primary function oriented towards monitoring and controlling safe traffic and the execution of significant events within a particular geographic area. Exploratory research on the significance of event execution in simple, complicated and complex traffic flow and process situations is related to the activities of monitoring and controlling functional states and performance of categorical variables, which include objects and locations of road infrastructure, communication infrastructure and networks of traffic inspection resources. It is emphasized that the words “work” and “traffic” have the semantic status as synonyms (in one world language), which is explained in the design of the Agent-based model of the complexity of content and contextual structure of TI work at the singular and plural level with 12 points of interest (POI) in the thematic research. An Event Execution Log (EEL) was created for on-site data collection with eight variables, seven of which are independent (event type, activities, objects, locations, host, duration-period and periodicity of the event) and one dependent (significance of the event) variable. The structured data set includes 10,994 input-output vectors in 970 categories collected in the EEL created by 32 human agents (traffic inspectors) over a 30-day period. An algorithmic presentation of the methodological research procedure for preprocessing and final data processing in the ensemble of machine learning models for classification and selection of TI tasks is given. Data cleaning was performed on the available dataset to increase data consistency for further processing. Vector elimination was carried out based on the Location variable, such that the total number of vectors equals the number of unique categories of this variable, which is 636. The main result of this research is the Classification modeling of the significance of events in TI work based on machine learning techniques and the Stacking ensemble. The created machine learning models for event significance classification modeling have high accuracy values. To evaluate the performance metrics of the Stacking ensemble of models, the confusion matrix, Precision, Recall, ND F1-score are used.

Recently natural gas (NG) global market attracted much attention in case it is cleaner than oil, and simultaneously in most regions is cheaper than renewable energy sources. However, price fluctuations, environmental concerns, technological development, emerging unconventional resources, energy security challenges, and shipment are some of the forces that made the NG market more dynamic and complex. From a policy-making perspective, it is vital to uncover demand-side future trends. This paper proposed an intelligent forecasting model to forecast NG global demand, however investigating a multi-dimensional purified input vector. The model starts with a data mining (DM) step to purify input features, identify the best time lags, and to pre-process selected input vector. Then a hybrid artificial neural network (ANN) which equipped with genetic optimizer is applied to set up ANN’s characteristics. Among 13 available input features, six features (e.g. Alternative and Nuclear Energy, CO2 Emissions, GDP per Capita, Urban Population, Natural Gas Production, Oil Consumption) selected as the most critical feature via the DM step. Then, the hybrid prediction model is designed to extrapolate the consumption of future trends. The proposed model overcomes competitive models refer to different error based evaluation statistics. Besides, as the model proposed the best input feature set, results compared to the model which used the raw input set, with no DM purification process.

Increasingly, there is a focus on utilising renewable energy resources in a bid to fulfil increasing energy requirements and mitigate the climate change impacts of fossil fuels. While most renewable resources are free, the technology used to usefully convert such resources is not and there is an increasing focus on improving the conversion economy and efficiency. To this end, advanced control technologies can have a significant impact and is already a relatively mature technology for wind turbines. Though hydroelectric plants can use simple regulation systems, significant benefits have been shown to accrue from the appropriate use of the same control methods designed for wind turbine plants. This represents the key point of the paper. In fact, to date, the application communities connected with wind and hydraulic energies have had little communication, resulting in little cross fertilisation of control ideas and experience, particularly from the more mature wind area to hydrodynamic systems. Therefore, this paper examines the models and the application of control technology across both domains, both from a comparative and contrasting point of view, with the aim of identifying commonalities in models and control objectives, as well as potential solutions. Key comparative reference points include the articulation of the exployed models, specification of control objectives, development of high--fidelity simulators, and development of solution concepts. Not least, in terms of realistic system requirements are the set of physical and constraints under which such renewable energy systems must operate, and the need to provide reliable and robust control solutions, which respect the often remote and relatively inaccessible location of many onshore and offshore deployments.

This paper examines the transformative impact of data science, machine learning (ML), and artificial intelligence (AI) on network management in telecommunications, focusing on techniques such as network monitoring, predictive maintenance, anomaly detection, automated network configuration, and self-healing mechanisms. We analyze specific methodologies, including deep learning for anomaly detection and federated learning for predictive maintenance, and address current challenges such as data quality, system integration, and model interpretability. Emerging technologies like edge computing, federated learning, and quantum computing are explored for their potential to enhance predictive maintenance and network management. The paper provides an overview of how AI-driven solutions are revolutionizing telecom networks, offering unprecedented efficiency, reliability, and performance while highlighting the need for ongoing research to tackle complex issues of explainability and privacy.

In today's technologically advanced landscape, sensors feed critical data for accurate decision-making and actions. Ensuring the integrity and reliability of sensor data is paramount to system performance and security. This paper introduces an innovative approach utilizing discrete wavelet transforms (DWT) embedded within microcontrollers to scrutinize sensor data meticulously. Our methodology aims to detect and isolate malfunctions, misuse, or any anomalies before they permeate the system, potentially causing widespread disruption. By leveraging the power of wavelet-based analysis, we embed computational intelligence directly into the microcontrollers, enabling them to monitor and validate their outputs in real-time. This proactive anomaly detection framework is designed to distinguish between normal and aberrant sensor behaviors, thereby safeguarding the system from erroneous data propagation. Our approach significantly enhances the reliability of embedded systems, providing a robust defense against false data injection attacks and contributing to overall cybersecurity.

This paper establishes methods that quantify the structure of statistical interactions within a given data set using the characterization of information theory in cohomology by finite methods, and provides their expression in terms of statistical physic and machine learning. Following [1–3], we show directly that k multivariate mutual-informations (I_k) are k-coboundaries. The k-cocycles are given by I_k = 0, which generalize statistical independence to arbitrary dimension k. The topological approach allows to investigate Shannon’s information in the multivariate case without the assumptions of independent identically distributed variables. We develop the computationally tractable subcase of simplicial information cohomology represented by entropy H_k and information I_k landscapes. The I₁ component defines a self-internal energy functional U_k, and (−1)^k I_k,k≥2 components define the contribution to a free energy functional G_k of the k-body interactions. The set of information paths in simplicial structures is in bijection with the symmetric group and random processes, provides a topological expression of the 2nd law and points toward a discrete Noether theorem (1st law). The local minima of free-energy, related to conditional information negativity and the non-Shannonian cone of Yeung [4], characterize a minimum free energy complex. This complex formalizes the minimum free-energy principle in topology, provides a definition of a complex system, and characterizes a multiplicity of local minima that quantifies the diversity observed in biology. Finite data size effects and estimation bias severely constrain the effective computation of the information topology on data, and we provide simple statistical tests for the undersampling bias and for the k-dependences following [5]. We give an example of application of these methods to genetic expression and cell-type classification. The maximal positive I_k identifies the variables that co-vary the most in the population, whereas the minimal negative I_k identifies clusters and the variables that differentiate-segregate the most. The methods unravel biologically relevant I₁₀ with a sample size of 41. It establishes generic methods to quantify the epigenetic information storage and a unified epigenetic unsupervised learning formalism.

Quorum Sensing (QS) and Machine Learning (ML) hybrid systems represent a groundbreaking innovation in synthetic biology, offering unprecedented control and adaptability in microbial gene regulation and metabolic processes. QS, a microbial communication mechanism, is crucial for coordinating gene expression in response to population density, impacting behaviors such as biofilm formation, virulence, and resource optimization. However, traditional QS systems are constrained by their reliance on static, pre-programmed feedback loops, limiting their flexibility in dynamic, complex environments. This review highlights how integrating advanced ML algorithms—such as reinforcement learning and deep learning—into QS systems can overcome these limitations by enabling real-time data processing, predictive modeling, and dynamic feedback control. Through these innovations, QS-ML systems can autonomously adjust gene expression and metabolic outputs, making them more efficient and scalable in applications ranging from pathogen control to precision medicine and industrial biomanufacturing. Key case studies illustrate the successful deployment of QS-ML systems to combat antimicrobial resistance, optimize bio-production, and enhance therapeutic precision in cancer and immune modulation. Despite the clear advantages, challenges remain in data integration, system robustness, and regulatory oversight. Addressing these hurdles through interdisciplinary collaboration and developing scalable, multi-omics data platforms will be critical for advancing QS-ML systems from experimental settings to real-world applications. This review underscores the transformative potential of QS-ML systems in revolutionizing synthetic biology, with profound implications for personalized medicine, sustainable biomanufacturing, and environmental health.

AbstractThe escalating impact of artificial intelligence (AI) has birthed the fascinating technology of deepfakes, capable of meticulously crafting hyper-realistic audio-visual manipulations. Within the realm of healthcare, this technology presents a double-edged sword, brimming with potential for revolutionizing various facets of care delivery while simultaneously harboring significant ethical and practical challenges. This research delves into the complex narrative surrounding AI deepfakes in healthcare, meticulously analyzing both the exciting opportunities they offer, and the inherent risks associated with their implementation.Background:Traditional healthcare practices face limitations in patient engagement, accessibility, and training efficacy. Deepfakes, with their ability to simulate real-world scenarios and interactions, emerge as a potential solution, offering personalized patient education, immersive mental health interventions, remote consultations with virtual avatars, and realistic training simulations for medical professionals.Objective:This research aims to comprehensively understand the multifaceted impact of AI deepfakes in healthcare systems. It seeks to: Identify and analyze the potential benefits of deepfakes in specific healthcare applications. Assess the ethical and practical challenges associated with deepfake implementation in healthcare settings. Propose recommendations for safe, responsible, and ethical integration of deepfakes within the healthcare system.Results/Conclusion:The research findings illuminate a landscape replete with opportunities and challenges. Deepfakes offer the potential to enhance patient education, personalize mental health interventions, facilitate remote consultations, and revolutionize medical training. However, concerns regarding misinformation, ethical breaches, data privacy, and technical limitations pose significant challenges.The conclusion emphasizes the need for a balanced approach that capitalizes on the innovative potential of deepfakes while mitigating potential harm. Collaborative efforts involving healthcare professionals, technologists, and policymakers are crucial for establishing ethical frameworks, ensuring responsible development, and harnessing the positive power of deepfakes to build a future where healthcare benefits from cutting-edge technology while prioritizing patient well-being and ethical principles.

We introduce the Concept-Model-Graph-View Cycle (CMGVC). The CMGVC facilitates coherent architecture analysis, reasoning, insight, and decision-making based on conceptual models that are transformed into a generic, robust graph data structure (GDS). The GDS is then transformed into multiple views of the model, which inform stakeholders in various ways. This GDS-based approach decouples the view from the model and constitutes a powerful enhancement of model-based systems engineering (MBSE). The CMGVC applies the rigorous foundations of Category Theory, a mathematical framework of representations and transformations. We show that modeling languages are categories, drawing an analogy to programming languages. The CMGVC architecture is superior to direct transformations and language-coupled common representations. We demonstrate the CMGVC to transform a conceptual system architecture model built with the Object Process Modeling Language (OPM) into dual graphs and a stakeholder-informing matrix that stimulates system architecture insight.

A two-year experiment was conducted with a local maize hybrid under full irrigation (F), deficit irrigation (D) and rainfed conditions (R) to estimate maize evapotranspiration in Bosnia and Herzegovina. Three approaches (Allen & Pereira (A&P), SIMDualKc (SD), and Vegetation Index (VI)) were used to estimate the actual crop coefficient (Kc act), actual basal crop coefficient (Kcb act), and actual crop evapotranspiration (ETc act) were applied with the dual crop coefficient method and remote sensing (RS) data. While Kcb act from all approaches matched FAO56 tabulated values, SD showed differences, in comparison to A&P, of up to 0.24 in D and R conditions, especially in initial and mid-season stages. VI demonstrated very good performance in all treatments. In F, the obtained Kc act for all approaches during the initial and end stages were higher than the tabulated values, ranging from 0.71-0.87 for Kc ini act and from 0.80-1.06 for Kc end act, while the mid-season period showed very good agreement with the literature. Maize crop evapotranspiration range is 769-813 mm, 480-752 mm, and 332-618 mm for F, D and R, respectively. The results confirmed the suitability of both approaches (SD and VI) to estimate maize crop evapotranspiration under F, with the VI approach demonstrating an advantage in calculating Kcb act, Kc act, and ETc act values under water stress conditions. The 67.6% increase in grain yields with irrigation emphasizes the need to transition from rainfed to irrigation-dependent agriculture, even for drought-resistant crops like maize.

The COVID-19 led to changes modifying the role of digital transformation and unleashing unparalleled opportunities to improve business production processes in all three dimensions of sustainability - economic, social, and environmental through data-driven innovative service implications that significantly impact restaurant business, resulting in an increased competitive advantage. This paper identifies the innovative service implications and summarizes sustainable social systems measures in the context of strategic management in the restaurant industry triggered by COVID-19. Based on in-depth interviews with sixteen key experts in the restaurant industry, the paper clarifies and concretizes the rapidly transforming problem of identifying the main changes in the restaurant business, using three dimensions: consumer demand, corporate strategy optimization, and the use of the company's innovative potential. The findings reveal how companies need to expand their digital strategies and adapt their management approach to all stakeholders bringing sustainable business development in the post-pandemic period into focus. This paper serves as a framework for understanding the digital transformation role in resilient business management within restaurant social systems, with friction occurring along the workflow from kitchen to customer.

This paper presents a comprehensive exploration of Data Quality terminology, revealing a significant lack of standardisation in the field. We propose a novel approach to aggregating disparate Data Quality terms used to describe the multiple facets of Data Quality, under common umbrella terms, with a focus on the ISO 25012 standard. Our aim is to design a Data Quality Data Model that serves as a universally applicable framework for Data Quality assessment. We introduce four additional Data Quality dimensions: Governance, Usefulness, Quantity, and Semantics, enhancing specificity, complementing the framework established by the ISO 25012 standard, and understanding of Data Quality aspects. The ISO 25012 standard, while tailored for software development, offers a foundation for the development of our proposed Data Quality Data Model. This is due to the prevalent nature of software development across a multitude of domains. In contrast, frameworks like ALCOA+ that are specific to certain domains lack the ability to be generalised. The model we propose can be seen as a "Rosetta Stone" for Data Quality terminology, facilitating a seamless communication of Data Quality between different domains when collaboration is required to tackle cross-domain projects or challenges.

We investigate some information properties of consecutive k-out-of-n:G systems in light of fractional generalized cumulative residual entropy. We firstly derive a formula to compute fractional generalized cumulative residual entropy related to the system's lifetime and explore its preservation properties in terms of established stochastic orders. Additionally, we obtain useful bounds. To aid practical applications, we propose two non parametric estimators for the fractional generalized cumulative residual entropy in these systems. The efficiency and performance of these estimators are illustrated using simulated and real datasets.

In recent years, more and more health data are being generated. These data come not only from professional health systems, but also from wearable devices. All these data combined form ‘big data’ that can be utilized to optimize treatments for each unique patient (‘precision medicine’). To achieve this precision medicine, it is necessary that hospitals, academia and industry work together to bridge the ‘valley of death’ of translational medicine. However, hospitals and academia often have problems with sharing their data, even though the patient is actually the owner of his/her own health data, and the sharing of data is associated with increased citation rate. Academic hospitals usually invest a lot of time in setting up clinical trials and collecting data, and want to be the first ones to publish papers on this data. The idea that society benefits the most if the patient’s data are shared as soon as possible so that other researchers can work with it, has not taken root yet. There are some publicly available datasets, but these are usually only shared after studies are finished and/or publications have been written based on the data, which means a severe delay of months or even years before others can use the data for analysis. One solution is to incentivize the hospitals to share their data with (other) academic institutes and the industry. Here we discuss several aspects of data sharing in the medical domain: publisher requirements, data ownership, support for data sharing, data sharing initiatives and how the use of federated data might be a solution. We also discuss some potential future developments around data sharing.

The rapid technological progress has ushered in a new era of human-computer interaction, where the distinction between the physical and virtual realms is becoming increasingly blurred. This research paper explores the profound and multifaceted intersection of Human-Data Interaction (HDI) and Data Virtualization (DV), examining how emerging technologies can significantly enhance the exploration, comprehension, and utilization of complex, multidimensional data sets. Informed by the insights gleaned from prior research in this domain , the present study delves into the potential of DV techniques to improve HDI, with a particular focus on three experimental investigations conducted within the realms of education, healthcare, and retail. The findings reveal the benefits and potential challenges associated with the implementation of DV in these diverse contexts, offering valuable guidance for the design and development of future HDI systems. Drawing upon a diverse array of authoritative sources, this paper presents a holistic, forward-looking perspective on the future of HDI, underscoring the critical role that DV will play in shaping the next generation of human-computer interfaces and facilitating a deeper, more intuitive understanding of the digital world. Furthermore, the paper presents a preliminary framework for integrating HDI principles into standard design practices. This framework outlines key considerations and guidelines to help designers and developers incorporate HDI techniques more effectively into the development of data-driven applications and interfaces.The proposed framework outlines key considerations for enhancing data accessibility and comprehension, empowering users to exercise greater control over their data, and cultivating transparent dialogues between data providers and end-users. By establishing this conceptual foundation, the paper aims to facilitate the seamless integration of HDI principles into standard design practices, ultimately leading to more intuitive, user-centric, and ethically-grounded approaches to data interaction and utilization.

In this work, a hybrid component Fault Detection and Diagnosis (FDD) approach for industrial sensor systems is established and analyzed, to provide a hybrid schema that combines the advantages and eliminates the drawbacks of both model-based and data-driven methods of diagnosis. Moreover, it shines the light on a new utilization of Random Forest (RF) together with model-based diagnosis, beyond its ordinary data-driven application. RF is trained and hyperparameter tuned using three-fold cross validation over a random grid of parameters using random search, to finally generate diagnostic graphs as the dynamic, data-driven part of this system. This is followed by translating those graphs into model-based rules in the form of if-else statements, SQL queries or semantic queries such as SPARQL, in order to feed the dynamic rules into a structured model essential for further diagnosis. The RF hyperparameters are consistently updated online using the newly generated sensor data to maintain the dynamicity and accuracy of the generated graphs and rules thereafter. The architecture of the proposed method is demonstrated in a comprehensive manner, and the dynamic rules extraction phase is applied using a case study on condition monitoring of a hydraulic test rig using time-series multivariate sensor readings.

In this work, A hybrid component Fault Detection and Diagnosis (FDD) approach for industrial sensor systems is established and analyzed, to provide a hybrid schema that combines the advantages and eliminates the drawbacks of both model-based and data-driven methods of diagnosis. Moreover, spotting the light on a new utilization of Random Forest (RF) together with model-based diagnosis, beyond its ordinary data-driven application. RF is trained and hyperparameter tuned using 3-fold cross-validation over a random grid of parameters using random search, to finally generate diagnostic graphs as the dynamic, data-driven part of this system. Followed by translating those graphs into model-based rules in the form of if-else statements, SQL queries or semantic queries such as SPARQL, in order to feed the dynamic rules into a structured model essential for further diagnosis. The RF hyperparameters are consistently updated online using the newly generated sensor data, in order to maintain the dynamicity and accuracy of the generated graphs and rules thereafter. The architecture of the proposed method is demonstrated in a comprehensive manner, as well as the dynamic rules extraction phase is applied using a case study on condition monitoring of a hydraulic test rig using time series multivariate sensor readings.

Nowadays, one of the greatest challenges in Data Meshes revolves around detecting and creating Data Domains and Data Products for providing the ability to adapt easily and quickly to changing business needs. This requires a disciplined approach to identify, differentiate and prioritize distinct data sources according to their content and diversity. The current paper tackles this highly com-plicated issue and suggests a standardized approach that integrates the concept of Data Blueprints with Data Meshes. In essence, a novel standardization framework is proposed that creates Data Products using a metadata semantic enrichment mechanism, the latter also offering Data Domain readiness and alignment. The approach is demonstrated using real-world data produced by mul-tiple sources in a poultry meat production factory. A set of functional attributes is used to compare qualitatively the proposed approach against existing data structures utilized in storage architectures with quite promising results. Finally, experimentation with different scenarios varying in data product complexity and granularity suggests successful performance.

With an increasing amount of biological data available publicly, there is a need for a guide on how to successfully download and use this data. The Ten simple rules for using public biological data are: 1) use public data purposefully in your research, 2) evaluate data for your use case, 3) check data reuse requirements and embargoes, 4) be aware of ethics for data reuse, 5) plan for data storage and compute requirements, 6) know what you are downloading, 7) download programmatically and verify integrity, 8) properly cite data, 9) make reprocessed data and models Findable, Accessible, Interoperable, and Reusable (FAIR) and share, and 10) make pipelines and code FAIR and share. These rules are intended as a guide for researchers wanting to make use of available data and to increase data reuse and reproducibility.

Improvements in web platforms for data exchange and trading are creating more opportunities for users to obtain data from data providers of different domains. However, the current data exchange platforms are limited to unilateral information provision from data providers to users. In contrast, there are insufficient means for data providers to learn what kinds of data users desire and for what purposes. In this paper, we propose and discuss the description items for sharing users’ call for data as data requests in the data marketplace. We also discuss structural differences in data requests and providable data using variables, as well as possibilities of data matching. In the study, we developed an interactive platform, treasuring every encounter of data affairs (TEEDA), to facilitate matching and interactions between data providers and users. The basic features of TEEDA are described in this paper. From experiments, we found the same distributions of the frequency of variables but different distributions of the number of variables in each piece of data, which are important factors to consider in the discussion of data matching in the data marketplace.

The study investigated the usage of open data in public organizations, focusing on the motives, preferences, and governance ideals that determine their quality. The study shed light on how open data platforms are created and improved, as well as their influence on government operations. The primary goal was to understand the motivations behind the usage of open data, evaluate gov-ernance ideals, and examine institutions' efforts to standardize data formats. Hierarchical regres-sion analysis divides variables into core reasons and different preferences, demonstrating a need for "diversification" in order to use open data effectively. Efficiency, accountability, community impact, knowledge, and high-quality service delivery are all emphasized in governance value analysis. The institution's dedication to standardizing open data formats is evidenced by legislative measures and the integration of many technologies. The findings illustrate the institution's dual strategy of em-ploying traditional techniques and new technologies for effective data management. The report suggests increasing data openness and standardization, investing in ongoing training, upgrading alerting and awareness systems, and adopting specific regulations for open data use. Monitoring and feedback techniques are critical for adjusting and refining open data services to satisfy de-velopment needs. This study adds to the scientific knowledge of open data use by highlighting important motives, preferences, and governance ideals. The offered guidelines provide practical insights for public organizations looking to improve their open data platforms by promoting openness, efficiency, and community participation.

This paper presents a robust and efficient fault detection and diagnosis framework for handling small faults and oscillations in synchronous generator (SG) systems. The proposed framework utilizes the Brunovsky form representation of nonlinear systems to mathematically formulate the fault detection problem. A differential-flatness model of SG systems is provided to meet the conditions of the Brunovsky form representation. A combination of high-gain observer and group method of data handling neural network is employed to estimate the trajectory of the system and to learn/ approximate the fault and uncertainties associated functions. The fault detection mechanism is developed based on output residual generation and monitoring so that any unfavourable oscillation and/or fault occurrence can be detected rapidly. Accordingly, an average L1-norm criterion is proposed for rapid decision making of faulty situations. The performance of the proposed framework is investigated for two benchmark scenarios which are actuation fault and fault impact on system dynamics. The simulation results demonstrate the capacity and effectiveness of the proposed solution for rapid fault detection and diagnosis in SG systems in practice, and thus enhancing service maintenance, protection, and life cycle of SGs.

As global concerns about climate change intensify, the need for effective strategies to reduce carbon emissions has never been more urgent. This paper explores the crucial role of data automation (DA) and decision support systems (DSS) in enhancing decarbonation efforts within the realms of solid waste management (SWM), wastewater treatment (WWT), and contaminated soil remediation (CSR). Specifically, the paper provides: (i) an overview of the carbon footprint (CFP) in relation to environmental management (EM) and the role of DA and DSS in decarbonization; (ii) DA case studies in areas of SWM, WWT, and CSR; (iii) 3. life cycle assessment (LCA) based DSS case studies in areas of SWM, WWT, and CSR; (iv) multi-criteria decision analysis (MCDA) based DSS case studies in areas of SWM, WWT, and CSR; and (v) optimal contractual delivery methods based DSS case studies in EM practices. The analysis disclosed that adoption of DA and DSS in SWM, WWT, and CSR holds significant potential for decarbonizing these EM processes. By optimizing operations, enhancing resource efficiency, and integrating renewable energy sources, these technologies contribute to the reduction of GHG emissions and promote sustainable environmental practices. As the demand for more effective and eco-friendly solutions grows, the role of DA and DSS will become increasingly pivotal in achieving global decarbonization goals.

In the rapidly evolving field of data management, numerous terminologies, such as data warehouse, data lake, data lakehouse, and data mesh , have emerged, each representing a unique analytical data architecture. However, the distinctions and similarities among these paradigms often remain unclear. The present paper aimed to navigate the data architecture landscape by conducting a comparative analysis of these paradigms. The analysis a identified and elucidated the differences and similari- ties in features, capabilities, and limitations of these architectural constructs. The study outcome serves as a comprehensive guide, assisting practitioners in selecting the most suitable analytical data architecture for their specific applications.

Data Meshes is an approach to data architecture and organization that treats data as a product and focuses on decentralizing data ownership and access. It has recently emerged as a field that presents quite a few challenges related to data ownership, governance, security, monitoring, and observability. To address these challenges, this paper introduces an innovative algorithmic framework leveraging data blueprints to enable the dynamic creation of Data Meshes and Data Products in response to user requests, ensuring that stakeholders will have access to specific portions of the Data Mesh as needed. Ownership and governance concerns are addressed through a unique mechanism involving Blockchain and Non-Fungible Tokens (NFTs). This facilitates secure and transparent transfer of data ownership, with the ability to mint time-based NFTs. By combining these advancements with the fundamental tenets of Data Meshes, this research offers a comprehensive solution to the challenges surrounding data ownership and governance. It empowers stakeholders to navigate the complexities of data management within a decentralized architecture, ensuring a secure, efficient, and user-centric approach to data utilization. The proposed framework is demonstrated using real-world data from a poultry meat production factory.

Soil water balance (SWB) in woody crops is sometimes difficult to estimate with one-dimensional models because these crops do not completely cover the soil and usually have a deep root system, particularly when cropped under rainfed conditions in a Mediterranean climate. In this study, the actual crop evapotranspiration (ETc act) is estimated with the soil water balance model SIMDualKc which uses the dual-Kc approach (relating the fraction of soil cover with the crop coefficients) to improve the estimation of the water requirements of a rainfed vineyard, using data from a deep soil profile. The actual basal crop coefficient (Kcb act) obtained using the SIMDualKc model was compared with the Kcb act estimated using the A&P approach, which is a simplified approach based on measurements of the fraction of ground cover and crop height. Spectral vegetation indices derived from Landsat-5 satellite data were used to determine the fraction of ground cover (fc VI) and thus, the density coefficient (Kd). The SIMDualKc model was calibrated using soil water content (SWC) measurements down to a depth of 1.85 meters, which significantly improved the conditions for using a SWB estimation model. The test of the model was performed using a different SWC dataset. A good agreement between simulated and field measured SWC was observed for both data sets along the crop season, with RMSE<12.0 mm, NRMSE <13%. The calibrated Kcb values were 0.15, 0.60 and 0.52 for the initial, mid-season, and end season, respectively. The ratio between actual (ETc act) and crop evapotranspiration (ETc) was quite low between veraison and maturity (mid-season), corresponding to 36%, indicating that the rainfall was not sufficient to satisfy the vineyards water requirements. Spectral vegetation indices used to compute fc VI were unable to fully track the plants’ conditions when water stress. However, ingestion of data from remote sensing showed promising results that could be used to support decisions making in irrigation scheduling. Further studies on the use of the A&P approach using remote sensing data are required.

This paper describes the proposal and development of a proof of concept (PoC) for a data logger system designed for operation and fault detection in bench testing of combustion engines. The main objective was to develop a data logger system that collects data on vibration, sound, temperature, and CO2 levels to identify ignition and combustion faults, thereby contributing to reducing greenhouse gas emissions (GHG). The paper presents (i) the proposal and development and (ii) the open-source code: proof of concept for a data logger system focused on detecting faults and monitoring the operational condition of benchtop combustion engines. The results indicate the feasibility of the PoC for data acquisition and dataset creation for Research and Development purposes.

The proposed method deals with the problem of data privacy and sharing when processing personal mobility tracking data. Previous methods concentrate on producing highly detailed data on short-term and restricted areas, e.g. for autonomous driving scenarios. Another possibility consists of city-wide scales and beyond, that are used to predict general traffic flows. The presented approach takes the tracked mobility behavior of individuals to create coherent new mobility data that reflects the long-term mobility behavior of the person, guaranteeing location persistency and sound embedding within the point-of-interest structure of the observed area. After an analysis and clustering step with the original data, the area is distributed into a geospatial grid structure (H3 is used here), and the neighborhood relationships between the grids are interpreted as a graph. A feed-forward-autoencoder and a graph encoding-decoding network generate a latent space representation of the area. The original clustered data is associated with their respective H3 grids. With a greedy algorithm approach and concerning privacy strategies, new combinations of grids are top-level patterns for individual mobility behavior. Concrete locations are found and connected within the grids based on the original data. The described method is then applied to a study with 1000 participants from the city of Munich in Germany, and the results are described, showing the application of the approach in generating synthetic data, enabling further research on individual mobility behavior and patterns. The result is a sharable dataset on the same abstraction level as the input data, which makes it interesting, particularly for machine learning applications.

Network effects, economies of scale, and lock-in-effects increasingly lead to a concentration of digital resources and capabilities, hindering the free and equitable development of digital entrepreneurship (SDG9), new skills, and jobs (SDG8), especially in small communities (SDG11) and their small and medium-sized enterprises (“SMEs”). To ensure the affordability and accessibility of technologies, promote digital entrepreneurship and community well-being (SDG3), and protect digital rights, we propose data cooperatives [1,2] as a vehicle for secure, trusted, and sovereign data exchange [3,4]. In post-pandemic times, community/SME-led cooperatives can play a vital role by ensuring that supply chains to support digital commons are uninterrupted, resilient, and decentralized [5]. Digital commons and data sovereignty provide communities with affordable and easy access to information and the ability to collectively negotiate data-related decisions. Moreover, cooperative commons (a) provide access to the infrastructure that underpins the modern economy, (b) preserve property rights, and (c) ensure that privatization and monopolization do not further erode self-determination, especially in a world increasingly mediated by AI. Thus, governance plays a significant role in accelerating communities’/SMEs’ digital transformation and addressing their challenges. Cooperatives thrive on digital governance and standards such as open trusted Application Programming Interfaces (APIs) that increase the efficiency, technological capabilities, and capacities of participants and, most importantly, integrate, enable, and accelerate the digital transformation of SMEs in the overall process. This policy paper presents and discusses several transformative use cases for cooperative data governance. The use cases demonstrate how platform/data-cooperatives, and their novel value creation can be leveraged to take digital commons and value chains to a new level of collaboration while addressing the most pressing community issues. The proposed framework for a digital federated and sovereign reference architecture will create a blueprint for sustainable development both in the Global South and North.

In this paper, intrusion detection systems are thoroughly investigated utilizing the CSE-CIC-IDS-2018 dataset. The research is divided into three key phases: first, applying Data Cleaning, Exploratory Data Analysis, and Data Normalization techniques (min-max and z-score) for preparing data across distinct classifiers. Second, feature importance is reduced using a combination of Principal Component Analysis (PCA) and Random Forest (RF), with the goal of improving processing speed and decreasing model complexity. This stage comprises a comparison with the entire dataset. Finally, machine learning algorithms (XGBoost, CART, DT, KNN, MLP, RF, LR, and Bayes) are applied to specific features and preprocessing approaches. Surprisingly, the XGBoost, DT, and RF models outperform in both ROC values and CPU runtime. Following evaluation, which includes PCA and RF feature selection, an optimal set is produced.

The scientific community has long benefited from the opportunities provided by data reuse. Recognizing the need to identify the challenges and bottlenecks to reuse in the agricultural research community and propose solutions for them, the data reuse working group was started within the AgBioData consortium (https://www.agbiodata.org/) framework. Here, we identify the limitations of data standards, metadata deficiencies, data interoperability, data ownership, data availability, user skill level, resource availability, and equity issues, with a specific focus on agricultural genomics research. We propose possible solutions stakeholders could implement to mitigate and overcome these challenges and provide an optimistic perspective on the future of genomics and transcriptomics data reuse.

To gain insight into the real-life care of patients in the healthcare system, data from hospital information systems and insurance systems are required. Consequently, linking clinical data with claims data is necessary. To ensure their syntactic and semantic interoperability, the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) was chosen. However, there is no detailed guide that would allow researchers to follow a consistent process for data harmonization. Thus, the aim of this paper is to conceptualize a generic data harmonization process for OMOP CDM. For this purpose, we conducted a literature review focusing on publications that address the harmonization of clinical or claims data in OMOP CDM. Subsequently, the process steps used and their chronological order were extracted for each included publication. The results were then compared to derive a generic sequence of the process steps. From 23 publications included, a generic data harmonization process for OMOP CDM was conceptualized, consisting of nine process steps: dataset specification, data profiling, vocabulary identification, coverage analysis of vocabularies, semantic mapping, structural mapping, extract-transform-load-process, qualitative and quantitative data quality analysis. This process can be used as a step-by-step guide to assist other researchers in harmonizing source data in OMOP CDM.

Context: Despite the effort put into developing standards for structuring construction cost, and the strong interest into the field. Most construction companies still perform the process of data gathering and processing manually. That provokes inconsistencies, different criteria when classifying, misclassifications, and the process becomes very time-consuming, particularly on big projects. Additionally, the lack of standardization makes very difficult the cost estimation and comparison tasks. Objective: To create a method to extract and organize construction cost and quantity data into a consistent format and structure, to enable rapid and reliable digital comparison of the content. Method: The approach consists of a two-step method: Firstly, the system implements data mining to review the input document and determine how it is structured based on the position, format, sequence, and content of descriptive and quantitative data. Secondly, the extracted data is processed and classified with a combination of data science and experts’ knowledge to fit a common format. Results: A big variety of information coming from real historical projects has been successfully extracted and processed into a common format with 97.5% of accuracy, using a subset of 5770 assets located on 18 different files, building a solid base for analysis and comparison. Conclusion: A robust and accurate method was developed for extracting hierarchical project cost data to a common machine-readable format to enable rapid and reliable comparison and benchmarking.

The rising importance of Big Data in modern information analysis is supported by vast quantities of user data, but it is only possible to collect sufficient data for all tasks within certain data-gathering contexts. There are many cases where a domain is too novel, too niche, or too sparsely collected to adequately support Big Data tasks. To remedy this, we have created ADG Engine that allows for the generation of additional data that follows the trends and patterns of the data that’s already been collected. Using a database structure that tracks users across different activity types, ADG Engine can use all available information to maximize the authenticity of the generated data. Our efforts are particularly geared towards data analytics by identifying abnormalities in the data and allowing the user to generate normal and abnormal data at custom ratios. In situations where it would be impractical or impossible to expand the available dataset by collecting more data, it can still be possible to move forward with algorithmically expanded data datasets.

Large datasets that enable researchers to perform investigations with unprecedented rigor are growing increasingly common in neuroimaging. Due to the simultaneous increasing popularity of open science, these state-of-the-art datasets are more accessible than ever to researchers around the world. While analysis of these samples has pushed the field forward, they pose a new set of challenges that might cause difficulties for novice users. Here, we offer practical tips for working with large datasets from the end-user’s perspective. We cover all aspects of the data life cycle: from what to consider when downloading and storing the data, to tips on how to become acquainted with a dataset one did not collect, to what to share when communicating results. This manuscript serves as a practical guide one can use when working with large neuroimaging datasets, thus dissolving barriers to scientific discovery.

Despite the demonstrated benefits of data monetization initiatives in achieving competitive advantages, many of these efforts struggle to realize their potential. Companies often find it challenging to sustain even initially successful data monetization initiatives due to significant data quality issues. This reflects a disconnect between advancements in data monetization research—spanning digitization, digitalization, and digital transformation—and practical implementation within companies. Consequently, misguided approaches to data monetization are relatively common. A critical prerequisite for successful data monetization is the establishment and maintenance of clean, high-quality data. This study underscores the importance of data quality by conducting an in-depth analysis of Medical Inc., a company engaged in preparing pristine customer master data for advanced customer analytics. The investigation aims to elucidate Medical Inc.’s approach to addressing data cleanliness challenges and to distill a general framework for the customer master data cleansing process. This framework illuminates a relatively unexplored aspect of data monetization supplementing existing literature on digitization, digitalization, and digital transformation.

Modern experimental astroparticle physics features large-scale setups measuring different messengers, namely high-energy particles generated by cosmic accelerators (e.g. supernova remnants, active galactic nuclei, etc): cosmic and gamma rays, neutrinos and recently discovered gravitational waves. Ongoing and future experiments are distributed over the Earth including ground, underground/underwater setups as well as balloon payloads and spacecrafts. The data acquired by these experiments have different formats, storage concepts and publication policies. Such differences are a crucial issue in the era of big data and of multi-messenger analysis strategies in astroparticle physics. We propose a service ASTROPARTICLE.ONLINE in the frame of which we develop an open science system which enables to publish, store, search, select and analyse astroparticle physics data. The cosmic-ray experiments KASCADE-Grande and TAIGA were chosen as pilot experiments to be included in this framework. In the first step of our initiative we will develop and test the following components of the full data life cycle concept: (i) describing, storing and reusing of astroparticle data; (ii) software for performing multi-experiment and multi-messenger analyses like deep-learning methods; (iii) outreach including example applications and tutorial for students and scientists outside the specific research field. In the present paper we describe the concepts of our initiative, and in particular the plans toward a common, federated astroparticle data storage.

As of 2020, public data for game ratings provided by Game Ratings And Administration Committee(GRAC) are more limited than public data for movie and video ratings provided by Korea Media Ratings Board and do not provide data which allow us to see information on ratings clearly and in detail. To get information on game ratings, we need to find information by searching for specific target on homepage which is inconvenient for us. In order to improve such inconvenience and extend scope of provision in public data, the author of this paper intends to study public data API which has been extended based on information on video ratings. To draw items to be extended, this study analyzes data for ratings on homepage of GRAC and designs collection system to build database. This study intends to implement system that provides data collected based on extended public data items in a form which users want. This study is expected to provide information on ratings to GRAC which will strengthen fairness and satisfy game users and people’s rights to know and contribute to promotion and development of game industry.

: Cybersecurity has become a critical area in the digital field in recent years. The expansion of networks has revolutionised the way network structures are organised and managed. However, with increased connectivity and the growing complexity of modern networks, the threat of cyber-attacks has become more intense. As technology continues to advance, it brings both opportunities and challenges. One of the major challenges is the need to secure networks and sensitive data from various malicious activities. Traditional networks have evolved to include Software Defined Network (SDN), which offers a more flexible and programmable framework. Researchers should focus on detecting attacks in SDN because SDN networks are becoming more popular and attractive targets for clients due to their programmability and dynamic nature. The centralised controller, known as the backbone of an SDN, becomes a single point of failure and a potential target for attackers if not properly secured. Researchers need to emphasise the detection of attacks in SDN in order to mitigate these risks. By understanding the potential vulnerabilities and attack methods specific to SDN, researchers can develop effective detection approaches and propose countermeasures. This methodology helps protect the network from potential threats and minimises the impact of successful attacks. Therefore, this survey paper provides a review of Intrusion Detection Systems (IDSs) in Software-Defined Networks (SDN) to provide a thorough understanding of SDN security issues.

The study was conducted on applying machine learning and data mining methods to personalizing the treatment. This allows investigating individual patient characteristics. Personalization is built on the clustering method and associative rules. It was suggested to determine the average distance between instances for optimal performance metrics finding. The formalization of the medical data pre-processing stage for finding personalized solutions based on current standards and pharmaceutical protocols is proposed. The model of patient data is built. The paper presents the novel approach to clustering built on ensemble of cluster algorithm with better than k-means algorithm Hopkins metrics. The personalized treatment usually is based on decision tree. Such approach requires a lot of computation time and cannot be paralyzed. Therefore, it is proposed to classify persons by conditions, to determine deviations of parameters from the normative parameters of the group, as well as the average parameters. This made it possible to create a personalized approach to treatment for each patient based on long-term monitoring. According to the results of the analysis, it becomes possible to predict the optimal conditions for a particular patient and to find the medicaments treatment according to personal characteristics.