This paper presents a comprehensive exploration of Data Quality terminology, revealing a significant lack of standardisation in the field. We propose a novel approach to aggregating disparate Data Quality terms used to describe the multiple facets of Data Quality, under common umbrella terms, with a focus on the ISO 25012 standard. Our aim is to design a Data Quality Data Model that serves as a universally applicable framework for Data Quality assessment. We introduce four additional Data Quality dimensions: Governance, Usefulness, Quantity, and Semantics, enhancing specificity, complementing the framework established by the ISO 25012 standard, and understanding of Data Quality aspects. The ISO 25012 standard, while tailored for software development, offers a foundation for the development of our proposed Data Quality Data Model. This is due to the prevalent nature of software development across a multitude of domains. In contrast, frameworks like ALCOA+ that are specific to certain domains lack the ability to be generalised. The model we propose can be seen as a "Rosetta Stone" for Data Quality terminology, facilitating a seamless communication of Data Quality between different domains when collaboration is required to tackle cross-domain projects or challenges.

As Artificial Intelligence (AI) technology, particularly Machine Learning algorithms, becomes increasingly ubiquitous, our abilities to understand and interpret AI and machine learning algorithms are becoming increasingly desirable. Visualization has been used as a common tool to view and understand complex machine learning processes. In this paper, we will focus on developing a general framework for the visualization of machine learning models as a scalar valued multi-dimensional function to help users understand how the models behave over different viewing spaces. We first give a formal definition of the visualization problem. Interpolation-based morphing and subspace sampling techniques are applied to generate various renderings through projections and cross-sections of the model space as 3D surfaces or heatmap images. This method will be applied to two real-world datasets and applications: the diagnosis of Alzheimer's Disease (AD) using a human brain networks dataset and a real-world benchmark dataset for predicting home credit default risks. The visualizations show that different machine learning algorithms can behave quite differently under different conditions.

Context: Despite the effort put into developing standards for structuring construction cost, and the strong interest into the field. Most construction companies still perform the process of data gathering and processing manually. That provokes inconsistencies, different criteria when classifying, misclassifications, and the process becomes very time-consuming, particularly on big projects. Additionally, the lack of standardization makes very difficult the cost estimation and comparison tasks. Objective: To create a method to extract and organize construction cost and quantity data into a consistent format and structure, to enable rapid and reliable digital comparison of the content. Method: The approach consists of a two-step method: Firstly, the system implements data mining to review the input document and determine how it is structured based on the position, format, sequence, and content of descriptive and quantitative data. Secondly, the extracted data is processed and classified with a combination of data science and experts’ knowledge to fit a common format. Results: A big variety of information coming from real historical projects has been successfully extracted and processed into a common format with 97.5% of accuracy, using a subset of 5770 assets located on 18 different files, building a solid base for analysis and comparison. Conclusion: A robust and accurate method was developed for extracting hierarchical project cost data to a common machine-readable format to enable rapid and reliable comparison and benchmarking.

This article affords the question of methane emissions in the context of the ESG framework at the global level. The World Bank ESG-Environmental, Social, and Governance database was used. The data refers to 193 countries for a period between 2011 and 2020. The econometric models used are Panel Data with Random Effects, Panel Data with Fixed Effects, Pooled Ordinary Least Squares-OLS, and Weighted Least Squares-WLS. The impact of methane on the ESG model was calculated through three equations capable of analyzing the impact of methane emissions, respectively, con-cerning the E-Environmental, S-Social, and G-Governance components of the ESG model. The re-sults show that methane emissions tend to increase even in the improvement of ESG conditions at world level.

In the field of Natural Language Processing (NLP), Large Language Models (LLMs) have shown great potential in document-level event extraction tasks, but existing methods face challenges in the design of prompts. To address this issue, we propose an optimization strategy called "Definition-driven Document-level Event Extraction (DDEE)." By adjusting the length of the prompt and enhancing the clarity of heuristics, we have significantly improved the event extraction performance of LLMs. We used data balancing techniques to solve the long-tail effect problem, enhancing the model's generalization ability for event types. At the same time, we refined the prompt to ensure it is both concise and comprehensive, adapting to the sensitivity of LLMs to the style of prompts. In addition, the introduction of structured heuristic methods and strict limiting conditions has improved the precision of event and argument role extraction. These strategies not only solve the prompt engineering problems of LLMs in document-level event extraction but also promote the development of event extraction technology, providing new research perspectives for other tasks in the NLP field.

The exponential growth of publicly available omics data presents both an opportunity and a challenge for biomedical researchers, particularly those in low- and middle-income countries (LMICs). The Collective Omics Data to Knowledge (CD2K) initiative aims to address this challenge by providing an accessible framework for biomedical research training. This review describes the development and implementation of the CD2K program, which comprises three core modules: COD1 (reductionist interpretation of collective omics data), COD2 (creation of curated dataset collections), and COD3 (re-analysis of omics data on a global scale). The CD2K approach emphasizes the reuse and reinterpretation of public data, integrating literature mining and emerging technologies like Large Language Models (LLMs). A key feature of the program is its focus on accessibility, designed to make the exploitation of large-scale datasets amenable to researchers without extensive data science skills. The curriculum aims to equip trainees with a range of skills, from basic data interpretation to more advanced bioinformatics analysis, with an emphasis on producing tangible outputs such as peer-reviewed publications, which directly address career development needs. The CD2K initiative has involved researchers from multiple institutions across several countries, resulting in several publications and publicly available dataset collections. While still in its early stages, the program shows promise in providing a structured framework for leveraging public omics data in biomedical research. This review also discusses the current limitations of the CD2K approach and ongoing efforts to expand its reach. By offering an accessible model for building research capacity, the CD2K initiative represents a step towards fostering data-driven discovery in global biomedical research, particularly in resource-limited settings.

Hydraulic relationships are important for water resource management, hazard prediction, and modelling. Since Leopold first identified power law expressions that could relate streamflow to top-width, depth, and velocity, hydrologists have been estimating ‘At-a-station Hydraulic Geometries’ (AHG) to describe average flow hydraulics. As the amount of data, data sources, and application needs increase, the ability to apply, integrate and compare disparate and often noisy data is critical for applications ranging from reach to continental scales. However, even with quality data, the standard practice of solving each AHG relationship independently can lead to solutions that fail to conserve mass. The challenge addressed here is how to extend the physical properties of the AHG relations, while improving the way they are hydrologically addressed and fit. We present a framework for minimizing error while ensuring mass conservation at reach - or hydrologic Feature - scale geometries’(FHG) that complies with current state-of-the-practice conceptual and logical models. Through this framework, FHG relations are fit for the United States Geological Survey’s (USGS) Rating Curve database, the USGS HYDRoacoustic dataset in support of the Surface Water Oceanographic Topography satellite mission (HYDRoSWOT), and the hydraulic property tables produced as part of the NOAA/Oakridge Continental Flood Inundation Mapping framework. The paper describes and demonstrates the accuracy, interoperability, and application of these relationships to flood modelling and presents this framework in an R package.

As an important part of coastal wetlands, tidal flats provide unique ecosystem services and functions. China's tidal flats are significantly threatened by industrialization, urbanization, aquaculture expansion and coastline reconstruction, and there is an urgent need for sustainable strategies to balance the protection and utilization of tidal flats. Remote sensing technology can realize large-scale spatiotemporal research of tidal flats, comprehensively improve the ecological environment of coastal zones, and help achieve the overall planning goals of major projects for the protection and restoration of important ecosystems in China. In this study, based on GEE (Google Earth Engine) platform, Sentinel-2 (MSI), Landsat 8 (OLI) and Landsat 9 (OLI-2) remote sensing images were used to construct multi-source intensive time series remote sensing image collection, combined with MSIC-OA algorithm. The tidal flat data of China in 2018 and 2023 are extracted and analyzed. The results show as follows: 1) The overall classification accuracy of the tidal flat in 2023 is 95.19%, and the Kappa coefficient is 0.89; In 2018, they were 92.77% and 0.83 respectively. 2) The total tidal flat area in 2018 and 2023 is 8300.34km2 and 8151.54km2, respectively, a decrease of 148.80km2; 3) In 2023, estuarine and bay tidal flats will account for 54.88% of the total area, and most of the tidal flats will be distributed near river inlets and bays; 4) In 2023, the total length of the coastline adjacent to the tidal flat is 10196.17km, of which the artificial shoreline accounts for 67.06%, and the development degree of the tidal flat is 2.04, indicating that most of the tidal flat has been developed and utilized. The research results provide valuable reference for the scientific planning and rational utilization of tidal flat resources in China.

The rapid adoption of hydrogen as an eco-friendly energy source has necessitated the development of intelligent power management systems capable of efficiently utilizing hydrogen resources. However, guaranteeing the security and integrity of hydrogen-related data has become a significant challenge. This paper proposes a pioneering approach to ensure secure hydrogen data analysis through the integration of blockchain technology, enhancing trust, transparency, and privacy in handling hydrogen-related information. By combining blockchain with intelligent power management systems, the efficient utilization of hydrogen resources becomes feasible. The utilization of smart contracts and distributed ledger technology facilitates secure data analysis, real-time monitoring, prediction, and optimization of hydrogen-based power systems. The effectiveness and performance of the proposed approach are demonstrated through comprehensive case studies and simulations. Notably, our prediction models, including ABiLSTM, ALSTM, and ARNN, consistently delivered high accuracy with MAE values of approximately 0.154, 0.151, and 0.151, respectively, enhancing the security and efficiency of hydrogen consumption forecasts. The blockchain-based solution offers enhanced security, integrity, and privacy for hydrogen data analysis, thus contributing to the advancement of clean and sustainable energy systems. Additionally, the research identifies existing challenges and outlines potential future directions for further enhancing the proposed system. This study adds to the growing body of research on blockchain applications in the energy sector, with a specific focus on secure hydrogen data analysis and intelligent power management systems.

Sparse reward long horizon task is a major challenge for deep reinforcement learning algorithm. One of the key barriers is data-inefficiency. Even in the simulation environment, it usually takes weeks to training the agent. In this study, a data-efficiency training framework is proposed, where a curriculum learning is design for the agent in the simulation scenario. Different distributions of the initial state are set for the agent to get more informative reward during the whole training process. A fine-tuning of the parameters in the output layer of the neural network for value function is conduct to bridge the gap between sim-to-real. An experiment of UAV maneuver control is conducted in the proposed training framework to verify the method more efficient. We demonstrate that data-efficiency is different for the same data in different training stages.

Cloud infrastructure provides computing services where computing resources can be adjusted on-demand. However, the adoption of cloud infrastructures brings concerns like reliance on the service provider network, reliability, compliance for service level agreements (SLAs), etc. Software-defined networking (SDN) is a networking concept that suggests the segregation of a network’s data plane from the control plane. This concept improves networking behavior. In this paper, we present an SDN-enabled resource-aware topology framework. The proposed framework employs SLA compliance, Path Computation Element (PCE) and shares fair loading to achieve better topology features. We also present an evaluation, showcasing the potential of our framework.

Laser scanning systems make use of Light Detection and Ranging (LiDAR) technology to acquire accurately georeferenced sets of dense 3D point cloud data. The information acquired using these systems produces better knowledge about the terrain objects which are inherently 3D in nature. The LiDAR data acquired from mobile, airborne or terrestrial platforms provides several benefit over conventional sources of data acquisition in terms of accuracy, resolution and attributes. However, the large volume and scale of LiDAR data have inhibited the development of automated feature extraction algorithms due to the extensive computational cost involved in it. Moreover, the heterogeneously distributed point cloud, which represents objects with varying size, point density, holes and complicated structures pose a great challenge for data processing. Currently, geospatial database systems do not provide a robust solution for efficient storage and accessibility of raw data in a way that data processing could be applied based on optimal spatial extent. In this paper, we present Global LiDAR and Imagery Mobile Processing Spatial Environment (GLIMPSE) system that provides a framework for storage, management and integration of 3D LiDAR data acquired from multiple platforms. The system facilitates an efficient accessibility to the raw dataset, which is hierarchically represented in a geographically meaningful way. We utilise the GLIMPSE system to automatically extract road median from Airborne Laser Scanning (ALS) point cloud. In the first part of this paper, we detail an approach to efficiently retrieve the point cloud data from the GLIMPSE system for a particular geographic area based on user requirements. In the second part, we present an algorithm to automatically extract road median from the retrieved LiDAR data. The developed road median extraction algorithm utilises the LiDAR elevation and intensity attributes to distinguish the median from the road surface. We successfully tested our algorithms on two road sections consisting of distinct road median types based on concrete and grass-hedge barriers. The use of GLIMPSE improved the efficiency of the road median extraction in terms of fast accessibility to ALS point cloud data for the required road sections. The developed system and its associated algorithms provide a comprehensive solution to the user's requirement for an efficient storage, integration, retrieval and processing of large volumes of LiDAR point cloud data. These findings and knowledge contribute to a more rapid, cost-effective and comprehensive approach to surveying road networks.

The main aim of this paper is to explore the issue of big data and to propose a conceptual framework for big data, based on the temporal dimension. The Temporal Big Data Maturity Model (TBDMM) is a means for assessing organization’s readiness to fully profit from big data analysis. It allows the measurement of the current state of the organization’s big data assets and analytical tools, and to plan their future development. The framework explicitly incorporates a time dimension, providing a complete means for assessing also the readiness to process temporal data and/or knowledge that can be found in modern sources, such as big data ones. Temporality in the proposed framework extends and enhances the already existing maturity models for big data. This research paper is based on a critical analysis of literature, as well as creative thinking, and on the case-study approach involving multiple cases. The literature-based research has shown that the existing maturity models for big data do not treat the temporal dimension as the basic one. At the same time, dynamic analytics is crucial for a sustainable competitive advantage. This conceptual framework was well received among practitioners, to whom it has been presented during interviews. The participants in the consultations often expressed their need of temporal big data analytics, and hence the temporal approach of the maturity model was widely welcomed.

A large amount of raw data collected by satellites is processed by the production chain to obtain a large amount of product data, of which the secure exchange and storage is of interest to researchers in the field of remote sensing information science. Authentic, secure data is a critical foundation for data analysis and decision-making. And traditional centralized cloud computing systems are vulnerable to attacks, and once the central server is successfully attacked, all data will be lost. Distributed Ledger Technology (DLT) is an innovative computer technology that can ensure information security, traceability and tamper-proof, and can be applied to the field of remote sensing. Although there are many advantages to using DLT in remote sensing applications, there are some obstacles and limitations to its application. Remote sensing data has the characteristics of large data volume, spatiotemporal nature, global and so on, and it is difficult to store and interconnect remote sensing data in the blockchain. To address these issues, this paper proposes a trustworthy and decentralized system using blockchain. The novelty of this paper is to propose a multi-level blockchain architecture in which the system collects remote sensing data and stores it in the Interplanetary File System (IPFS) network, after generating the IPFS hash, the network rehashes the value again and uploads it on the Ethereum chain for public query. Distributed data storage improves data security, supports the secure exchange of information, and improves the efficiency of data management.

This paper presents an approach to assess and improve the cybersecurity infras- tructure of developing countries. We have highlighted and addressed the critical gaps through a hybrid approach encompassing SWOT analysis, benchmarking using Data Envelopment Analysis (DEA) and, Root Cause Analysis (RCA). This approach has provided a strong basis for evaluating cybersecurity performance by combining qualitative insights with quantitative metrics. As a case study, we have compared an underdeveloped country’s (Pakistan) cybersecurity pos- ture to five highly developed countries (Lithuania, Estonia, Singapore, Spain,and Norway). Our analysis has identified cybersecurity shortcomings and pro- vided actionable recommendations within a flexible framework, applicable for all developing countries to identify and address vulnerabilities, and align their cybersecurity infrastructure with international standards.

This paper will discuss Data, Information, Knowledge, and Wisdom, which is commonly referred to as DIKW. The DIKW Pyramid Model that is often referenced in both academics and practitioner circles will be discussed and shown to be faulty on several levels, including. a lack of definitional agreement. A new DIKW framework will be proposed that focuses on what the DIKW elements do in the way humans think, not what they are by definition. Information as a replacement for wasted physical resources in goal-oriented tasks will be a central organizing point. The paper will move the DIKW discussion to the computer-based concept of Digital Twins (DTs) and its augmentation of how we can use DIKW to be more effective and efficient. This will especially be the case as we move to Intelligent Digital Twins (IDT) with Artificial Intelligence (AI).

Sensors available on mobile devices allow the automatic identification of Activities of Daily Living (ADL). This paper describes an approach for the creation of a framework for the identification of ADL, taking in account several concepts, including data acquisition, data processing, data fusion, pattern recognition, and machine learning. These concepts can be mapped in a module of the framework, including the use and creation of several algorithms. For the development of a framework that works in several conditions, e.g., without Internet connection, these algorithms should take in account the hardware and software limitations of the mobile devices to run all main tasks locally. The main purpose of this paper is related to the presentation the sensors, algorithms, and architecture of the proposed approach.

This paper proposes an approach for image data extraction and driving behavior analysis using geographic information and driving data. Information derived from geographic and global positioning systems was used for image data extraction. In addition, we used an onboard diagnostic II and a controller area network bus logger to record driving data for driving behavior analysis. Driving behavior was analyzed using sparse automatic encoders and data exploration to detect abnormal and aggressive behavior. A regression analysis was used to derive the relationship between aggressive driving behavior and road facilities. Several traffic improvements were proposed for specific intersections and roads. The results indicate that lane ratios without lane markings and with straight lane markings are important features that affect aggressive driving behaviors.

The understanding of water quality and its underlying processes is important for the protection of aquatic environments enabling the rare opportunity of access to a domain expert. Hence, an explainable AI (XAI) framework is proposed that is applicable to multivariate time series resulting in explanations that are interpretable by a domain expert. The XAI combines in three steps a data-driven choice of a distance measure with explainable cluster analysis through supervised decision trees. The multivariate time series consists of water quality measurements, including nitrate, electrical conductivity, and twelve other environmental parameters. The relationships between water quality and the environmental parameters are investigated by identifying similar days within a cluster and dissimilar days between clusters. The XAI does not depend on prior knowledge about data structure, and its explanations are tendentially contrastive. The relationships in the data can be visualized by a topographic map representing high-dimensional structures. Two comparable decision-based XAIs were unable to provide meaningful and relevant explanations from the multivariate time series data. Open-source code in R for the three steps of the XAI framework is provided.

Machinery degradation assessment can offer meaningful prognosis and health management in-formation. Although numerous machine prediction models based on artificial intelligence have emerged in recent years, they still face a series of challenges: (1) Many models continue to rely on manual feature extraction. (2) Deep learning models still struggle with long sequence prediction tasks. (3) Health indicators are inefficient for remaining useful life (RUL) prediction with cross-operational environments when dealing with high-dimensional datasets as inputs. This research proposes a health indicator construction methodology based on a transformer self-attention transfer network (TSTN). This methodology can directly deal with the high-dimensional raw dataset and keep all the information without missing when the signals are taken as the input of the diagnosis and prognosis model. First, we design an encoder with a long-term and short-term self-attention mechanism to capture crucial time-varying information from a high-dimensional dataset. Second, we propose an estimator that can map the embedding from the encoder output to the estimated degradation trends. Then, we present a domain dis-criminator to extract invariant features from different machine operating conditions. The case studies with the FEMTO-ST bearing dataset and the Monte Carlo method for RUL prediction during the degradation process are conducted. The experiment results fully exhibited the signif-icant advantages of the proposed method compared to other state-of-the-art techniques.

The diverse, heterogeneous, and dynamic nature of urban data poses challenges for semantic integration and knowledge sharing in smart city applications. Traditional urban governance sectors often develop domain-specific data standards, which are insufficient for integrating and applying multi-source heterogeneous data. This article proposes the Smart City Ontology Framework (SMOF), leveraging ontology technology for semantic-level data sharing and interoperability across different industries. SMOF adopts a top-down integration strategy, harmonizing diverse data standards from IoT, BIM, and GIS into a cohesive structure. This research delineates the foundational components of SMOF, encompassing entities, relationships, properties, events, and rules, and outlines the methodology and principles underpinning its construction. We further develop a scalable, hierarchical classification system for entities, properties and relationships, adaptable for specific semantic applications. Through a fire emergency scenario, we exemplify SMOF's practical utility in knowledge representation and data mapping, highlighting its capacity for semantic querying within complex urban data ecosystems. Our findings indicate SMOF's significant role in fostering integrated urban data management, thereby enhancing data interoperability and applicability in diverse urban governance contexts.

This study presents an advanced data augmentation framework to enhance diagnostics in centrifugal pumps using vibration data, with a focus on practical industrial applications. Initially, Gaussian noise and signal stretching were employed to generate synthetic data, addressing the common issue of insufficient defect data in industrial settings. These methods simulate varied operating conditions and different rotating speeds. Recognizing the limitations of traditional approaches, we further integrated advanced models—Long Short-Term Memory (LSTM), Autoencoder (AE), and Generative Adversarial Networks (GANs) to augment the dataset comprehensively. This enhanced approach increases the robustness and accuracy of machine-learning models for fault detection and classification. Experimental results show significant improvements in diagnostic algorithm performance, reducing false positives and increasing fault detection rates. The study offers a complete framework for incorporating both traditional and advanced data augmentation techniques into predictive maintenance protocols, ensuring reliable operation of centrifugal pumps in diverse industrial environments.

This paper presents a new framework to classify floor plan elements and represent them in a vector format. Unlike existing approaches using image-based learning frameworks as the first step to segment the image pixels, we first convert the input floor plan image into vector data and utilize graph neural network. Our framework consists of three steps. (1) image pre-processing and vectorization of the floor plan image. (2) region adjacency graph conversion. (3) graph neural network on converted floor plan graphs. Our approach is able to capture different types of indoor elements including basic elements such as walls, doors, and symbols as well as spatial elements such as rooms and corridors. In addition, the proposed method can also detect element shapes. Experimental results show that our framework can classify indoor elements with an F1 score of 95%, with scale and rotation invariance. Furthermore, we propose a new graph neural network model that takes the distance between nodes into account, which is a valuable feature of spatial network data.

With the prevalence and evolution of social media platforms, social media data have emerged as a crucial source for obtaining spatio-temporal information about various urban events. Providing accurate spatio-temporal information of these events enhances the capacities of urban management and emergency response. However, existing research mostly focuses on the textual content while mining this spatio-temporal information, often neglecting data from other modalities like images and videos.To address this, our study introduces a novel method for extracting spatio-temporal information from multi-modal social media data (MIST-SMMD), serving as a valuable supplement to current urban event monitoring methods. Leveraging deep learning and Geographic Information System (GIS) technologies, we extract spatio-temporal information from large-scale, multi-modal Weibo data about urban waterlogging events at both coarse and fine granularities.Through an in-depth experimental evaluation of the “July 20 Zhengzhou extreme rainstorm” event, the results show that in coarse-grained spatial information extraction solely using textual data, our method achieves a Spatial Precision of 87.54% within a 60m range and 100% Spatial Precision within a 201m range. In the fine-grained spatial information extraction, by incorporating other modalities such as images and videos, the Spatial Error saw a significant improvement, with MAESE increasing by 95.53% and RMSESE by 93.62%.These outcomes illustrate the capability of the MIST-SMMD method in extracting spatio-temporal information of urban events at both coarse and fine granularities. They also confirm the notable advantage of multi-modal data in enhancing the accuracy of spatial information extraction.

Genomics involving tens of thousands of genes is a complex system determining phenotype. An interesting and vital issue is that how to integrate highly sparse genetic genomics data with a mass of minor effects into prediction model for improving prediction power. We find that deep learning method can work well to extract features by transforming highly sparse dichotomous data to lower dimensional continuous data in a non-linear way. This idea may provide benefits in risk prediction based on genome-wide data associated e.g. integrating most of the information in the genotype data. Hence, we developed a multi-stage strategy to extract information from highly sparse binary genotype data and applied it for risk prediction. Specifically, we first reduced the number of biomarkers via a univariable regression model to a moderate size. Then a trainable auto-encoder was used to extract compact representations from the reduced data. Next, we performed a LASSO problem process over a grid of tuning parameter values to select the optimal combination of extracted features. Finally, we applied such feature combination to two prognostic models, and evaluated predictive effect of the models. The results of simulation studies and real data applying indicated that these highly compressed transformation features could better improve predictive performance and did not easily lead to over-fitting.

In an IoT system, the sheer volume of data generated by numerous sensing devices necessitates a well-designed scheme for storing and retrieving data efficiently, enabling streamlined data processing and analytics. One promising storage architecture involves utilizing solid-state drives (SSDs) to cache data from hard disk drives (HDDs), thereby creating an SSD-based caching storage system. To further enhance access performance, it is possible to employ readahead techniques to minimize data access latency. However, the existing Linux readahead scheme falls short in fully leveraging SSD-based caching storage systems. We address this limitation by introducing a novel cross-layered readahead architecture that effectively communicates with the VFS layer, the file system layer, and the block I/O layer. This communication facilitates the acquisition of readahead timing, readahead data continuity, and readahead data location, respectively. To guide prefetching decisions, our architecture analyzes the degree of data access sequentiality, the performance model of the target storage device, and the access patterns of the I/O workload on the corresponding storage device. The implementation of this new architecture in the Linux kernel yields promising experimental results, demonstrating its robustness by consistently outperforming the stock Linux kernel. Notably, our architecture reduces the total execution time of the stock Linux kernel by up to 49%, except in cases of random workloads where both the stock Linux kernel and our architecture exhibit similar performance.

Sensor fusion algorithms and models have been widely used in recent times. Although research evidence has informed the use of sensor fusion models in diverse applications, there is room for improvement, especially in home-based health monitoring applications which require less supervision and technical knowledge of users. The present work compares data mining-based fusion software packages such as RapidMiner Studio, Anaconda, Weka, and Orange, and proposes a data fusion framework suitable for in-home applications. 574 privacy-friendly (binary) images and 1,722 datasets gleaned from thermal and Radar sensing solutions respectively, were fused using the software packages on instances of homogeneous and heterogeneous data aggregation. Experimental results indicated that the proposed fusion framework achieved an average Classification Accuracy of 84.7% and 95.7% on homogeneous and heterogeneous datasets respectively, with the help of data mining and machine learning models such as Naïve Bayes, Decision Tree, Neural Network, Random Forest, Stochastic Gradient Descent, Support Vector Machine, K-Nearest Neighbours and CN2 induction. Further evaluation of the sensor data fusion framework based on cross validation of features indicated average values of 94.4% for Classification Accuracy, 95.7% Precision and 96.4% for Recall.

This study presents a strategic approach to developing applications focused on implementing Large Language Models using the Langchain framework in Python. Three language models are highlighted: GPT-3.5 (turbo mode), LLaMA 2, and Vicuna 7B, each with their distinctive features and capabilities. The methodology used is described in detail, including data extraction from medical reports using zero-shot prompting data extraction techniques, interaction with language models, and structured storage of results. The performance of the models in data extraction is evaluated, presenting metrics such as precision, recall, and F1 score. The results demonstrate high model capability in extracting information, although areas for improvement are identified, particularly in data extraction precision. In conclusion, the efficacy of the models in extracting information from medical histories is not considerably acknowledged, with an emphasis on the importance of improving precision and increasing the volume of trained data for future research in healthcare digitalization.

In recent years supply chains have evolved into huge ecosystems, demanding trust, provenance, and data privacy. Since blockchain technology (BCT) allows for the development of a distributed environment, it is ideal for supply chain management (SCM) applications. However, concerns regarding data privacy have impeded the development of blockchains. Despite the fact that some blockchains can restrict participants to read and write data, the blockchain’s transparency makes protecting sensitive data challenging. To solve the data privacy challenge, this paper proposes a framework, AccessChain, that is an SCM access control framework based on an attribute-based access control (ABAC) model that restricts access to competing parties while allowing for network scalability. This proposed AccessChain model has two types of ledgers in the system: local and global. Local ledgers are used to store business contracts between stakeholders and the ABAC model management, whereas the global ledger is used to record transaction data. AccessChain can enable decentralized, fine-grained and dynamic access control management in SCM when combined with the ABAC model and BCT. This paper’s experimental results illustrate that high throughput can be achieved in a large-scale request environment while maintaining data privacy and sustaining a scalable network.

The monitoring of lake waterbody area in the Qinghai Tibet Plateau (QTP) is of great significance to deal with global climate change. As the latest generation of Landsat series satellites, Landsat-9 data not only have higher radiometric resolution, but also cooperate with other Landsat satellites to greatly improve the temporal resolution. It has great application potential in lake waterbody area monitoring. In order to explore the performance of different algorithms for extracting waterbody and lake waterbody area in Landsat-9 data under large-scale QTP regions, this study relies on Google Earth Engine (GEE) platform and selects 10 waterbody extraction algorithms as the basis to realize the quantitative evaluation of QTP lake waterbody area extraction results. The results show that the Random Forest (RF) algorithm performs best in all models. The overall accuracy of waterbody extraction is 95.84%, and the average error of lake waterbody area extraction is 1.505%. Among the traditional threshold segmentation waterbody extraction algorithms, the overall accuracy of the NDWI waterbody extraction method is 89.89%, and the average error of lake waterbody area extraction is 3.501%, which is the highest performance model in this kind of algorithms. This study proves that Landsat-9 data can effectively classify QTP waterbodies. With the development of cloud computing technologies such as Gee, more complex models such as RF can be selected to improve the extraction accuracy of water body and Lake area in large-scale research.

Deep learning dominates automated animal activity recognition (AAR) tasks due to the high performance on large-scale datasets. However, constructing centralised data across diverse farms raises data privacy issues. Federated learning (FL) provides a distributed learning solution to train a shared model by coordinating multiple farms (clients) without sharing their private data. Whereas directly applying FL to AAR tasks often faces two challenges: client-drift during local training and gradient conflicts during global aggregation. In this study, we develop a novel FL framework called FedAAR to achieve AAR with sensor data. Specifically, we devise a prototype-guided local update module to alleviate the client-drift issue, which introduces global prototypes as shared knowledge to force clients to learn consistent features. To reduce gradient conflicts between clients, we design a gradient refinement-based aggregation module to eliminate conflicting components between client gradients during global aggregation, thereby improving the agreement between clients. Experiments are conducted on a public dataset to verify FedAAR’s effectiveness, which consists of 87,621 2-s motion data. The results demonstrate that FedAAR outperforms state-of-the-arts, with precision (75.23%), recall (75.17%), F1-score (74.70%), and accuracy (88.88%), respectively. The ablation experiments also show FedAAR’s robustness against various factors (i.e., different data sizes, communication frequency, and client numbers).

In community-based participatory projects, needs assessments are one of the first steps to identify priority areas. Access-related issues often pose significant barriers to participation for rural and remote communities, particularly Indigenous communities which have a complicated relationship with academia due to a history of exploitation and trauma. In order to bridge this gap, work with Indigenous communities requires consistent and meaningful engagement. The prominence of digital devices (i.e., smartphones) offers an unparalleled opportunity to ethically and equitably engage citizens across jurisdictions, particularly in remote communities. We propose a framework to guide needs assessments which embed digital tools in partnership with Indigenous communities. Guided by this framework, a needs assessment was conducted with a subarctic Métis community in Saskatchewan, Canada. This project is governed by a Citizen Scientist Advisory Council which includes Traditional Knowledge Keepers, Elders, and youth. An environmental scan of relevant programs, key informant interviews, and focus groups were conducted to systematically identify community priority areas. Given the timing of the needs assessment, the community identified the Coronavirus pandemic as a key priority area requiring digital initiatives. Recommendations for community-based needs assessments to conceptualize and implement digital infrastructure are put forward, with an emphasis on self-governance and data sovereignty.

In this paper, we present a framework that automatically labels Latent Dirichlet Allocation (LDA) generated topics using sentiment and aspect terms from COVID-19 tweets to help the end-users by minimizing the cognitive overhead of identifying key topics labels. Social media platforms especially Twitter are considered as one of the most influential sources of information for providing public opinion related to a critical situation like the COVID-19 pandemic. LDA is a popular topic modelling algorithm that extracts hidden themes of documents without assigning a specific label. Thus automatic labelling of LDA-generated topics from COVID-19 tweets is a great challenge instead of following the manual labelling approach to get an overview of wider public opinion. To overcome this problem, in this paper, we propose a framework named \texttt{SATLabel} that effectively identifies significant topic labels using \textit{top unigrams features of sentiment terms and aspect terms clusters from LDA generated topics} of COVID-19 related tweets to uncover various issues related to the COVID-19 pandemic. The experimental results show that our methodology is more effective, simpler, and traces better topic labels compare to the manual topic labelling approach.

This article presents a state-of-the-art system to extract and synthesize causal statements from company reports into a directed causal graph. The extracted information is organized by the relevance to different stakeholder groups’ benefits (customers, employees, investors, and the community/environment). The presented method of synthesizing extracted data into a knowledge graph comprises a framework that can be used for similar tasks in other domains, e.g. medical information. The current work addresses the problem of finding, organizing, and synthesizing a view of the cause-and-effect relationships based textual data, in order to inform and even prescribe the best actions that may affect target business outcomes related to different stakeholders’ benefits (customers, employees, investors, and the community/environment).

This paper presents a comprehensive study on applying machine learning (ML) techniques for real-time credit card fraud detection. With the increasing prevalence of credit card fraud, financial institutions face the challenge of detecting fraudulent transactions promptly and accurately. This research evaluates various ML models, including Logistic Regression, Decision Trees, Random Forests, XGBoost, and Deep Convolutional Neural Networks, for their effectiveness in identifying fraudulent activities. Utilizing PySpark for processing large-scale transaction data, the study highlights the importance of real-time analysis, adaptive learning, and handling imbalanced datasets. Key findings reveal that XgBoost, with its balance of accuracy and complexity, emerged as the most promising model, achieving an accuracy rate of 98% in detecting fraudulent transactions. The paper further discusses the potential of ensemble methods, graph-powered systems, and intelligent sampling in enhancing fraud detection capabilities. Challenges such as overfitting, data access, and the need for real-time analysis are addressed. Future research directions include implementing models in live transaction environments, expanding model applicability across financial platforms, and developing advanced anomaly detection methodologies. This study underscores the pivotal role of machine learning in safeguarding financial transactions against fraud, offering significant implications for consumers, financial institutions, and the broader financial ecosystem.

We propose a novel tensor-based formalism for inferring causal structures from time series. An information theoretical analysis of transfer entropy (TE), shows that TE results from transmission of information over a set of communication channels. Tensors are the mathematical equivalents of these multi-channel causal channels. A multi-channel causal channel is a generalization of a discrete memoryless channel (DMC). We consider a DMC as a single-channel causal channel. Investigation of a system comprising three variables shows that in our formalism, bivariate analysis suffices to differentiate between direct and indirect relations. For this to be true, we have to combine the output of multi-channel causal channels with the output of single-channel causal channels. We can understand this result when we consider the role of noise. Subsequent transmission of information over noisy channels can never result in less noisy transmission overall. This implies that a Data Processing Inequality (DPI) exists for transfer entropy.

Various heterogeneous devices or objects shall be integrated for transplant and seamless communication under the umbrella of internet of things (IoT). It would facilitate the open accession of data for the growth of a glut of digital services. To build a general framework of IoT is very complex task because of heterogeneity in devices, technologies, platforms and services, operating in the same system. In this paper, we mainly focus on the framework for big data analytics in smart city applications , which being a broad category specifies the different domains for each application. IoT is intended to support the vision of Smart City, where advance technologies will be used for communication for the quality life of citizens. A novel approach used in this paper, is for enhancing the energy conservation and to reduce the delay in big data gathering at tiny sensor nodes used in IoT framework. To implement the smart city scenario in terms of big data in IoT, an efficient (optimized in quality of service) WSN is required where communication of nodes is energy effcient. That is why, a new protocol QoS-IoT is proposed on the top layer of the architecture which is validated over the traditional protocols.

Seniors safety is a compelling need, which necessitates 24/7 real-time monitoring and timely dangerous action recognition. Being able to mirror characteristics of physical objects (PO) to corresponding logical objects (LO) and seamlessly monitor their footprints thus detect anomaly parameters, Digital Twins (DT) has been considered a practical way to provide virtual health services for seniors safety. Meanwhile, widely adopted Internet of Medical Things (IoMT) consisting of wearable sensors and non-contact optical cameras for self and remote health data monitoring also raises concerns on information security and privacy violation. Therefore, security of POs, LOs and reliable data sharing among healthcare professionals are challenging as constructing trust and privacy-preserving virtual health services. Thanks to characteristics of decentralization, traceability and unalterability, Blockchain is promising to enhance security and privacy properties in many areas like data analysis, finance and healthcare. This paper envisions a lightweight authentication framework (LAF) to enable secure and privacy-preserving virtual healthcare services. Leveraging Non-Fungible Token (NFT) technology to tokenize LOs and data streams on blockchain, anyone can certify the authenticity of a digital LO along with its synchronized data between PO without relying on a third-party agency. In addition, the NFT-based tokenization not only allows owners fully control their IoMT devices and data, but it also enables verifiable ownership and traceable transferability during data sharing process. Moreover, NFT only contains references to encrypted raw data that are saved on off-chain storage like local files or distributed databases, such a hybrid storage strategy ensures privacy-preservation for sensitive information. A proof-of-concept prototype is implemented and tests are conducted on a case study of seniors safety. The experimental evaluation shows the feasibility and effectiveness of the proposed LAF solution.

The variety of risks due to climate change with a potential impact on Cultural Heritage CH requires a multidisciplinary approach and a preliminary overview of the existing methods for risk analysis and assessment in different fields. Thus, the starting point of the research conducted by the Sapienza PNRR working group consists in a systematic literature review of risk assessment approaches, methods and indicators. As a first outcome, the research has designed a multidisciplinary comprehensive framework consisting of the definition of risk categorization, the framework represented by a measurable index and the main target, according to the classification of Cultural Heritage based on the harmonization of European vocabularies definitions and protocols. The risk assessment framework sets the methodological core of a future multi criteria matrix and digital platform for decision focused on the historic built environment and it is functional to the definition of specific operational guidelines connected to each risk for elaborating descriptive/predictive Architectural Heritage’s transformation scenarios to support the development of mitigation and adaptation strategies.

Conventional deduplication systems face critical challenges such as excessive write amplification, high read/write latency, and sub-optimal storage utilization. These limitations often undermine the performance benefits of deduplication by slowing down I/O acknowledgements, due to amplified deduplication I/Os, excessive data chunk replication and strict consistency requirements. To address these issues, we present Speed-Dedup, a novel deduplication framework that employs a deduplicated primary - semi deduplicated replica object approach. This strategy reduces write amplification by restricting deduplication to the primary object while maintaining a semi-deduplicated replica object used for immediate read/write acknowledgements, thus enhancing I/O latency and storage efficiency. Speed-Dedup also replaces traditional strong consistency models with eventual consistency, allowing for non-blocking read operations and improving overall system throughput. Experimental results demonstrate that Speed-Dedup significantly outperforms traditional methods like GRATE and CAO, showing up to 21% improvement in I/O performance under low deduplication ratios and maintaining 14% or more gains under higher ratios. Additionally, write amplification is substantially reduced, and latency improves by over 100%, with faster recovery times during system failures. These findings highlight the effectiveness of Speed-Dedup as a scalable and efficient solution.

The Circular Economy has been of growing significance within academic, policymaking and industry groups. Latest developments in the field of Circular Economy has led to an expansion of CE studies focused on interrogating CE as a paradigm, its relationship with sustainability and concepts and definitions of the Circular Economy. Research has also identified the significant potential of applying circular approaches to areas of the economy, including manufacturing and Industry 4.0, which, with data, is enabling latest the advances in digital technologies. This is the first review paper to integrate the fields of CE and digital technologies resulting in a framework which provides directions for policymakers and guidance for future research. To achieve this, we conduct a systematic literature review of the empirical literature related to digital technologies, industry 4.0 and circular approaches, from the point of the 9 Rs. The systematic literature review (SLR) is based on peer-reviewed articles published between 2000-2018. The findings reveal that while research on the circular economy has been on an annual rise, research on digital technologies enabled circular economy is still relatively an untouched area of research across all nine (9) circular approaches. As such this is an area rife for further research. This paper also presents illustrative charts and graphs to summarize the current trends in circular economy research in manufacturing. From this, a framework for future circular economy research for manufacturing for digital technologies is proposed.

This survey delves into cross layer energy-efficient solutions and cutting-edge security measures for Internet of Things (IoT) networks. The conventional security techniques are considered inadequate, leading to the suggestion of AI-powered intrusion detection systems and novel strategies such as blockchain integration. In this paper, we provide a comprehensive review and analysis of secure and energy efficient cross-layer framework for IoT.We highlight the significance of developing IoT security for robust and sustainable connected systems. We discuss multi-layered security approaches and ways to enhance energy efficiency of resource-constrained devices in IoT networks. Finally, we identify open research issues and future research directions in the emerging field ofcross-layer design for secure and energy efficient IoT networks. We expect this study will stimulate further research endeavors to build a secure and energy-efficient framework for next-generation IoT systems.

This study introduces the Dynamic Feedback-Driven Learning Optimization Framework (DFDLOF), an innovative machine learning-based approach to personalize educational pathways. DFDLOF leverages advanced algorithms for in-depth analysis of learner data, enabling the dynamic customization of educational content and methodologies. Its application in diverse online platforms, including Khan Academy and Coursera, underscores its adaptability and scalability. DFDLOF enhances learner engagement and outcomes by providing tailored learning experiences and real-time feedback. Key insights reveal its strengths in personalized education, particularly in dynamically adapting learning paths and the importance of real-time feedback. Challenges identified include integration complexities and data privacy concerns. Future research directions emphasize the need for longitudinal impact studies and broader demographic applications. This study contributes significantly to the evolving domain of adaptive learning technologies, demonstrating the transformative potential of machine learning in personalizing education.

Digital twins are gaining in popularity for simulating complex natural and urban environments. In this context, accurate segmentation of objects within 3D urban environments is of crucial importance. The aim of this project is to develop a methodology for extracting buildings from textured 3D meshes. To this end, PicassoNet-II, a semantic segmentation architecture is employed. The methodology also incorporates Markov field-based contextual analysis to assess post-segmentation features. In addition, building instantiation is performed using cluster analysis algorithms. Training this model to fit various datasets requires a large amount of annotated data, both from Quebec City, Canada, and from simulated data. Experimental results show that the use of simulated data improves segmentation accuracy, and the DBScan algorithm proves effective in extracting isolated buildings. This project paves the way for improved applications in 3D urban modeling, offering opportunities in fields ranging from urban planning to resource management. The positive results with simulated data reinforce the impact of this research on improving digital models of our ever-changing urban environments.

Current language models have achieved remarkable success in NLP tasks. Nonetheless, individual decoding methods face difficulties in realizing the immense potential of these models. The challenge is primarily due to the lack of a decoding framework that can integrate language models and decoding methods. We introduce the DecoStrat which bridges the gap between language modeling and the decoding process in D2T generation. By leveraging language models, DecoStrat facilitates the exploration of alternative decoding methods tailored to specific tasks. We fine-tune the model on the MultiWOZ dataset to meet task-specific requirements and employ it to generate output(s) through multiple interactive modules of the framework. The Director module orchestrates the decoding processes, engaging the Generator to produce output(s) text based on the selected decoding method and input data. The Manager module enforces a selection strategy, integrating Ranker and Selector to identify the optimal result. Evaluations on the stated dataset show that DecoStrat effectively produces diverse and accurate output, with MBR variants consistently outperforming other methods. DecoStrat with the T5-small model surpasses some baseline. Generally, the findings highlight DecoStrat's potential for optimizing decoding methods in diverse real-world applications.

Mobile devices (MD) are used by mobile cloud computing (MCC) customers users because of their 11 portability and robust connectivity and the ability to house and operate third-party applications 12 (apps). However, the apps installed on a MD may pose data security risks to the MD owner and to 13 other MCC users, especially when the requested permissions include access to sensitive data (e.g., 14 user’s location and contacts). Calculating the risk score of an app or quantifying its potential 15 harmfulness based on user input or on data gathered while the app is actually running may not 16 provide reliable and sufficiently accurate results to avoid harmful consequences. This study 17 develops and evaluates a risk assessment framework for Android-based MDs that does not depend 18 on user input or on actual app behaviour. Rather, an app risk evaluator assigns a risk category to 19 reach resident app based on the app’s classification (benign or malicious) and the app’s risk score. 20 The app classifier (a trained machine learning model) considers the permissions and the intents 21 requested by the app. The apps risk score is calculated by a probabilistic function based on the 22 app’s use of a set of selected dangerous permissions. The results from the testing of an instance of 23 the framework on a MD with real-life resident apps indicated that the proposed security solution 24 was effective and feasible.

This article aims to analyze household energy data to predict electricity self-sufficiency and identify the key features that impact it. For this purpose, we use SHAP (Shapley Additive Explanations), LightGBM (Light Gradient Boosting Machine), and a correlation heatmap-based framework to analyze 12 months of energy and questionnaire survey data collected from over 200 smart houses in Kitakyushu, Japan. We use the SHAP summary plot to identify the impact-wise order of key features influencing the electricity self-sufficiency rate (ESSR). Using SHAP, we demonstrated that key features are; housing types, average monthly electricity bill, floor heating, electric capacity, number of washing and drying machines, fee plans, occupation of household head, total floor area, average monthly gas bill, cooking equipment, etc. Furthermore, we adopted the LightGBM classifier with $\ell^1$ regularization to extract the most significant features and predict the electricity self-sufficiency rate of households. This LightGBM-based model can also predict the electricity self-sufficiency rate of households that did not participate in the questionnaire survey. A heat map is also used to analyze the correlation among household variables. The findings discussed in this article offer valuable insights for energy policymakers to achieve the targets of energy self-sufficient houses.

The surge in big data and analytics has catalysed the proliferation of cybercrime, largely driven by organisations' intensified focus on gathering and processing personal data for profit, often overlooking security considerations. Hadoop and its derivatives are prominent platforms for managing big data, however, investigating security incidents within Hadoop environments poses intricate challenges due to scale, distribution, data diversity, replication, component complexity, and dynamicity. This paper proposes a digital forensics readiness framework and an incident response script for Linux-Hadoop systems, streamlining preliminary investigations. The framework offers a novel approach to digital forensics in the domains of big data and Hadoop environments. A prototype implementing important aspects of the DFR framework was developed and evaluated through comprehensive functionality and usability testing. The results demonstrated robust performance and efficacy.

The purpose of this study was to evaluate the implementation level of urban Sustainable Development Goals (SDGs) in the Republic of Korea and to measure the extent of internal and external impacts on the implementation level. An evaluation framework was established based on relative efficiency theory, and the implementation level of urban SDGs at the local government unit in the Republic of Korea was examined by performing an analysis of each stage. First, in reference to the 2018 cross-section, the implementation level of target 11.2 (public transportation) was assessed as excellent across the country, compared with the implementation level of targets 11.5 (disaster safety), 11.6 (environment), and 11.7 (public space), which were assessed as needing improvement. Second, the factors positively impacting the implementation level of target 11.2 were urban population, GRDP, financial independence, urbanization area, and bus-only lanes, whereas the factors positively impacting the implementation level of target 11.5 were population density and GRDP. The positive factors influencing the implementation level of target 11.6 (air quality sector) were found to be GRDP, financial independence, administrative area, and renewable energy generation, whereas the effective factors of the implementation level of target 11.6 (waste management sector) were analyzed as GRDP, financial independence, and the population density of households in the waste management area. The positive factors influencing the implementation level of target 11.7 were GRDP, financial independence, administrative area, and green area.

This paper introduces an innovative theoretical framework for quantum-inspired data embeddings, grounded in foundational concepts of quantum mechanics such as superposition and entanglement. This approach aims to advance semi-supervised learning in contexts characterized by limited labeled data by enabling more intricate and expressive embeddings that capture the underlying structure of the data effectively. Grounded in foundational quantum mechanics concepts such as superposition and entanglement, this approach redefines data representation by enabling more intricate and expressive embeddings. Emulating quantum superposition encodes each data point as a probabilistic amalgamation of multiple feature states, facilitating a richer, multidimensional representation of underlying structures and patterns. Additionally, quantum-inspired entanglement mechanisms are harnessed to model intricate dependencies between labeled and unlabeled data, promoting enhanced knowledge transfer and structural inference within the learning paradigm. In contrast to conventional quantum machine learning methodologies that often rely on quantum hardware, this framework is fully realizable within classical computational architectures, thus bypassing the practical limitations of quantum hardware. The versatility of this model is illustrated through its application to critical domains such as medical diagnosis, resource-constrained natural language processing, and financial forecasting—areas where data scarcity impedes the efficacy of traditional models. Experimental evaluations reveal that quantum-inspired embeddings substantially outperform standard approaches, enhancing model resilience and generalization in high-dimensional, low-sample scenarios. This research marks a significant stride in integrating quantum theoretical principles with classical machine learning, broadening the scope of data representation and semi-supervised learning while circumventing the technological barriers of quantum computing infrastructure.

There has been a great deal of research in the area of using graph engines and graph databases to model network traffic and network attacks, but the novelty of this research lies in visually or graphically representing the Reconnaissance Tactic (TA0043) of the MITRE ATT&CK framework. Using the newly created dataset, UWF-Zeekdata22, based on the MITRE ATT&CK framework, patterns involving network connectivity, connection duration, and data volume were found and loaded into a graph environment. Patterns were also found in the graphed data that match the Reconnaissance as well as other tactics captured by UWF-Zeekdata22. The Star motif was particularly useful in mapping the Reconnaissance tactic. The results of this paper show that graph databases/graph engines can be essential tools for understanding network traffic and trying to detect network intrusions before they happen. Finally, an analysis of the run-time performance of the reduced dataset used to create the graph databases showed that the reduced datasets performed better than the full dataset.

Tornadoes remain an active subject of observational and numerical research due to the damage and fatalities they cause worldwide as well as poor understanding of their behavior, such as what processes result in their genesis and what determines their longevity and morphology. A numerical model executed on a supercomputer run at high resolution can serve as a powerful tool for exploring the rapidly evolving tornado-scale features within a simulated storm, but saving large amounts data for meaningful analysis can result in unacceptably slow model performance, an unwieldy amount of saved data, and saved data spread across millions of files. In this paper, a system for efficiently saving and managing hundreds of terabytes of compressed model output is described in order to support a supercomputer simulation of a tornadic supercell thunderstorm. The challenges of managing a simulation spanning over a quarter trillion grid volumes across the Blue Waters supercomputer are also described. The simulated supercell produces a long-track EF5 tornado, and the near-tornado environment is described during tornadogenesis, where single upward-growing vortex undergoes several vortex mergers before transitioning into a multiple vortex tornado.

Dataspaces are decentralized and open ecosystems that guarantee trustworthy and secure sharing of data among their participants. In recent years, dataspaces have gained popularity due to their design for managing and sharing heterogeneous data from various sources and domains; and their capability to incrementally solve data integration issues. Leveraging dataspace and advanced technologies plays a vital role in solving many real-world applications effectively and efficiently in real-time. Drone technology is one type of technology that can be deployed to gather data from different resources in harsh or smart environments. Beyond fifth-generation (B5G) communication networks significantly contribute to drones’ development and widespread use by providing low latency and high throughput. Therefore, data sharing among drones in B5G networks offer significant potential to enhance commercial and civilian applications. However, several security issues for collaboration and data sharing, such as data privacy leakage, because of sensitive data and the lack of trustworthy centralized monitoring. Furthermore, sharing data is one of the essential requirements for drone collaboration to achieve their tasks effectively and efficiently in real-time. This conceptual framework presents a novel dataspace in the sky, focusing on securing drone data sharing in B5G for Industry 4.0 toward Industry 5.0. We present how Federated Learning (FL) assists drones in collaboration effectively and efficiently, sharing models instead of raw data. However, because of the fragility of the central curator, the reliability of contribution recording, and the poor quality of shared local models, there are still significant security and privacy issues for drone-assisted smart environments in B5G. Therefore, we present the conceptual framework for leveraging blockchain and FL to secure and manage data sharing of collaborative drones’ dataspace in space in a decentralized fashion. The decentralisation of dataspaces would significantly expand the drive and market for the development of citizen-friendly mobility services.

The architecture, Engineering, and Construction (AEC) industry is dealing with serious challenges on a global scale, i.e., project delays, budget overruns, and insufficient stakeholder collaboration. In this context, Value Engineering (VE) and Building Information Modeling (BIM) have been used recently to address these challenges and cope with large-scale and complex construction projects. An extensive body of literature highlights significant advantages of integrated VE within BIM technology. Despite this, it is full practical potential has not yet been realized. For this reason, this paper aims to investigate the integration of Value Engineering (VE) and Building Information Modeling (BIM) within a Common Data Environment (CDE) for the Architecture, Engineering, and Construction (AEC) industry. In doing this research, a comprehensive framework was developed and systematically implemented into practice through the use of four interconnected modules: (M. 1); Creating CDE, (M. 2); Design BIM Model Development, (M. 3); Value Analysis / Engineering Model, and (M. 4); Value Engineering Study. Introducing a new term the ""VEIDEA"" databank based on the OmniClass classification system provides a structured database utilized to store, manage, and accumulate VE ideas. Moreover, the study incorporates the Analytical Hierarchy Process (AHP) to automate the evaluation phase. Such a framework seeks to assist designers and VE team members make informed decisions when choosing appropriate design alternatives. Lastly, a case study method was adopted to examine the proposed framework for an office building. Quantitative data showed a significant link between cost savings and VR integration with BIM technology. For instance, cost of the RC slabs dropped by 20%, while flooring materials cost dropped by a 39%. Empirically, evidence from the case study supports literature regarding t the potential for significant enhancements in both cost-effectiveness and overall project performance through this innovative integration. In the context of knowledge contribution, this study provides an innovative way to assist designers and VE team members in making well-informed decisions when choosing appropriate design alternatives.

In the last decades, climate and environmental changes have highlighted the fragility and vulnerability of the landscape, especially in mountain areas where the effects are most severe. The strategy for hazard mitigation must deploy synergistic actions based on a thorough knowledge of the territory and its phenomena to enable integrated and effective land planning and management through suitable communication tools. This study promotes the methodological setup of a Landscape Digital Twin to establish a multi-disciplinary and multi-scalar hazards overview according to a matrix framework implementable over time and space. The original contribution to the research addresses a holistic vision that combines meaningfully qualitative with quantitative approaches to generate risk maps by integrating various indicators within a multi-hazard framework from the socio-economic perspective. This contribution presents road network risk analysis by exploiting flooding and landslide scenarios. The critical road segments or nodes most vulnerable or impacted by network performance and accessibility can be identified with minimal preprocessing from credible open-source sources. The method's applicability is tested in a Piedmont Region, northern Italy case study. The integration proposed will help generate comprehensive risk analysis maps that effectively portray the interconnectedness among natural hazards, infrastructure, and socio-economic factors fostering more resilient decision-making processes.

Data from Earth Observation (EO) satellites are increasingly used to monitor the environment, understand variability and change, inform evaluations of climate model forecasts and manage natural resources. Policy makers are progressively relying on the information derived from these datasets to make decisions on mitigating and adapting to climate change. These decisions should be evidence based, which requires confidence in derived products as well as the reference measurements used to calibrate, validate or inform product development. In support of the European Union’s Earth Observation Programmes Copernicus Climate Change Service, the Quality Assurance for Essential Climate Variables (QA4ECV) project fulfilled a gap in the delivery of climate quality satellite derived datasets by prototyping a robust, generic system for the implementation and evaluation of Quality Assurance (QA) measures for satellite-derived ECV climate data record products. The project demonstrated the QA system on six new long-term, climate quality ECV data records for surface Albedo, Leaf Area Index, FAPAR, NO₂, HCHO and CO. Provision of standardized QA information provides data users with evidence-based confidence in the products and enables judgement on the fitness-for-purpose of various ECV data products their specific applications.

In the evolving landscape of Portfolio Management (PM), the fusion of advanced machine 1 learning techniques with traditional financial methodologies has opened new avenues for innovation. 2 Our study introduces a cutting-edge model combining Deep Reinforcement Learning (DRL) with 3 a Non-stationary Transformer architecture. This model is specifically designed to decode complex 4 patterns in financial time series data, enhancing portfolio management strategies with deeper insights 5 and robustness. It effectively tackles the challenges of data heterogeneity and market uncertainty, 6 key obstacles in PM. Our approach integrates key macroeconomic indicators and targeted news 7 sentiment analysis into its framework, capturing a comprehensive picture of market dynamics. This 8 amalgamation of varied data types addresses the multifaceted nature of financial markets, enhancing 9 the model’s ability to navigate through the complexities of asset management. Rigorous testing 10 demonstrates the model’s efficacy, highlighting the benefits of blending diverse data sources and 11 sophisticated algorithmic approaches in mastering the nuances of PM.12

This research presents a comprehensive framework for efficiently generating forest fire datasets from Google Earth Engine data sources. The primary contribution of this work lies in providing a methodology to swiftly extract forest fire factors without the need for permissions or access to private datasets, rendering the dataset openly accessible and shared without barriers. Furthermore, given that the remote sensing data used is a global dataset, it can be applied in any region without restrictions. In this study, Peninsular Malaysia is chosen as a case study to demonstrate the framework's effectiveness. The generated dataset includes essential variables including the climate and environment, landcover, topography, and anthropogenic factors facilitating the analysis of fire occurrences. The methodology empowers data scientists, enabling them to leverage their analytical skills on the extracted dataset without requiring specialized remote sensing knowledge. Additionally, this study also showcases the adoption of large language models, specifically GPT-4 with the Noteable plugin, as a tool for conducting preliminary analyses on the generated dataset. Sample analyses reveal that several key features, including the KBDI, LST, PDSI, climate water deficit, and precipitation, significantly impact forest fire occurrences in Peninsular Malaysia. Despite the successful application of the GPT-4 with Noteable plugin, certain limitations and challenges are identified, highlighting the necessity for further validation of the tool's applicability and limitations. This study encourages future research to (1) adopt the proposed framework in other regions, (2) explore more detailed analyses encompassing all variables, and (3) leverage machine learning for advanced forecasting.

In recent years, more and more health data are being generated. These data come not only from professional health systems, but also from wearable devices. All these data combined form ‘big data’ that can be utilized to optimize treatments for each unique patient (‘precision medicine’). To achieve this precision medicine, it is necessary that hospitals, academia and industry work together to bridge the ‘valley of death’ of translational medicine. However, hospitals and academia often have problems with sharing their data, even though the patient is actually the owner of his/her own health data, and the sharing of data is associated with increased citation rate. Academic hospitals usually invest a lot of time in setting up clinical trials and collecting data, and want to be the first ones to publish papers on this data. The idea that society benefits the most if the patient’s data are shared as soon as possible so that other researchers can work with it, has not taken root yet. There are some publicly available datasets, but these are usually only shared after studies are finished and/or publications have been written based on the data, which means a severe delay of months or even years before others can use the data for analysis. One solution is to incentivize the hospitals to share their data with (other) academic institutes and the industry. Here we discuss several aspects of data sharing in the medical domain: publisher requirements, data ownership, support for data sharing, data sharing initiatives and how the use of federated data might be a solution. We also discuss some potential future developments around data sharing.

The rapid technological progress has ushered in a new era of human-computer interaction, where the distinction between the physical and virtual realms is becoming increasingly blurred. This research paper explores the profound and multifaceted intersection of Human-Data Interaction (HDI) and Data Virtualization (DV), examining how emerging technologies can significantly enhance the exploration, comprehension, and utilization of complex, multidimensional data sets. Informed by the insights gleaned from prior research in this domain , the present study delves into the potential of DV techniques to improve HDI, with a particular focus on three experimental investigations conducted within the realms of education, healthcare, and retail. The findings reveal the benefits and potential challenges associated with the implementation of DV in these diverse contexts, offering valuable guidance for the design and development of future HDI systems. Drawing upon a diverse array of authoritative sources, this paper presents a holistic, forward-looking perspective on the future of HDI, underscoring the critical role that DV will play in shaping the next generation of human-computer interfaces and facilitating a deeper, more intuitive understanding of the digital world. Furthermore, the paper presents a preliminary framework for integrating HDI principles into standard design practices. This framework outlines key considerations and guidelines to help designers and developers incorporate HDI techniques more effectively into the development of data-driven applications and interfaces.The proposed framework outlines key considerations for enhancing data accessibility and comprehension, empowering users to exercise greater control over their data, and cultivating transparent dialogues between data providers and end-users. By establishing this conceptual foundation, the paper aims to facilitate the seamless integration of HDI principles into standard design practices, ultimately leading to more intuitive, user-centric, and ethically-grounded approaches to data interaction and utilization.

Nowadays, one of the greatest challenges in Data Meshes revolves around detecting and creating Data Domains and Data Products for providing the ability to adapt easily and quickly to changing business needs. This requires a disciplined approach to identify, differentiate and prioritize distinct data sources according to their content and diversity. The current paper tackles this highly com-plicated issue and suggests a standardized approach that integrates the concept of Data Blueprints with Data Meshes. In essence, a novel standardization framework is proposed that creates Data Products using a metadata semantic enrichment mechanism, the latter also offering Data Domain readiness and alignment. The approach is demonstrated using real-world data produced by mul-tiple sources in a poultry meat production factory. A set of functional attributes is used to compare qualitatively the proposed approach against existing data structures utilized in storage architectures with quite promising results. Finally, experimentation with different scenarios varying in data product complexity and granularity suggests successful performance.

With an increasing amount of biological data available publicly, there is a need for a guide on how to successfully download and use this data. The Ten simple rules for using public biological data are: 1) use public data purposefully in your research, 2) evaluate data for your use case, 3) check data reuse requirements and embargoes, 4) be aware of ethics for data reuse, 5) plan for data storage and compute requirements, 6) know what you are downloading, 7) download programmatically and verify integrity, 8) properly cite data, 9) make reprocessed data and models Findable, Accessible, Interoperable, and Reusable (FAIR) and share, and 10) make pipelines and code FAIR and share. These rules are intended as a guide for researchers wanting to make use of available data and to increase data reuse and reproducibility.

Improvements in web platforms for data exchange and trading are creating more opportunities for users to obtain data from data providers of different domains. However, the current data exchange platforms are limited to unilateral information provision from data providers to users. In contrast, there are insufficient means for data providers to learn what kinds of data users desire and for what purposes. In this paper, we propose and discuss the description items for sharing users’ call for data as data requests in the data marketplace. We also discuss structural differences in data requests and providable data using variables, as well as possibilities of data matching. In the study, we developed an interactive platform, treasuring every encounter of data affairs (TEEDA), to facilitate matching and interactions between data providers and users. The basic features of TEEDA are described in this paper. From experiments, we found the same distributions of the frequency of variables but different distributions of the number of variables in each piece of data, which are important factors to consider in the discussion of data matching in the data marketplace.

The study investigated the usage of open data in public organizations, focusing on the motives, preferences, and governance ideals that determine their quality. The study shed light on how open data platforms are created and improved, as well as their influence on government operations. The primary goal was to understand the motivations behind the usage of open data, evaluate gov-ernance ideals, and examine institutions' efforts to standardize data formats. Hierarchical regres-sion analysis divides variables into core reasons and different preferences, demonstrating a need for "diversification" in order to use open data effectively. Efficiency, accountability, community impact, knowledge, and high-quality service delivery are all emphasized in governance value analysis. The institution's dedication to standardizing open data formats is evidenced by legislative measures and the integration of many technologies. The findings illustrate the institution's dual strategy of em-ploying traditional techniques and new technologies for effective data management. The report suggests increasing data openness and standardization, investing in ongoing training, upgrading alerting and awareness systems, and adopting specific regulations for open data use. Monitoring and feedback techniques are critical for adjusting and refining open data services to satisfy de-velopment needs. This study adds to the scientific knowledge of open data use by highlighting important motives, preferences, and governance ideals. The offered guidelines provide practical insights for public organizations looking to improve their open data platforms by promoting openness, efficiency, and community participation.

In the rapidly evolving field of data management, numerous terminologies, such as data warehouse, data lake, data lakehouse, and data mesh , have emerged, each representing a unique analytical data architecture. However, the distinctions and similarities among these paradigms often remain unclear. The present paper aimed to navigate the data architecture landscape by conducting a comparative analysis of these paradigms. The analysis a identified and elucidated the differences and similari- ties in features, capabilities, and limitations of these architectural constructs. The study outcome serves as a comprehensive guide, assisting practitioners in selecting the most suitable analytical data architecture for their specific applications.

Data Meshes is an approach to data architecture and organization that treats data as a product and focuses on decentralizing data ownership and access. It has recently emerged as a field that presents quite a few challenges related to data ownership, governance, security, monitoring, and observability. To address these challenges, this paper introduces an innovative algorithmic framework leveraging data blueprints to enable the dynamic creation of Data Meshes and Data Products in response to user requests, ensuring that stakeholders will have access to specific portions of the Data Mesh as needed. Ownership and governance concerns are addressed through a unique mechanism involving Blockchain and Non-Fungible Tokens (NFTs). This facilitates secure and transparent transfer of data ownership, with the ability to mint time-based NFTs. By combining these advancements with the fundamental tenets of Data Meshes, this research offers a comprehensive solution to the challenges surrounding data ownership and governance. It empowers stakeholders to navigate the complexities of data management within a decentralized architecture, ensuring a secure, efficient, and user-centric approach to data utilization. The proposed framework is demonstrated using real-world data from a poultry meat production factory.

As the digital transformation accelerates in our society, open data is being increasingly recognized as a key resource for digital innovation in the public sector. This study explores the following two research questions: 1) Can a machine learning approach be appropriately used for measuring and evaluating open data utilization? 2) Should different machine learning models be applied for measuring open data utilization depending on open data attributes (field and usage type)? This study used single-model (Random Forest, XGBoost, LightGBM, CatBoost) and multi-model (Stacking Ensemble) machine learning methods. A key finding is that the best-performing models differed depending on open data attributes (field and type of use). The applicability of the machine learning approach for measuring and evaluating open data utilization in advance was also confirmed. This study contributes to open data utilization and to the application of its intrinsic value to society.

The proposed method deals with the problem of data privacy and sharing when processing personal mobility tracking data. Previous methods concentrate on producing highly detailed data on short-term and restricted areas, e.g. for autonomous driving scenarios. Another possibility consists of city-wide scales and beyond, that are used to predict general traffic flows. The presented approach takes the tracked mobility behavior of individuals to create coherent new mobility data that reflects the long-term mobility behavior of the person, guaranteeing location persistency and sound embedding within the point-of-interest structure of the observed area. After an analysis and clustering step with the original data, the area is distributed into a geospatial grid structure (H3 is used here), and the neighborhood relationships between the grids are interpreted as a graph. A feed-forward-autoencoder and a graph encoding-decoding network generate a latent space representation of the area. The original clustered data is associated with their respective H3 grids. With a greedy algorithm approach and concerning privacy strategies, new combinations of grids are top-level patterns for individual mobility behavior. Concrete locations are found and connected within the grids based on the original data. The described method is then applied to a study with 1000 participants from the city of Munich in Germany, and the results are described, showing the application of the approach in generating synthetic data, enabling further research on individual mobility behavior and patterns. The result is a sharable dataset on the same abstraction level as the input data, which makes it interesting, particularly for machine learning applications.

Network effects, economies of scale, and lock-in-effects increasingly lead to a concentration of digital resources and capabilities, hindering the free and equitable development of digital entrepreneurship (SDG9), new skills, and jobs (SDG8), especially in small communities (SDG11) and their small and medium-sized enterprises (“SMEs”). To ensure the affordability and accessibility of technologies, promote digital entrepreneurship and community well-being (SDG3), and protect digital rights, we propose data cooperatives [1,2] as a vehicle for secure, trusted, and sovereign data exchange [3,4]. In post-pandemic times, community/SME-led cooperatives can play a vital role by ensuring that supply chains to support digital commons are uninterrupted, resilient, and decentralized [5]. Digital commons and data sovereignty provide communities with affordable and easy access to information and the ability to collectively negotiate data-related decisions. Moreover, cooperative commons (a) provide access to the infrastructure that underpins the modern economy, (b) preserve property rights, and (c) ensure that privatization and monopolization do not further erode self-determination, especially in a world increasingly mediated by AI. Thus, governance plays a significant role in accelerating communities’/SMEs’ digital transformation and addressing their challenges. Cooperatives thrive on digital governance and standards such as open trusted Application Programming Interfaces (APIs) that increase the efficiency, technological capabilities, and capacities of participants and, most importantly, integrate, enable, and accelerate the digital transformation of SMEs in the overall process. This policy paper presents and discusses several transformative use cases for cooperative data governance. The use cases demonstrate how platform/data-cooperatives, and their novel value creation can be leveraged to take digital commons and value chains to a new level of collaboration while addressing the most pressing community issues. The proposed framework for a digital federated and sovereign reference architecture will create a blueprint for sustainable development both in the Global South and North.

The scientific community has long benefited from the opportunities provided by data reuse. Recognizing the need to identify the challenges and bottlenecks to reuse in the agricultural research community and propose solutions for them, the data reuse working group was started within the AgBioData consortium (https://www.agbiodata.org/) framework. Here, we identify the limitations of data standards, metadata deficiencies, data interoperability, data ownership, data availability, user skill level, resource availability, and equity issues, with a specific focus on agricultural genomics research. We propose possible solutions stakeholders could implement to mitigate and overcome these challenges and provide an optimistic perspective on the future of genomics and transcriptomics data reuse.

To gain insight into the real-life care of patients in the healthcare system, data from hospital information systems and insurance systems are required. Consequently, linking clinical data with claims data is necessary. To ensure their syntactic and semantic interoperability, the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) was chosen. However, there is no detailed guide that would allow researchers to follow a consistent process for data harmonization. Thus, the aim of this paper is to conceptualize a generic data harmonization process for OMOP CDM. For this purpose, we conducted a literature review focusing on publications that address the harmonization of clinical or claims data in OMOP CDM. Subsequently, the process steps used and their chronological order were extracted for each included publication. The results were then compared to derive a generic sequence of the process steps. From 23 publications included, a generic data harmonization process for OMOP CDM was conceptualized, consisting of nine process steps: dataset specification, data profiling, vocabulary identification, coverage analysis of vocabularies, semantic mapping, structural mapping, extract-transform-load-process, qualitative and quantitative data quality analysis. This process can be used as a step-by-step guide to assist other researchers in harmonizing source data in OMOP CDM.

The rising importance of Big Data in modern information analysis is supported by vast quantities of user data, but it is only possible to collect sufficient data for all tasks within certain data-gathering contexts. There are many cases where a domain is too novel, too niche, or too sparsely collected to adequately support Big Data tasks. To remedy this, we have created ADG Engine that allows for the generation of additional data that follows the trends and patterns of the data that’s already been collected. Using a database structure that tracks users across different activity types, ADG Engine can use all available information to maximize the authenticity of the generated data. Our efforts are particularly geared towards data analytics by identifying abnormalities in the data and allowing the user to generate normal and abnormal data at custom ratios. In situations where it would be impractical or impossible to expand the available dataset by collecting more data, it can still be possible to move forward with algorithmically expanded data datasets.

Large datasets that enable researchers to perform investigations with unprecedented rigor are growing increasingly common in neuroimaging. Due to the simultaneous increasing popularity of open science, these state-of-the-art datasets are more accessible than ever to researchers around the world. While analysis of these samples has pushed the field forward, they pose a new set of challenges that might cause difficulties for novice users. Here, we offer practical tips for working with large datasets from the end-user’s perspective. We cover all aspects of the data life cycle: from what to consider when downloading and storing the data, to tips on how to become acquainted with a dataset one did not collect, to what to share when communicating results. This manuscript serves as a practical guide one can use when working with large neuroimaging datasets, thus dissolving barriers to scientific discovery.

Despite the demonstrated benefits of data monetization initiatives in achieving competitive advantages, many of these efforts struggle to realize their potential. Companies often find it challenging to sustain even initially successful data monetization initiatives due to significant data quality issues. This reflects a disconnect between advancements in data monetization research—spanning digitization, digitalization, and digital transformation—and practical implementation within companies. Consequently, misguided approaches to data monetization are relatively common. A critical prerequisite for successful data monetization is the establishment and maintenance of clean, high-quality data. This study underscores the importance of data quality by conducting an in-depth analysis of Medical Inc., a company engaged in preparing pristine customer master data for advanced customer analytics. The investigation aims to elucidate Medical Inc.’s approach to addressing data cleanliness challenges and to distill a general framework for the customer master data cleansing process. This framework illuminates a relatively unexplored aspect of data monetization supplementing existing literature on digitization, digitalization, and digital transformation.

Modern experimental astroparticle physics features large-scale setups measuring different messengers, namely high-energy particles generated by cosmic accelerators (e.g. supernova remnants, active galactic nuclei, etc): cosmic and gamma rays, neutrinos and recently discovered gravitational waves. Ongoing and future experiments are distributed over the Earth including ground, underground/underwater setups as well as balloon payloads and spacecrafts. The data acquired by these experiments have different formats, storage concepts and publication policies. Such differences are a crucial issue in the era of big data and of multi-messenger analysis strategies in astroparticle physics. We propose a service ASTROPARTICLE.ONLINE in the frame of which we develop an open science system which enables to publish, store, search, select and analyse astroparticle physics data. The cosmic-ray experiments KASCADE-Grande and TAIGA were chosen as pilot experiments to be included in this framework. In the first step of our initiative we will develop and test the following components of the full data life cycle concept: (i) describing, storing and reusing of astroparticle data; (ii) software for performing multi-experiment and multi-messenger analyses like deep-learning methods; (iii) outreach including example applications and tutorial for students and scientists outside the specific research field. In the present paper we describe the concepts of our initiative, and in particular the plans toward a common, federated astroparticle data storage.

As of 2020, public data for game ratings provided by Game Ratings And Administration Committee(GRAC) are more limited than public data for movie and video ratings provided by Korea Media Ratings Board and do not provide data which allow us to see information on ratings clearly and in detail. To get information on game ratings, we need to find information by searching for specific target on homepage which is inconvenient for us. In order to improve such inconvenience and extend scope of provision in public data, the author of this paper intends to study public data API which has been extended based on information on video ratings. To draw items to be extended, this study analyzes data for ratings on homepage of GRAC and designs collection system to build database. This study intends to implement system that provides data collected based on extended public data items in a form which users want. This study is expected to provide information on ratings to GRAC which will strengthen fairness and satisfy game users and people’s rights to know and contribute to promotion and development of game industry.

The study was conducted on applying machine learning and data mining methods to personalizing the treatment. This allows investigating individual patient characteristics. Personalization is built on the clustering method and associative rules. It was suggested to determine the average distance between instances for optimal performance metrics finding. The formalization of the medical data pre-processing stage for finding personalized solutions based on current standards and pharmaceutical protocols is proposed. The model of patient data is built. The paper presents the novel approach to clustering built on ensemble of cluster algorithm with better than k-means algorithm Hopkins metrics. The personalized treatment usually is based on decision tree. Such approach requires a lot of computation time and cannot be paralyzed. Therefore, it is proposed to classify persons by conditions, to determine deviations of parameters from the normative parameters of the group, as well as the average parameters. This made it possible to create a personalized approach to treatment for each patient based on long-term monitoring. According to the results of the analysis, it becomes possible to predict the optimal conditions for a particular patient and to find the medicaments treatment according to personal characteristics.

Data spaces are a relatively recent concept for a trusted and secure distributed data ecosystem through which to exchange resources in the Web. Several different efforts are currently being made to define guidance toward data space implementation, with some initiatives and organizations providing solutions and standards that address interoperability and good data exchange practices, especially in the domain of geospatial information. Geospatial Use Cases often require effective and high-quality data sharing between systems dealing with different aspects of real-world objects. However, the different solutions proposed do not yet provide a common interoperability framework with mature implementation options. This gap between concept and implementation risks confusing users and developers, instead of reciprocally strengthening the respective data spaces' infrastructures and capabilities. This paper reviews and compares some of the proposed solutions, providing mapping and integration of these blueprints to available interoperability standards. This concrete mapping is designed to support effective practical implementation of data spaces, and to guide future solutions developments.

Intellecta dataset emerges as an innovative synthetic dataset, engineered to enhance the cognitive processing capabilities of contemporary language models. With a composition of 11.53 billion tokens, integrating 8.01 billion tokens of synthetic data with 3.52 billion tokens of rich textbook data, Intellecta is crafted to foster advanced reasoning and comprehensive educational narrative generation. Leveraging the Mixtral-8x7B-Instruct-v0.1 model, the dataset facilitates the generation of complex thought processes and detailed, textbook-style explanations, thus enabling language models to engage in both critical thinking and profound educational discourse. This hybrid dataset stands as a testament to the potential of synthetic data in pushing the boundaries of AI, offering a repository that is not only vast and varied but also refined to align with ethical standards and intellectual rigor.

In the coming years, digital applications and services that continue to use the country's native cloud systems will be huge. By 2023, that will exceed 500 million, according to IDC. This corresponds to the sum of all applications developed in the last 40 years. If you are the one you answered, yes! This article is for you!

This manuscript describes the construction and validation of high resolution daily gridded (0.05° × 0.05°) rainfall and maximum and minimum temperature data for Bangladesh : the Enhancing National Climate Services for Bangladesh Meteorological Department (ENACTS-BMD) dataset. The dataset was generated by merging data from weather stations, satellite products (for rainfall) and reanalysis (for temperature). ENACTS-BMD is the first high-resolution gridded surface meteorological dataset developed specifically for studies of surface climate processes in Bangladesh. Its record begins in January 1981 and is updated in real-time monthly and outputs have daily, decadal and monthly time resolution. The Climate Data Tools (CDT), developed by the International Research Institute for Climate and Society (IRI), Columbia University, is used to generate the dataset. This data processing includes the collection of weather and gridded data, quality control of stations data, downscaling of the reanalysis for temperature, bias correction of both satellite rainfall and downscaled reanalysis of temperature, and the combination of station and bias-corrected gridded data. The ENACTS-BMD dataset is available as an open-access product at BMD’s official website, allowing the enhancement of the provision of services, overcoming the challenges of data quality, availability, and access, promoting at the same time the engagement and use by stakeholders.

The implementation of the European Cohesion Policy aiming at fostering regions competitiveness, economic growth and creation of new jobs is documented over the period 2014–2020 in the publicly available Open Data Portal for the European Structural and Investment funds. On the base of this source, this paper aims at describing the process of data mining and visualization for information production on regional programmes performace in achieving effective expenditure of resouces.

The increasing availability of longitudinal data (repeated numerical observations of same units at different times) requires the development of flexible techniques to automatically detect common errors in such data. Besides obvious and easily identifiable cases, such as missing or out-of-range data, large longitudinal dataset often present problems not easily traceable by the techniques used for generic datasets. In particular, elusive and baffling problems are i) inversion of one or more values from one unit to another; ii) anomalous jumps in the series of values, iii) errors in the timing of the values due to a recalculation operated by the data providers to compensate previous errors. This work proposes a statistical-mathematical approach based on a system of indicators that is able to capture the complexity of the described problems by working at the formal level, regardless of the specific meaning of the data. The proposed approach identifies suspect erroneous data and is applicable in a variety of contexts. We implement this approach in a relevant database of European Higher Education institutions (ETER) by analyzing Total academic staff, that is one of the most important variables, used in empirical analysis as proxy of size and also considered by policy makers at European level.

In the last decade and a half, the world has experienced the outbreak of a range of viruses such as COVID-19, H1N1, flu, Ebola, Zika Virus, Middle East Respiratory Syndrome (MERS), Measles, and West Nile Virus, just to name a few. During these virus outbreaks, the usage and effectiveness of social media platforms increased significantly as such platforms served as virtual communities, enabling their users to share and exchange information, news, perspectives, opinions, ideas, and comments related to the outbreaks. Analysis of this Big Data of conversations related to virus outbreaks using concepts of Natural Language Processing such as Topic Modeling has attracted the attention of researchers from different disciplines such as Healthcare, Epidemiology, Data Science, Medicine, and Computer Science. The recent outbreak of the MPox virus has resulted in a tremendous increase in the usage of Twitter. Prior works in this field have primarily focused on the sentiment analysis and content analysis of these Tweets, and the few works that have focused on topic modeling have multiple limitations. This paper aims to address this research gap and makes two scientific contributions to this field. First, it presents the results of performing Topic Modeling on 601,432 Tweets about the 2022 Mpox outbreak, which were posted on Twitter between May 7, 2022, and March 3, 2023. The results indicate that the conversations on Twitter related to Mpox during this time range may be broadly categorized into four distinct themes - Views and Perspectives about MPox, Updates on Cases and Investigations about Mpox, MPox and the LGBTQIA+ Community, and MPox and COVID-19. Second, the paper presents the findings from the analysis of these Tweets. The results show that the theme that was most popular on Twitter (in terms of the number of Tweets posted) during this time range was - Views and Perspectives about MPox. It is followed by the theme of MPox and the LGBTQIA+ Community, which is followed by the themes of MPox and COVID-19 and Updates on Cases and Investigations about Mpox, respectively. Finally, a comparison with prior works in this field is also presented to highlight the novelty and significance of this research work.

In this paper, we present a method to map information regarding service activity provision residing in governmental portals across European Commission. In order to perform this, we used as a basis the enriched Greek e-GIF ontology, modeling concepts, and relations in one of the two data portals (i.e., Points of Single Contacts) examined, since relevant information on the second was not provided. Mapping consisted in transforming information appearing in governmental portals in RDF format (i.e., as Linked data), in order to be easily exchangeable. Mapping proved a tedious task, since description on how information is modeled in the second Point of Single Contact is not provided and must be extracted in a manual manner.

Background: Observational health data has the potential to be a rich resource to inform clinical practice and regulatory decision making. However, the lack of standard data quality processes makes it difficult to know if these data are research ready. The EHDEN COVID-19 Rapid Col-laboration Call presented the opportunity to assess how the newly developed open-source tool Data Quality Dashboard (DQD) informs the quality of data in a federated network. Methods: 15 Data Partners (DPs) from 10 different countries worked with the EHDEN taskforce to map their data to the OMOP CDM. Throughout the process at least two DQD results were collected and compared for each DP. Results: All DPs showed an improvement in their data quality between the first and last run of the DQD. The DQD excelled at helping DPs identify and fix conformance is-sues but showed less of an impact on completeness and plausibility checks. Conclusions: This is the first study to apply the DQD on multiple, disparate databases across a network. While study-specific checks should still be run, we recommend that all data holders converting their data to the OMOP CDM use the DQD as it ensures conformance to the model specifications and that a database meets a baseline level of completeness and plausibility for use in research.

One of the most remarkable features in the 20th century was the digitalization of technical progress, which changed the output of companies worldwide and became a defining feature of the century. The growth of information technology systems and the implementation of new technical advances, which enhance the integrity, agility and long-term organizational performance of the supply chain, can distinguish a digital supply chain from other supply chains. For example, the Internet of Things (IoT)-enabled information exchange and Big Data analysis might be used to regulate the mismatch between supply and demand. In order to assess contemporary ideas and concepts in the field of data analysis in the context of supply chain management, this literary investigation has been decided. The research was conducted in the form of a comprehensive literature review. In the SLR investigation, a total of 71 papers from leading journals were used. SLR has found that data analytics integrate into supply chain management can have long-term benefits on supply chain management from the input side, i.e., improved strategic development, management and other areas.

During virus outbreaks in the recent past web behavior mining, modeling, and analysis have served as means to examine, explore, interpret, assess, and forecast the worldwide perception, readiness, reactions, and response linked to these virus outbreaks. The recent outbreak of the Marburg Virus disease (MVD), the high fatality rate of MVD, and the conspiracy theory linking the FEMA alert signal in the United States on October 4, 2023, with MVD and a zombie outbreak, resulted in a diverse range of reactions in the general public which has transpired in a surge in web behavior in this context. This resulted in “Marburg Virus” featuring in the list of the top trending topics on Twitter on October 3, 2023, and “Emergency Alert System” and “Zombie” featuring in the list of top trending topics on Twitter on October 4, 2023. No prior work in this field has mined and analyzed the emerging trends in web behavior in this context. The work presented in this paper aims to address this research gap and makes multiple scientific contributions to this field. First, it presents the results of performing time series forecasting of the search interests related to MVD emerging from 216 different regions on a global scale using ARIMA, LSTM, and Autocorrelation. The results of this analysis present the optimal model for forecasting web behavior related to MVD in each of these regions. Second, the correlation between search interests related to MVD and search interests related to zombies (in the context of this conspiracy theory) was investigated. The findings show that there were several regions where there was a statistically significant correlation between MVD-related searches and zombie-related searches (in the context of this conspiracy theory) on Google on October 4, 2023. Finally, the correlation between zombie-related searches (in the context of this conspiracy theory) in the United States and other regions was investigated. This analysis helped to identify those regions where this correlation was statistically significant.

A distinction is made between data rescue (i.e., copying, digitizing and archiving) and data recovery that implies deciphering, interpreting and transforming early instrumental readings and their metadata to obtain high-quality datasets in modern units. This requires a multidisciplinary approach that includes: palaeography and knowledge of Latin and other languages to read the handwritten logs and additional documents; history of science to interpret the original text, data e metadata within the cultural frame of the 17th, 18th and early 19th century; physics and technology to recognize bias of early instruments or calibrations, or to correct for observational bias; astronomy to calculate and transform the original time in canonical hours that started from twilight. The liquid-in-glass thermometer was invented in 1641 and the earliest temperature records started in 1654. Since then, different types of thermometers were invented, based on the thermal expansion of air or selected thermometric liquids with deviation from linearity. Reference points, thermometric scales, calibration methodologies were not comparable, and not always adequately described. Thermometers had various locations and exposures, e.g., indoor, outdoor, on windows, gardens or roofs, facing different directions. Readings were made only one or a few times a day, not necessarily respecting a precise time schedule: this bias is analysed for the most popular combinations of reading times. The time was based on sundials and local Sun, but the hours were counted starting from twilight. In 1789-90 Italy changed system and all cities counted hours from their lower culmination (i.e., local midnight), so that every city had its local time; in 1866, all the Italian cities followed the local time of Rome; in 1893, the whole Italy adopted the present-day system, based on the Coordinated Universal Time and the time zones. In 1873, when the International Meteorological Committee (IMO) was founded, later transformed in World Meteorological Organization (WMO), a standardization of instruments and observational protocols was established, and all data became fully comparable. In the early instrumental period, from 1654 to 1873, the comparison, correction and homogenization of records is quite difficult, mainly because of the scarcity or even absence of metadata. This paper deals about this confused situation, discussing the main problems, but also the methodologies to recognize missing metadata, distinguish indoor from outdoor readings; correct and transform early datasets in unknown or arbitrary units into modern units; finally, in which cases it is possible to reach the quality level required by WMO. The focus is to explain the methodology needed to recover early instrumental records, i.e., the operations that should be performed to interpret, correct, and transform the original raw data into a high-quality dataset of temperature, usable for climate studies.

In the dynamic arena of healthcare research, where the complexities of data often rival the intricacies of biological systems, the ability to model and analyze such multifaceted datasets is crucial. This comprehensive review delves into the evolution and application of Soft Sets and their extensions, including HyperSoft Sets, SuperHyperSoft Sets, IndetermSoft Sets, IndetermHyperSoft Sets, and TreeSoft Sets, in healthcare claims data analysis. These extensions address intricate challenges in data analysis, offering versatile frameworks for managing uncertainty and indeterminacy inherent in healthcare claims data. By exploring their definitions and applications, this review elucidates how these mathematical tools have evolved and their significance in advancing healthcare research and enhancing data analysis methodologies. Real-world examples underscore the implications of these tools, emphasizing their pivotal role in facilitating informed decision-making and knowledge discovery in healthcare. The review systematically examines various case studies and research findings to illustrate the practical utility of Soft Set extensions. Detailed analyses of real-world scenarios highlight advancements in processing complex healthcare data. The conclusions drawn from this analysis indicate that the adoption of Soft Sets and their extensions can significantly improve the accuracy and efficiency of healthcare data analysis, ultimately contributing to better healthcare outcomes and more informed policy-making. Future research directions are also discussed, suggesting further potential applications and developments in this field.

The World Health Organization (WHO) added Disease X to their shortlist of blueprint priority diseases to represent a hypothetical, unknown pathogen that could cause a future epidemic. During different virus outbreaks of the past, such as COVID-19, Influenza, Lyme Disease, and Zika virus, researchers from various disciplines utilized Google Trends to mine multimodal components of web behavior to study, investigate, and analyze the global awareness, preparedness, and response associated with these respective virus outbreaks. As the world prepares for Disease X, a dataset on web behavior related to Disease X would be crucial to contribute towards the timely advancement of research in this field. Furthermore, none of the prior works in this field have focused on the development of a dataset to compile relevant web behavior data, which would help to prepare for Disease X. To address these research challenges, this work presents a dataset of web behavior related to Disease X, which emerged from different geographic regions of the world, between February 2018 to August 2023. Specifically, this dataset presents the search interests related to Disease X from 94 geographic regions. These regions were chosen for data mining as these regions recorded significant search interests related to Disease X during this timeframe. The dataset was developed by collecting data using Google Trends. The relevant search interests for all these regions for each month in this time range are available in this dataset. This paper also discusses the compliance of this dataset with the FAIR principles of scientific data management. Finally, a brief analysis of specific features of this dataset is presented to uphold the applicability, relevance, and usefulness of this dataset for the investigation of different research questions in the interrelated fields of Big Data, Data Mining, Healthcare, Epidemiology, and Data Analysis.

Mining and analysis of the Big Data of Twitter conversations have been of significant interest to the scientific community in the fields of healthcare, epidemiology, big data, data science, computer science, and their related areas, as can be seen from several works in the last few years that focused on sentiment analysis and other forms of text analysis of Tweets related to Ebola, E-Coli, Dengue, Human papillomavirus (HPV), Middle East Respiratory Syndrome (MERS), Measles, Zika virus, H1N1, influenza-like illness, swine flu, flu, Cholera, Listeriosis, cancer, Liver Disease, Inflammatory Bowel Disease, kidney disease, lupus, Parkinson's, Diphtheria, and West Nile virus. The recent outbreaks of COVID-19 and MPox have served as "catalysts" for Twitter usage related to seeking and sharing information, views, opinions, and sentiments involving both these viruses. While there have been a few works published in the last few months that focused on performing sentiment analysis of Tweets related to either COVID-19 or MPox, none of the prior works in this field thus far involved analysis of Tweets focusing on both COVID-19 and MPox at the same time. With an aim to address this research gap, a total of 61,862 Tweets that focused on Mpox and COVID-19 simultaneously, posted between May 7, 2022, to March 3, 2023, were studied to perform sentiment analysis and text analysis. The findings of this study are manifold. First, the results of sentiment analysis show that almost half the Tweets (the actual percentage is 46.88%) had a negative sentiment. It was followed by Tweets that had a positive sentiment (31.97%) and Tweets that had a neutral sentiment (21.14%). Second, this paper presents the top 50 hashtags that were used in these Tweets. Third, it presents the top 100 most frequently used words that are featured in these Tweets. The findings of text analysis show that some of the commonly used words involved directly referring to either or both viruses. In addition to this, the presence of words such as "Polio", "Biden", "Ukraine", "HIV", "climate", and "Ebola" in the list of the top 100 most frequent words indicate that topics of conversations on Twitter in the context of COVID-19 and MPox also included a high level of interest related to other viruses, President Biden, and Ukraine. Finally, a comprehensive comparative study that involves a comparison of this work with 49 prior works in this field is presented to uphold the scientific contributions and relevance of the same.

Information has been and will be a vital element for a person or department groups in an organization. That is why there are technologies that help us to give them the proper management of data; Business Intelligence is responsible for bringing technological solutions that correctly and effectively manage the entire volume of necessary and important information for companies. Among the solutions offered by Business Intelligence are Data Warehouses, Data Mining, among other business technologies that working together achieve the objectives proposed by an organization. It is important to highlight that these business technologies have been present since the 50's and have been evolving through time, improving processes, infrastructure, methodologies and implementing new technologies, which have helped to correct past mistakes based on information management for companies. There are questions about Business Intelligence. Could it be that in the not-too-distant future it will be used as an essential standard or norm in any organization for data management, since it provides many benefits and avoids failures at the time of classifying information. On the other hand, Cloud storage has been the best alternative to safeguard information and not depend on physical storage media, which are not 100% secure and are exposed to partial or total loss of information, by presenting hardware failures or security failures due to mishandling that can be given to such information.

This paper presents an innovative data-centric paradigm for designing computational systems by introducing a new informatics domain model. The proposed model moves away from the conventional node-centric framework and focuses on data-centric categorization, using a multimodal approach that incorporates objects, events, concepts, and actions. By drawing on interdisciplinary research and establishing a foundational ontology based on these core elements, the model promotes semantic consistency and secure data handling across distributed ecosystems. We also explore the implementation of this model as an OWL 2 ontology, discuss its potential applications, and outline its scalability and future directions for research. This work aims to serve as a foundational guide for system designers and data architects in developing more secure, interoperable, and scalable data systems.

This study aims to propose a method for constructing basic digital twin data in South Korea by adhering to international standards and utilizing publicly available data. Specifically, the study focuses on designing and proposing a digital twin data model for buildings, which are the most applicable among the basic digital twin data. To achieve this, the first section provides essential background information, introduces concepts and requirements related to digital twin basic data, and offers a brief overview of CityGML. The second section explains the methodology and data used in this study. The third section presents the main findings: the selection of public data (buildings) for constructing digital twin basic data, the mapping process using CityGML, and the creation of UML diagrams. The fourth section discusses these findings. Finally, the conclusion and suggestions for future research are provided. This approach enhances the accuracy of building-related digital twin data and supports the use of digital twin services in both public and private sectors by enabling various spatial analyses.

Background: Real-world data (RWD) related to the health status and care of cancer patients reflect the ongoing medical practice, and their analysis yields essential real-world evidence. Advanced information technologies are vital for their collection, qualification, and reuse in research projects. Methods: UNICANCER, the French federation of comprehensive cancer centres, has innovated a unique research network : Consore. This potent federated tool enables the analysis of data from millions of cancer patients across eleven French hospitals. Results: Currently operational within eleven French cancer centres, Consore employs natural language processing to structure the therapeutic management data of approximately 1.3 million cancer patients. This data originates from their electronic medical records, encompassing about 65 millions of medical records. Thanks to the structured data, which is harmonized within a common data model, and its federated search tool, Consore can create patient cohorts based on patient or tumor characteristics, and treatment modalities. This ability to derive larger cohorts is particularly attractive when studying rare cancers. Conclusions: Consore serves as a tremendous data mining instrument that propels French cancer centres into the big data era. With its federated technical architecture and unique shared data model, Consore facilitates compliance to regulations and acceleration of cancer research projects.

Nowadays, information security is a challenge especially when transmitted or shared in public clouds. Many of researchers have been proposed technique which fails to provide data integrity, security, authentication and another issue related to sensitivity data. The most common techniques were used to protect data during transmission on public cloud are cryptography, steganography, and compression. The proposed scheme suggests an entirely new approach for data security on public cloud. Authors have suggested an entirely new approach that completely makes secret data invisible behind carrier object and it is not been detected with the image performance parameters like PSNR, MSE, entropy and others. The details of results are explain in result section of paper. Proposed technique have better outcome than any other existing technique as a security mechanism on a public cloud. Primary focus of suggested approach is to minimize integrity loss of public storage data due to unrestricted access rights by uses. To improve reusability of carrier even after data concealed is really a challenging task and achieved through suggested approach.

Educational data-mining is an evolving discipline that focuses on the improvement of self-learning and adaptive methods. It is used for finding hidden patterns or intrinsic structures of educational data. In the arena of education, the heterogeneous data is involved and continuously growing in the paradigm of big-data. To extract meaningful information adaptively from big educational data, some specific data mining techniques are needed. This paper presents a clustering approach to partition students into different groups or clusters based on their learning behavior. Furthermore, personalized e-learning system architecture is also presented which detects and responds teaching contents according to the students’ learning capabilities. The primary objective includes the discovery of optimal settings, in which learners can improve their learning capabilities. Moreover, the administration can find essential hidden patterns to bring the effective reforms in the existing system. The clustering methods K-Means, K-Medoids, Density-based Spatial Clustering of Applications with Noise, Agglomerative Hierarchical Cluster Tree and Clustering by Fast Search and Finding of Density Peaks via Heat Diffusion (CFSFDP-HD) are analyzed using educational data mining. It is observed that more robust results can be achieved by the replacement of existing methods with CFSFDP-HD. The data mining techniques are equally effective to analyze the big data to make education systems vigorous.

The aim of this article is to summarize recent bioinformatic and statistical developments applicable to NMR-based metabolomics. Extracting relevant information from large multivariate datasets by statistical data analysis strategies may be of considerable complexity. Typical tasks comprise for example classification of specimens, identification of differentially produced metabolites, and estimation of fold changes. In this context it is of prime importance to minimize contributions from unwanted biases and experimental variance prior to these analyses. This is the goal of data normalization. Therefore, special emphasize is given to different data normalization strategies. In the first part, we will discuss the requirements and the pros and cons for a variety of commonly applied strategies. In the second part, we will concentrate on possible solutions in case that the requirements for the standard strategies are not fulfilled. In the last part, very recent developments will be discussed that allow reliable estimation of metabolic signatures for sample classification without prior data normalization. In this contribution special emphasis will be given to techniques that have worked well in our hands.

In the age of the digital economy, the security and privacy for multimedia systems issues are increasingly manifested in the form of data. The level of data protection governance capability determines whether the security and privacy of multimedia systems can be protected. In recent years, China has introduced laws and regulations on the protection of personal information, personal privacy, data security, and cyber-security. Although data protection is still to be improved, China has been refining the provisions on data security management through practice and the adoption of supporting regulations.