Quantile regression model is widely used in variable relationship research of general size data, due to strong robustness and more comprehensive description of the response variables' characteristics. With the increase of data size and data dimension, there have been some studies on high-dimensional quantile regression under the classical statistical framework, including higher-efficient frequency perspective, which is however at cost of randomness quantification, or lower-efficient Bayesian method based on MCMC sampling. To overcome these problems, we propose the high-dimensional quantile regression with Spike-and-Slab Lasso penalty based on variational Bayesian (VBSSLQR), which can not only improve the computational efficiency but also measure the randomness via variational distributions. The simulation studies and real data analysis illustrate that the proposed VBSSLQR method is superior to or equivalent to other quantile and non-quantile regression methods (including Bayesian and non-Bayesian methods), and its efficiency is higher than any other method.

In this paper, we present a relapse based demonstrating way to deal with investigate various arrangement MTC information. A commonplace use of this displaying approach incorporates three stages: first, define a model that approximates the connection between quality articulation and trial factors, with boundaries consolidated to address the exploration premium; second, utilize least-squares and assessing condition methods to gauge boundaries and their relating standard blunders; third, register test insights, P-qualities and NFD as proportions of factual criticalness. The benefits of this methodology are as per the following. To begin with, it tends to the exploration interest in a particular, precise way, and maximally uses all the information and other important data. Second, it represents both orderly and irregular varieties related with the information, and the consequences of such examination give not just quality explicit data applicable to the exploration objective, yet additionally its dependability, in this way helping agents to settle on better choices for subsequent investigations. Third, this methodology is truly adaptable, and can undoubtedly be stretched out to different sorts of MTC considers or other microarray explores by detailing various models dependent on the test plan of the investigations.

Tuberculosis cause of death worldwide and the leading cause from a single infectious agent, ranking above Human immunodeficiency virus (HIV) and Acquired Immune Deficiency Syndrome (AIDS). The aim of this study is to ascertain the trend of tuberculosis prevalence and the effect of HIV prevalence onl Tuberculosis case in some West African countries from 2000 to 2016 using count panel data regression models. The data used annual HIV and Tuberculosis cases spanning from 2000 to 2016 extracted from online publication of World health Organization (WHO). Panel Poisson regression model and Negative binomial regression model for fixed and random effects were used to analyzed the count data, the result revealed a positive trend in TB cases while increased in HIV cases leads to increase in TB cases in West African countries. Among the competing models used in this study, Panel Negative Binomial Regression Model with fixed effect emerged the best model with log likelihood value of -1336.554. This study recommended that Government and NGOs need more strategies to fight against HIV menace in West Africa as this will in turn reduced TB cases in West Africa.

In this work we looked for a stable and accurate procedure to perform feature selection in datasets with a much higher number of predictors than individuals, as in Genome-Wide Association Studies. Due to the instability in feature selection when many potential predictors are measured, a variable selection procedure is proposed that combines several replications of shrinkage regression models. A weighted formulation is used to define the final predictors. The procedure is applied to investigate Single Nucleotide Polymorphisms (SNPs) predictors associated to Alzheimer’s disease in the Alzheimer’s disease Neuroimaging Initiative (ADNI) dataset. Two data scenarios are investigated: one considering only the set of SNPs and another with the covariates age, sex, educational level and APOE4 genotype. The SNP rs2075650 and the APOE4 genotype are given as risk factors for AD, which is in line with the literature, and other four new SNPs are pointed, opening new hypotheses for in vivo analyses. These experiments demonstrate the potential of the new method for stable feature selection.

Although data acquisition is a very usual technique, there are several aspects not always considered, as synchronization of acquired measures and evaluation of the errors that derive from this fact. The paper hereby aims to point this thing out, by mathematical determination of the necessary correction and implementing the software meant to evaluate the performances of the acquisition system. As an example, a three-phased acquisition system has been developed in order to monitor the currents and voltages on the three phases. Also other measures have been calculated, such as power and phase. The components on each phase don’t have to be fully identified because a whole system calibration can be made in the first stage. Calibration consists in finding the weighting coefficients for each quantity. The implemented solution for three-phased measures data acquisition starts from the hypothesis of a sampling frequency that respects Shannon theorem. The distance between two samples is small enough to consider a linear evolution between two moments for the same measure. Errors that affect the above mentioned, due to the different moments of time when samples are acquired, are analyzed and brought to the minimum value.

This study attempts to assess the impact of corruption on economic growth in the Mediterranean countries, during the period from 1998 to 2007. Econometric analysis using panel regression has been adopted to test this effect. Individual effects models such as random effects model and fixed effects model were applied to the study sample of 160 observations, and to choose the suitable model, we implemented several tests. For our analysis, we used a basic model that includes the dependent variable GDP per capita as a factor of economic growth and the corruption perception index as the independent variable concerned. Then we completed the model with several standardized macroeconomic control variables mentioned above and applied the individual effects models. The outcomes illustrate that corruption has a negative impact on the selected Mediterranean countries’ economic growth.

Background: In the functional data analysis (FDA), the hybrid or mixed data are scalar and functional datasets. The semi-functional partial linear regression model (SFPLR) is one of the first semiparametric models for the scalar response with hybrid covariates. Various extensions of this model are explored and summarized. Methods: Two first research articles, including “semi-functional partial linear regression model”, and “Partial functional linear regression” have more than 300 citations in Google Scholar. Finally, only 106 articles remained according to the inclusion and exclusion criteria such as 1) including the published articles in the ISI journals and excluding 2) non-English and 3) preprints, slides, and conference papers. We use the PRISMA standard for systematic review. Results: The articles are categorized into the following main topics: estimation procedures, confidence regions, time series, and panel data, Bayesian, spatial, robust, testing, quantile regression, varying Coefficient Models, Variable Selection, Single-index model, Measurement error, Multiple Functions, Missing values, Rank Method and Others. There are different applications and datasets such as the Tecator dataset, air quality, electricity consumption, and Neuroimaging, among others. Conclusions: SFPLR is one of the most famous regression modeling methods for hybrid data that has a lot of extensions among other models.

High-dimensional measurement error data are becoming more prevalent across various fields. Research on measurement error regression models has gained increasing attention due to the risk of drawing inaccurate conclusions if measurement errors are ignored. When the dimension p is larger than the sample size n, it is challenging to develop statistical inference methods for high-dimensional measurement error regression models due to the existence of bias, nonconvexity of objective function, high computational cost and many other difficulties. Over the past few years, some works have overcome the aforementioned difficulties and proposed several statistical inference methods. This paper mainly reviews the current development on estimation, hypothesis testing and variable screening methods for high-dimensional measurement error regression models and shows the theoretical results of these methods with some directions worthy of exploring for future research.

The coronavirus disease (COVID-19) vaccine is key to reducing the probability of contracting COVID-19. The vaccine is generally known to prevent severe illness, death, and hospitalization as a result of the disease and for considerably reducing COVID-19 infection risk. Accordingly, this might significantly change an individual’s perceived risk of altering everyday behaviors. For instance, the proliferation of vaccination is anticipated to reduce preventive behaviors such as staying at home, handwashing, and wearing a mask. We corresponded with the same individuals monthly for 18 months from March 2020 (early stage of COVID-19) to September 2021 in Japan to independently construct large sample panel data (N=54,007), with a participation rate of 54.7 %. We used a fixed effects model, controlling for key confounders, to determine whether vaccination was associated with a change in preventive behaviors. The major findings are as follows. Contrary to the prediction, (1) based on the whole sample, being vaccinated against COVID-19 led people to stay at home; however, it did not change the habit of handwashing and wearing a mask. Especially after the second shot, respondents were likelier to stay at home by 0.107 (95% CIs: 0.059–0.154) points on a 5-point scale compared to before the vaccination. Dividing the entire sample into young and old, (2) those aged ≤ 40 years were more likely to go out after being vaccinated, and (3) people over 40 years of age were more likely to stay at home (similar to the first result). Preventive behaviors impact all individuals during the current pandemic. Informal social norms motivate people to increase or maintain preventive behaviors even after being vaccinated in societies where these behaviors are not enforced.

We present a differentially private extension of the block coordinate descent based on objective perturbation. The algorithm iteratively performs linear regression in a federated setting on vertically partitioned data. In addition to a privacy guarantee, the algorithm also offers a utility guarantee; a tolerance parameter indicates how much the differentially private regression may deviate from an analysis without differential privacy. The algorithm’s performance is compared with the standard block coordinate descent algorithm and the trade-off between utility and privacy is studied. The performance is studied using both artificial test data and the forest fires data set. We find that the algorithm is fast and able to generate practical predictions with single-digit privacy budgets, albeit with some accuracy loss.

Panel data of our interest consist of a moderate number of panels, while the panels contain a small number of observations. An estimator of common breaks in panel means without a boundary issue for this kind of scenario is proposed. In particular, the novel estimator is able to detect a common break point even when the change happens immediately after the first time point or just before the last observation period. Another advantage of the elaborated change point estimator is that it results in the last observation in situations with no structural breaks. The consistency of the change point estimator in panel data is established. The results are illustrated through a simulation study. As a by-product of the developed estimation technique, a theoretical utilization for correlation structure estimation, hypothesis testing, and bootstrapping in panel data is demonstrated. A practical application to non-life insurance is presented as well.

We present a new penalized method for estimation in sparse logistic regression models with group structure. Group sparsity suggests us to consider the Group Lasso penalty. Being different from penalized log-likelihood estimation, our method can be viewed as a penalized weighted score function method. Under some mild conditions, we provide non-asymptotic oracle inequalities promoting group sparsity of predictors. A modified block coordinate descent algorithm based on a weighted score function is also employed. The net advantage of our algorithm over the existing Group Lasso-type procedures is that the tuning parameter can be pre-specified. The simulations show that this algorithm is considerably faster and more stable than competing methods. Finally, we illustrate our methodology with two real data sets.

Asymptotic theories for fractional cointegrations have been extensively studied in the context of time series data, with numerous empirical studies and tests developed. However, most of the previously developed testing procedures for fractional cointegration were primarily designed for time series data. This paper proposes a generalized residual-based test for fractionally cointegrated panels with fixed effects. The test development is based on bivariate panel series with the regressor assumed to be fixed across cross-sectional units. The proposed test procedure accommodates any integration order between [0,1], and it is asymptotically normal under the null hypothesis. Monte Carlo experiments demonstrate that the test exhibits better size and power compared to a similar residual-based test across varying sample sizes.

Genome-wide association studies (GWAS) have successfully revealed many disease-associated genetic variants. For a case-control study, the adequate power of an association test can be achieved with a large sample size, although genotyping large samples is expensive. A cost‐effective strategy to boost power is to integrate external control samples with publicly available genotyped data. However, the naïve integration of external controls may inflate the type I error rates if ignoring the systematic differences (batch effect) between studies, such as the differences in sequencing platforms, genotype calling procedures, population stratification, and so forth. To account for the batch effect, we propose an approach by integrating External Controls into the Association Test by Regression Calibration (iECAT-RC) in case-control association studies. Extensive simulation studies show that iECAT-RC not only can control type I error rates but also can boost statistical power in all models. We also apply iECAT-RC to the UK Biobank data for M72 Fibroblastic disorders by considering genotype calling as the batch effect. Four SNPs associated with Fibroblastic disorders have been detected by iECAT-RC and the other two comparison methods. However, our method has a higher probability of identifying these significant SNPs in the scenario of an unbalanced case-control association study.

Missing observations constitute one of the most important issues in data analysis in applied research studies. The magnitude and their structure impact parameters estimation in the modeling with important consequences for decision-making. This study aims to evaluate the efficiency of imputation methods combined with the backpropagation algorithm in a nonlinear regression context. The evaluation is conducted through a simulation study including sample sizes (50, 100, 200, 300 and 400) with different missing data rates (10, 20, 30 40 and 50%) and three missingness mechanisms (MCAR, MAR and MNAR). Four imputation methods (Last Observation Carried Forward, Random Forest, Amelia and MICE) were used to impute datasets before making prediction with backpropagation. 3-MLP model was used by varying the activation functions (Logistic-Linear, Logistic-Exponential, TanH-Linear and TanH-Exponentiel), the number of nodes in the hidden layer (3 - 15) and the learning rate (20 - 70%). Analysis of the performance criteria (R2, r and RMSE) of the network revealed good performances when it is trained with TanH-Linear functions, 11 nodes in the hidden layer and a learning rate of 50%. MICE and Random Forest were the most appropriate for data imputation. These methods can support up to 50% of missing rate with an optimal sample size of 200.

With the popularity of solar energy in the electricity market, demand arises for data such as precise locations of solar panels for efficient energy planning, management, and distribution. However, this data is not easily accessible and in some cases, information such as precise locations does not exist. Furthermore, existing data sets for training semantic segmentation models of PV installations are limited, and their annotation is time-consuming and labor-intensive. Therefore, for additional remote sensing (RS) data creation, the pix2pix generative adversarial network (GAN) is utilized, enriching the original resampled training data of varying GSDs without compromising its integrity. Experiments done with the DeepLabV3 model, ResNet-50 backbone, and pix2pix GAN architecture were conducted to find the optimal configuration for an accurate RS imagery segmentation model. The result is a fine-tuned solar panel semantic segmentation model, trained using transfer learning and utilizing an optimal amount – 60% of generated RS imagery for additional training data, increasing model accuracy. The findings demonstrate the benefits of using GAN-generated images as additional training data, increasing the size of small data sets, and improving the capabilities of the segmentation model for solar panel detection in RS images.

Building energy demand impacts a myriad of interconnected economic, societal, and environmental aspects. As a result, Buildings Energy Models (BEM) play an important role in the process of urban design and planning. While previous studies have investigated the effects of building interventions on energy efficiency, their applicability may be limited due to the BEM’s high computational complexity. This limits their ability to systematically study important aspects of energy demand on a large scale. The development of Machine Learning Models (MLM) allows to design the required detailed analysis and solutions, while reducing the computational burden, making MLM attractive for urban designers. The capability of MLM to generalize well for multiple contexts (in our case, multiple buildings) is a crucial contributor to their applicability. However, the validation process in a wider context is often overlooked, therefore its generalization capabilities are not quantified. In this paper, we present a framework to train and validate a surrogate model derived from a physics-based BEM. Our method employs a Multiple Linear Regression model to predict Energy Use Intensity (EUI) for office buildings in Singapore using 36 input parameters (covariates), based on a training dataset of 23,000 samples. Model validation is performed by comparing the results of the Surrogate Model (SM) to a widely used BEM for a sample of 120 buildings. Our results indicate that the SM has an accuracy of NRMSE of 13%, NMBE of −3.56%, and R2 of 0.92, which suggests it can effectively and accurately predict building EUI. We also conduct a sensitivity analysis, which indicates that the parameters associated with internal loads and internal space usage are the most influential. Additionally, we present a reduced order model trained with only the 11 most influential parameters, which exhibits negligible loss in accuracy compared to the full SM while providing reduced complexity. Finally, we demonstrate an application of our SM to evaluate energy efficiency under uncertainty scenarios. The analytically derived results indicate a potential reduction of EUI of offices in Singapore from 227kWh/m2 to 99kWh/m2 by altering the building parameters that were identified as most influential.

This study investigates why young adults live with their parents in Sweden. As young adults’ living arrangements affect decisions about marriage, education, childbirth, and participation in the workforce, more knowledge for policy makers is crucial to implementing effective policies to support young adults and promote financial independence and well-being. Using a data set from 1998 to 2021 at the municipal level in Sweden, we used a spatial autoregressive panel data model to examine the proportion of young adults living at home and regional disparities. The study uncovers intraregional variations, illustrating how different municipalities within Sweden exhibit different patterns of young adults living at home. Our findings reveal that economic factors, such as unemployment, significantly impact this pattern. The dynamics of the housing market, demographic factors, cultural differences, and location-specific characteristics also play an essential role in explaining this pattern. The findings suggest that the key drivers are the lack of rental housing, high unemployment rates, a high degree of urbanisation, interregional migration, and lack of social capital.

The capability of extracting information and analyze it into a common format is essential for performing predictions, comparing projects through cost benchmarking, and for having a deeper understanding of the project costs. However, the lack of standardization and the manual inclusion of the data makes this process very time-consuming, unreliable, and inefficient. To tackle this problem, a novel approach with a big impact is presented combining the benefits of data mining, statistics, and machine learning to extract and analyze the information related to railway costs infrastructure data. To validate the suggested approach, data from 23 real historical projects from the client network rail was extracted, allowing their costs to be comparable. Finally, some machine learning and data analytics methods were implemented to identify the most relevant factors allowing for costs benchmarking. The presented method proves the benefits of data extraction being able to gather, analyze and benchmark each project in an efficient manner, and deeply understand the relationships and the relevant factors that matter in infrastructure costs.

China’s transportation industry has made rapid progress, which has led to a mass of carbon emissions. However, it is still unclear how the carbon emission from transport sector is punctuated by shifts in underlying drivers. This paper aims to examine the process of China’s carbon emissions from transport sector as well as its major driving forces during the period of 2000 to 2015 at the provincial level. We firstly estimate the carbon emissions from transport sector at the provincial level based on the fuel and electricity consumption using a top-down method. We find that the carbon emission per capita is steadily increasing across the nation, especially in the provinces of Chongqing and Inner Mongolia. However, the carbon emission intensity is decreasing in most provinces of China, except in Yunnan, Qinghai, Chongqing, Zhejiang, Heilongjiang, Jilin, Inner Mongolia, Henan and Anhui. We then quantify the effect of socio-economic factors and their regional variations on the carbon emissions using panel data model. The results show that the development of secondary industry is the most significant variable in both the entire nation level and the regional level, while the effects of the other variables vary across regions. Among these factors, population density is the main motivator of the increasing carbon emissions per capita from transport sector for both the whole nation and the western region, whereas the consumption level per capita of residents and the development of tertiary industry are the primary drivers of per capita carbon emissions for the eastern and central region.

Evaporation is one of the main processes in the hydrological cycle, and it is one of the most critical factors in agricultural, hydrological, and meteorological studies. Due to the interactions of multiple climatic factors, the evaporation is a complex and nonlinear phenomenon; therefore, the data-based methods can be used to have precise estimations of it. In this regard, in the present study, Gaussian Process Regression (GPR), Nearest-Neighbor (IBK), Random Forest (RF) and Support Vector Regression (SVR) were used to estimate the pan evaporation (PE) in the meteorological stations of Golestan Province, Iran. For this purpose, meteorological data including PE, temperature (T), relative humidity (RH), wind speed (W) and sunny hours (S) collected from the Gonbad-e Kavus, Gorgan and Bandar Torkman stations from 2011 through 2017. The accuracy of the studied methods was determined using the statistical indices of Root Mean Squared Error (RMSE), correlation coefficient (R) and Mean Absolute Error (MAE). Furthermore, the Taylor charts utilized for evaluating the accuracy of the mentioned models. The outcome indicates that the optimum state of Gonbad-e Kavus, Gorgan and Bandar Torkman stations, Gaussian Process Regression (GPR) with the error values of 1.521, 1.244, and 1.254, the Nearest-Neighbor (IBK) with error values of 1.991, 1.775, and 1.577, Random Forest (RF) with error values of 1.614, 1.337, and 1.316, and Support Vector Regression (SVR) with error values of 1.55, 1.262, and 1.275, respectively, have more appropriate performances in estimating PE. It found that GPR for Gonbad-e Kavus Station with input parameters of T, W and S and GPR for Gorgan and Bandar Torkmen stations with input parameters of T, RH, W, and S had the most accurate performances and proposed for precise estimation of PE. Due to the high rate of evaporation in Iran and the lack of measurement instruments, the findings of the current study indicated that the PE values might be estimated with few easily measured meteorological parameters accurately.

Context: Despite the effort put into developing standards for structuring construction cost, and the strong interest into the field. Most construction companies still perform the process of data gathering and processing manually. That provokes inconsistencies, different criteria when classifying, misclassifications, and the process becomes very time-consuming, particularly on big projects. Additionally, the lack of standardization makes very difficult the cost estimation and comparison tasks. Objective: To create a method to extract and organize construction cost and quantity data into a consistent format and structure, to enable rapid and reliable digital comparison of the content. Method: The approach consists of a two-step method: Firstly, the system implements data mining to review the input document and determine how it is structured based on the position, format, sequence, and content of descriptive and quantitative data. Secondly, the extracted data is processed and classified with a combination of data science and experts’ knowledge to fit a common format. Results: A big variety of information coming from real historical projects has been successfully extracted and processed into a common format with 97.5% of accuracy, using a subset of 5770 assets located on 18 different files, building a solid base for analysis and comparison. Conclusion: A robust and accurate method was developed for extracting hierarchical project cost data to a common machine-readable format to enable rapid and reliable comparison and benchmarking.

The use of hyperthermia is one of the effective methods of treating cancer. In this case, the problem arises of constructing and predicting the distribution of the thermal field inside tissues depending on their type. This paper discusses the use of linear and polynomial regression methods, as well as regression algorithms based on decision tree, random forest and K nearest neighbors methods to recover missing temperature values. The influence of the size of the training sample when performing regression on the quality of the reconstructed values is investigated. Experimental recommendations on sample size are given for the selected decision tree and random forest methods. The possibility of a significant (10 times or more) reduction in the initial sample size, without leading to a decrease in the R² metric by more than 0.05 for various tissues, has been shown.

COVID-19 is the most severe health crisis of the 21st century. COVID-19 presents a threat to almost all countries world-wide. The restriction of human mobility is one of the strategies used to control the transmission of COVID-19. However, it has yet to be determined how effective this restriction is in controlling the rise in COVID-19 cases, particularly in major capital cities such as Jakarta, Indonesia. Using Facebook's mobility data, our study explores the impact of restricting human mobility on COVID-19 case control in Jakarta. Our main contribution is showing how the restriction of human mobility data can give important information about how COVID-19 spreads in different places. We proposed modifying a global regression model into a local regression model by accounting for the spatial and temporal interdependence of COVID-19 transmission across space and time. We applied Bayesian hierarchical Poisson spatiotemporal models with spatially varying regression coefficients. We estimated the regression parameters using an Integrated Nested Laplace Approximation. We found that the local regression model with spatially varying regression coefficients outperforms the global regression model based on DIC, WAIC, MPL, and R2 criteria for model selection. In Jakarta's 44 districts, the impact of human mobility varies significantly. The impacts of human mobility on the log relative risk of COVID-19 range from –4.445 to 2.353. The prevention strategy involving the restriction of human mobility may be beneficial in some districts but ineffective in others. Therefore, a cost-effective strategy had to be adopted.

The aim of this work is to explain the behaviour of the multiresistance percentage of Pseudomona aeruginosa in some countries of Europe through a multivariate statistical analysis and machine learning validation, using data from the European Antimicrobial Resistance Surveillance System, the World Health Organization and the World Bank. First, we will use a descriptive analysis and a principal components analysis. Then, we use a k-means clustering to determine the countries and regions that are most affected by the antibiotic resistance. Second, we expand the database by adding some socioeconomic, governance and antibiotic-consumption variables. We then run a data panel regression analysis to determine some functions that relates the multiresistance percentage with those new variables. Finally, we use machine learning techniques to validate a pooling panel data case, using XGBoost and random forest algorithms. The results of the data panel analysis indicate that the most important variables for the multiresistance percentage are corruption control and the rule of law. Similar results are found with the machine learning validation analysis, where the human development index is an additional important variable for the multiresistance percentage.

Recent advances in mathematical modelling and artificial intelligence have challenged the use of traditional regression analysis in biomedical research. This study examined artificial and cancer research data using binomial and multinomial logistic regression and compared its performance with other machine learning models such as random forests, support vector machines, Bayesian classifiers, k-nearest neighbours and repeated incremental clipping (RIPPER). The alternative models often outperformed regression in accurately classifying new cases. Logistic regression had a structural problem similar to early single-layer neural networks, which limited its ability to identify variables with high statistical significance for reliable class assignment. Therefore, regression is not always the best model for class prediction in biomedical datasets. The study emphasises the importance of validating selected models and suggests that a mixture of experts approach may be a more advanced and effective strategy for analysing biomedical datasets.

The rapid development of digital multimedia has resulted in a massive storm of large-scale data. The data compression method reduces data size and lowers transmission costs. As a result, data-hiding research in the compression domain poses significant challenges to researchers. This paper proposes a highly imperceptible data-hiding scheme for a compressed image of Absolute Moment Block Truncation Coding (AMBTC). The combination theory is implemented to ensure the high imperceptibility of the modified compressed images. By only modifying one pixel in a block to embed secret bits, the experimental results show that the proposed method achieved high imperceptibility and high hiding capacity.

Ridge regression is one of the most popular shrinkage estimation methods for linear models. Ridge regression effectively estimates regression coefficients in the presence of high-dimensional regressors. Recently, a generalized ridge estimator was suggested by generalizing the uniform shrinkage of ridge regression to the non-uniform shrinkage, which was shown to perform well under sparse and high-dimensional linear models. In this paper, we introduce our newly developed R package “g.ridge” (the first version published on 2023-12-07 at https://cran.r-project.org/package=g.ridge) that implements both the ridge estimator and generalized ridge estimators. The package equips with the generalized cross-validation for automatic estimation of shrinkage parameters. The package also includes a convenient tool for generating a design matrix. By simulations, we test the performance of the R package under sparse and high-dimensional settings with the normal and skew-normal error distributions. From the simulation results, we conclude that the generalized ridge estimator is superior to the benchmark ridge estimator based on “glmnet”, and hence, it can be the most recommended estimator under sparse and high-dimensional models. We demonstrate the package using the intracerebral hemorrhage data.

The Benford method can be used to detect manipulation of epidemiological or trial data during the validation of new drugs. We extend here the Benford method after having detected particular properties for the Fibonacci values 1, 2, 3, 5 and 8 of the first decimal of 10 runs of official epidemiological data published in France and Italy (positive cases, intensive care, and deaths) for the periods of March 1 to May 30, 2020 and 2021, each with 91 raw data. This new method – called “BFP” for Benford-Fibonacci-Perez - is positive in all 10 cases (i.e. 910 values) with an average of favorable cases close to 80%, which, in our opinion, would validate the reliability of these basic data.

Most existing data synthesis methods are designed to tackle problems such as dataset imbalance, data anonymization and insufficient sample size. There is a lack of effective synthesis methods for the limited number of datasets which contain a large of features and unknown noise to expand the size of the dataset. We propose a data synthesis method, named Adaptive Subspace Interpolation for Sample Optimization (ASISO). The idea is to divide the original feature space into several subspaces with an equal number of samples, and then perform interpolation for the samples in the adjacent subspaces. This method can adaptively adjust the size of the dataset containing unknown noise, and the expanded data typically contain minimal error with actual. Moreover, it adjusts the structure of the samples, which can significantly reduce the proportion of samples with large errors. In addition, the hyperparameters of this method have an intuitive explanation and usually require little calibration. Experimental results on artificial data and benchmark data sets demonstrate that ASISO is a robust and stable method to optimize samples.

To solve the problem that the common long-tailed classification method does not use the semantic features of the original label text of the image, and the difference between the classification accuracy of most classes and minority classes is large, the long-tailed image classification method based on enhanced contrast visual language trains the head class and tail class samples separately, uses text image to pre-train the information, and uses enhanced momentum contrast loss function and RandAugment enhancement to improve the learning of tail class samples. On the ImageNet-LT long-tailed dataset, the enhanced contrastive visual-language based long-tailed image classification method has improved all class accuracy, tail class accuracy, middle class accuracy, and F1 values by 3.4%, 7.6%, 3.5%, and 11.2%, respectively, compared to the BALLAD method. The difference in accuracy between the head class and tail class is reduced by 1.6% compared to the BALLAD method. The results of three comparative experiments indicate that the long-tailed image classification method based on enhanced contrastive visual-language has improved the performance of tail classes and reduced the accuracy difference between majority and minority classes.

A Natural gas is increasingly being sought after as a vital source of energy, given that its production is very cheap and does not cause the same environmental harms that other resources, such as coal combustion, do. Understanding and characterizing the behavior of natural gas is essential in hydrocarbon reservoir engineering, natural gas transport, and process. Natural gas compressibility factor, as a critical parameter, defines the compression and expansion characteristics of natural gas under different conditions. In this study, a simple second-order polynomial model based on the group method of data handling (GMDH) is presented to determine the compressibility factor of different natural gases at different conditions, using corresponding state principles. The accuracy of the model evaluated through graphical and statistical analyses. The results show that the model is capable of predicting natural gas compressibility with an average absolute error of only 2.88%, a root means square of 0.03, and a regression coefficient of 0.92. The performance of the developed model compared to widely known, previously published equations of state (EOSs) and correlations, and the precision of the results demonstrates its superiority over all other correlations and EOSs.

Despite the proposal of minimum reporting guidelines for metabolomics over a decade ago, reporting on the data analysis step in metabolomics studies has been shown to be unclear and incomplete. Major omissions and a lack of logical flow render the data analysis’ sections in metabolomics studies impossible to follow, and therefore replicate or even imitate. Here, we propose possible reasons why the original reporting guidelines have had poor adherence and present an approach to improve their uptake. We present in this paper an R markdown reporting template file that guides the production of text and generates workflow diagrams based on user input. This R Markdown template contains, as an example in this instance, a set of minimum information requirements specifically for the data pre-treatment and data analysis section of biomarker discovery metabolomics studies, (gleaned directly from the original proposed guidelines by Goodacre at al.). These minimum requirements are presented in the format of a questionnaire checklist in an R markdown template file. The R Markdown reporting template proposed here can be presented as a starting point to encourage the data analysis section of a metabolomics manuscript to have a more logical presentation and to contain enough information to be understandable and reusable. The idea is that these guidelines would be open to user feedback, modification and updating by the metabolomics community via GitHub.

The herd effect is a common phenomenon in social society. The detection of this phenomenon is of great significance in many tasks based on social network analysis such as recommendation. However, the research on social network and natural language processing seldom focuses on this issue. In this paper, we propose an unsupervised data mining method to detect herding in social networks. Taking shopping review as an example, our algorithm can identify other reviews which are affected by some previous reviews and detect a herd effect chain. From the overall perspective, the cross effects of all views form the herd effect graph. This algorithm can be widely used in various social network analysis methods through graph structure, which provides new useful features for many tasks.

Low-resource languages often face the problem of insufficient data, which leads to poor quality in machine translation. One approach to address this issue is data augmentation. Data augmentation involves creating new data by transforming existing data through methods such as flipping, cropping, rotating, and adding noise. Traditionally, pseudo-parallel corpora are generated by randomly replacing words in low-resource language machine translation. However, this method can introduce ambiguity as the same word may have different meanings in different contexts. This study proposes a new approach for low-resource language machine translation, which involves generating pseudo-parallel corpora by replacing phrases. The performance of this approach is compared with other data augmentation methods, and it is observed that combining it with other data augmentation methods further improves performance. To enhance the robustness of the model, R-Drop regularization is also used. R-Drop is an effective method for improving the quality of machine translation. The proposed method was tested on Chinese-Kazakh (Latin script) translation tasks, resulting in performance improvements of 4.99 and 7.7 for Chinese-to-Kazakh and Kazakh-to-Chinese translations, respectively.

Obesity is a global public health problem and the environment as its major determinant. To identify interventions an evidence base is warranted. To this aim we investigate the relationship between the consumption of foods and eating locations (like home, school/work and others) in British adolescents, using data from the UK National Diet and Nutrition Survey Rolling Program (2008–2012 and 2013-2016). Cross-sectional analysis of 62,523 food diary entries from this nationally representative sample then focused on foods contributing up to 80% total energy to the daily adolescent´s diet. Correspondence Analysis (CA) was first used to generate food-location relationship hypotheses and Logistic Regression (LR) to quantify the evidence in terms of odds ratios and formally test those hypotheses. The less-healthy foods that emerged from CA were chips, soft drinks, chocolate and meat pies. Adjusted Odds Ratios (99% CI) for consuming specific foods at a location “Other” than home (H) or school/work (S) in the 2008-12 survey sample were: for soft drinks 2.8 (2.1 to 3.8) vs. H and 2.0 (1.4 to 2.8) vs. S; for chips 2.8 (2.2 to 3.7) vs. H and 3.4 (2.1 to 5.5) vs. S; for chocolates 2.6 (1.9 to 3.5) vs. H and 1.9 (1.2 to 2.9) vs. S; and for meat pies 2.7 (1.5 to 5.1) vs. H and 1.3 (0.5 to 3.1) vs. S. These trends were confirmed in the 2013-16 survey sample. Interactions between location and BMI were not significant in either sample. In conclusion, our study showed that adolescents are more likely to consume specific less-healthy foods at locations away from home and school/work, irrespective of BMI. Such locations include leisure places, food outlets and “on the go”, hence public health policies to discourage less-healthy food choices in these locations is warranted for all adolescents.

Within rehabilitation, there is great need for a simple method to monitor wheelchair use, especially whether it is active or passive. For this purpose, an existing measurement technique was extended with a method for detecting self or attendant pushed wheelchair propulsion. The validity was determined by comparison with manual annotation of wheelchair use. Twenty-four amputation and stroke patients completed a semi-structured course of active and passive wheelchair use. Based on a machine learning approach, a method was developed that detected the type of movement. The machine learning method was trained based on the data of a single wheel sensor as well as a setup using an additional sensor on the frame. The method showed high accuracy (F1 = 0.886, frame and wheel sensor) even if only a single wheel sensor was used (F1 = 0.827). The developed and validated measurement method is ideally suited to easily determine wheelchair use and the corresponding activity level of patients in rehabilitation.

The use of logistic regression models in data analysis and machine learning has expanded in recent years and has become the primary preference of researchers in risk assessment studies across a wide range of scientific fields. From the assessment of credit risk in financial institutions to the estimation of risk factors for traffic accidents or the identification of etiological factors for chronic diseases. All logistic models are natural extensions of the simple binary model, and their interpretation is based on it. Using the data of a cross-sectional study on the risk factors of traffic collisions, the two main extended models of logistic techniques, multinomial and ordinal logistic regression, are presented in the article in detail. Emphasis is placed on the use of ordinal regression since the outcome variable of the collision data is defined as ordinal measurement reflecting a latent continuous scale.

Bioinformatics is a rapidly developing field enabling scientific experiments through computer models and simulations. Considering the vast databases of biological data available, it is ex-tremely important to develop efficient methods and algorithms for their processing. Sequence comparison is the best method for studying the evolutionary interaction between genes. It is based on alignment – the process of arranging two or more sequences to achieve the maximum level of identity and degree of similarity. The paper presents a new version of the algorithm for pairwise DNA sequences alignment, based on a new method called CAT, where a dependency with a previous match and the closes neighbor are taken in consideration to increase uniqueness of the CAT profile and to reduce possible collisions, i.e. two or more sequence having same CAT profiles. This makes proposed algorithm suitable for finding exact match of a concrete DNA se-quence in a big set of DNA data faster. The generation of CAT profiles is made once before data has been uploaded to the database, allowing the profiles to be used as metadata for the sequenc-es. It consists of an algorithm to calculate a CAT profile against the selected reference sequences and an algorithm to compare two sequences based on the calculated CAT profiles. Improve-ments in generation of the CAT profiles, are detailed described in the paper. Block scheme, pseudo code tables and figures were updated according to the proposed new version and ex-perimental results. Experiments have been carried out with the new version of the method and different datasets to align DNA sequences based on the CAT method. New experimental results in terms of collisions, speed, and efficiency of the proposed solutions are presented. Experiments related to the performance comparison with Needleman-Wunsch were re-executed with the new version of the algorithm to confirm that we have the same performance. An analysis of the per-formance of the proposed CAT based algorithm against Knuth–Morris–Pratt algorithm, which has a complexity of O(n) and is one of the most widely used for searching biological data, was performed. The impact of prior matching dependencies on uniqueness for generated CAT pro-files is investigated. The analysis of the experimental results obtained by sequence alignment shows a small deviation of the proposed algorithm based on the CAT method, which can be ig-nored if this deviation is acceptable at the expense of performance. The time efficiency of the CAT algorithm remains constant, regardless of the length of the sequences. Therefore, the ad-vantage of the proposed method is its fast processing in the alignment of large sequences, for which the execution of the exact algorithms takes a long time. The example code realization of the CAT Method, under the protection of the GNU General Public License v3.0, can be accessed on GitHub at: https://github.com/HristoS/CATSequenceAnalysis.

A data-driven analysis method known as dynamic mode decomposition (DMD) approximates the linear Koopman operator on projected space. In the spirit of Johnson-Lindenstrauss Lemma, we will use random projection to estimate the DMD modes in reduced dimensional space. In practical applications, snapshots are in high dimensional observable space and the DMD operator matrix is massive. Hence, computing DMD with the full spectrum is infeasible, so our main computational goal is estimating the eigenvalue and eigenvectors of the DMD operator in a projected domain. We will generalize the current algorithm to estimate a projected DMD operator. We focus on a powerful and simple random projection algorithm that will reduce the computational and storage cost. While clearly, a random projection simplifies the algorithmic complexity of a detailed optimal projection, as we will show, generally the results can be excellent nonetheless, and quality understood through a well-developed theory of random projections. We will demonstrate that modes can be calculated for a low cost by the projected data with sufficient dimension.

The Internet of Things (IoT) is a concept based on the integration of various devices and methods of communication to exchange information in order to contribute to the improvement of everyday life, business and environment. This paper focuses on the establishment of a modern Internet of Things platform to ensure secure collection, processing and storage of data, under unexpected events. This platform establishes reliable connectivity which enhance system uptime; the key to success when implementing an IoT strategy. For this purpose, we proposed a hybrid approach combining different connectivity technologies to ensure the availability and smooth operation of the system and the prevention of data loss in unforeseen cases.

As a novel concept in technology and communication world, “Internet of Things (IoT)” has been emerged. In such modern technology, the capability to transmit data through data communication networks (such as Internet or Intranet) is provided for each organism (e.g. human being, animals, things, and so forth). Due to the limited hardware and communication operational capability as well as small dimensions, IoT undergoes quite a few challenges. Such inherent challenges not only cause fundamental restrictions in the efficiency of aggregation, transmission, and communication between nodes; but they also degrade routing performance. To cope with the reduced availability time and unstable communications among nodes, data aggregation and transmission approaches in such networks are designed more intelligently. In this paper, a distributed method is proposed to set child balance among nodes. In this method, the height of the network graph is increased through restricting the degree; and network congestion is reduced as a result. Besides, a dynamic data aggregation approach -named as LA-RPL- is proposed for RPL networks. More specifically, each node is equipped with learning automata in order to perform data aggregation and transmissions. Simulation results demonstrate that the proposed approach outperforms previously suggested based approaches in terms of energy consumption, network control overhead, and packet loss rate.

Kinect is a device that has been widely used in many areas since it was released in 2010. Kinect SDK was announced in 2011 and used in many other areas than its original purpose, which was a controller for gaming. In particular, it has been used by a number of artists in digital media art since it is inexpensive and has a fast recognition rate. However, there is a problem. Kinect create 3D coordinates with a single 2D RGB image for x, y value - single depth image for z value. And this creates a significant limitation on the installation for interactivity of media art. Because the Cartesian XY coordinate and the spherical Z coordinate system are used in combination, depth error depending on the distance is generated, which makes real-time rotation recognition and coordinate correction difficult above coordinate system. This paper proposes a real-time calibration method of Kinect recognition range expansion for useful application in the digital media art area. The proposed method can recognize the viewer accurately by calibrating a coordinate in any direction in front of the viewer. 3,400 datasets witch acquire from experiment were measured as five stances: the 1m attention stance, 1m hands-up stance, 2m attention stance, 2m hands-up stance, and 2m hands-half-up stance, which were taken and recorded every 0.5 sec. The experimental results showed that the accuracy rate was improved about 11.5% compared with front measurement data according to Kinect reference installation method.

Nowadays, and with the mechanization of life, speech processing has become so crucial for the interaction between humans and machines. Deep neural networks require a database with enough data for training. The more features are extracted from the speech signal, the more samples are needed to train these networks. Adequate training of these networks can be ensured when there is access to sufficient and varied data in each class. If there is not enough data; it is possible to use data augmentation methods to obtain a database with enough samples. One of the obstacles to developing speech emotion recognition systems is the Data sparsity problem in each class for neural network training. The current study has focused on making a cycle generative adversarial network for data augmentation in a system for speech emotion recognition. For each of the five emotions employed, an adversarial generating network is designed to generate data that is very similar to the main data in that class, as well as differentiate the emotions of the other classes. These networks are taught in an adversarial way to produce feature vectors like each class in the space of the main feature, and then they add to the training sets existing in the database to train the classifier network. Instead of using the common cross-entropy error to train generative adversarial networks and to remove the vanishing gradient problem, Wasserstein Divergence has been used to produce high-quality artificial samples. The suggested network has been tested to be applied for speech emotion recognition using EMODB as training, testing, and evaluating sets, and the quality of artificial data evaluated using two Support Vector Machine (SVM) and Deep Neural Network (DNN) classifiers. Moreover, it has been revealed that extracting and reproducing high-level features from acoustic features, speech emotion recognition with separating five primary emotions has been done with acceptable accuracy.

More and more works are using machine learning techniques while adopting supervisory control and data acquisition (SCADA) system for wind turbine anomaly or failure detection. While parameter selection is important for modelling a wind turbine’s health condition, only a few papers have been published focusing on this issue and in those papers interconnections among sub-components in a wind turbine are used to address this problem. However, merely the interconnections for decision making sometimes is too general to provide a parameter list considering the differences of each SCADA dataset. In this paper, a method is proposed to provide more detailed suggestions on parameter selection based on mutual information. Moreover, after proving that Copula, a multivariate probability distribution for which the marginal probability distribution of each variable is uniform is capable of simplifying the estimation of mutual information, an empirical copula based mutual information estimation method (ECMI) is introduced for an application. After that, a real SCADA dataset is adopted to test the method, and the results show the effectiveness of the ECMI in providing parameter selection suggestions when physical knowledge is not accurate enough.

Land surface temperature (LST) is a critical parameter for the dynamic simulation of land surface processes and for analyzing variations on regional or global scales. Obtaining LST with high spatiotemporal resolution is a subject of intensive and ongoing research. This study proposes a pixel-wise temporal alignment iterative linear regression model for downscaling based on MODIS LST products. This approach allows us to address the problem of high temporal resolution but low spatial resolution of the ERA5 reanalysis LST product, while remaining immune to pixel loss caused by clouds. The hourly ERA5 LST of the study area for 2012–2021 was downscaled to 1000 m resolution, and its accuracy was verified by comparison with measured data from meteorological stations. The downscaled LST offers intricate details and is faithful to the LST characteristics of distinct land-cover categories. In comparison with other downscaling techniques, the proposed technique is more stable and preserves the spatial distribution of ERA5 LST with minimal missing pixels. The pixel-wise average R-squared and mean absolute error for MODIS view times are 0.87 and 2.7 K, respectively, for cloud-free conditions at a 1000 m scale. Accuracy verification using data from meteorological stations indicates that the overall error is lower during cloudless periods rather than during overcast periods, during the night rather than during the day, and at MODIS view times rather than at non-view times. The maximum and minimum mean errors are 0.13 K for cloud-free periods and −0.98 K for cloudy periods, indicating a slight underestimation and overestimation, respectively. Conversely, the maximum and minimum mean absolute errors are 2.01 K for the daytime and 0.85 K for the nighttime. Therefore, the model ensures higher accuracy during cloudy periods with only clear sky LST as input data, making it suitable for long-term, all-weather ERA5 LST downscaling.

Fire detection from satellite sensors relies on an accurate estimation of the unperturbed state of a target pixel, from which an anomaly can be isolated. Methods for estimating the radiation budget of a pixel without fire depend upon training data derived from the location's recent history of brightness temperature variation over the diurnal cycle, which can be vulnerable to cloud contamination and the effects of weather. This study proposes a new method that utilises the common solar budget found at a given latitude in conjunction with an area's local solar time to aggregate a broad-area training dataset, which can be used to model the expected diurnal temperature cycle of a location. This training data is then used in a temperature fitting process with the measured brightness temperatures in a pixel, and compared to pixel-derived training data and contextual methods of background temperature determination. Results of this study show similar accuracy between clear-sky medium wave infrared upwelling radiation and the diurnal temperature cycle estimation compared to previous methods, with demonstrable improvements in processing time and training data availability. This method can be used in conjunction with brightness temperature thresholds to provide a baseline for upwelling radiation, from which positive thermal anomalies such as fire can be isolated.

Enhancing energy efficiency within the building sector is imperative to curbing energy losses, given that this sector alone contributes to over 34% of global energy consumption. Employing a building management system, along with its regular updates, presents a strategic avenue to decrease energy usage, enhance building energy efficiency, and more. Tailored control strategies, aligned with the unique characteristics and usage patterns of each building, are essential for achieving energy savings. This article presents an evaluation of HVAC system efficiency in office buildings, utilizing a data-driven approach coupled with simulations conducted in IDA ICE software. The research explores the control strategy of an office building equipped with a constant air volume HVAC system, featuring a regularly controlled air handling unit. The objective is to boost energy efficiency while striking a balance between occupant comfort and energy consumption. Findings indicate that by analyzing measured data and adjusting configurable parameters, building energy consumption can be significantly reduced. Close monitoring of indoor parameters by building operators and corresponding adjustments to the HVAC system can yield energy savings of up to 16%. Leveraging these insights, the paper suggests integrating data-driven and dynamic simulation methods into building management system models to optimize HVAC systems, enhance energy efficiency, and advance ambitious carbon neutrality objectives.

Social media platforms are increasingly enabling the propagation of content from groups related to drug use, thus posing risks for the wider population and, in particular, individuals who are amenable to drug use and drug addiction. The detection of drug use content on social media platforms is a priority for governments, technology companies, and drug law enforcement organizations. To counter this issue, various techniques have been developed to identify and promptly remove drug use content, while also blocking its creators from network access. In this paper, we introduce a manually annotated Twitter dataset, comprising 156,521 tweets published between 2008 and 2022, specifically compiled for the purpose of drug use detection. The dataset underwent annotation by several group of expert annotators who classified the tweets as either drug use or non-drug use. Exploratory data analysis was conducted to comprehend the dataset's characteristics. Various classification algorithms, including SVM, XGBoost, RF, NB, LSTM, and BERT were employed using the dataset. Among the traditional machine learning models, SVM utilizing term frequency-inverse document frequency features achieved the highest F1-Score (0.9017). However, BERT with textual features concatenated with numerical and categorical features in ensemble method surpassed the performance of traditional models, attaining F1-Score of 0.9112. To facilitate future research and enhance English online drug use classification accuracy, the dataset will be made publicly available.

In research applications across several areas, noise removal is indispensable for accuracy of final results. Noise is caused due to physical principals, such as background electronic noise, quantum effect, and wave rebound effect to name a few. Noise removal can help improve results in medical, astronomy, defense, and numerous other fields. Addressing this limitation would result in potentially low cost, automatic, and reliable systems. In this paper, a generalized new approach i.e. Multi-Frame Noise Removal (MFNR) is proposed for noise removal. Given any type of data, the probability density function (PDF) of the noise can be determined. Herein, we extracted the noise PDF parameters using KDE (Kernel Density Estimation). Because the data is corrupted by “deterministic” noise, hence can be cleaned. This could be used as a general purpose noise removal tool. The data point with same position in multiple frames helps us determine the noise PDF characteristics and hence making it possible to remove noise. The conventional wisdom which states that noise removal and detail preservation are contrary to each other is not true for MFNR. Experimental results validate our proposed method which showed practically complete noise reduction based on number of frames used, as compared to existing benchmark methods.

The quality of underground space information has become a major problem that endangers the safety of underground spaces. Currently, the main methods for the high-precision and long-distance transmission of detection information are radar and optical methods. However, in practical applications, we found that the radar method has the shortcomings of large energy loss and poor anti-jamming ability, which limit the accuracy of information data transmission and distance. The optical method has the shortcomings that the weather has a great impact on its accuracy and can only be applied to static objects above ground; therefore, it has the limitation of application objects and use environment. More importantly, the current high-precision information remote detection methods are limited to the detection of overground space objects and are not applicable to the detection of various information data in underground space. In this study, we analyze the spectral properties of the fractional differential operator and find that it is suitable for studying non-linear, non-causal, and non-stationary signals. The theory of fractional calculus is applied to the field of data processing, and a mathematical model of remote transmission and high-precision detection of information based on fractional difference is established, which realizes the functions of high-precision and remote detection of information. By fusing the information data to detect the mathematical model over a long distance and with high accuracy, a mathematical model for stratum data processing used to provide long-distance and high-accuracy data was established. Through application in engineering practice, the effectiveness of this method for underground space information data detection was verified.

The information data accuracy affects the working reliability of production management system directly. Mobile equipment is an important part of integrated manufacturing system, in the course of its works, due to the complex working environment and the dynamic change of its position, it lead to the important problem of information detection distortion. Because the application of fractional differential operator has the dual functions of enhancing signal strength and reducing data error, we puts forward a data processing method of obtaining production information data of various accuracy by changing the parameters of fractional differential operator. Establish a mobile equipment detection data fusion processing model based on fractional order partial differential equations and apply it in the processing experiment of mobile equipment testing information detection data in an integrated manufacturing system, the feasibility and effectiveness of the method are verified. We conclude that the fractional order partial differential equations used in the processing of mobile equipment monitoring information data of an integrated manufacturing system has the function of obtaining production information data of various accuracy, which are of great significance to improve the working reliability in integrated manufacturing system. which is of great significance to improve the working reliability and scientific decision of integrated manufacturing system.

With the prevalence and evolution of social media platforms, social media data have emerged as a crucial source for obtaining spatio-temporal information about various urban events. Providing accurate spatio-temporal information of these events enhances the capacities of urban management and emergency response. However, existing research mostly focuses on the textual content while mining this spatio-temporal information, often neglecting data from other modalities like images and videos.To address this, our study introduces a novel method for extracting spatio-temporal information from multi-modal social media data (MIST-SMMD), serving as a valuable supplement to current urban event monitoring methods. Leveraging deep learning and Geographic Information System (GIS) technologies, we extract spatio-temporal information from large-scale, multi-modal Weibo data about urban waterlogging events at both coarse and fine granularities.Through an in-depth experimental evaluation of the “July 20 Zhengzhou extreme rainstorm” event, the results show that in coarse-grained spatial information extraction solely using textual data, our method achieves a Spatial Precision of 87.54% within a 60m range and 100% Spatial Precision within a 201m range. In the fine-grained spatial information extraction, by incorporating other modalities such as images and videos, the Spatial Error saw a significant improvement, with MAESE increasing by 95.53% and RMSESE by 93.62%.These outcomes illustrate the capability of the MIST-SMMD method in extracting spatio-temporal information of urban events at both coarse and fine granularities. They also confirm the notable advantage of multi-modal data in enhancing the accuracy of spatial information extraction.

In this paper, the Shannon entropy measure was used to assess changes in precipitation and temperature conditions. Due to the short, low-volume sequences of precipitation and temperature data analysed, a bootstrap method was used in the procedure for calculating Shannon entropy. The analysis used minimum and maximum values of monthly precipitation totals and monthly mean temperatures for 377 catchments distributed across the globe. A 110-year data series from 1901 to 2010 was analysed. Entropy values for the estimated parameters of the generalised extreme value distribution (GEV) were calculated for the adopted data. Entropy value calculations were performed for the left-hand constraint, based on minimum values, and for the right-hand constraint, based on maximum values. The applicability of Shannon's entropy measure in the analysis of climate change was demonstrated by allowing the degree of disorder and complexity of the distributions describing climate variables in the form of precipitation and temperature to be measured. This made it possible to obtain information on the directions of changes occurring with regard to minimum and maximum values in the field of monthly precipitation and mean temperatures in the analysed catchments. The study demonstrated the existence of Shannon entropy trends. The evaluation of entropy trends for precipitation and temperature sequences was performed using non-parametric tests. Mann -Kendall tests at the 5% significance level were used for trend analyses. The Pettitt test was performed to determine the point of change in trend for the rainfall and temperature data. The performed analysis was supported by graphical presentations.

Genomics involving tens of thousands of genes is a complex system determining phenotype. An interesting and vital issue is that how to integrate highly sparse genetic genomics data with a mass of minor effects into prediction model for improving prediction power. We find that deep learning method can work well to extract features by transforming highly sparse dichotomous data to lower dimensional continuous data in a non-linear way. This idea may provide benefits in risk prediction based on genome-wide data associated e.g. integrating most of the information in the genotype data. Hence, we developed a multi-stage strategy to extract information from highly sparse binary genotype data and applied it for risk prediction. Specifically, we first reduced the number of biomarkers via a univariable regression model to a moderate size. Then a trainable auto-encoder was used to extract compact representations from the reduced data. Next, we performed a LASSO problem process over a grid of tuning parameter values to select the optimal combination of extracted features. Finally, we applied such feature combination to two prognostic models, and evaluated predictive effect of the models. The results of simulation studies and real data applying indicated that these highly compressed transformation features could better improve predictive performance and did not easily lead to over-fitting.

Plant Factory Transplanter (PFT) is a key component of the plant factory system. Its operation status directly affects the quality and survival rate of planted seedlings, which in turn affects the overall yield and economic efficiency. To monitor the operation status and transplanting quality of a transplanting machine in a timely manner, the primary task is to use a computerized and easy-to-use method to monitor the transplanting units. Inspired by the latest developments in augmented reality and robotics, a DT model-based and data-driven online monitoring method for plant factory transplanting equipment is proposed. First, a data-driven and virtual model approach is combined to construct a multi-domain digital twin of the transplanting equipment. Then, taking the vibration frequency domain signal above the transplanting manipulator and the image features of the transplanting seedling tray as input variables, the evaluation method and configuration method of the PFT digital twin system are proposed. Finally, the effect of the transplanter is evaluated, and the cycle can be repeated to optimize the transplanter to achieve optimal operation parameters. The results show that the digital twin model can effectively use the sensor data to identify the mechanical vibration characteristics and avoid affecting transplanting quality due to mechanical resonance. At a transplanting rate of 3000 plants/h, the transplanting efficiency can be maintained at a high level and the vibration signal of X, Y, Z-axis above the transplanting manipulator is relatively calm. In this case, Combined the optimal threshold method with the traditional Wiener algorithm, the identification rate of healthy potted seedlings can reach 94.3%. Through comprehensively using the optimal threshold method and 3D block matching filtering algorithm for image threshold segmentation and denoising, the recognition rate of healthy seedlings has reached over 96.10%. In addition, the developed digital twin can predict the operational efficiency and optimal timing of the detected transplanter, even if the environmental and sensor data are not included in the training. The proposed digital twin model can be used for damage detection and operational effectiveness assessment of other plant factory equipment structures.

In this work a new pre-tuning multivariable PID controllers method for quadrotors is put forward. A procedure based on LQR/LQG theory is proposed for attitude and altitude control. With the aim of analyzing performance and robustness of the proposed method, a non-linear mathematical model of the DJI-F450 quadrotor is employed, where rotors dynamics, togheter with sensors drift/bias properties and noise characteristics of low-cost comercial sensors typically used in this type of applications (such as MARG with MEMS technology and LIDAR) are considered. In order to estimate the state vector and compensate bias/drift effects on rate gyros of the MARG, a combination of filtering and data fusion algorithms (Kalman filter and Madgwick algorithm for attitude estimation) are proposed and implemented. Performance and robutsness analysis of the control system is carried out by means of numerical simulations, which take into account the presence of uncertainty in the plant model and external disturbances. The obtained results show that the proposed pre-tuning method for multivariable PID controller is robust with respect to: a) parametric uncertainty in the plant model, b) disturbances acting at the plant input, c) sensors measurement and estimation errors.

For equivalent modeling of mixed wind farms (WFs), existing clustering indicators cannot consider the complex coupling characteristics between different types of wind turbines (WTs). This paper proposes a refined equivalent modeling method for mixed WFs based on artificial intelligence technology. Firstly, the electromechanical transient performance of mixed WFs is analyzed. The WT type, wind speed and direction, and voltage dip are considered the main factors affecting the external dynamic response of mixed WFs. Secondly, the equivalent node model is established, including the selection of independent and dependent variables. Then, the multiple artificial neural networks (ANNs) are trained one by one based on sample data, to explore the nonlinear relationship between the dependent variables and the independent variables. Finally, the electromechanical transient simulations of the power systems with a mixed WF is carried out by using the MATLAB platform. Simulation results show that the proposed model can reflect the external characteristics of the mixed WF in different wind scenarios and voltage dips.

This article addresses the challenge of simulating rainstorm waterlogging in urban-scale areas where reliable drainage pipe network data is often lacking. Despite existing methods attempting to tackle this issue, there remains a gap in effectiveness. We present a novel approach, the Modified Equivalent Infiltration (MEI) method, building upon the foundation of the Equivalent Infiltration (EI) method. The study focuses on the outer ring area of Shanghai, utilizing data from the "In-Fa" typhoon period for simulation and comparison. Our findings reveal that the MEI method, requiring the same data inputs as the EI method, surpasses its predecessor in both principle and simulation results. Additionally, the MEI method demonstrates robustness in handling rainstorm waterlogging scenarios.

Ecosystem surveillance monitoring is critical to managing natural resources and especially so under changing environments. Despite this importance, the design and implementation of monitoring programs across large temporal and spatial scales has been hampered by the lack of appropriately standardised methods and data streams. To address this gap, we outline a surveillance monitoring method based on permanent plots and voucher samples suited to rangeland environments around the world that is repeatable, cost-effective, appropriate for large-scale comparisons and adaptable to other global biomes. The method provides comprehensive data on vegetation composition and structure along with soil attributes relevant to plant growth, delivered as a combination of modules that can be targeted for different purposes or available resources. Plots are located in a stratified design across vegetation units, landforms and climates to enhance continental and global comparisons. Changes are investigated through revisits. Vegetation is measured to inform on composition, cover and structure. Samples of vegetation and soils are collected and tracked by barcode labels and stored long-term for subsequent analysis. Technology is used to enhance the accuracy of field methods, including differential GPS r plot locations, instrument based Leaf Area Index (LAI) measures, and three dimensional photo-panoramas for advanced analysis. A key feature of the method is the use of electronic field data collection to enhance data delivery into a publicly-accessible database.Our method is pragmatic, whilst still providing consistent data, information and samples on key vegetation and soil attributes. The method is operational and has been applied at more than 704 field locations across the Australian rangelands as part of the Ecosystem Surveillance program of the Terrestrial Ecosystem Research Network (TERN). The methodology enables continental analyses, and has been tested in communities broadly representative of rangelands globally, with components being applicable to other biomes. Here we also recommend the consultative process and guiding principles that drove the development of this method as an approach for development of the method into other biomes. The consistent, standardised and objective method enables continental, and potentially global analyses than were not previously possible with disparate programs and datasets.

Soil organic matter is an important component that reflects soil fertility and promotes plant growth. The soil of typical Chinese tea plantations was used as the research object in this work, and by combining soil hyperspectral data and image texture characteristics, a quantitative prediction model of soil organic matter based on machine vision and hyperspectral imaging technology was built. Three methods, standard normalized variate (SNV), multisource scattering correction (MSC) and smoothing, were first used to preprocess the spectra. After that, random frog (RF), variable combination population analysis (VCPA) and variable combination population analysis and iterative retained information variable algorithm (VCPA-IRIV) algorithms were used to extract the characteristic bands. Finally, the quantitative prediction model of nonlinear support vector regression (SVR) and linear partial least squares regression (PLSR) for soil organic matter was established by combining nine color features and five texture features of hyperspectral images. The outcomes demonstrate that, in comparison to single spectral data, fusion data may greatly increase the performance of the prediction model, with MSC+VCPA-IRIV+SVR (R2C=0.995, R2P=0.986, RPD=8.155) being the optimal approach combination. This work offers excellent justification for more investigation into nondestructive methods for determining the amount of organic matter in soil.

The aerospace industry develops prognosis and health management algorithms to ensure better safety on board. Particularly for in-flight controls where jamming is dreaded. For that, vibration signals are monitored to predict future defect occurrences. However, time series are not labeled according to severity level, and the user can only assess the system health from the data mining procedure. To that extent, we developed a clustering algorithm using a deep neural network core. We encoded the time series into pictures to be feed into an artificially trained neural network: U-NET. From the segmented output, one-dimensional information on cluster frontiers is extracted and filtered without any parameter selection. Then, a kernel density estimation finally transforms the signal into an empirical density. Ultimately, a Gaussian mixture model extracts the latter independent components. The method empowered us to reveal different degrees of severity faults in the studied data, with their respective likelihood without prior knowledge. We compared it to state-of-the-art machine learning algorithms. However, internal clustering results evaluation for time series is an open question. As state-of-the-art indexes were not producing relevant results, we built a new indicator to fulfill this task. We applied the whole method to an actuator consisting of an induction machine linked to a ball screw. This study lays the groundwork for future training of diagnosis and prognosis structures in the health management framework.

Rapid climate change requires more powerful and precise modeling methods to forecast future climate variability. The GSTARIMA Model is efficient, combining space-time analysis with the Autoregressive Moving Average (ARIMA) Model. The integration of heteroscedasticity error and the Kriging method can strengthen the Model's ability to handle the problem of non-constant error variance in the GSTARIMA Model and forecast at unobserved locations of climate observations. This paper's Systematics Literature Review (SLR) is presented comprehensively with the principal aim of developing a thorough understanding of applying the GSTARIMA Model with heteroskedasticity error and the Kriging Method in climate forecasting following the Data Analytics Lifecycle methodology. The Systematic Literature Review (SLR) process consists of three main stages. We sourced the articles from databases such as Scopus, Dimensions, and EBSCO-Host The subsequent stage involved conducting a comprehensive literature review using the PRISMA method to ensure rigor and depth. Additionally, we performed bibliometric analysis to enhance rigor. Lastly, we conducted a gap analysis session to scrutinize existing research on the GSTARIMA Model and identify new opportunities. This literature review reveals that integrating GSTARIMA Model with heteroscedasticity errors and the Kriging method is suitable for climate forecasting. This research inspires researchers to contribute to the improvement and refinement of the Model, making it a more potent and valuable tool in climate forecasting.

The divination function of China's Yijing has led to its circulation for thousands of years. In our exploration of Yijing's characteristics using big data, we have discovered variations in results between the coin toss method and the ancient yarrow-stalk method of divination, known as "the number for the great expansion method of divination(大衍之数)". The yarrow-stalk method serves as the fundamental method of divination in Yijing and continues to hold significance in studying the essential characteristics of Yijing. Despite the complexity of yarrow calculations, advancements in computer technology and big data have simplified its application. By employing the yarrow-stalk method, we simulated changes in the 64 hexagrams, calculated probabilities and proportions of hexagram alterations, and derived fundamental characteristics and patterns of hexagrams. Additionally, we constructed the spatial representation of lines and hexagrams. Through a binary system rearrangement, we created a 64x64 matrix illustrating hexagram transformations. Subsequently, we generated 100 million random hexagrams and analyzed line and hexagram changes accordingly. Our findings indicate the following:(1) Big data analysis reveals evident asymmetry in the hexagrams obtained through the yarrow-stalk method, with a triangular fractal characteristic forming the background.(2) Each of the 64 hexagrams exhibits a distinct probability distribution when transforming into other hexagrams, which can be categorized into five types.(3)The occurrence probabilities of Laoyang, Laoyin, Shaoyang, and Shaoyin are 18.61%, 6.387%, 31.38%, and 43.62% respectively. The probabilities of Yin and Yang occurrences are nearly equal, each close to 50%. However, the probability of Laoyang is approximately three times higher than that of Laoyin.(4) Visualized and analyzed the characteristics of hexagram changes greater than 100000 times using 3D statistical maps and Sankey diagram.These results demonstrate that the yarrow-stalk method effectively unveils the characteristics and underlying patterns of the 64 hexagrams. This study provides a novel approach for scientifically exploring the internal laws governing the 64 hexagrams in Yijing.

The boundary layer height (BLH) distinguishes the interface between the lower and free atmosphere, which is a key variable in numerical simulation, aerosol, and environmental pollution studies. Thus, the goal of this work is to propose a novel method conjuncting with numerical regularization to analyze climate characteristics of the marine boundary layer height (MBLH) using 2007-2011 GPS-RO data from the COSMIC mission. While traditionally, the difference method has been used to achieve this aim, herein, we propose an innovative method, in which the bending angle profile gradient was calculated using the numerical regulation method where the regulation parameters are determined by the double-parameter model function method. Then, the MBLH was determined by employing the maximum gradient method to ascertain the height corresponding to the smallest gradient. The results show a correlation between currents and the MBLH—a relationship that has not been previously demonstrated. A low MBLH is associated with seasons and regions where cold ocean currents are prevailing; whereas a high MBLH is observed in the seasons and places where warm currents are prevailing. This correlation was validated by comparing the obtained results with different occultation data—i.e., atmprf and echprf—which also established that atmprf is more sensitive to convective cloud top capture. In seas with active convection, the armprf calculated bending angle is higher than that from echprf. Subsequently, the standard deviation was used to express the MBLH confidence level. The results show that the MBLH standard deviation is highest in low latitudes and lowest in the middle and high latitudes. Furthermore, we analyzed the interannual MBLH variation trend, which displayed a seasonal variation and spatial distribution corresponding with the current and subsolar point. Finally, we conducted a case study in the South China Sea, and identified a distinctive seasonal change and downward trend.

Current satellite remote sensing methods struggle to detect and map forest degradation, a critical issue as it is likely a major and growing source of carbon emissions and biodiveristy loss. TanDEM-X InSAR phase height (hϕ) is a promising variable for measuring forest disturbances, as it is closely related to mean canopy height, and thus should decrease if canopy trees are removed. However, previous research has focused on relatively flat terrain, despite the fact that much of the worlds’ remaining tropical forests are found in hilly areas, and this inevitably introduces artifacts in sideways imaging systems. In this paper, we find a relationship between hϕ and aboveground biomass change in four selectively logged plots in a hilly region of central Gabon. We show that minimising the level of multilooking in the interferometric processing chain strengthens this relationship, and that degradation estimates across steep slopes in the surrounding region are improved by selecting data from the most appropriate pass directions on a pixel-by-pixel basis. This shows that TanDEM-X InSAR can measure the magnitude of degradation, and that topographic effects can be mitigated if data from multiple SAR viewing geometries are available.

Management of demand and capacity for airport operation is important. The effect of capacity setting on slot adjustment, maximum adjustment and flight delay has been extensively investigated and discussed in previous slot adjustment models. But its effect on characteristics of flight waves has not been studied deeply. At present, in order to resolve the problem that Linear Integer Programming (LIP) is limited in slot allocation due to its fast dimension growth and large memory consumption, the general practice is to optimize the slot application according to data-splitting technology. However, the relationship among data splitting method, capacity setting and characteristics of slot wave has not been investigated in detail, which limits the application of LIP in slot allocation. Through the detailed analysis and testing, we found that the waveform and amplitude of slot wave can be controlled and designed by appropriate virtual capacity settings, while the number of capacity constraints and the computing time is reduced by adopting appropriate data feeding method. Our research also provides clues for further research on the construction of the flight waves for airlines operating at specific airports in order to establish direct or indirect connectivity, and increase hit rate by using our approaches.

This paper evaluates norms and assesses the level of knowledge in air conditioning project management within the construction industry. A total of 25 questions were distributed to multiple candidates, who were filtered based on pre-established inclusion and exclusion criteria. Thirty-nine candidates were ultimately approved to participate in the survey. The questions were designed to address five hypotheses, with each set of five questions corresponding to one hypothesis. The results were obtained after pre-processing the data using Matlab software. The data was pre-processed using Matlab software, and the results were analyzed using the Delphi method. The analysis revealed that only two hypotheses were approved: No matter whether there are nationalized safety rules or not, the impact of data sciences and smart technologies, including air conditioning management systems, is critical for human life in the building business.

Wind turbine upgrades have been spreading in the recent years in the wind energy industry, with the aim of optimizing the efficiency of wind kinetic energy conversion. This kind of interventions has material and labor costs and it is therefore fundamental to estimate realistically the production improvement. Further, the retrofitting of wind turbines sited in harsh environments might exacerbate the stressing conditions to which wind turbines are subjected and consequently might affect the residue lifetime. This work deals with a case of retrofitting: the testing ground is a multi-megawatt wind turbine from a wind farm sited in a very complex terrain. The blades have been optimized by installing vortex generators and passive flow control devices. The complexity of this test case, dictated by the environment and by the features of the data set at disposal, inspires the formulation of a general method for estimating production upgrades, based on multivariate linear modeling of the power output of the upgraded wind turbine. The method is a distinctive part of the outcome of this work because it is generalizable to the study of whatever wind turbine upgrade and it is adaptable to the features of the data sets at disposal. In particular, applying this model to the test case of interest, it arises that the upgrade increases the annual energy production of the wind turbine of an amount of the order of the 2%. This quantity is of the same order of magnitude, albeit non-negligibly lower, than the estimate based on the assumption of ideal wind conditions. Therefore, it arises that complex wind conditions might affect the efficiency of wind turbine upgrades and it is therefore important to estimate their impact using data from wind turbines operating in the real environment of interest.

Fault line detection timely and accurately when single-phase-to-earth fault occurs in resonant grounding system is still a focus of research. This paper presents a new approach for fault detection based on data fusion and it has non-artificial setting. Firstly, the fault criterion for interphase difference energy ratio and time-frequency correlation coefficient of each line is proposed. Subsequently, the paper establish a coordinate system with the interphase difference energy ratio as X axis and the time-frequency correlation coefficient as Y axis, and it uses the Euclidean distance algorithm to get the characteristic distance of each line by fusing two-dimensional information. Finally, comparing the sound distance and the fault distance of each line to discriminate the fault line. Electromagnetic Transients Program (EMTP) simulation results and adaptability analysis have confirmed the effectiveness and reliability of the proposed scheme.

Ethnopharmacology experts face several challenges when identifying and retrieving documents and resources related to their scientific focus. The volume of sources that need to be monitored, the variety of formats utilized, the different quality of language use across sources, present some of what we call “big data” challenges in the analysis of this data. This study aims to understand if and how experts can be supported effectively through intelligent tools in the task of ethnopharmacological literature research. To this end, we utilize a real case study of ethnopharmacology research, aimed at the Southern Balkans and Coastal zone of Asia Minor. Thus, we propose a methodology for more efficient research in ethnopharmacology. Our work follows an “Expert-Apprentice” paradigm in an automatic URL extraction process, through crawling, where the apprentice is a Machine Learning (ML) algorithm, utilizing a combination of Active Learning (AL) and Reinforcement Learning (RL), and the Expert is the human researcher. ML-powered research improved 3.1 times the effectiveness and 5.14 times the efficiency of the domain expert, fetching a total number of 420 relevant ethnopharmacological documents in only 7 hours versus an estimated 36-hour human-expert effort. Therefore, utilizing Artificial Intelligence (AI) tools to support the researcher can boost the efficiency and effectiveness of the identification and retrieval of appropriate documents.

Impervious surface mapping with high-resolution remote sensing imagery has attracted increasing interest as it can provide detailed information for urban structure and distribution. Previous studies have suggested that the combination of LiDAR data and high-resolution imagery for impervious surface mapping performs better than using only high-resolution imagery. However, due to the high cost of the acquisition of LiDAR data, it is difficult to obtain the multi-sensor remote sensing data acquired at the same acquisition time for impervious surface mapping. Consequently, real landscape changes between multi-sensor remote sensing data at different acquisition times would lead to the error of misclassification in impervious surface mapping. This issue has mostly been neglected in previous works. Furthermore, the observation differences generated from multi-sensor data, including the problems of misregistration, missing data in LiDAR data, and shadow in high-resolution images would also challenge the final mapping result in the fusion of LiDAR data and high-resolution images. In order to conquer these problems, we propose an improved impervious surface mapping method incorporating both LiDAR data and high-resolution imagery at different acquisition times in consideration of real landscape changes and observation differences. In the proposed method, a multi-sensor change detection by supervised multivariate alteration detection is employed to obtain changed areas and misregistration areas. The no-data areas in the LiDAR data and the shadow areas in the high-resolution imagery are extracted by independent classification yielded by its corresponding single sensor data. Finally, an object-based post-classification fusion is proposed to take advantage of independent classification results with single-sensor data and the joint classification result with stacked multi-sensor data. Experiments covering the study site in Buffalo, NY, USA demonstrate that our method can accurately detect landscape changes and obviously improve the performance of impervious surface mapping.

One of the industries with the fastest rate of growth is healthcare, and this industry's enormous data requires extensive cloud storage. The cloud may offer some protection, but there is no assurance that data owners can rely on it for refuge and privacy amenities. Therefore, it is essential to offer security and privacy protection. Increased customer satisfaction with security and privacy preservation is crucial since healthcare big data and its sources are stored in the cloud and contain increasingly private and sensitive information. However, maintaining privacy and security in an untrusted green cloud environment is difficult, thus the data owner should have complete data control. A new work SecPri-BGMPOP(security and privacy of Boost graph Convolutional Network -Pinpointing-Optimization Performance) is suggested that can offer a solution that involves several different steps in order to handle the numerous problems relating to security and protecting privacy. Initially Boost Graph Convolutional Network Clustering (BGCNC) algorithm, which reduces computational complexity in terms of time and memory measurements, is first applied to the input dataset to begin the clustering process. Second, enlarge by employing a piece of the magnifying bit string to generate a safe key, pinpointing based encryption avoids amplify leakage even if a rival or attacker decrypts the key or asymmetric encryption. Finally, to determine the accuracy of the method, an optimal key was created using a meta-heuristic algorithmic framework called Hybrid fragment horde bland lobo Optimization (HFHBLO). Our proposed method currently kept in a cloud environment, allowing analytics users to utilize it without risking their privacy or security.

In recent years, more and more health data are being generated. These data come not only from professional health systems, but also from wearable devices. All these data combined form ‘big data’ that can be utilized to optimize treatments for each unique patient (‘precision medicine’). To achieve this precision medicine, it is necessary that hospitals, academia and industry work together to bridge the ‘valley of death’ of translational medicine. However, hospitals and academia often have problems with sharing their data, even though the patient is actually the owner of his/her own health data, and the sharing of data is associated with increased citation rate. Academic hospitals usually invest a lot of time in setting up clinical trials and collecting data, and want to be the first ones to publish papers on this data. The idea that society benefits the most if the patient’s data are shared as soon as possible so that other researchers can work with it, has not taken root yet. There are some publicly available datasets, but these are usually only shared after studies are finished and/or publications have been written based on the data, which means a severe delay of months or even years before others can use the data for analysis. One solution is to incentivize the hospitals to share their data with (other) academic institutes and the industry. Here we discuss several aspects of data sharing in the medical domain: publisher requirements, data ownership, support for data sharing, data sharing initiatives and how the use of federated data might be a solution. We also discuss some potential future developments around data sharing.

The effective integration of aerial remote sensing data and ground multi-source data has always been one of the difficulties of quantitative remote sensing. A new monitoring mode is designed which installs the hyperspectral imager on the UAV and places a buoy spectrometer on the river. Water samples are collected simultaneously to obtain in situ assay data of total phosphorus, total nitrogen, COD, turbidity and chlorophyll during data collection. The cross correlogram spectral matching (CCSM) algorithm is used to match the data of the buoy spectrometer with the UAV spectral data to reduce the UAV data noise significantly. An absorption characteristics recognition algorithm (ACR) is designed to realize a new method for comparing UAV data with laboratory data. This method takes into account the spectral characteristics and the correlation characteristics of test data synchronously. It is concluded that the most accurate water quality parameters can be calculated by using the regression method under five scales after the regression tests of multiple linear regression method (MLR), support vector machine method (SVM) and neural network (NN) method. This new working mode of integrating spectral imager data with point spectrometer data will become a trend in water quality monitoring.

Nowadays, one of the greatest challenges in Data Meshes revolves around detecting and creating Data Domains and Data Products for providing the ability to adapt easily and quickly to changing business needs. This requires a disciplined approach to identify, differentiate and prioritize distinct data sources according to their content and diversity. The current paper tackles this highly com-plicated issue and suggests a standardized approach that integrates the concept of Data Blueprints with Data Meshes. In essence, a novel standardization framework is proposed that creates Data Products using a metadata semantic enrichment mechanism, the latter also offering Data Domain readiness and alignment. The approach is demonstrated using real-world data produced by mul-tiple sources in a poultry meat production factory. A set of functional attributes is used to compare qualitatively the proposed approach against existing data structures utilized in storage architectures with quite promising results. Finally, experimentation with different scenarios varying in data product complexity and granularity suggests successful performance.

With an increasing amount of biological data available publicly, there is a need for a guide on how to successfully download and use this data. The Ten simple rules for using public biological data are: 1) use public data purposefully in your research, 2) evaluate data for your use case, 3) check data reuse requirements and embargoes, 4) be aware of ethics for data reuse, 5) plan for data storage and compute requirements, 6) know what you are downloading, 7) download programmatically and verify integrity, 8) properly cite data, 9) make reprocessed data and models Findable, Accessible, Interoperable, and Reusable (FAIR) and share, and 10) make pipelines and code FAIR and share. These rules are intended as a guide for researchers wanting to make use of available data and to increase data reuse and reproducibility.

Improvements in web platforms for data exchange and trading are creating more opportunities for users to obtain data from data providers of different domains. However, the current data exchange platforms are limited to unilateral information provision from data providers to users. In contrast, there are insufficient means for data providers to learn what kinds of data users desire and for what purposes. In this paper, we propose and discuss the description items for sharing users’ call for data as data requests in the data marketplace. We also discuss structural differences in data requests and providable data using variables, as well as possibilities of data matching. In the study, we developed an interactive platform, treasuring every encounter of data affairs (TEEDA), to facilitate matching and interactions between data providers and users. The basic features of TEEDA are described in this paper. From experiments, we found the same distributions of the frequency of variables but different distributions of the number of variables in each piece of data, which are important factors to consider in the discussion of data matching in the data marketplace.

The study investigated the usage of open data in public organizations, focusing on the motives, preferences, and governance ideals that determine their quality. The study shed light on how open data platforms are created and improved, as well as their influence on government operations. The primary goal was to understand the motivations behind the usage of open data, evaluate gov-ernance ideals, and examine institutions' efforts to standardize data formats. Hierarchical regres-sion analysis divides variables into core reasons and different preferences, demonstrating a need for "diversification" in order to use open data effectively. Efficiency, accountability, community impact, knowledge, and high-quality service delivery are all emphasized in governance value analysis. The institution's dedication to standardizing open data formats is evidenced by legislative measures and the integration of many technologies. The findings illustrate the institution's dual strategy of em-ploying traditional techniques and new technologies for effective data management. The report suggests increasing data openness and standardization, investing in ongoing training, upgrading alerting and awareness systems, and adopting specific regulations for open data use. Monitoring and feedback techniques are critical for adjusting and refining open data services to satisfy de-velopment needs. This study adds to the scientific knowledge of open data use by highlighting important motives, preferences, and governance ideals. The offered guidelines provide practical insights for public organizations looking to improve their open data platforms by promoting openness, efficiency, and community participation.

As we know, the economy of science is to achieve optimal gains using scarce resources. Similarly, a problem where economies of the world are trying to resolve it is the issue of how to achieve an optimal economic contribution from limited tourism resources. According to the fact that global studies and statistics indicate that good governance is considered as the most important factor in developing countries and is considered as a strong governance of the development and as Information and Communication Technology (ICT) is effective in the interactions and economic and social exchanges of any society, it is the link between the tourism industry and the technology under the form of a robust tool and utilitarian in the tourism process called E-tourism can play a significant role. Therefore, the aim of this study was to investigate the effect of network Readiness Index and good governance on income from tourism industry. In this study, data and information about 14 selected countries were collected from Southwest Asia in the annual period of 2016-2011 in the form of panel data and the proposed model was used and estimated by the generalized torques system method. The estimated results of the model indicate that both hypotheses have a positive and significant impact on the amount of Network Readiness Index in the income of tourism industry, as well as the positive and significant effect of the index the amount of income from the tourism industry is confirmed, and their impact has been positive and significant, as well as exchange rate variables, revenue and commercial openness, also have a positive and significant effect on revenues of the tourism industry.

Validation and verification are the critical requirements in the knowledge acquisition method for the clinical decision support system (CDSS). After acquiring the medical knowledge from diverse sources, the rigorous validation and formal verification process are required before creating the final knowledge model. Previously, we have proposed a hybrid knowledge acquisition method for acquiring medical knowledge from clinical practice guidelines (CPGs) and patient data in the Smart CDSS for treatment of oral cavity cancer. The final knowledge model was created by combining knowledge models obtained from CPGs and patient data after passing through a rigorous validation process. However, detailed analysis shows that due to lack of formal verification process, it involves various inconsistencies in knowledge relevant to the formalism of knowledge, conformance to CPGs, quality of knowledge, and complexities of knowledge acquisition artifacts. Therefore, it is required to enhance a hybrid knowledge acquisition method that thwarts the inconsistencies using formal verification. This paper presents the verification process using the Z formal method and its outcome as an enhanced acquisition method – known as the refined knowledge acquisition (ReKA) method. The ReKA method adopted verification method and explored the mechanism of theorem proving using the Z notation. It enables to identify inconsistencies in the validation process used for hybrid knowledge acquisition. Additionally, it refines the hybrid knowledge acquisition method by discovering the missing steps in the current validation process at the acquisition stage. Consequently, ReKA adds a set of nine additional criteria to be used to have a final valid refined clinical knowledge model. The criteria ensure the validity of final knowledge model concerning formalism of knowledge, conformance to GPGs, quality of the knowledge, usage of stringent conditions and treatment plans, and inconsistencies possibly resulting from the complexities. Evaluation, using four medical knowledge acquisition scenarios, shows that newly added knowledge in CDSS due to the addition of criteria by ReKA method always produces a valid knowledge model. The final knowledge model was also evaluated with 1229 oral cavity patient cases, which outperformed with an accuracy of 72.57\% compared to a similar approach with an accuracy of 69.7\%. Furthermore, ReKA method identified a set of decision paths (about 47.8%) in the existing approach, which results in a final knowledge model with low quality, non-conformed from standard CPGs. In conclusion, ReKA is formally proved method which always yields valid knowledge model having high quality, supporting local practices, and influenced from standard guidelines.

In the rapidly evolving field of data management, numerous terminologies, such as data warehouse, data lake, data lakehouse, and data mesh , have emerged, each representing a unique analytical data architecture. However, the distinctions and similarities among these paradigms often remain unclear. The present paper aimed to navigate the data architecture landscape by conducting a comparative analysis of these paradigms. The analysis a identified and elucidated the differences and similari- ties in features, capabilities, and limitations of these architectural constructs. The study outcome serves as a comprehensive guide, assisting practitioners in selecting the most suitable analytical data architecture for their specific applications.

Data Meshes is an approach to data architecture and organization that treats data as a product and focuses on decentralizing data ownership and access. It has recently emerged as a field that presents quite a few challenges related to data ownership, governance, security, monitoring, and observability. To address these challenges, this paper introduces an innovative algorithmic framework leveraging data blueprints to enable the dynamic creation of Data Meshes and Data Products in response to user requests, ensuring that stakeholders will have access to specific portions of the Data Mesh as needed. Ownership and governance concerns are addressed through a unique mechanism involving Blockchain and Non-Fungible Tokens (NFTs). This facilitates secure and transparent transfer of data ownership, with the ability to mint time-based NFTs. By combining these advancements with the fundamental tenets of Data Meshes, this research offers a comprehensive solution to the challenges surrounding data ownership and governance. It empowers stakeholders to navigate the complexities of data management within a decentralized architecture, ensuring a secure, efficient, and user-centric approach to data utilization. The proposed framework is demonstrated using real-world data from a poultry meat production factory.

The land subsidence occurring in goafs after coal mining is a protracted process. The accurate prediction of long-term land subsidence in goafs relies heavily on the availability of long-term monitoring data. However, the scarcity of continuous long-term land subsidence monitoring data subsequent to the cessation of mining significantly hinders the accurate prediction of long-term land subsidence in goafs. To address this challenge, this study proposes an innovative method based on Interferometric Synthetic Aperture Radar (InSAR) for predicting long-term land subsidence of goafs following coal mining. The proposed method employs a concatenation approach that integrates multiple short-term monitoring data from different coal faces, each with distinct cessation times, into a cohesive and uniform long-term sequence by normalizing the subsidence rates. The method was verified using actual monitoring data from the Yangquan No.2 mine in Shanxi Province, China. Initially, coal faces with same shapes but varying cessation times were selected for analysis. Using InSAR monitoring data collected between June and December of 2016, the average subsidence rate corresponding to the duration after coal mining cessation of each coal face was back-calculated. Subsequently, a function relating subsidence rate to the duration after coal mining cessation was fitted to the data. Finally, the relationship between cumulative subsidence and the duration after coal mining cessation was derived by integrating the function. The results indicated that the relationship between subsidence rate and duration after coal mining cessation followed an exponential function for a given coal face, whereas the relationship between cumulative subsidence and duration after coal mining cessation conformed to the Knothe time function. Notably, after the cessation of coal mining, significant land subsidence persisted in the goaf of the Yangquan No.2 mine for a duration ranging from 5 to 10 years. The cumulative subsidence curve along the long axis of the coal face ultimately exhibited an inclined W-shape. The proposed method enables the quantitative prediction of residual land subsidence in goafs, even in cases where continuous long-term monitoring data are insufficient, thus providing valuable guidance for construction decisions above the goaf.

Network effects, economies of scale, and lock-in-effects increasingly lead to a concentration of digital resources and capabilities, hindering the free and equitable development of digital entrepreneurship (SDG9), new skills, and jobs (SDG8), especially in small communities (SDG11) and their small and medium-sized enterprises (“SMEs”). To ensure the affordability and accessibility of technologies, promote digital entrepreneurship and community well-being (SDG3), and protect digital rights, we propose data cooperatives [1,2] as a vehicle for secure, trusted, and sovereign data exchange [3,4]. In post-pandemic times, community/SME-led cooperatives can play a vital role by ensuring that supply chains to support digital commons are uninterrupted, resilient, and decentralized [5]. Digital commons and data sovereignty provide communities with affordable and easy access to information and the ability to collectively negotiate data-related decisions. Moreover, cooperative commons (a) provide access to the infrastructure that underpins the modern economy, (b) preserve property rights, and (c) ensure that privatization and monopolization do not further erode self-determination, especially in a world increasingly mediated by AI. Thus, governance plays a significant role in accelerating communities’/SMEs’ digital transformation and addressing their challenges. Cooperatives thrive on digital governance and standards such as open trusted Application Programming Interfaces (APIs) that increase the efficiency, technological capabilities, and capacities of participants and, most importantly, integrate, enable, and accelerate the digital transformation of SMEs in the overall process. This policy paper presents and discusses several transformative use cases for cooperative data governance. The use cases demonstrate how platform/data-cooperatives, and their novel value creation can be leveraged to take digital commons and value chains to a new level of collaboration while addressing the most pressing community issues. The proposed framework for a digital federated and sovereign reference architecture will create a blueprint for sustainable development both in the Global South and North.

The scientific community has long benefited from the opportunities provided by data reuse. Recognizing the need to identify the challenges and bottlenecks to reuse in the agricultural research community and propose solutions for them, the data reuse working group was started within the AgBioData consortium (https://www.agbiodata.org/) framework. Here, we identify the limitations of data standards, metadata deficiencies, data interoperability, data ownership, data availability, user skill level, resource availability, and equity issues, with a specific focus on agricultural genomics research. We propose possible solutions stakeholders could implement to mitigate and overcome these challenges and provide an optimistic perspective on the future of genomics and transcriptomics data reuse.

To gain insight into the real-life care of patients in the healthcare system, data from hospital information systems and insurance systems are required. Consequently, linking clinical data with claims data is necessary. To ensure their syntactic and semantic interoperability, the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) was chosen. However, there is no detailed guide that would allow researchers to follow a consistent process for data harmonization. Thus, the aim of this paper is to conceptualize a generic data harmonization process for OMOP CDM. For this purpose, we conducted a literature review focusing on publications that address the harmonization of clinical or claims data in OMOP CDM. Subsequently, the process steps used and their chronological order were extracted for each included publication. The results were then compared to derive a generic sequence of the process steps. From 23 publications included, a generic data harmonization process for OMOP CDM was conceptualized, consisting of nine process steps: dataset specification, data profiling, vocabulary identification, coverage analysis of vocabularies, semantic mapping, structural mapping, extract-transform-load-process, qualitative and quantitative data quality analysis. This process can be used as a step-by-step guide to assist other researchers in harmonizing source data in OMOP CDM.

The rising importance of Big Data in modern information analysis is supported by vast quantities of user data, but it is only possible to collect sufficient data for all tasks within certain data-gathering contexts. There are many cases where a domain is too novel, too niche, or too sparsely collected to adequately support Big Data tasks. To remedy this, we have created ADG Engine that allows for the generation of additional data that follows the trends and patterns of the data that’s already been collected. Using a database structure that tracks users across different activity types, ADG Engine can use all available information to maximize the authenticity of the generated data. Our efforts are particularly geared towards data analytics by identifying abnormalities in the data and allowing the user to generate normal and abnormal data at custom ratios. In situations where it would be impractical or impossible to expand the available dataset by collecting more data, it can still be possible to move forward with algorithmically expanded data datasets.

Large datasets that enable researchers to perform investigations with unprecedented rigor are growing increasingly common in neuroimaging. Due to the simultaneous increasing popularity of open science, these state-of-the-art datasets are more accessible than ever to researchers around the world. While analysis of these samples has pushed the field forward, they pose a new set of challenges that might cause difficulties for novice users. Here, we offer practical tips for working with large datasets from the end-user’s perspective. We cover all aspects of the data life cycle: from what to consider when downloading and storing the data, to tips on how to become acquainted with a dataset one did not collect, to what to share when communicating results. This manuscript serves as a practical guide one can use when working with large neuroimaging datasets, thus dissolving barriers to scientific discovery.

Modern experimental astroparticle physics features large-scale setups measuring different messengers, namely high-energy particles generated by cosmic accelerators (e.g. supernova remnants, active galactic nuclei, etc): cosmic and gamma rays, neutrinos and recently discovered gravitational waves. Ongoing and future experiments are distributed over the Earth including ground, underground/underwater setups as well as balloon payloads and spacecrafts. The data acquired by these experiments have different formats, storage concepts and publication policies. Such differences are a crucial issue in the era of big data and of multi-messenger analysis strategies in astroparticle physics. We propose a service ASTROPARTICLE.ONLINE in the frame of which we develop an open science system which enables to publish, store, search, select and analyse astroparticle physics data. The cosmic-ray experiments KASCADE-Grande and TAIGA were chosen as pilot experiments to be included in this framework. In the first step of our initiative we will develop and test the following components of the full data life cycle concept: (i) describing, storing and reusing of astroparticle data; (ii) software for performing multi-experiment and multi-messenger analyses like deep-learning methods; (iii) outreach including example applications and tutorial for students and scientists outside the specific research field. In the present paper we describe the concepts of our initiative, and in particular the plans toward a common, federated astroparticle data storage.

As of 2020, public data for game ratings provided by Game Ratings And Administration Committee(GRAC) are more limited than public data for movie and video ratings provided by Korea Media Ratings Board and do not provide data which allow us to see information on ratings clearly and in detail. To get information on game ratings, we need to find information by searching for specific target on homepage which is inconvenient for us. In order to improve such inconvenience and extend scope of provision in public data, the author of this paper intends to study public data API which has been extended based on information on video ratings. To draw items to be extended, this study analyzes data for ratings on homepage of GRAC and designs collection system to build database. This study intends to implement system that provides data collected based on extended public data items in a form which users want. This study is expected to provide information on ratings to GRAC which will strengthen fairness and satisfy game users and people’s rights to know and contribute to promotion and development of game industry.

The study was conducted on applying machine learning and data mining methods to personalizing the treatment. This allows investigating individual patient characteristics. Personalization is built on the clustering method and associative rules. It was suggested to determine the average distance between instances for optimal performance metrics finding. The formalization of the medical data pre-processing stage for finding personalized solutions based on current standards and pharmaceutical protocols is proposed. The model of patient data is built. The paper presents the novel approach to clustering built on ensemble of cluster algorithm with better than k-means algorithm Hopkins metrics. The personalized treatment usually is based on decision tree. Such approach requires a lot of computation time and cannot be paralyzed. Therefore, it is proposed to classify persons by conditions, to determine deviations of parameters from the normative parameters of the group, as well as the average parameters. This made it possible to create a personalized approach to treatment for each patient based on long-term monitoring. According to the results of the analysis, it becomes possible to predict the optimal conditions for a particular patient and to find the medicaments treatment according to personal characteristics.

Intellecta dataset emerges as an innovative synthetic dataset, engineered to enhance the cognitive processing capabilities of contemporary language models. With a composition of 11.53 billion tokens, integrating 8.01 billion tokens of synthetic data with 3.52 billion tokens of rich textbook data, Intellecta is crafted to foster advanced reasoning and comprehensive educational narrative generation. Leveraging the Mixtral-8x7B-Instruct-v0.1 model, the dataset facilitates the generation of complex thought processes and detailed, textbook-style explanations, thus enabling language models to engage in both critical thinking and profound educational discourse. This hybrid dataset stands as a testament to the potential of synthetic data in pushing the boundaries of AI, offering a repository that is not only vast and varied but also refined to align with ethical standards and intellectual rigor.

In the coming years, digital applications and services that continue to use the country's native cloud systems will be huge. By 2023, that will exceed 500 million, according to IDC. This corresponds to the sum of all applications developed in the last 40 years. If you are the one you answered, yes! This article is for you!

This manuscript describes the construction and validation of high resolution daily gridded (0.05° × 0.05°) rainfall and maximum and minimum temperature data for Bangladesh : the Enhancing National Climate Services for Bangladesh Meteorological Department (ENACTS-BMD) dataset. The dataset was generated by merging data from weather stations, satellite products (for rainfall) and reanalysis (for temperature). ENACTS-BMD is the first high-resolution gridded surface meteorological dataset developed specifically for studies of surface climate processes in Bangladesh. Its record begins in January 1981 and is updated in real-time monthly and outputs have daily, decadal and monthly time resolution. The Climate Data Tools (CDT), developed by the International Research Institute for Climate and Society (IRI), Columbia University, is used to generate the dataset. This data processing includes the collection of weather and gridded data, quality control of stations data, downscaling of the reanalysis for temperature, bias correction of both satellite rainfall and downscaled reanalysis of temperature, and the combination of station and bias-corrected gridded data. The ENACTS-BMD dataset is available as an open-access product at BMD’s official website, allowing the enhancement of the provision of services, overcoming the challenges of data quality, availability, and access, promoting at the same time the engagement and use by stakeholders.

The implementation of the European Cohesion Policy aiming at fostering regions competitiveness, economic growth and creation of new jobs is documented over the period 2014–2020 in the publicly available Open Data Portal for the European Structural and Investment funds. On the base of this source, this paper aims at describing the process of data mining and visualization for information production on regional programmes performace in achieving effective expenditure of resouces.

The increasing availability of longitudinal data (repeated numerical observations of same units at different times) requires the development of flexible techniques to automatically detect common errors in such data. Besides obvious and easily identifiable cases, such as missing or out-of-range data, large longitudinal dataset often present problems not easily traceable by the techniques used for generic datasets. In particular, elusive and baffling problems are i) inversion of one or more values from one unit to another; ii) anomalous jumps in the series of values, iii) errors in the timing of the values due to a recalculation operated by the data providers to compensate previous errors. This work proposes a statistical-mathematical approach based on a system of indicators that is able to capture the complexity of the described problems by working at the formal level, regardless of the specific meaning of the data. The proposed approach identifies suspect erroneous data and is applicable in a variety of contexts. We implement this approach in a relevant database of European Higher Education institutions (ETER) by analyzing Total academic staff, that is one of the most important variables, used in empirical analysis as proxy of size and also considered by policy makers at European level.

In the last decade and a half, the world has experienced the outbreak of a range of viruses such as COVID-19, H1N1, flu, Ebola, Zika Virus, Middle East Respiratory Syndrome (MERS), Measles, and West Nile Virus, just to name a few. During these virus outbreaks, the usage and effectiveness of social media platforms increased significantly as such platforms served as virtual communities, enabling their users to share and exchange information, news, perspectives, opinions, ideas, and comments related to the outbreaks. Analysis of this Big Data of conversations related to virus outbreaks using concepts of Natural Language Processing such as Topic Modeling has attracted the attention of researchers from different disciplines such as Healthcare, Epidemiology, Data Science, Medicine, and Computer Science. The recent outbreak of the MPox virus has resulted in a tremendous increase in the usage of Twitter. Prior works in this field have primarily focused on the sentiment analysis and content analysis of these Tweets, and the few works that have focused on topic modeling have multiple limitations. This paper aims to address this research gap and makes two scientific contributions to this field. First, it presents the results of performing Topic Modeling on 601,432 Tweets about the 2022 Mpox outbreak, which were posted on Twitter between May 7, 2022, and March 3, 2023. The results indicate that the conversations on Twitter related to Mpox during this time range may be broadly categorized into four distinct themes - Views and Perspectives about MPox, Updates on Cases and Investigations about Mpox, MPox and the LGBTQIA+ Community, and MPox and COVID-19. Second, the paper presents the findings from the analysis of these Tweets. The results show that the theme that was most popular on Twitter (in terms of the number of Tweets posted) during this time range was - Views and Perspectives about MPox. It is followed by the theme of MPox and the LGBTQIA+ Community, which is followed by the themes of MPox and COVID-19 and Updates on Cases and Investigations about Mpox, respectively. Finally, a comparison with prior works in this field is also presented to highlight the novelty and significance of this research work.

In this paper, we present a method to map information regarding service activity provision residing in governmental portals across European Commission. In order to perform this, we used as a basis the enriched Greek e-GIF ontology, modeling concepts, and relations in one of the two data portals (i.e., Points of Single Contacts) examined, since relevant information on the second was not provided. Mapping consisted in transforming information appearing in governmental portals in RDF format (i.e., as Linked data), in order to be easily exchangeable. Mapping proved a tedious task, since description on how information is modeled in the second Point of Single Contact is not provided and must be extracted in a manual manner.

Background: Observational health data has the potential to be a rich resource to inform clinical practice and regulatory decision making. However, the lack of standard data quality processes makes it difficult to know if these data are research ready. The EHDEN COVID-19 Rapid Col-laboration Call presented the opportunity to assess how the newly developed open-source tool Data Quality Dashboard (DQD) informs the quality of data in a federated network. Methods: 15 Data Partners (DPs) from 10 different countries worked with the EHDEN taskforce to map their data to the OMOP CDM. Throughout the process at least two DQD results were collected and compared for each DP. Results: All DPs showed an improvement in their data quality between the first and last run of the DQD. The DQD excelled at helping DPs identify and fix conformance is-sues but showed less of an impact on completeness and plausibility checks. Conclusions: This is the first study to apply the DQD on multiple, disparate databases across a network. While study-specific checks should still be run, we recommend that all data holders converting their data to the OMOP CDM use the DQD as it ensures conformance to the model specifications and that a database meets a baseline level of completeness and plausibility for use in research.