Galvani, M.; Bardelli, C.; Figini, S.; Muliere, P. A Bayesian Nonparametric Learning Approach to Ensemble Models Using the Proper Bayesian Bootstrap. Algorithms2021, 14, 11.
Galvani, M.; Bardelli, C.; Figini, S.; Muliere, P. A Bayesian Nonparametric Learning Approach to Ensemble Models Using the Proper Bayesian Bootstrap. Algorithms 2021, 14, 11.
Galvani, M.; Bardelli, C.; Figini, S.; Muliere, P. A Bayesian Nonparametric Learning Approach to Ensemble Models Using the Proper Bayesian Bootstrap. Algorithms2021, 14, 11.
Galvani, M.; Bardelli, C.; Figini, S.; Muliere, P. A Bayesian Nonparametric Learning Approach to Ensemble Models Using the Proper Bayesian Bootstrap. Algorithms 2021, 14, 11.
Abstract
Bootstrap resampling techinques, introduced by Efron and Rubin, can be presented in a general Bayesian framework, approximating the statistical distribution of a statistical functional φ(F), where F is a random distribution function. Efron’s and Rubin’s bootstrap procedures can be extended introducing an informative prior through the Proper Bayesian bootstrap. In this paper different bootstrap techniques are used and compared in predictive classification and regression models based on ensemble approaches, i.e. bagging models involving decision trees. Proper Bayesian bootstrap, proposed by Muliere and Secchi, is used to sample the posterior distribution over trees, introducing prior distributions on the covariates and the target variable. The results obtained are compared with respect to other competitive procedures employing different bootstrap techniques. The empirical analysis reports the results obtained on simulated and real data.
MATHEMATICS & COMPUTER SCIENCE, Algebra & Number Theory
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
