Article Version 1 Preserved in Portico This version is not peer-reviewed
Bayesian Smoothing Splines
Version 1 : Received: 15 February 2022 / Approved: 18 February 2022 / Online: 18 February 2022 (09:30:41 CET)
How to cite: Venter, G. Bayesian Smoothing Splines. Preprints 2022, 2022020230. https://doi.org/10.20944/preprints202202.0230.v1. Venter, G. Bayesian Smoothing Splines. Preprints 2022, 2022020230. https://doi.org/10.20944/preprints202202.0230.v1.
Fitting parameters on spline curves produces more parsimonious models, maintaining fit quality. Smoothing the splines reduces predictive variance. Individual splines are often fit by type of variable, e.g., in age-period-cohort models. Linear and cubic splines are most common. Several smoothing criteria have been used for parameter curves, with cubic splines fit by constraining the integral of splines’ squared-second derivatives popular recently. Constraining the sum of squared second differences for linear splines is analogous. Generally the degree of smoothing is selected using cross-validation. Known spline dummy-variable matrices allow regression estimation of splines, with smoothing done via constrained regression. Smoothing criteria based on sums of squares or absolute values of parameters, as in ridge regression or LASSO, improves predictive accuracy and produces splines similar to smoothing by second-derivative constraints. Variables with very low t-statistics represent points where curve-shapes barely change. Eliminating those variables leaves knots concentrated where spline shapes change. A Bayesian version of this puts shrinkage priors on spline parameters. This yields realistic joint parameter distributions, avoids problems associated with using cross-validation for parameter estimation, and readily expands to non-linear modeling, such as interactions among variable types. Regularized regression and Bayesian spline methods are compared for two example datasets.
smoothing splines; shrinkage priors; MCMC; Bayesian methods
MATHEMATICS & COMPUTER SCIENCE, Probability and Statistics
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.Leave a public comment
Send a private comment to the author(s)