Bayesian Estimation of Parameters of A Linear Regression Model With Correlated Explanatory Variables

Subscribe to access this work and thousands more


This paper addressed the popular issue of collinearity among explanatory variables in the context of a multiple linear regression analysis, and the parameter estimations of both the classical and the Bayesian approaches were compared using Mean Square Error (MSE) and Absolute bias. Five sample sizes: 10, 25, 50, 100 and 500 each replicated 1000 times were simulated using Monte Carlo method. Four degrees of correlation representing no correlation, weak correlation, moderate correlation and strong correlation were considered. The estimation techniques considered were, Ordinary Least Squares (OLS); Feasible Generalized Least Squares (FGLS) and Bayesian Methods. The performances of the estimators were evaluated using Absolute Bias (ABIAS) and Mean Square Error (MSE) of the estimates respectively. In all cases considered, the Bayesian estimators performed better. It was consistently more efficient than the OLS and FGLS.


Subscribe to access this work and thousands more