TY - JOUR
T1 - Problems of nonnormality and multicollinearity for forecasting methods based on least squares
AU - Montgomery, Douglas C.
AU - Askin, Ronald G.
N1 - Funding Information:
Supported in pat by the Office of ~ a v a~l esearchu nder contract N00014-784-0312, NR047-175.
PY - 1981/6
Y1 - 1981/6
N2 - Many popular forecasting and time-series analysis methods assume that the variable to be forecast can be expressed as a linear function of a set of predictors. The predictors may include variables related in either a correlative or causal fashion to the response variable, lagged values of this variable, or known mathematical functions of time. The method of least squares is used almost exclusively to estimate the parameters in these models. This paper discusses two hazards in the indiscriminant use of least squares; nonnormality of the observations on the variable of interest and multicollinearity among the predictors. Robust estimation methods are suggested as alternatives to least squares for nonnormal data, and a robust version of exponential smoothing is developed. A small Monte Carlo study indicates that the robust procedure can be superior to ordinary exponential smoothing in many situations. The sources and effects of multicollinearity are discussed, and several diagnostic statistics are presented. Methods for dealing with multicollinearity are reviewed, including collecting additional data, variable selection, and biased estimation. An example of ridge regression is included.
AB - Many popular forecasting and time-series analysis methods assume that the variable to be forecast can be expressed as a linear function of a set of predictors. The predictors may include variables related in either a correlative or causal fashion to the response variable, lagged values of this variable, or known mathematical functions of time. The method of least squares is used almost exclusively to estimate the parameters in these models. This paper discusses two hazards in the indiscriminant use of least squares; nonnormality of the observations on the variable of interest and multicollinearity among the predictors. Robust estimation methods are suggested as alternatives to least squares for nonnormal data, and a robust version of exponential smoothing is developed. A small Monte Carlo study indicates that the robust procedure can be superior to ordinary exponential smoothing in many situations. The sources and effects of multicollinearity are discussed, and several diagnostic statistics are presented. Methods for dealing with multicollinearity are reviewed, including collecting additional data, variable selection, and biased estimation. An example of ridge regression is included.
UR - http://www.scopus.com/inward/record.url?scp=0019581203&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0019581203&partnerID=8YFLogxK
U2 - 10.1080/05695558108974542
DO - 10.1080/05695558108974542
M3 - Article
AN - SCOPUS:0019581203
SN - 0569-5554
VL - 13
SP - 102
EP - 115
JO - AIIE Transactions
JF - AIIE Transactions
IS - 2
ER -