頁籤選單縮合
題 名 | A Note on the Lasso and Related Procedures in Model Selection |
---|---|
作 者 | Leng, Chenlei; Lin, Yi; Wahba, Grace; | 書刊名 | Statistica Sinica |
卷 期 | 16:4 民95.10 |
頁 次 | 頁1273-1284 |
分類號 | 319.51 |
關鍵詞 | Consistent model selection; Forward stagewise regression; Lars; Lasso; Variable selection; |
語 文 | 英文(English) |
英文摘要 | The Lasso, the Forward Stagewise regression and the Lars are closely related procedures recently proposed for linear regression problems. Each of them can produce sparse models and can be used both for estimation and variable selection. In practical implementations these algorithms are typically tuned to achieve optimal prediction accuracy. We show that, when the prediction accuracy is used as the criterion to choose the tuning parameter, in general these procedures are not consistent in terms of variable selection. That is, the sets of variables selected are not consistently the true set of important variables. In particular, we show that for any sample size n, when there are superfluous variables in the linear regression model and the design matrix is orthogonal, the probability that these procedures correctly identify the true set of important variables is less than a constant (smaller than one) not depending on n. This result is also shown to hold for two-dimensional problems with general correlated design matrices. The results indicate that in problems where the main goal is variable selection, prediction-accuracy-based criteria alone are not sufficient for this purpose. Adjustments will be discussed to make the Lasso and related procedures useful/consistent for variable selection. |
本系統中英文摘要資訊取自各篇刊載內容。