A new approach to variable selection in least squares problems

M.R. Osborne, B. Presnell, Berwin Turlach

    Research output: Contribution to journalArticle

    492 Citations (Scopus)

    Abstract

    The title Lasso has been suggested by Tibshirani (1996) as a colourful name for a technique of variable selection which requires the minimization of a sum of squares subject to an l(1) bound kappa on the solution. This forces zero components in the minimizing solution for small values of kappa. Thus this bound can function as a selection parameter. This paper makes two contributions to computational problems associated with implementing the Lasso: (1) a compact descent method for solving the constrained problem for a particular value of kappa is formulated, and (2) a homotopy method, in which the constraint bound kappa becomes the homotopy parameter, is developed to completely describe the possible selection regimes. Both algorithms have a finite termination property. It is suggested that modified Gram-Schmidt orthogonalization applied to an augmented design matrix provides an effective basis for implementing the algorithms.
    Original languageEnglish
    Pages (from-to)389-403
    JournalIMA Journal of Numerical Analysis
    Volume20
    Issue number3
    DOIs
    Publication statusPublished - 2000

    Fingerprint Dive into the research topics of 'A new approach to variable selection in least squares problems'. Together they form a unique fingerprint.

    Cite this