67
3

An error bound for Lasso and Group Lasso in high dimensions

Abstract

We leverage recent advances in high-dimensional statistics to derive new L2 estimation upper bounds for Lasso and Group Lasso in high-dimensions. For Lasso, our bounds scale as (k/n)log(p/k)(k^*/n) \log(p/k^*)---n×pn\times p is the size of the design matrix and kk^* the dimension of the ground truth β\boldsymbol{\beta}^*---and match the optimal minimax rate. For Group Lasso, our bounds scale as (s/n)log(G/s)+m/n(s^*/n) \log\left( G / s^* \right) + m^* / n---GG is the total number of groups and mm^* the number of coefficients in the ss^* groups which contain β\boldsymbol{\beta}^*---and improve over existing results. We additionally show that when the signal is strongly group-sparse, Group Lasso is superior to Lasso.

View on arXiv
Comments on this paper