386

Shallow neural network representation of polynomials

Abstract

We show that dd-variate polynomials of degree RR can be represented on [0,1]d[0,1]^d as shallow neural networks of width d+1+r=2R(r+d1d1)[(r+d1d1)+1]d+1+\sum_{r=2}^R\binom{r+d-1}{d-1}[\binom{r+d-1}{d-1}+1]. Also, by SNN representation of localized Taylor polynomials of univariate CβC^\beta-smooth functions, we derive for shallow networks the minimax optimal rate of convergence, up to a logarithmic factor, to unknown univariate regression function.

View on arXiv
Comments on this paper