Machine Learning Friendly Set Version of Johnson-Lindenstrauss Lemma
In this paper we make a novel use of the Johnson-Lindenstrauss Lemma. The Lemma has an existential form saying that there exists a JL transformation of the data points into lower dimensional space such that all of them fall into predefined error range . We formulate in this paper a theorem stating that we can choose the target dimensionality in a random projection type JL linear transformation in such a way that with probability all of them fall into predefined error range for any user-predefined failure probability . This result is important for applications such a data clustering where we want to have a priori dimensionality reducing transformation instead of trying out a (large) number of them, as with traditional Johnson-Lindenstrauss Lemma.
View on arXiv