ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1304.4806
42
2
v1v2v3v4 (latest)

Unsupervised model-free representation learning

17 April 2013
D. Ryabko
    CMLAI4TS
ArXiv (abs)PDFHTML
Abstract

Numerous control and learning problems face the situation where sequences of high-dimensional highly dependent data are available, but no or little feedback is provided to the learner. To address this issue, we formulate the following problem. Given a series of observations X_0,...,X_n coming from a large (high-dimensional) space X, find a representation function f mapping X to a finite space Y such that the series f(X_0),...,f(X_n) preserve as much information as possible about the original time-series dependence in X_0,...,X_n. We show that, for stationary time series, the function f can be selected as the one maximizing the time-series information h_0(f(X))- h_\infty (f(X)) where h_0(f(X)) is the Shannon entropy of f(X_0) and h_\infty (f(X)) is the entropy rate of the time series f(X_0),...,f(X_n),... Implications for the problem of optimal control are presented.

View on arXiv
Comments on this paper