Circumventing the Curse of Dimensionality in Prediction: Causal Rate-Distortion for Infinite-Order Markov Processes
نویسندگان
چکیده
SFI Working Papers contain accounts of scienti5ic work of the author(s) and do not necessarily represent the views of the Santa Fe Institute. We accept papers intended for publication in peer-‐reviewed journals or proceedings volumes, but not papers that have already appeared in print. Except for papers by our external faculty, papers must be based on work done at SFI, inspired by an invited visit to or collaboration at SFI, or funded by an SFI grant.
منابع مشابه
Predictive Rate-Distortion for Infinite-Order Markov Processes
Predictive rate-distortion analysis suffers from the curse of dimensionality: clustering arbitrarily long pasts to retain information about arbitrarily long futures requires resources that typically grow exponentially with length. The challenge is compounded for infiniteorder Markov processes, since conditioning on finite sequences cannot capture all of their past dependencies. Spectral argumen...
متن کاملMarkov decision programming techniques applied to the animal replacement problem
The major difficulties of the animal replacement problem are identified as uniformity, herd restraints and the "curse of dimensionality". Approaches for circumventing these difficulties using Markov decision programming methods are systematically discussed, and possible optimization techniques are described and evaluated. Assuming that the objective of the farmer is maximum net returns from the...
متن کاملON THE INFINITE ORDER MARKOV PROCESSES
The notion of infinite order Markov process is introduced and the Markov property of the flow of information is established.
متن کاملSimultaneous optimization of management decisions at the operational and tactical level in animal production
In herd management, we face a hierarchy of decisions made at different levels with different time horizon, and the decisions made at different levels are mutually dependent. Furthermore, decisions have to be made without certainty about the future state of the system. If, for instance, a decision has to be made at the tactical level, it is necessary to assume some policy to be followed concerni...
متن کاملMultiscale Sparse Microcanonical Models
We study density estimation of stationary processes defined over an infinite grid from a single, finite realization. Gaussian Processes and Markov Random Fields avoid the curse of dimensionality by focusing on low-order and localized potentials respectively, but its application to complex datasets is limited by their inability to capture singularities and long-range interactions, and their expe...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1412.2859 شماره
صفحات -
تاریخ انتشار 2014