Predicting algorithmic complexity through structure analysis and compression
نویسندگان
چکیده
The complexity of an algorithm is usually specied by the maximum number of steps made by the algorithm, as a function of the size of the input. However, as dierent inputs of equal size can yield dramatically dierent algorithm runtime, the size of the input is not always an appropriate basis for predicting algorithm runtime. In this paper, we argue that the compressed size of the input is more appropriate for this purpose. In particular, we devise a genetic algorithm for compressing a graph by nding the most compact description of its structure, and we demonstrate how the compressed size of the problem instance correlates with the runtime of an exact algorithm for two hard combinatorial problems (graph coloring and Boolean satisability).
منابع مشابه
Shannon Information and Kolmogorov Complexity
We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories: Shannon entropy versus Kolmogorov complexity, the relation of both to universal coding, Shannon mutual information versus Kolmogorov (‘algorithmic’) mutual inform...
متن کاملOn Board Data Compression: Distortion and Complexity Related Aspects
Digital signal Processing (DSP), and in particular data analysis and compression, has been studied for many years. However, only the recent advances in computing technology have made it possible to use DSP in day-to-day applications. Users expect the data to be transmitted in a minimum of time and to take up as little storage space as possible. These requirements call for efficient data compres...
متن کاملAlgorithmic Relative Complexity
Information content and compression are tightly related concepts that can be addressed through both classical and algorithmic information theories, on the basis of Shannon entropy and Kolmogorov complexity, respectively. The definition of several entities in Kolmogorov’s framework relies upon ideas from classical information theory, and these two approaches share many common traits. In this wor...
متن کاملTwo-dimensional Kolmogorov complexity and an empirical validation of the Coding theorem method by compressibility
We propose a measure based upon the fundamental theoretical concept in algorithmic information theory that provides a natural approach to the problem of evaluating n-dimensional complexity by using an n-dimensional deterministic Turing machine. The technique is interesting because it provides a natural algorithmic process for symmetry breaking generating complex n-dimensional structures from pe...
متن کاملTwo-Dimensional Kolmogorov Complexity and Validation of the Coding Theorem Method by Compressibility
The question of natural measures of complexity for objects other than strings and sequences, in particular suited for 2-dimensional objects, is an open important problem in complexity science. Here we provide a measure based upon the concept of Algorithmic Probability that elegantly connects to Kolmogorov complexity that provides a natural approach to n-dimensional algorithmic complexity by usi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Appl. Soft Comput.
دوره 13 شماره
صفحات -
تاریخ انتشار 2013