Information theory - Exercises
ثبت نشده
چکیده
Exercise 1. Design a Huffman code for the outcome of a fair die. Evaluate the average length, and compare it against the source entropy. For which source distribution this would be an optimal code? Exercise 2. Let p be the probability of head in a sequence of tosses of a biased coin. A sequence of messages is parsed using the alphabet X = {h, th, tt}. Evaluate H(X) in bits/message and also in bits per coin toss. Verify that the latter entropy is H(p), as expected. Exercise 3. Consider the following codes for the source alphabet X = {a, b, c, d, e}:
منابع مشابه
Informing Students about Information: Seven Semantic Exercises
Information is a term widely but carelessly used in our day-to-day language While used poorly as a common expression, a growing number of recent publications on information have identified the importance of the term for both IS research and practice. Most of these publications, seeking to anchor the term more specifically, attribute meaning to information to distinguish it from data. In this pa...
متن کاملInforming About Semantic Information: A Set of Exercises and Lessons Learned
Information is a ubiquitous term that in both academic and practical settings is taken seriously while used carelessly (Lee 2010; McKinney and Yoos 2015). While used poorly, a growing number of recent publications on information identify the importance of the term for both IS research and practice (Boell and Cecez-Kecmanovic 2011; Floridi 2011; Kettinger and Li 2010; Mingers 2013). While the ac...
متن کاملMeasurement of information flows in rescue exercises in the aftermath of the collapse of a building
Collapsed buildings are one of the most complex challenges for rescue forces. The large amount of incoming information in particular is a major challenge to handle for the involved forces. The Assessment of this information is necessary in order to be able to give reliable statements about the number of buried and missing victims. To improve the handling of the information, the authors have dev...
متن کاملAn Introduction for the Telecom Scientist
Information theory lies at the heart of modern technology, underpinning all communications, networking, and data storage systems. This book sets out, for the first time, a complete overview of both classical and quantum information theory. Throughout, the reader is introduced to key results without becoming lost in mathematical details. The opening chapters deal with the basic concepts and vari...
متن کاملCoding theory, cryptography and cryptographic protocols - exercises with solutions
The main goal of this work is to present detailed solutions of exercises that have been submitted to students of the course Coding, cryptography and cryptographic protocols, given by prof. RNDr. Jozef Gruska, DrSc. in 2006 as homeworks. This way a handbook of solved exercises from coding theory and cryptography is created. Ahead of each set of new exercises we include main concepts and results ...
متن کاملThe role of fitness and aerobic exercises on the executive functions of dyslexia and dyscalculia children
Abstract Background and Purpose: Studies carried out in recent decades show that exercises have useful impact on improving executive functions. Therefore, this study aims to investigate the roles of fitness and aerobic exercises on problem-solving process of dyslexic and dyscalculia children. Materials and methods: Using systematic review study and key terms including fitness and aerobic e...
متن کامل