Abstract
In the last chapter, we have discussed the significance of entropy in the context of zero-error data compression. In this chapter and the next, we explore entropy in terms of the asymptotic behavior of i.i.d. sequences. Specifically, two versions of the asymptotic equipartition property (AEP), namely the weak AEP and the strong AEP, are discussed. The role of these AEP’s in information theory is analogous to the role of the weak law of large numbers in probability theory. In this chapter, the weak AEP and its relation with the source coding theorem are discussed. All the logarithms are in the base 2 unless otherwise specified.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science+Business Media New York
About this chapter
Cite this chapter
Yeung, R.W. (2002). Weak Typicality. In: A First Course in Information Theory. Information Technology: Transmission, Processing and Storage. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-8608-5_4
Download citation
DOI: https://doi.org/10.1007/978-1-4419-8608-5_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-4645-6
Online ISBN: 978-1-4419-8608-5
eBook Packages: Springer Book Archive