Abstract
We discuss the relation between entropy and information from the physicists point of view differing between bound and free information. The quantitative physical aspects of information flow are given by flows of entropy, which are closely related to the reduction of uncertainty and the predictability of events. Free information is considered as a quantity, which has intrinsic non – physical components, and is originally created by selforganization and evolution. Bound and free information are both represented by a matter carrier but not as tight – bounded like mass or energy. Free information is connected with information – processing; it is introduced as a binary relation between a sender and a receiver, which may have different carriers, it is essentially characterized by symbolic representations. Processing free information is originally created by selforganization on the early earth and is connected with the origin of life, therefore it is always at least indirectly related to living systems.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
W. Ebeling, R. Feistel, Physik der Selbstorganisation und Evolution (Akademie-Verlag, Berlin, 1982, 1986, 1990)
W. Ebeling, R. Feistel, Selforganization of Symbols and Information, Chapter 9 in J.S. Nicolis, V. Bassos (eds.), Chaos, Information Processing and Praradoxical Games: The Legacy of J.S. Nicolis (World Scientific, Singapore, 2015)
R. Feistel, W. Ebeling, Evolution of Complex Systems (Dt. Verlag der Wiss. Berlin 1989; Kluwer Academic Publishers Dordrecht/Boston/London, 1989)
R. Feistel, W. Ebeling, Physics of selforganization and evolution (Wiley – VCH, Weinheim, 2011)
M. Eigen, Selforganization of matter and the evolution of biological macromolecules, Naturwissenschaften 58, 465 (1971)
M. Eigen, W. Gardiner, P. Schuster, R. Winkler-Oswatitsch, The origin of genetic information, Scientific American 244, 88 (1981)
M. Eigen, The origin of genetic information, Origins Life Evol. Biospheres 24, 241 (1994)
M. Eigen, From strange simplicity to complex familiarity, A treatise on matter, information, life and thought (Oxford University Press, Oxford, 2013)
M. Eigen, P. Schuster, The hypercycle. A principle of natural self-organization. Part A: Emergence of the hypercycle, Naturwissenschaften 64, 541 (1977)
H. Haken, Information and Selforganization (Springer, Berlin, 1988)
H. Haken, M. Haken-Krell, Information and selforganization, A macroscopic approach to complex systems (Springer, Berlin, 1988)
H. Haken, J. Portugali, Information Adaptation: The Interplay Between Shannon Information and Semantic Information in Cognition (Springer, 2015)
M.V. Volkenstein, Entropy and information (Birkhäuser, Basel, 2009)
M. Burgin, Theory of Information: Fundamentality, Diversity and Unification (World Scientific, Singapore, 2010)
P.C. Marijuan et al., Foundations of Information Science, fis@listas.unizar.es
R. Landauer, Information is physical, Physics Today 91, 23 (1991)
R. Landauer, The physical nature of information, Phys. Lett. A 217, 188 (1996)
R. Penrose, Some remarks on Gravity and Quantum Mechanics, in Quantum Structure of Space and Time, edited by M.J. Duff, C.J. Isham, (Cambridge University Press, 1982)
J.A. Wheeler, It from bit. In: Proc. Int. Symp. Foundations Quantum Machanics (Tokyo, 1989)
D. John Barrow, C.W. PaulDavies, C. Harper jr. (eds.), Science and Ultimate Reality. Quantum Theory, Cosmology, and Complexity (Cambridge University Press, 2004)
J.D. Bekenstein, Lett. Nuovo Cim. 11, 467 (1974)
S. Kauffman, Investigations (Oxford University Press, 2000)
T. Stonier, Information and the Internal Structure of the Universe (Springer, Berlin, Heidelberg, 1992)
S. Lloyd, Programming the Universe (Vintage (Random House), New York, 2007)
W. Ebeling, J. Freund, F. Schweitzer, Entropie, Struktur, Komplexität (Teubner-Verlag, Stuttgart, 1998)
C. Shannon, Predictions and Entropy of Printed English, Bell Systems Tech. 30, 50 (1951)
A.N. Kolmogorov, Dokl. Akad. Nauk USSR 124, 754 (1959)
A.N. Kolmogorov, IEEE Transactions Inf. Theory 14, 14 (1968)
B. Ya. Sinai, Dokl. Akad. Nauk USSR 124, 768 (1959)
B. Ya. Sinai, Dokl. Akad. Nauk USSR 125, 1200 (1959)
H.G. Schuster, Deterministic Chaos (VCH Wiley, 1988)
L. Gatlin, Information Theory and the Living System (Columbia University Press, New York, 1972)
G. von Heijne, Sequence Analysis in Molecular Biology (Academic press, San Diego, 1987)
H.P. Yockey, Information Theory and Molecular Biology (University Press, Cambridge, 1992)
W. Hofkirchner (Ed.), The quest for a unified theory of information: Proc. of the 2nd Int. Conf. on the Foundations of Information Science (Gordon and Breach, Amsterdam, 1999)
L. Molgedey, W. Ebeling, Local order, entropy and predictability of financial time series, Eur. Phys. J. B 15, 733 (2000)
R. Steuer et al., Entropy and local uncertainty of data from sensory neurons, Phys. Rev. E 64, 061911-1 (2001)
W. Ebeling, M.V. Volkenstein, Entropy and the evoluion of biological information, Physica 163, 398 (1990)
M. Conrad, W. Ebeling, Michael Volkenstein's evolutionary thinking and the structure of fitness landscapes, BioSystems 27, 125 (1992)
W. Ebeling, Relation between various entropy concepts and the valoric interpretation, Physica A 182, 108 (1992)
W. Ebeling, Entropy and information if processes of selforganization: uncertainty and predictability, Physica A 194, 563 (1993)
L. Szilard, über die Entropievermehrung in einem thermodynamischen System bei Eingriffen intelligenter Wesen, Z. Physik 53, 840 (1929)
R. Stratonovich, On the problem of the valuabilty of information, In: I. Lamprecht, A.I. Zotin, Thermodynamics and regulation in biological processes (De Gryter, Berlin 1985)
D.S. Chernavsky, Synergetics and information (in Russ.) (Nauka, Moskva, 2001)
W. Ebeling, G. Nicolis, Word frequency and symbolic sequences: A dynamical perspective, Chaos, Solitons & Fractals 2, 635 (1992)
W. Ebeling, T. Pöschel, K.F. Albrecht, Int. J. Bifurcation Chaos 5, 51 (1995)
W. Li, K. Kaneko, Europhys. Lett. 17, 655 (1992)
H. Herzel, A.O. Schmitt, W. Ebeling, Phys. Rev. E 50, 5061 (1994)
M.A. Jimenez, R. Feistel, G. Diez-Martinez, Nonlin. Dyn. Psychol. Life Sci. 8, 445 (2004)
M.A. Jimenez-Montano, M. He, Irreplaceable mino acids and reduced alphabets, in I. Manndoiu et al., Bioinformatics (Springer, Berlin, 2009)
M.A. Jimenez-Montano et al., Codon information value and codon transition – probability, Physica A 454, 117 (2016)
R. Feistel, W. Ebeling, Entropy and the Self-organization of Information and Value, Entropy 18, 193 (2016)
R. Feistel, Self-organisation of symbolic information, Eur. Phys. J. Special Topics (2016), Doi: 10.1140/epjst/e2016-60170-9
T. Asselmeyer, W. Ebeling, H. Rosé, Smoothing representation of fitness landscapes – the genotyp – phenotype map of evolution, BioSystems 39, 63 (1996)
T. Asselmeyer, W. Ebeling, H. Rosé, Evolutionary strategies of optimization, Phys. Rev. E 56, 1171 (1997)
Author information
Authors and Affiliations
Corresponding author
Additional information
On the occasion of the 90th birthday of Manfred Eigen.
Rights and permissions
About this article
Cite this article
Ebeling, W. Physical basis of information and the relation to entropy٭. Eur. Phys. J. Spec. Top. 226, 161–176 (2017). https://doi.org/10.1140/epjst/e2016-60366-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1140/epjst/e2016-60366-5