# Emergence of Zipf's Law in the Evolution of Communication

@article{CorominasMurtra2011EmergenceOZ, title={Emergence of Zipf's Law in the Evolution of Communication}, author={Bernat Corominas-Murtra and Jordi Fortuny Andreu and Ricard V. Sol{\'e}}, journal={Physical review. E, Statistical, nonlinear, and soft matter physics}, year={2011}, volume={83 3 Pt 2}, pages={ 036115 } }

Zipf's law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and hearer in a communication system, we introduce evolution by means of a variational approach to the problem based on Kullback's Minimum Discrimination of Information Principle. Therefore, using a formalism fully embedded in the framework of information theory… Expand

#### 43 Citations

Optimization Models of Natural Communication

- Computer Science, Physics
- J. Quant. Linguistics
- 2018

Two important components of the family, namely the information theoretic principles and the energy function that combines them linearly, are reviewed from the perspective of psycholinguistics, language learning, information theory and synergetic linguistics. Expand

Zipf's Law in Human-Machine Dialog

- Computer Science
- IVA
- 2020

It is found that even though both the human and agent frequency distributions follow Zipf's law, these distributions are not necessarily similar, shed light on where agent dialog may distinguish itself from human dialog, and can serve as a way to monitor to what extent ubiquitous patterns in human-human dialog are found inhuman-machine dialog. Expand

On the Origin of Ambiguity in Efficient Communication

- Computer Science, Mathematics
- J. Log. Lang. Inf.
- 2013

The emergence of irreversible computations is required if the complexities of the coding and the decoding processes are balanced in a symmetric scenario, which means that the emergence of ambiguous codes is a necessary condition for natural communication to succeed. Expand

On ambiguity. Its locus in the architecture of Language and its origin in efficient communication

- Computer Science, Mathematics
- ArXiv
- 2011

This work locates ambiguity at the externalization branch of language, provides a rigorous, general definition of ambiguity through the concept of logical irreversibility, quantifying the amount of ambiguity within the framework of Shannon’s information theory. Expand

Large-Scale Analysis of Zipf’s Law in English Texts

- Computer Science, Mathematics
- PloS one
- 2016

This work studies three different versions of Zipf’s law by fitting them to all available English texts in the Project Gutenberg database and finds one of them is able to fit more than 40% of thetexts in the database at the 0.05 significance level. Expand

Zipf’s Law, unbounded complexity and open-ended evolution

- Computer Science, Biology
- Journal of the Royal Society Interface
- 2018

It is concluded that statistical information (standard Shannon information) is not conserved, resulting in the paradoxical situation in which the increase of information content has the effect of erasing itself, and it is proved that this paradox is solved if the authors consider non-statistical forms of information. Expand

Luís F . Seoane Ambiguity in language networks

- 2015

Human language defines the most complex outcomes of evolution. The emergence of such an elaborated form of communication allowed humans to create extremely structured societies and manage symbols at… Expand

Statistical laws in linguistics

- Mathematics, Physics
- ArXiv
- 2015

It is argued that linguistic laws are only meaningful if accompanied by a model for which the fluctuations can be computed (e.g., a generative model of the text) and the constraints imposed by linguistic laws on the creativity process of text generation are not as tight as one could expect. Expand

Ambiguity in language networks

- Mathematics, Physics
- ArXiv
- 2014

Ambiguity is shown to play an essential role in providing a source of language efficiency, and is likely to be an inevitable byproduct of network growth. Expand

Analysis of an information-theoretic model for communication

- Mathematics, Physics
- 2012

We study the cost-minimization problem posed by Ferrer i Cancho and Sol\'e in their model of communication that aimed at explaining the origin of Zipf's law [PNAS 100, 788 (2003)]. Direct analysis… Expand

#### References

SHOWING 1-10 OF 50 REFERENCES

Evolution of networks

- Physics, Biology
- 2002

The recent rapid progress in the statistical physics of evolving networks is reviewed, and how growing networks self-organize into scale-free structures is discussed, and the role of the mechanism of preferential linking is investigated. Expand

Contemporary Physics

- Nature
- 1945

IT must, of course, be clearly understood that the following brief notes do not profess to mention, even by name, every important line of research in physics that is going on in the U.S.S.R.; they… Expand

Elements of Information Theory

- Engineering, Computer Science
- 1991

The author examines the role of entropy, inequality, and randomness in the design of codes and the construction of codes in the rapidly changing environment. Expand

Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems

- Computer Science
- 2004

This ninth volume of the proceedings of the international A-life conference reflects the growing quality and impact of this interdisciplinary scientific community. Expand

Information Theory

- Nature
- 1962

Information TheoryPapers read at a Symposium on Information Theory held at the Royal Institution, London, August 29th to September 2nd, 1960. Edited by Colin Cherry. Pp. xi + 476. (London:… Expand

Art

- The Lancet
- 2000

Descrizione sommaria dell’attività di ricerca: La/il candidata/o deve sviluppare ricerche nell’ambito della robotica sociale (sia Socially Assistive Robotics, sia Robots in Educational Contexts)… Expand

Phys

- Rev. E 82, 011102
- 2010

Information Theory and Statistics (John Wiley and Sons

- New York,
- 1959

Information Theory and Statistics

- Mathematics, Computer Science
- International Encyclopedia of Statistical Science
- 2011

Lingua 77

- 187 (1989). 036115-6 EMERGENCE OF ZIPF’s LAW IN THE EVOLUTION OF . . . PHYSICAL REVIEW E 83, 036115
- 2011