Journal
PSYCHONOMIC BULLETIN & REVIEW
Volume 21, Issue 5, Pages 1112-1130Publisher
SPRINGER
DOI: 10.3758/s13423-014-0585-6
Keywords
Language; Zipf's law; Statistics
Categories
Funding
- NICHD NIH HHS [F32 HD070544, F32HD070544] Funding Source: Medline
Ask authors/readers for more resources
The frequency distribution of words has been a key object of study in statistical linguistics for the past 70 years. This distribution approximately follows a simple mathematical form known as Zipf's law. This article first shows that human language has a highly complex, reliable structure in the frequency distribution over and above this classic law, although prior data visualization methods have obscured this fact. A number of empirical phenomena related to word frequencies are then reviewed. These facts are chosen to be informative about the mechanisms giving rise to Zipf's law and are then used to evaluate many of the theoretical explanations of Zipf's law in language. No prior account straightforwardly explains all the basic facts or is supported with independent evaluation of its underlying assumptions. To make progress at understanding why language obeys Zipf's law, studies must seek evidence beyond the law itself, testing assumptions and evaluating novel predictions with new, independent data.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available