Lexibank, a public repository of standardized wordlists with computed phonological and lexical features

The past decades have seen substantial growth in digital data on the world's languages. At the same time, the demand for cross-linguistic datasets has been increasing, as witnessed by numerous studies devoted to diverse questions on human prehistory, cultural evolution, and human cognition. Unfortunately, most published datasets lack standardization which makes their comparison difficult. Here, we present a new approach to increase the comparability of cross-linguistic lexical data. We have designed workflows for the computer-assisted lifting of datasets to Cross-Linguistic Data Formats, a collection of standards that make these datasets more Findable, Accessible, Interoperable, and Reusable (FAIR). We test the Lexibank workflow on 100 lexical datasets from which we derive an aggregated database of wordlists in unified phonetic transcriptions covering more than 2000 language varieties. We illustrate the benefits of our approach by showing how phonological and lexical features can be automatically inferred, complementing and expanding existing cross-linguistic datasets.

Automated summary

The past decades have witnessed substantial growth in digital data on the world's languages, leading to an increasing demand for cross-linguistic datasets. However, the lack of standardization in published datasets makes comparison difficult. This study presents a new approach to improve comparability by converting datasets to Cross-Linguistic Data Formats and demonstrates the benefits through automatic inference of phonological and lexical features.