Skip to content
Back to the collection

Different languages, similar encoding efficiency: Comparable information rates across the human communicative niche

Christophe Coupé, Yoon Mi Oh, Dan Dediu, François Pellegrino

2019 · Science Advances

Read the paper
HN score
0
Mentions
13
Readers
13
Months
11
What’s in a score?

From the abstract

Human languages encode similar average information rates (~39 bits/s) despite their remarkable differences.

Metadata: Crossref. Abstracts retain their original authors’ rights.

In the conversation

Original HN comments, with labels from simple text rules. A label describes the whole comment and may miss context or irony. Read the discussion to make up your own mind. About the labels

13 selected excerpts · 13 total mentions

Twey
Neutral mention · rule
Sure, if we want to shift topic from directness to density, but that's not a cultural difference either: all (spoken) languages famously transmit at about 39 bits per second [1]. Specific idioms, especially newer ones, might be a bit more or less information-dense, but there will always be others that make up for it. And if an idiom falls too far below the 39 B/s rate it'll get worn down over time to something shorter. If you are shortening your communication you are doing it by reducing the information content. In some cultures it's acceptable to spend longer buying bread than in others, so you might take the time to exchange more information with the baker. But that is a (to them, if not to you) valuable interaction that they have chosen to have, filled with information whose exchange is (to them) just as important as the price of bread. [1]: https://www.science.org/doi/10.1126/sciadv.aaw2594
nindalf
Neutral mention · rule
I love seeing people from other countries share their own folk tales about what makes their countries special and unique. I've seen it up close in my country and I always cringed when I heard my fellow countrymen came up with these stories. In my adulthood I'm reassured that it happens everywhere and I find it endearing. On the information density of languages: it is true that some languages have a more information dense textual representation. But all spoken languages convey about the same information in the same time. Which is not all that surprising, it just means that human brains have an optimal range at which they process information. Further reading: Coupé, Christophe, et al. "Different Languages, Similar Encoding Efficiency: Comparable Information Rates across the Human Communicative Niche." Science Advances. https://doi.org/10.1126/sciadv.aaw2594
CMay
Neutral mention · rule
The paper does not seem to support that human speech has a universal transmission rate or that every spoken language has a universal information rate. They showed that information rate varied by individual and by language, just that it varied less than the syllable rate. This was also bounded by a reading task, so the performance shown per language could be influenced by the average reading skills of people who speak those languages. They also asked them to pronounce differently than they normally would. If you take the 17 languages they tested and get the average between them, you get 39bits/s. For English and French, the information rate they recorded was higher, with…
Read the full comment
an average closer to ~45bits/s (just eyeballing their chart). Their results also showed Thai at ~35bits/s. A 10bits/s swing from median to median is pretty huge. From the paper: "We collected recordings of 170 native adult speakers of the aforementioned 17 languages, each reading at their normal rate a standardized set of 15 semantically similar texts across the languages (for a total amount of approximately 240,000 syllables). Speakers became familiar with the texts, by reading them several times before being recorded, so that they understand the described situation and minimize reading errors" "Together, our findings show that while there is wide interspeaker variation in speech and IRs (information rates), this variation is also structured by language. This means that an individual’s speech behavior is not entirely due to individual characteristics but is further constrained by the language being spoken." "However, languages seem to stably inhabit an optimal range of IRs, away from the extremes that can still be available to individual speakers. Languages achieve this balance through a trade-off between ID (information density) and SR (syllable rate), resulting in a narrower distribution of IRs compared to SRs. In the introduction, we rhetorically asked whether too low or too high an IR would impede communicative and/or cognitive efficiency. Our results here suggest that the answer to both questions is positive and that human communication seems to avoid two extreme sociolinguistic profiles: on the one hand, high ID languages spoken fast by their speakers (“high-fast”), and, on the other, low ID languages spoken slowly by their speakers (“low-slow”)." https://www.science.org/doi/10.1126/sciadv.aaw2594
gizmo686
Neutral mention · rule
Some vaguely related research: https://www.science.org/doi/10.1126/sciadv.aaw2594 If you compare different languages, the speed people tend to speak (measured in syllables per second) varies significantly. However, the number of possible syllables also varies significantly. Once you account for that, the speed of speaking in terms of information is fairly consistent across languages. I'm not aware of any specific research directly on point to what the author of the posted blog describes. But his hypothesis that having a consistent speaker reduces the cognitive overhead of decoding seems to be part of the story. However, we would expect a similar effect in people who read,…
Read the full comment
as the writing is also highly standardized. However, I've generally seen silent reading speads for English estimated at around 250. Getting up to 800 WPM puts you well within the realm of speed reading territory. The relatively high structure of code and rote emails probably helps too.
nand4011
Neutral mention · rule
https://www.science.org/doi/10.1126/sciadv.aaw2594 Apparently human language conveys information at around 39 bits/s. You could use a similar technique as that paper to determine the information rate of a speaker and then correct it to 39 bits/s by changing the speed of the video.
monocasa
Neutral mention · rule
There's a lot of evidence from other studies of being able to track about 4 simultaneous objects. It looks like (but we don't have concrete evidence quite yet) that somewhere (maybe higher level parts of the visual cortex, maybe something higher level like state scratch pads, maybe something else we haven't thought of) there's a four wide logical pathway. When we overload it, it seems that we sort of time slice whatever it is, jumping between the objects at roughly four at a time. In addition to performance tests, there's also the data point that there's a surprising amount of languages in pre agricultural societies that have words for 'one' through 'four', but anything…
Read the full comment
else is some degree of 'many'. And yeah, you can train your brain to see larger sets if they're in a pattern that the middle parts of the visual cortex can train on, but the limit does seem to be around 4 visual symbols/tokens concurrently. Another place you see an interesting bandwidth limitation is that pretty much all languages have a pretty fixed semantic bits per secondnwhen spoken. Specifically around 39 bits per second. We can listen and hear faster but rates, but it's very difficult to speak faster. Similar to the above discussion the cute hack to go faster is to essentially give a single internal symbol to a larger sequence of syllables through training, not casting off the limitation but sort of hacking around it. https://www.science.org/doi/10.1126/sciadv.aaw2594
HappyPanacea
Neutral mention · rule
> Japanese [...] is also significantly more expressive than English is My first reaction was to doubt it because I remember reading [0] that spoken languages have roughly the same bit rate ( 39.15 bits/s on avg ). However, bit rate is far from everything (and this is also written not spoken), so could you try to explain what creates the expressiveness compared to other languages you know? [0]: https://www.science.org/doi/10.1126/sciadv.aaw2594
bckygldstn
Neutral mention · rule
Also wrong are "a hour" and "an cats". Sometime Spanish uses one word ("hablo") where English needs two ("I speak"). Comparative analysis of language isn't taboo [1]. It's just vastly more complicated than you make out, and the specific examples you chose aren't representative enough to support any point. You're likely getting downvoted for misunderstanding basic socio-linguistic concepts that belie the confidence of your arguing: conflating biological and grammatical gender, implying that English was created by a committee of clever language designers, a focus on letters and words over concepts and comprehension. [1] https://www.science.org/doi/10.1126/sciadv.aaw2594
k8si
Neutral mention · rule
Communication rates are very similar across languages: https://www.science.org/doi/10.1126/sciadv.aaw2594 See also (great read): https://pubmed.ncbi.nlm.nih.gov/31006626/ wrt your Spanish example: grammatical gender adds information redundancy to make it easier to process spoken language (e.g. helps with reference resolution). This redundancy enables Spanish speakers to speak at a relatively fast rate without incurring perception errors. English has fewer words but a slower speech rate. It's an optimization problem. The speech rate issue isn't as obvious if you're only looking at text, but I'd argue/speculate that lossless speech as a language evolutionary constraint has implications for learnability. tl;dr there is no communication tax, languages are basically equivalent wrt to information rate, they just solved the optimization problem of compactness vs speech rate differently
O__________O
Neutral mention · rule
Here’s what appears to be an independent review of Spritz: https://www.tsw.it/wp-content/uploads/Rapid-serial-visual-pr... One of the issues with tests like these is that the companies sponsor the research and they are one-off vs long exposure studies; that is as with most interfaces with high-throughput, takes time for the mind to adjust. My guess that given human speech appears to have a universal transmission rate of around 39-bits per second, that on average that’s going to be the actual performance target: https://www.science.org/doi/epdf/10.1126/sciadv.aaw2594

Keep following the thread.

More in Other research

More from the same topics.