BrainScoreDaily

Verbal Comprehension

How many words do you know?

It is a good question and almost every site that asks it will hand you a number. We will not, and this page is the argument for that — starting with the fact that the published estimates disagree with each other by a factor of twenty.

The best answer anyone has, and what it is an answer to

The most careful recent estimate is Brysbaert and colleagues (2016), who combined a review of the literature with a large crowdsourcing study. Their headline: an average twenty-year-old native speaker of American English knows about 42,000 lemmas and 4,200 non-transparent multiword expressions, derived from around 11,100 word families. The spread they report is wide — roughly 27,000 at the low end of their sample and 52,000 at the high end (their own figures are given as the lowest and highest five per cent of participants; we have not verified their sample size, so the percentages are not repeated here) — and between twenty and sixty the average person adds about 6,000 more lemmas, which works out at roughly one new word every two days.

Every one of those numbers describes a population, and none of them describes you. They come from a sample of other people, analysed by other researchers, under one particular decision about what a word is. That last part is not a footnote. It is the whole problem.

Why the estimates disagree by a factor of twenty

The same paper surveys the earlier attempts and says, plainly, that the published estimates "range from less than 10 thousand words known to over 200 thousand words mastered." Not because anyone was careless — because word is not one thing:

Three of the estimates surveyed in Brysbaert et al. (2016), Table 3. The numbers are not measuring the same quantity, which is exactly the point.
StudyEstimateWhat it counted
D'Anna and colleagues (1991)17,000Functionally important lemmas from a dictionary, excluding abbreviations, hyphenations, affixes, contractions, slang, foreign words and more
Anderson and Nagy (1993)40,000Distinct lemmas from a corpus of school textbooks, excluding proper nouns and very transparent derivations
Milton and Treffers-Daller (2013)9,800Word families, and only where the participant could supply a synonym or explanation

Decide that quick and quickly are one word and you get one answer; decide they are two and you get another. Count word families and the number collapses; count every inflected form and it balloons. A vocabulary size is not a measurement so much as a measurement plus a definition, and the definition is usually the part nobody shows you.

So why will we not give you a size?

Because producing one would mean doing something we have said we will not do.

A vocabulary size test does not count your words. It samples a few dozen words from known frequency bands, sees how far down the frequency curve you can still go, and then projects a total using a statistical model built on other people. The projection is the product. And a projection built on other people is a claim about a population — which, with a reference sample of zero, is precisely the claim we are not entitled to make (D-006).

We could produce a number that looks exactly like everyone else's. The arithmetic is not hard and nobody would check it. It would also be the single easiest way for this site to stop being worth reading, so the refusal is written down rather than left to good intentions.

What we give you instead

Word Meaning shows you twenty words, five candidate meanings each, untimed. Your score is how many of the twenty you got right. That is all it is, and it is not converted into anything.

Twenty words cannot estimate a vocabulary and we do not pretend otherwise. What it can do is show you where your recognition starts to fail, using items you can inspect.

What "verbal comprehension" actually names

It is a specific thing rather than a general one. In the ETS Kit of Factor-Referenced Cognitive Tests — the same reference behind several of our other instruments — V, Verbal Comprehension, is the factor a vocabulary task marks. The Kit lists five vocabulary tests under it.

It also lists five further verbal factors that a vocabulary test does not touch: word fluency, associational fluency, expressional fluency, ideational fluency and verbal closure. So "language" is at least six factors in this reference, and knowing a lot of words is one of them. It is not reading comprehension, it is not writing, and it is not how well you explain things.

We named the domain after the factor the task marks, rather than after the broader word. That discipline is the reason this page can be specific about what the score is not.

What moves this score that is not your vocabulary

What we do not know

We have never measured test–retest reliability for this instrument, so we cannot tell you how much of a change between two attempts is you and how much is the day. We have no reference sample, so there is no distribution for you to sit inside. And the difficulty ordering of the word list is unvalidated, which we would fix with a frequency corpus and have not yet.

Those three gaps are the honest state of it. Why two vocabulary tests give you different answers goes further into the first one.

Where to go next

Sources