Distributional hypothesis: Difference between revisions

From Helpful
Jump to navigation Jump to search
mNo edit summary
mNo edit summary
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{name|The distributional hypothesis}}
'''{{name|The distributional hypothesis}}''' is the idea that words that are used and occur in the same contexts tend to convey similar meanings - "a word is characterized by the company it keeps".
is the idea that words that are used and occur in the same contexts tend to convey similar meanings - "a word is characterized by the company it keeps".


This seems e.g. supported by the way language learners pick up the likely meaning of new words.
This seems e.g. supported by the way language learners pick up the likely meaning of new words.
Line 10: Line 9:


For example,  
For example,  
[https://en.wikipedia.org/wiki/Distributional_semantics distributional semantics] still says little more than "we look at distributions".
[https://en.wikipedia.org/wiki/Distributional_semantics distributional semantics] says "we do that by looking at distributions", but actually little more than that.


<!--
<!--
Line 19: Line 18:
and maybe say something about the similarity of nouns based on what verbs they often appear with.
and maybe say something about the similarity of nouns based on what verbs they often appear with.
-->
-->
Z S Harris (1954) "{{search|Harris 1954  "Distributional Structure"|Distributional Structure}}"

Latest revision as of 13:41, 28 March 2024

The distributional hypothesis is the idea that words that are used and occur in the same contexts tend to convey similar meanings - "a word is characterized by the company it keeps".

This seems e.g. supported by the way language learners pick up the likely meaning of new words.


This idea is known under a few names, but note that few of them really describe a very specific or technique or further assumptions they make.


For example, distributional semantics says "we do that by looking at distributions", but actually little more than that.


Z S Harris (1954) "Distributional Structure"