Pointwise Mutual Information: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

28 June 2024

  • curprev 13:3113:31, 28 June 2024Helpful talk contribs 5,199 bytes +5,199 Created page with "{{stub}} Pointwise Mutual Information (PMI) quantifies coincidence from their joint distribution and their individual distributions, assuming independence. A little more concretely, PMI calculates probability of one word following another divided by the probability of each appearing at all: PMI(word1,word2) = log( P(word1,word2) / ( P(word2) * ​P(word1) )​ ) Notes: * the base for the log isn't important when this is a unitless thing used ''only'' for relati..."