Masked language modeling: Revision history

Jump to navigation Jump to search

Diff selection: Mark the radio buttons of the revisions to compare and hit enter or the button at the bottom.
Legend: (cur) = difference with latest revision, (prev) = difference with preceding revision, m = minor edit.

24 May 2024

  • curprev 15:3615:36, 24 May 2024‎ Helpful talk contribs‎ 1,001 bytes +1,001‎ Created page with "<!-- Masked language modeling is somewhat fuzzily defined. It is a task -- but it's typically implemented with a very specific type of neural nets. '''What is the task?''' The task removes one word from a piece of text {{comment|(or rather replaces it with a token indicating "missing word goes here")}}, and asks to predict the most likely word. '''Why is it NNs?''' Because of the ''way'' we like to use a window of context around it (in both directions), this is..."
Retrieved from "https://helpful.knobs-dials.com/index.php/Masked_language_modeling"