Masked language modeling: Difference between revisions
Jump to navigation
Jump to search
(Created page with "<!-- Masked language modeling is somewhat fuzzily defined. It is a task -- but it's typically implemented with a very specific type of neural nets. '''What is the task?''' The task removes one word from a piece of text {{comment|(or rather replaces it with a token indicating "missing word goes here")}}, and asks to predict the most likely word. '''Why is it NNs?''' Because of the ''way'' we like to use a window of context around it (in both directions), this is...") |
(No difference)
|