Masked language modeling: Difference between revisions

From Helpful
Jump to navigation Jump to search
(Created page with "<!-- Masked language modeling is somewhat fuzzily defined. It is a task -- but it's typically implemented with a very specific type of neural nets. '''What is the task?''' The task removes one word from a piece of text {{comment|(or rather replaces it with a token indicating "missing word goes here")}}, and asks to predict the most likely word. '''Why is it NNs?''' Because of the ''way'' we like to use a window of context around it (in both directions), this is...")
 
(No difference)

Latest revision as of 15:36, 24 May 2024