Masked language modeling
From Helpful
Revision as of 15:36, 24 May 2024 by Helpful (talk | contribs) (Created page with "<!-- Masked language modeling is somewhat fuzzily defined. It is a task -- but it's typically implemented with a very specific type of neural nets. '''What is the task?''' The task removes one word from a piece of text {{comment|(or rather replaces it with a token indicating "missing word goes here")}}, and asks to predict the most likely word. '''Why is it NNs?''' Because of the ''way'' we like to use a window of context around it (in both directions), this is...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)