All public logs

Combined display of all available logs of Helpful. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).

• 10:55, 10 June 2024 Helpful talk contribs created page MLM and NSP notes (Created page with "<!-- Masked Language Modeling (MLM) In many cases it's less about the specific word, and more about the fact that this is self-supervised learning: this is learned without labeled/annotated training data. MLM can give decent answers for text classification, question answering, and simpler text generation tasks. MLM can also be a sort of pre-filtering to train more complex models, often those in the bidirectional transformers because they are currently hip, bu...")