Media Summary: neural language models, simple composition functions, recurrent neural networks slides: ... language models, ngram models, perplexity slides: REALM, k-NN LM, do LMs use retrievals? slides:
Umass Cs685 F21 Advanced Nlp - Detailed Analysis & Overview
neural language models, simple composition functions, recurrent neural networks slides: ... language models, ngram models, perplexity slides: REALM, k-NN LM, do LMs use retrievals? slides: prompt-based learning, prefix tuning, prompt tuning slides: representing images, multimodal transfer learning, visual question answering, image captioning, multimodal pretraining (VilBERT, ... multilingual language models, many-to-many machine translation, multilingual datasets, zero-shot transfer for low-resource ...
computational psycholinguistics slides: course schedule: from words to subwords to characters/bytes to learned tokenization slides: course schedule: ... gradient descent, backpropagation with single neuron, feed-forward NN, recurrent NN notes: ... semantic parsing slides: course schedule:
