Media Summary: This video is part of a series: As an ... Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the ... A walkthrough of the Anthropic paper In-Context Learning and
Metalearning Induction Heads Rough Early - Detailed Analysis & Overview
This video is part of a series: As an ... Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the ... A walkthrough of the Anthropic paper In-Context Learning and "Neural network parameters can be thought of as compiled computer programs. Somehow, they encode sophisticated algorithms, ... This video has been superseded by this paper: This video is part of a ... BlackboxNLP 2022 keynote by Catherine Olsson Blackbox NLP .
The AI Interpretability reading group meets Rohan Hitchcock presents the Anthropic paper "In-context learning and
![Metalearning & Induction Heads [rough early thoughts]](https://i.ytimg.com/vi/mvSRsZduc3c/mqdefault.jpg)
![Attention - General - Copying & Induction heads [rough early thoughts]](https://i.ytimg.com/vi/Vea4cfn6TOA/mqdefault.jpg)
!["Induction Bump" Phase Change [rough early thoughts]](https://i.ytimg.com/vi/1jLjtrM1Rn0/mqdefault.jpg)
![1L Attention - Results [rough early thoughts]](https://i.ytimg.com/vi/ZBlHFFE-ng8/mqdefault.jpg)
![Attention - General - Indirect & n-gram Attention Heads [rough early thoughts]](https://i.ytimg.com/vi/g4xV2mPi8aY/mqdefault.jpg)
![MLP Neurons - Privileged vs Non-Privileged Basis [rough early thoughts]](https://i.ytimg.com/vi/-oKuDRFHW_Y/mqdefault.jpg)