Media Summary: We study LLMs which are Large LMs trained on large corpora. We see how they can be evaluated, fine-tuned, and/or deployed ... We next study the MCMC sampling, looking into Gibbs sampling and Langevin algorithms. We learn how we can use them to train ... We go through a general framework for developing a computational AR model. These models extract a masked content and ...

Genai Ece Uoft Lecture 2 - Detailed Analysis & Overview

We study LLMs which are Large LMs trained on large corpora. We see how they can be evaluated, fine-tuned, and/or deployed ... We next study the MCMC sampling, looking into Gibbs sampling and Langevin algorithms. We learn how we can use them to train ... We go through a general framework for developing a computational AR model. These models extract a masked content and ... We start with LMs and understand how we can feed a text into it by doing the so-called "Tokenization" and "Embedding". We build ... Unfortunately, the recording did not work, so this is an older recording from last year.) We start with GANs. We see that though ... We study the main definitions in Generative Learning. We then look into the Naive Bayes algorithm, the most basic generative ...

We study the discriminative and generative models. We see that many classical computational models we use in practice are ... We talk about Boltzmann distribution and how we could use it to build a distribution model from an arbitrary computational model. We discuss their training and sampling of flow-based models and find out how complex they are. We investigate the Real NVP ...

Photo Gallery

GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models
GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models
GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models
GenAI @ ECE-UofT - Lecture 5 - Part 2/2: EBMs and MCMC Algorithms
GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics
GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models
GenAI @ ECE-UofT - Lecture 1: Language Modeling
GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets
GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes
GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning
GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models
GenAI @ ECE-UofT - Lecture 6 - Part 2/2: Flow-based Models
View Detailed Profile
GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models

GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models

We study LLMs which are Large LMs trained on large corpora. We see how they can be evaluated, fine-tuned, and/or deployed ...

GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models

GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models

In this

GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models

GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models

In this

GenAI @ ECE-UofT - Lecture 5 - Part 2/2: EBMs and MCMC Algorithms

GenAI @ ECE-UofT - Lecture 5 - Part 2/2: EBMs and MCMC Algorithms

We next study the MCMC sampling, looking into Gibbs sampling and Langevin algorithms. We learn how we can use them to train ...

GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics

GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics

This

GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models

GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models

We go through a general framework for developing a computational AR model. These models extract a masked content and ...

GenAI @ ECE-UofT - Lecture 1: Language Modeling

GenAI @ ECE-UofT - Lecture 1: Language Modeling

We start with LMs and understand how we can feed a text into it by doing the so-called "Tokenization" and "Embedding". We build ...

GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets

GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets

Unfortunately, the recording did not work, so this is an older recording from last year.) We start with GANs. We see that though ...

GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes

GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes

We study the main definitions in Generative Learning. We then look into the Naive Bayes algorithm, the most basic generative ...

GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning

GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning

We study the discriminative and generative models. We see that many classical computational models we use in practice are ...

GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models

GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models

We talk about Boltzmann distribution and how we could use it to build a distribution model from an arbitrary computational model.

GenAI @ ECE-UofT - Lecture 6 - Part 2/2: Flow-based Models

GenAI @ ECE-UofT - Lecture 6 - Part 2/2: Flow-based Models

We discuss their training and sampling of flow-based models and find out how complex they are. We investigate the Real NVP ...

GenAI @ ECE-UofT - Lecture 6 - Part 1/2: Normalizing Flow

GenAI @ ECE-UofT - Lecture 6 - Part 1/2: Normalizing Flow

In this