Media Summary: We go through a general framework for developing a computational AR model. These models extract a masked content and ... We study the problem of dimensionality reduction. We investigate linear approach which leads to PCA algorithm. We review some ... We study the main definitions in Generative Learning. We then look into the Naive Bayes algorithm, the most basic generative ...

Genai Ece Uoft Lecture 4 - Detailed Analysis & Overview

We go through a general framework for developing a computational AR model. These models extract a masked content and ... We study the problem of dimensionality reduction. We investigate linear approach which leads to PCA algorithm. We review some ... We study the main definitions in Generative Learning. We then look into the Naive Bayes algorithm, the most basic generative ... We start with LMs and understand how we can feed a text into it by doing the so-called "Tokenization" and "Embedding". We build ... Unfortunately, the recording did not work, so this is an older recording from last year.) We start with GANs. We see that though ... We talk about Boltzmann distribution and how we could use it to build a distribution model from an arbitrary computational model.

We study LLMs which are Large LMs trained on large corpora. We see how they can be evaluated, fine-tuned, and/or deployed ... We study the discriminative and generative models. We see that many classical computational models we use in practice are ... We next study the MCMC sampling, looking into Gibbs sampling and Langevin algorithms. We learn how we can use them to train ...

Photo Gallery

GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models
GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models
IntroML @ ECE-UofT - Lecture 4 - Part I: Dimensionality Reduction and PCA
GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes
GenAI @ ECE-UofT - Lecture 3 - Part 1/3: Fundamentals of Data Generation
GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics
GenAI @ ECE-UofT - Lecture 1: Language Modeling
GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets
GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models
GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models
GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models
GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning
View Detailed Profile
GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models

GenAI @ ECE-UofT - Lecture 4 - Part 1/2: Autoregressive Models

In this

GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models

GenAI @ ECE-UofT - Lecture 4 - Part 2/2: Computational Autoregressive Models

We go through a general framework for developing a computational AR model. These models extract a masked content and ...

IntroML @ ECE-UofT - Lecture 4 - Part I: Dimensionality Reduction and PCA

IntroML @ ECE-UofT - Lecture 4 - Part I: Dimensionality Reduction and PCA

We study the problem of dimensionality reduction. We investigate linear approach which leads to PCA algorithm. We review some ...

GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes

GenAI @ ECE-UofT - Lecture 3 - Part 3/3: Generative Learning and Naive Bayes

We study the main definitions in Generative Learning. We then look into the Naive Bayes algorithm, the most basic generative ...

GenAI @ ECE-UofT - Lecture 3 - Part 1/3: Fundamentals of Data Generation

GenAI @ ECE-UofT - Lecture 3 - Part 1/3: Fundamentals of Data Generation

In this

GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics

GenAI @ ECE-UofT - Lecture 0: Course Overview and Logistics

This

GenAI @ ECE-UofT - Lecture 1: Language Modeling

GenAI @ ECE-UofT - Lecture 1: Language Modeling

We start with LMs and understand how we can feed a text into it by doing the so-called "Tokenization" and "Embedding". We build ...

GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets

GenAI @ ECE-UofT - Lecture 7 - Part 1/2: Generative Adversarial Nets

Unfortunately, the recording did not work, so this is an older recording from last year.) We start with GANs. We see that though ...

GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models

GenAI @ ECE-UofT - Lecture 2 - Part 1/2: Transformer-based Language Models

In this

GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models

GenAI @ ECE-UofT - Lecture 5 - Part 1/2: Energy-based Models

We talk about Boltzmann distribution and how we could use it to build a distribution model from an arbitrary computational model.

GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models

GenAI @ ECE-UofT - Lecture 2 - Part 2/2: Large Language Models

We study LLMs which are Large LMs trained on large corpora. We see how they can be evaluated, fine-tuned, and/or deployed ...

GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning

GenAI @ ECE-UofT - Lecture 3 - Part 2/3: Discriminative vs Generative Learning

We study the discriminative and generative models. We see that many classical computational models we use in practice are ...

GenAI @ ECE-UofT - Lecture 5 - Part 2/2: EBMs and MCMC Algorithms

GenAI @ ECE-UofT - Lecture 5 - Part 2/2: EBMs and MCMC Algorithms

We next study the MCMC sampling, looking into Gibbs sampling and Langevin algorithms. We learn how we can use them to train ...