Media Summary: Unfortunately, the first lecture did not get recorder. This is an old recording. In this lecture, we go through the idea of data-driven ... In this lecture, we go through self-attention mechanism and transformer architecture. In this lecture we get into details of components used in CNNs.

Uoft Ece1508 Applied Deep Learning - Detailed Analysis & Overview

Unfortunately, the first lecture did not get recorder. This is an old recording. In this lecture, we go through the idea of data-driven ... In this lecture, we go through self-attention mechanism and transformer architecture. In this lecture we get into details of components used in CNNs. In this lecture we go through Auto-Encoders, studying vanilla AE, sparse AE, denoising AE and finally variational AE that can be ... We unfold the problem of overfitting, try to develop a solution called Regularization and then get to Dropout idea. In this lecture we go through Seq2Seq models and build a simple language model.

In this lecture, we complete our discussions on Gradient Descent. We then start with Fully Connected FNNs and discuss how we ... In this lecture, we go through batch normalization idea. We then start chapter 4, where we introduce convolutional neural networks ... In this lecture, we discuss the idea of data augmentation, synthetic data generation and data cleaning. We understand the concept ... This lecture goes through ResNet and the idea of skip connection.

Photo Gallery

UofT - ECE1508 -- Applied Deep Learning -- Lecture 1: Preliminaries
UofT - ECE1508 -- Applied Deep Learning -- Lecture 22: Self-Attention and Transformers
UofT - ECE1508 -- Applied Deep Learning -- Lecture 14: CNN Components
UofT - ECE1508 -- Applied Deep Learning -- Lecture 23: Auto-Encoders and Data Generation
UofT - ECE1508 -- Applied Deep Learning -- Lecture 11: Regularization and Dropout
UofT - ECE1508 -- Applied Deep Learning -- Lecture 15: Deep CNNs and Training CNNs (Part I)
UofT - ECE1508 -- Applied Deep Learning -- Lecture 20: Seq2Seq Models
UofT - ECE1508 -- Applied Deep Learning -- Lecture 5: Gradient Descent + Forward Pass in MLPs
UofT - ECE1508 -- Applied Deep Learning -- Lecture 13: Batch Normalization and Introduction to CNN
UofT - ECE1508 -- Applied Deep Learning -- Lecture 12: Data Augmentation and Cleaning
UofT - ECE1508 -- Applied Deep Learning -- Lecture 4: Deep Neural Networks and Gradient Descent
UofT - ECE1508 -- Applied Deep Learning -- Lecture 19: Deep RNN and Gating Technique
View Detailed Profile
UofT - ECE1508 -- Applied Deep Learning -- Lecture 1: Preliminaries

UofT - ECE1508 -- Applied Deep Learning -- Lecture 1: Preliminaries

Unfortunately, the first lecture did not get recorder. This is an old recording. In this lecture, we go through the idea of data-driven ...

UofT - ECE1508 -- Applied Deep Learning -- Lecture 22: Self-Attention and Transformers

UofT - ECE1508 -- Applied Deep Learning -- Lecture 22: Self-Attention and Transformers

In this lecture, we go through self-attention mechanism and transformer architecture.

UofT - ECE1508 -- Applied Deep Learning -- Lecture 14: CNN Components

UofT - ECE1508 -- Applied Deep Learning -- Lecture 14: CNN Components

In this lecture we get into details of components used in CNNs.

UofT - ECE1508 -- Applied Deep Learning -- Lecture 23: Auto-Encoders and Data Generation

UofT - ECE1508 -- Applied Deep Learning -- Lecture 23: Auto-Encoders and Data Generation

In this lecture we go through Auto-Encoders, studying vanilla AE, sparse AE, denoising AE and finally variational AE that can be ...

UofT - ECE1508 -- Applied Deep Learning -- Lecture 11: Regularization and Dropout

UofT - ECE1508 -- Applied Deep Learning -- Lecture 11: Regularization and Dropout

We unfold the problem of overfitting, try to develop a solution called Regularization and then get to Dropout idea.

UofT - ECE1508 -- Applied Deep Learning -- Lecture 15: Deep CNNs and Training CNNs (Part I)

UofT - ECE1508 -- Applied Deep Learning -- Lecture 15: Deep CNNs and Training CNNs (Part I)

In this lecture we go through

UofT - ECE1508 -- Applied Deep Learning -- Lecture 20: Seq2Seq Models

UofT - ECE1508 -- Applied Deep Learning -- Lecture 20: Seq2Seq Models

In this lecture we go through Seq2Seq models and build a simple language model.

UofT - ECE1508 -- Applied Deep Learning -- Lecture 5: Gradient Descent + Forward Pass in MLPs

UofT - ECE1508 -- Applied Deep Learning -- Lecture 5: Gradient Descent + Forward Pass in MLPs

In this lecture, we complete our discussions on Gradient Descent. We then start with Fully Connected FNNs and discuss how we ...

UofT - ECE1508 -- Applied Deep Learning -- Lecture 13: Batch Normalization and Introduction to CNN

UofT - ECE1508 -- Applied Deep Learning -- Lecture 13: Batch Normalization and Introduction to CNN

In this lecture, we go through batch normalization idea. We then start chapter 4, where we introduce convolutional neural networks ...

UofT - ECE1508 -- Applied Deep Learning -- Lecture 12: Data Augmentation and Cleaning

UofT - ECE1508 -- Applied Deep Learning -- Lecture 12: Data Augmentation and Cleaning

In this lecture, we discuss the idea of data augmentation, synthetic data generation and data cleaning. We understand the concept ...

UofT - ECE1508 -- Applied Deep Learning -- Lecture 4: Deep Neural Networks and Gradient Descent

UofT - ECE1508 -- Applied Deep Learning -- Lecture 4: Deep Neural Networks and Gradient Descent

We formally introduce

UofT - ECE1508 -- Applied Deep Learning -- Lecture 19: Deep RNN and Gating Technique

UofT - ECE1508 -- Applied Deep Learning -- Lecture 19: Deep RNN and Gating Technique

In this lecture, we go over

UofT - ECE1508 -- Applied Deep Learning -- Lecture 17: Skip Connection and ResNet

UofT - ECE1508 -- Applied Deep Learning -- Lecture 17: Skip Connection and ResNet

This lecture goes through ResNet and the idea of skip connection.