Media Summary: Challenges of parallelizing code, motivations for Producer-consumer locality, RDD abstraction, Spark implementation and scheduling To follow along with the course, visit the ... Definition of memory coherence, invalidation-based coherence using MSI and MESI, false sharing To follow along with the course ...

Stanford Cs149 I Parallel Computing - Detailed Analysis & Overview

Challenges of parallelizing code, motivations for Producer-consumer locality, RDD abstraction, Spark implementation and scheduling To follow along with the course, visit the ... Definition of memory coherence, invalidation-based coherence using MSI and MESI, false sharing To follow along with the course ... Motivation for transactions, design space of transactional memory implementations. To follow along with the course, visit the ... This lecture is a review for the course midterm. To follow along with the course, visit the course website: ... Fine-grained synchronization via locks, basics of lock-free

Message passing, async vs. blocking sends/receives, pipelining, increasing arithmetic intensity, avoiding contention To follow ... Performance/productivity motivations for DSLs, case studies on several DSLs To follow along with the course, visit the course ... Efficiently scheduling DNN layers, mapping convs to matrix-multiplication, transformers, layer fusion To follow along with the ...

Photo Gallery

Stanford CS149 I Parallel Computing I 2023 I Lecture 1 - Why Parallelism? Why Efficiency?
Stanford CS149 I Parallel Computing I 2023 I Lecture 2 - A Modern Multi-Core Processor
Stanford CS149 I Parallel Computing I 2023 I Lecture 7 - GPU architecture and CUDA Programming
Stanford CS149 I Parallel Computing I 2023 I Lecture 8 - Data-Parallel Thinking
Stanford CS149 I Parallel Computing I 2023 I Lecture 4 - Parallel Programming Basics
Stanford CS149 I 2023 I Lecture 9 - Distributed Data-Parallel Computing Using Spark
Stanford CS149 I Parallel Computing I 2023 I Lecture 11 - Cache Coherence
Stanford CS149 I Parallel Computing I 2023 I Lecture 16 - Transactional Memory 1
Stanford CS149 I Parallel Computing I 2023 I Lecture 14 - Midterm Review
Stanford CS149 I 2023 I Lecture 13 - Fine-Grained Synchronization and Lock-Free Programming
Stanford CS149 I Lecture 6 - Performance Optimization II: Locality, Communication, and Contention
Stanford CS149 I Parallel Computing I 2023 I Lecture 15 - Domain Specific Programming Languages
View Detailed Profile
Stanford CS149 I Parallel Computing I 2023 I Lecture 1 - Why Parallelism? Why Efficiency?

Stanford CS149 I Parallel Computing I 2023 I Lecture 1 - Why Parallelism? Why Efficiency?

Challenges of parallelizing code, motivations for

Stanford CS149 I Parallel Computing I 2023 I Lecture 2 - A Modern Multi-Core Processor

Stanford CS149 I Parallel Computing I 2023 I Lecture 2 - A Modern Multi-Core Processor

Forms of

Stanford CS149 I Parallel Computing I 2023 I Lecture 7 - GPU architecture and CUDA Programming

Stanford CS149 I Parallel Computing I 2023 I Lecture 7 - GPU architecture and CUDA Programming

CUDA

Stanford CS149 I Parallel Computing I 2023 I Lecture 8 - Data-Parallel Thinking

Stanford CS149 I Parallel Computing I 2023 I Lecture 8 - Data-Parallel Thinking

Data-

Stanford CS149 I Parallel Computing I 2023 I Lecture 4 - Parallel Programming Basics

Stanford CS149 I Parallel Computing I 2023 I Lecture 4 - Parallel Programming Basics

Ways of thinking about

Stanford CS149 I 2023 I Lecture 9 - Distributed Data-Parallel Computing Using Spark

Stanford CS149 I 2023 I Lecture 9 - Distributed Data-Parallel Computing Using Spark

Producer-consumer locality, RDD abstraction, Spark implementation and scheduling To follow along with the course, visit the ...

Stanford CS149 I Parallel Computing I 2023 I Lecture 11 - Cache Coherence

Stanford CS149 I Parallel Computing I 2023 I Lecture 11 - Cache Coherence

Definition of memory coherence, invalidation-based coherence using MSI and MESI, false sharing To follow along with the course ...

Stanford CS149 I Parallel Computing I 2023 I Lecture 16 - Transactional Memory 1

Stanford CS149 I Parallel Computing I 2023 I Lecture 16 - Transactional Memory 1

Motivation for transactions, design space of transactional memory implementations. To follow along with the course, visit the ...

Stanford CS149 I Parallel Computing I 2023 I Lecture 14 - Midterm Review

Stanford CS149 I Parallel Computing I 2023 I Lecture 14 - Midterm Review

This lecture is a review for the course midterm. To follow along with the course, visit the course website: ...

Stanford CS149 I 2023 I Lecture 13 - Fine-Grained Synchronization and Lock-Free Programming

Stanford CS149 I 2023 I Lecture 13 - Fine-Grained Synchronization and Lock-Free Programming

Fine-grained synchronization via locks, basics of lock-free

Stanford CS149 I Lecture 6 - Performance Optimization II: Locality, Communication, and Contention

Stanford CS149 I Lecture 6 - Performance Optimization II: Locality, Communication, and Contention

Message passing, async vs. blocking sends/receives, pipelining, increasing arithmetic intensity, avoiding contention To follow ...

Stanford CS149 I Parallel Computing I 2023 I Lecture 15 - Domain Specific Programming Languages

Stanford CS149 I Parallel Computing I 2023 I Lecture 15 - Domain Specific Programming Languages

Performance/productivity motivations for DSLs, case studies on several DSLs To follow along with the course, visit the course ...

Stanford CS149 I Parallel Computing I 2023 I Lecture 10 - Efficiently Evaluating DNNs on GPUs

Stanford CS149 I Parallel Computing I 2023 I Lecture 10 - Efficiently Evaluating DNNs on GPUs

Efficiently scheduling DNN layers, mapping convs to matrix-multiplication, transformers, layer fusion To follow along with the ...