# Lecture Notes | Deep Learning | Electrical Engineering and Computer Science | MIT OpenCourseWare

https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/lecture-notes/

###  Browse Course Material  ![](https://ocw.mit.edu/static_shared/images/close_small.b0a2684ccc0da6407a56.svg)
  * [ Syllabus ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/syllabus/)
* * *
  * [ Readings ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/readings/)
* * *
  * [ Lecture Notes ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/lecture-notes/)
* * *
  * [ Lecture Videos ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/video_galleries/lecture-videos/)
* * *
  * [ Homework ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/homework/)
* * *
  * [ Final Project ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/final-project/)
* * *
    * [ Final Project Ideas ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/project-ideas/)
    * [ Final Project Grading Rubric ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/final-project-grading-rubric/)


![](https://ocw.mit.edu/static_shared/images/close_small.b0a2684ccc0da6407a56.svg)
##  Course Info 
###  Instructors 
  * [Prof. Phillip Isola](https://ocw.mit.edu/search/?q=Prof.+Phillip+Isola)
  * [Prof. Sara Beery](https://ocw.mit.edu/search/?q=Prof.+Sara+Beery)
  * [Dr. Jeremy Bernstein](https://ocw.mit.edu/search/?q=Dr.+Jeremy+Bernstein)


###  Departments 
  * [Electrical Engineering and Computer Science](https://ocw.mit.edu/search/?d=Electrical+Engineering+and+Computer+Science)


###  As Taught In 
Fall 2024 
###  Level 
[Undergraduate](https://ocw.mit.edu/search/?l=Undergraduate)  
[Graduate](https://ocw.mit.edu/search/?l=Graduate)  

###  Topics 
  * [Engineering](https://ocw.mit.edu/search/?t=Engineering)
    * [Computer Science](https://ocw.mit.edu/search/?t=Computer+Science)
      * [Artificial Intelligence](https://ocw.mit.edu/search/?t=Artificial+Intelligence)
      * [Graphics and Visualization](https://ocw.mit.edu/search/?t=Graphics+and+Visualization)


###  Learning Resource Types 
_notes_ Lecture Notes
_theaters_ Lecture Videos
_assignment_ Problem Sets
_grading_ Projects with Examples
_auto_stories_ Readings
* * *
[ Download Course ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/download)
_menu_
[ ![MIT OpenCourseWare](https://ocw.mit.edu/static_shared/images/ocw_logo_white.cabdc9a745b03db3dad4.svg) ](https://ocw.mit.edu/)
  * [ _search_ ](https://ocw.mit.edu/search/)
  * [Give Now](https://giving.mit.edu/give/to/ocw/?utm_source=ocw&utm_medium=homepage_banner&utm_campaign=nextgen_home)
  * [About OCW](https://ocw.mit.edu/about)
  * [Help & Faqs](https://mitocw.zendesk.com/hc/en-us)
  * [Contact Us](https://mitocw.zendesk.com/hc/en-us/requests/new)


[ ![MIT OpenCourseWare](https://ocw.mit.edu/static_shared/images/ocw_logo_white.cabdc9a745b03db3dad4.svg) ](https://ocw.mit.edu/)
[ _search_ ](https://ocw.mit.edu/search/) [ GIVE NOW ![](https://ocw.mit.edu/static_shared/images/heart_burgundy.e7c8635e8cc6538b89fa.svg) ](https://giving.mit.edu/give/to/ocw/?utm_source=ocw&utm_medium=homepage_banner&utm_campaign=nextgen_home) [about ocw](https://ocw.mit.edu/about) [help & faqs](https://mitocw.zendesk.com/hc/en-us) [contact us](https://mitocw.zendesk.com/hc/en-us/requests/new)
6.7960 | Fall 2024 | Undergraduate, Graduate   
  

#  [Deep Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/)
![](https://ocw.mit.edu/static_shared/images/expand.a062b1c47b121e3c7e03.svg) Menu
More Info 
  * [ Syllabus ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/syllabus/)
* * *
  * [ Readings ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/readings/)
* * *
  * [ Lecture Notes ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/lecture-notes/)
* * *
  * [ Lecture Videos ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/video_galleries/lecture-videos/)
* * *
  * [ Homework ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/homework/)
* * *
  * [ Final Project ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/final-project/)
* * *
    * [ Final Project Ideas ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/project-ideas/)
    * [ Final Project Grading Rubric ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/pages/final-project-grading-rubric/)


## Lecture Notes
Lectures 22 and 25 are not available. 
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 33 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec1.pdf)
[Lecture 1: Introduction to Deep Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec1_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 7 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec2.pdf)
[Lecture 2: How to Train a Neural Net](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec2_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 5 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec3.pdf)
[Lecture 3: Approximation Theory](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec3_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 6 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec4.pdf)
[Lecture 4: Architectures for Grids](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec4_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 3 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec5.pdf)
[Lecture 5: Graph Neural Networks](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec5_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 7 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec6.pdf)
[Lecture 6: Neural Network Generalization](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec6_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 4 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec7.pdf)
[Lecture 7: Scaling Rules for Optimization](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec7_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 13 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec8.pdf)
[Lecture 8: Transformers](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec8_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 5 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec9.pdf)
[Lecture 9: Hacker's Guide to Deep Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec9_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 5 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec10.pdf)
[Lecture 10: Memory and Sequence Modeling](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec10_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 8 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec11.pdf)
[Lecture 11: Representation Learning I](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec11_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 48 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec12.pdf)
[Lecture 12: Similarity-Based Representation Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec12_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 4 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec13.pdf)
[Lecture 13: Architectural Bias on Representations](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec13_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 6 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec14.pdf)
[Lecture 14: Deep Generative Models I](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec14_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 6 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec15.pdf)
[Lecture 15: Deep Generative Models II](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec15_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 4 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec16.pdf)
[Lecture 16: Deep Generative Models III](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec16_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 5 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec17.pdf)
[Lecture 17: Out-of-Distribution Generalization](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec17_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 7 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec18.pdf)
[Lecture 18: Transfer Learning I](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec18_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 6 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec19.pdf)
[Lecture 19: Transfer Learning II](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec19_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 3 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec20.pdf)
[Lecture 20: Scaling Laws](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec20_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 9 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec21.pdf)
[Lecture 21: Language Models](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec21_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 3 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec23.pdf)
[Lecture 23: Metrized Deep Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec23_pdf/)
[ pdf ![](https://ocw.mit.edu/static_shared/images/resource-download.d374f56f2572d49418bc.svg) 5 MB  ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/mit6_7960_f24_lec24.pdf)
[Lecture 24: Inference Methods for Deep Learning](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/mit6_7960_f24_lec24_pdf/)
![](https://ocw.mit.edu/static_shared/images/left_arrow.3c482a1f6223bff3f0e6.svg) ![](https://ocw.mit.edu/static_shared/images/close_small.b0a2684ccc0da6407a56.svg)
##  Course Info 
###  Instructors 
  * [Prof. Phillip Isola](https://ocw.mit.edu/search/?q=Prof.+Phillip+Isola)
  * [Prof. Sara Beery](https://ocw.mit.edu/search/?q=Prof.+Sara+Beery)
  * [Dr. Jeremy Bernstein](https://ocw.mit.edu/search/?q=Dr.+Jeremy+Bernstein)


###  Departments 
  * [Electrical Engineering and Computer Science](https://ocw.mit.edu/search/?d=Electrical+Engineering+and+Computer+Science)


###  As Taught In 
Fall 2024 
###  Level 
[Undergraduate](https://ocw.mit.edu/search/?l=Undergraduate)  
[Graduate](https://ocw.mit.edu/search/?l=Graduate)  

###  Topics 
  * [Engineering](https://ocw.mit.edu/search/?t=Engineering)
    * [Computer Science](https://ocw.mit.edu/search/?t=Computer+Science)
      * [Artificial Intelligence](https://ocw.mit.edu/search/?t=Artificial+Intelligence)
      * [Graphics and Visualization](https://ocw.mit.edu/search/?t=Graphics+and+Visualization)


###  Learning Resource Types 
_notes_ Lecture Notes
_theaters_ Lecture Videos
_assignment_ Problem Sets
_grading_ Projects with Examples
_auto_stories_ Readings
* * *
[ Download Course ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/download)
[ ![MIT Open Learning](https://ocw.mit.edu/static_shared/images/mit_ol.4165342f87abb1da46fd.svg) ](https://openlearning.mit.edu/)
Over 2,500 courses & materials 
Freely sharing knowledge with learners and educators around the world. [Learn more](https://ocw.mit.edu/about)
[ ![facebook](https://ocw.mit.edu/static_shared/images/Facebook.d1f5caeb73d7d12505a2.png) ](https://www.facebook.com/MITOCW)
[ ![instagram](https://ocw.mit.edu/static_shared/images/Instagram.4df41828ffee4ff33d8a.png) ](https://www.instagram.com/mitocw)
[ ![x \(formerly twitter\)](https://ocw.mit.edu/static_shared/images/x-formerly-twitter-black.f8c75ad9f42902726d25.png) ](https://twitter.com/MITOCW)
[ ![youtube](https://ocw.mit.edu/static_shared/images/Youtube.7c9f62c4f1dc9515ebb4.png) ](https://www.youtube.com/mitocw)
[ ![linkedin](https://ocw.mit.edu/static_shared/images/linkedin-black.2f7f8a6a3899f5d1e1d6.png) ](https://www.linkedin.com/company/mit-opencourseware/)
[ ![bluesky](https://ocw.mit.edu/static_shared/images/bluesky-black.9f4523fcefa9b6f25be7.png) ](https://bsky.app/profile/mitocw.bsky.social)
[ ![mastodon](https://ocw.mit.edu/static_shared/images/mastodon-black.9e2de31a28415c123800.png) ](https://mastodon.social/@mitocw)
© 2001–2026 Massachusetts Institute of Technology 
[Accessibility](https://accessibility.mit.edu)
[Creative Commons License](https://creativecommons.org/licenses/by-nc-sa/4.0/)
[Terms and Conditions](https://ocw.mit.edu/pages/privacy-and-terms-of-use/)
Proud member of: [ ![Open Education Global](https://ocw.mit.edu/static_shared/images/oeg_logo.8a31f7b87f30df2d0169.png) ](https://www.oeglobal.org/)
[ ![facebook](https://ocw.mit.edu/static_shared/images/Facebook.d1f5caeb73d7d12505a2.png) ](https://www.facebook.com/MITOCW)
[ ![instagram](https://ocw.mit.edu/static_shared/images/Instagram.4df41828ffee4ff33d8a.png) ](https://www.instagram.com/mitocw)
[ ![x \(formerly twitter\)](https://ocw.mit.edu/static_shared/images/x-formerly-twitter-black.f8c75ad9f42902726d25.png) ](https://twitter.com/MITOCW)
[ ![youtube](https://ocw.mit.edu/static_shared/images/Youtube.7c9f62c4f1dc9515ebb4.png) ](https://www.youtube.com/mitocw)
[ ![linkedin](https://ocw.mit.edu/static_shared/images/linkedin-black.2f7f8a6a3899f5d1e1d6.png) ](https://www.linkedin.com/company/mit-opencourseware/)
[ ![bluesky](https://ocw.mit.edu/static_shared/images/bluesky-black.9f4523fcefa9b6f25be7.png) ](https://bsky.app/profile/mitocw.bsky.social)
[ ![mastodon](https://ocw.mit.edu/static_shared/images/mastodon-black.9e2de31a28415c123800.png) ](https://mastodon.social/@mitocw)
© 2001–2026 Massachusetts Institute of Technology 
![](https://ocw.mit.edu/static_shared/images/external_link.58bbdd86c00a2c146c36.svg)
#  You are leaving MIT OpenCourseWare 
close
Please be advised that external sites may have terms and conditions, including license rights, that differ from ours. MIT OCW is not responsible for any content on third party sites, nor does a link suggest an endorsement of those sites and/or their content. 
Stay Here  [ Continue ](https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/lists/lecture-notes/)