Deep Learning Course

# Deep Learning Fundamentals - Classic Edition

Intuition Math Code

Level: Beginner

Instructor: Mandy

##### Open Course

##### Open Course

##### Course Includes:

36 Video Lectures

Watch Duration: 4.2 Hours

73 Pages of Lecture Notes

Reading Time: 8 Hours

130 Quiz Questions

355 Lines of Code

157 Inline Math Snippets

52 Inline Code Snippets

9 Custom Visual Graphics

Updated and Maintained

## What you'll learn ...

Learn the relationship between machine learning and deep learning

Understand artificial neural networks and all their components

Gain an intuitive understanding of neural network training

Learn how neural networks are implemented in code

Understand fundamental network training concepts like learning rates and loss functions

Learn about potential problems that can arise during training and potential solutions

Gain an understanding of how to process data for neural networks

Learn about the different categories of datasets in deep learning: training, validation, test

Understand the different categories of learning: supervised, unsupervised, semi-supervised

Gain an understanding of all the components in a convolutional neural network (CNN)

Understand how CNNs detect patterns in image data

Learn how data is affected by zero padding and max pooling included in neural networks

Learn the mathematics behind backpropagation and how it's used during training

Gain an understanding of the learnable parameters present in a neural network

Learn how network training is improved by regularization and batch normalization

## Part 1 - INTRO TO DEEP LEARNING

### Section 1 - Artificial Neural Network Basics

### Lesson #1

##### Deep Learning playlist overview & Machine Learning intro

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 6

Lines of Code: 32

Watch Duration: 04:28

Reading Time: 9 Minutes

Inline Code Snippets: 2

Updated and Maintained

### Lesson #2

##### Deep Learning explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 11

Watch Duration: 03:31

Reading Time: 5 Minutes

Custom Visual Graphics: 1

### Lesson #3

##### Artificial Neural Networks explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 12

Inline Code Snippets: 3

Watch Duration: 04:45

Reading Time: 10 Minutes

Custom Visual Graphics: 1

Lines of Code: 7

### Lesson #4

##### Layers in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 8

Inline Code Snippets: 2

Watch Duration: 06:16

Reading Time: 12 Minutes

Custom Visual Graphics: 2

Lines of Code: 15

### Lesson #5

##### Activation Functions in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 9

Lines of Code: 20

Watch Duration: 05:01

Reading Time: 12 Minutes

Inline Code Snippets: 5

Inline Math Snippets: 9

### Lesson #6

##### Training a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 7

Inline Code Snippets: 1

Watch Duration: 03:47

Reading Time: 10 Minutes

Custom Visual Graphics: 1

Lines of Code: 3

### Lesson #7

##### How a Neural Network Learns explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 11

Lines of Code: 44

Watch Duration: 07:00

Reading Time: 12 Minutes

Inline Code Snippets: 5

Inline Math Snippets: 1

### Lesson #8

##### Loss in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 4

Lines of Code: 10

Watch Duration: 04:13

Reading Time: 8 Minutes

Inline Code Snippets: 2

Inline Math Snippets: 4

### Lesson #9

##### Learning Rate in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 8

Inline Code Snippets: 3

Watch Duration: 04:26

Reading Time: 10 Minutes

Custom Visual Graphics: 1

Lines of Code: 14

### Section 2 - Data Topics for Deep Learning

### Lesson #10

##### Train, Test, & Validation Sets explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 12

Watch Duration: 06:58

Reading Time: 11 Minutes

Updated and Maintained

### Lesson #11

##### Predicting with a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 4

Lines of Code: 13

Watch Duration: 05:06

Reading Time: 12 Minutes

Inline Code Snippets: 2

Updated and Maintained

### Lesson #12

##### Overfitting in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 10

Watch Duration: 04:16

Reading Time: 10 Minutes

Updated and Maintained

### Lesson #13

##### Underfitting in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 3

Watch Duration: 03:31

Reading Time: 8 Minutes

Updated and Maintained

### Lesson #14

##### Supervised Learning explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 2

Lines of Code: 35

Watch Duration: 04:46

Reading Time: 10 Minutes

Inline Code Snippets: 6

Updated and Maintained

### Lesson #15

##### Unsupervised Learning explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 05:23

Reading Time: 12 Minutes

Updated and Maintained

### Lesson #16

##### Semi-supervised Learning explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 2

Watch Duration: 03:46

Reading Time: 8 Minutes

Updated and Maintained

### Lesson #17

##### Data Augmentation explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 03:20

Reading Time: 7 Minutes

Updated and Maintained

### Lesson #18

##### One-hot Encoding explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 06:00

Reading Time: 12 Minutes

Updated and Maintained

## Part 2 - DEEP LEARNING CONCEPTS

### Section 1 - Convolutional Neural Networks (CNNs)

### Lesson #19

##### Convolutional Neural Networks (CNNs) explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 2

Watch Duration: 08:37

Reading Time: 22 Minutes

Updated and Maintained

### Lesson #20

##### Visualizing Convolutional Filters from a CNN

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Lines of Code: 20

Watch Duration: 06:09

Reading Time: 10 Minutes

Inline Code Snippets: 4

Updated and Maintained

### Lesson #21

##### Zero Padding in Convolutional Neural Networks explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 2

Inline Code Snippets: 5

Inline Math Snippets: 2

Watch Duration: 13:48

Reading Time: 22 Minutes

Custom Visual Graphics: 1

Lines of Code: 63

Updated and Maintained

### Lesson #22

##### Max Pooling in Convolutional Neural Networks explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Lines of Code: 35

Watch Duration: 10:50

Reading Time: 21 Minutes

Inline Code Snippets: 3

Updated and Maintained

### Section 2 - Backpropagation

### Lesson #23

##### Backpropagation explained | Part 1 - The intuition

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Inline Math Snippets: 1

Watch Duration: 10:56

Reading Time: 20 Minutes

Custom Visual Graphics: 1

Updated and Maintained

### Lesson #24

##### Backpropagation explained | Part 2 - The mathematical notation

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Lines of Code: 8

Watch Duration: 11:03

Reading Time: 12 Minutes

Inline Code Snippets: 2

Inline Math Snippets: 10

### Lesson #25

##### Backpropagation explained | Part 3 - Mathematical observations

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 11:26

Reading Time: 10 Minutes

Inline Math Snippets: 33

### Lesson #26

##### Backpropagation explained | Part 4 - Calculating the gradient

On-Demand Video Lecture

Full Lecture Notes

Inline Math Snippets: 39

Watch Duration: 14:26

Reading Time: 10 Minutes

Updated and Maintained

### Lesson #27

##### Backpropagation explained | Part 5 - What puts the "back" in backprop?

On-Demand Video Lecture

Full Lecture Notes

Inline Math Snippets: 37

Watch Duration: 14:10

Reading Time: 28 Minutes

Updated and Maintained

### Section 3 - Additional Deep Learning Concepts

### Lesson #28

##### Vanishing & Exploding Gradient explained | A problem resulting from backpropagation

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 3

Watch Duration: 07:43

Reading Time: 16 Minutes

Updated and Maintained

### Lesson #29

##### Weight Initialization explained | A way to reduce the vanishing gradient problem

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Lines of Code: 8

Watch Duration: 10:12

Reading Time: 20 Minutes

Inline Code Snippets: 1

Inline Math Snippets: 5

### Lesson #30

##### Bias in an Artificial Neural Network explained | How bias impacts training

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 07:12

Reading Time: 13 Minutes

Inline Math Snippets: 6

### Lesson #31

##### Learnable Parameters in an Artificial Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Watch Duration: 06:34

Reading Time: 12 Minutes

Updated and Maintained

### Lesson #32

##### Learnable Parameters in a Convolutional Neural Network (CNN) explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 2

Lines of Code: 5

Watch Duration: 07:32

Reading Time: 14 Minutes

Inline Code Snippets: 1

Updated and Maintained

### Lesson #33

##### Regularization in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Custom Visual Graphics: 1

Watch Duration: 05:55

Reading Time: 9 Minutes

Inline Math Snippets: 9

### Lesson #34

##### Batch Size in a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Interactive Quiz Questions: 1

Lines of Code: 14

Watch Duration: 03:54

Reading Time: 10 Minutes

Inline Code Snippets: 2

Updated and Maintained

### Lesson #35

##### Fine-tuning a Neural Network explained

On-Demand Video Lecture

Full Lecture Notes

Watch Duration: 04:49

Reading Time: 11 Minutes

### Lesson #36

##### Batch Normalization (“batch norm”) explained

On-Demand Video Lecture

Full Lecture Notes

Inline Code Snippets: 3

Inline Math Snippets: 1

Watch Duration: 07:32

Reading Time: 15 Minutes

Lines of Code: 9

Updated and Maintained