Preview Artificial Intelligence A-Z

Back

Welcome to the course

Why AI

Course Structure

Download Resources

Installing Anaconda

Meet Your Instructor

Addional Notes

PDF

Part 0 - Fundamentals Of Reinforcement Learning

Welcome

Q-Learning Intuition

Plan of Attack

What is reinforcement learning

The Bellman Equation

The Plan

Markov Decision Process

Policy vs Plan

Adding a Living Penalty

Q-Learning Intuition

Temporal Difference

Q-Learning Visualization

Q-Learning Visualization

Part 1 - Deep Q-Learning

Welcome

Deep Q-Learning Intuition

Plan of Attack

Deep Q-Learning Intuition - Learning

Deep Q-Learning Intuition - Acting

Experience Replay

Action Selection Policies

Deep Q-Learning Implementation

Plan of Attack

Getting Started

Self Driving Car - Step 1

Self Driving Car - Step 2

Self Driving Car - Step 3

Self Driving Car - Step 4

Self Driving Car - Step 5

Self Driving Car - Step 6

Self Driving Car - Step 7

Self Driving Car - Step 8

Self Driving Car - Step 9

Self Driving Car - Step 10

Self Driving Car - Step 11

Self Driving Car - Step 12

Self Driving Car - Step 13

Self Driving Car - Step 14

Self Driving Car - Step 15

Self Driving Car - Step 16

Deep Q-Learning Visualization

Self Driving Car - Level 1

Self Driving Car - Level 2

Self Driving Car - Level 3

Self Driving Car - Level 4

Part 2 - Deep Convolutional Q-Learning

Welcome

Deep Convolutional Q-Learning Intuition

Plan of Attack

Deep Convolutional Q-Learning Intuition

Eligibility Trace

Deep Convolutional Q-Learning Implementation

Plan of attack

Doom - Step 1

Doom - Step 2

Doom - Step 3

Doom - Step 4

Doom - Step 5

Doom - Step 6

Doom - Step 7

Doom - Step 8

Doom - Step 9

Doom - Step 10

Doom - Step 11

Doom - Step 12

Doom - Step 13

Doom - Step 14

Doom - Step 15

Doom - Step 16

Doom - Step 17

Deep Convolutional Q-Learning Visualization

Watching our AI play Doom

Part 3 - A3C

Welcome

A3C Intuition

Plan of Attack

The three As in A3C

Actor-Critic

Asynchronous

Advantage

LSTM Layer

A3C Implementation

Plan of Attack

Breakout - Step 1

Breakout - Step 2

Breakout - Step 3

Breakout - Step 4

Breakout - Step 5

Breakout - Step 6

Breakout - Step 7

Breakout - Step 8

Breakout - Step 9

Breakout - Step 10

Breakout - Step 11

Breakout - Step 12

Breakout - Step 13

Breakout - Step 14

A3C Visualization

Watching our AI play Breakout

Annex 1 Artificial Neural Networks

What is Deep Learning

Plan of Attack

The Neuron

The Activation Function

How do Neural Networks work

How do Neural Networks learn

Gradient Descent

Stochastic Gradient Descent

Backpropagation

Annex 2 Convolutional Neural Networks

Plan of Attack

What are convolutional neural networks

Step 1 - Convolution Operation

Step 1(b) - ReLU Layer

Step 2 - Pooling

Step 3 - Flattening

Step 4 - Full Connection

Summary

Softmax Cross-Entropy

Thank You

Preview - Artificial Intelligence A-Z