Python Programming

Department of Computing | Imperial College London

book

Introduction to Deep Learning with PyTorch

  • Chapter 1: Introduction
  • Chapter 2: Gradient Descent
  • Chapter 3: PyTorch Tensors
  • Chapter 4: PyTorch for Automatic Gradient Descent
    • [4.1] Introduction
    • [4.2] 1-dimensional Gradient Descent with torch Tensors
    • [4.3] The Secrets of torch Parameters
    • [4.4] Automatic Gradient Calculation with PyTorch
    • [4.5] Exercise: Gradient Descent with Automatic Gradient
    • [4.6] Automatic Gradient Descent
    • [4.7] Automatic Gradient Descent with PyTorch Optimisers
    • [4.8] Exercise: Automatic Gradient Descent
    • [4.9] Other Gradient Descent Optimization Algorithms
  • Chapter 5: Training a Linear Model with PyTorch
  • Chapter 6: Introduction to Deep Learning
  • Chapter 7: Building and Training a simple Classification Model
  • Chapter 8: Building and Training an AutoEncoder
  • Chapter 9: Summary

Chapter 4: PyTorch for Automatic Gradient Descent

Introduction

face Luca Grillotti

In this chapter, we will combine the content of the 2 previous chapters:

  • Gradient Descent
  • PyTorch tensors

Then we will see:

  1. How to compute gradients automatically
  2. How to perform gradient descent automatically
Previous Next

Page designed by Josiah Wang

Department of Computing | Imperial College London