The Little Book of Reinforcement Learning

Associated GitHub Page

This is the associated GitHub page of the Little Book of Reinforcement Learning. This book is a short introduction to Reinforcement Learning, from the basics to applied algorithms.

In this repo, along with the book itself, you can find the supplementary material of the book. More precisely:

• Under the algos/ folder, the PyTorch-based implementation of the different algorithms covered in the book, from MC to PPO.
• Under the supplementary/ folder, you can find detailed explanations and rigorous proofs for the dynamic programming algorithms briefly covered in the book.

This is a document I wrote in 2021. More material is subject to be added along the way in this repo.

You can print one for yourself here.

Versions of the Book

• V1 (June 2026)

The book is distributed under a non-commercial Creative Commons license (CC BY-SA 4.0).