The Little Book of Reinforcement Learning
The Little Book of Reinforcement Learning
《强化学习小书》
The Little Book of Reinforcement Learning This is the associated GitHub page of the Little Book of Reinforcement Learning. This book is a short introduction to Reinforcement Learning, from the basics to applied algorithms. 《强化学习小书》是该书配套的 GitHub 页面。本书是对强化学习的简要介绍，涵盖了从基础知识到应用算法的内容。
In this repo, along with the book itself, you can find the supplementary material of the book. More precisely: under the algos/ folder, the Pytorch-based implementation of the different algorithms covered in the book, from MC to PPO.
在这个仓库中，除了书籍本身，你还可以找到相关的补充材料。具体来说：在 algos/ 文件夹下，包含了书中涵盖的从蒙特卡洛（MC）到近端策略优化（PPO）等不同算法的 PyTorch 实现。
Under the supplementary/ folder, you can find detailed explanations and rigorous proofs for the dynamic programming algorithms briefly covered in the book. This is a document I wrote in 2021.
在 supplementary/ 文件夹下，你可以找到书中简要介绍的动态规划算法的详细解释和严谨证明。这是我在 2021 年编写的一份文档。
More material is subject to be added along the way in this repo. You can print one for yourself here. 未来该仓库还会持续添加更多材料。你可以在此处打印一份属于你自己的副本。
Versions of the book : V1 (June 2026) 书籍版本：V1（2026 年 6 月）
The book is distributed under a non-commercial Creative Commons license (CC BY-SA 4.0). 本书采用知识共享署名-相同方式共享 4.0 国际许可协议（CC BY-SA 4.0）进行非商业性分发。