Pytorch Learning Notes

Reference tutorial: https://datawhalechina.github.io/thorough-pytorch/ This tutorial is pretty rubbish: it describes things but does not explain them. Switching to other books https://github.com/INTERMT/Awesome-PyTorch-Chinese https://pytorch123.com/

Basic Concepts

Important points:

  • Understanding N-dimensional tensors
  • Broadcasting
  • How to compute backpropagation
    1. https://zhuanlan.zhihu.com/p/40378224

I cannot learn much from the pythorch tutorial. To go deeper, I need to understand the framework’s underlying principles—in other words, build it myself. Switching to tinynn: https://github.com/borgwang/tinynn