Podchaser Logo
Home
Compiled autograd

Compiled autograd

Released Monday, 19th February 2024
Good episode? Give it some love!
Compiled autograd

Compiled autograd

Compiled autograd

Compiled autograd

Monday, 19th February 2024
Good episode? Give it some love!
Rate Episode

Compiled autograd is an extension to PT2 that permits compiling the entirety of a backward() call in PyTorch. This allows us to fuse accumulate grad nodes as well as trace through arbitrarily complicated Python backward hooks. Compiled autograd is an important part of our plans for compiled DDP/FSDP as well as for whole-graph compilation.

Show More

Unlock more with Podchaser Pro

  • Audience Insights
  • Contact Information
  • Demographics
  • Charts
  • Sponsor History
  • and More!
Pro Features