Podchaser Logo
Home
Tensor subclasses and PT2

Tensor subclasses and PT2

Released Saturday, 24th February 2024
Good episode? Give it some love!
Tensor subclasses and PT2

Tensor subclasses and PT2

Tensor subclasses and PT2

Tensor subclasses and PT2

Saturday, 24th February 2024
Good episode? Give it some love!
Rate Episode

Tensor subclasses allow you to add extend PyTorch with new types of tensors without having to write any C++. They have been used to implement DTensor, FP8, Nested Jagged Tensor and Complex Tensor. Recent work by Brian Hirsh means that we can compile tensor subclasses in PT2, eliminating their overhead. The basic mechanism by which this compilation works is a desugaring process in AOTAutograd. There are some complications involving views, dynamic shapes and tangent metadata mismatch.

Show More

Unlock more with Podchaser Pro

  • Audience Insights
  • Contact Information
  • Demographics
  • Charts
  • Sponsor History
  • and More!
Pro Features