Task Tracker

[guangyey]

Motivation

This ticket tracks features that are currently under development in other PyTorch backends. Once they are finalized, we will add corresponding support for XPU.

Pending items

• Lightweight API to get private pool reserved memory bytes @guangyey
• Fix batch_norm eval returning populated save_mean/save_invstd @guangyey
• [[DTensor][1/2][ThreadRNGTracker] Embed sharding spec in CUDA RNG state for global-index-aware random generation]（[DTensor][1/2][ThreadRNGTracker] Embed sharding spec in CUDA RNG state for global-index-aware random generation pytorch/pytorch#171928 @guangyey