DeepSeekV3 DualPipeV with SAC#2099

Draft

H-Huang wants to merge 14 commits intopytorch:mainfrom

H-Huang:deepseek-v3-with-SAC

Commits on Jan 5, 2026

Enable PP and EP overlap for MoE

wconstab
authored and
H-Huang
committed
WIP

wconstab
authored and
H-Huang
committed
Add other ops

wconstab
authored and
H-Huang
committed
claude fix errors

wconstab
authored and
H-Huang
committed
debugging mm backwards shape error

wconstab
authored and
H-Huang
committed
fix grad_out passing

wconstab
authored and
H-Huang
committed
Refactor to avoid faketensor computation in separate grad functions

wconstab
authored and
H-Huang
committed
Refactor to avoid faketensor computation in separate grad functions

wconstab
authored and
H-Huang
committed
try to fix RMSNorm

wconstab
authored and
H-Huang
committed
Fix fused_rms_norm

wconstab
authored and
H-Huang
committed
Got past RMSNorm errors, now hitting a segfault in all2allv coming from

wconstab
authored and
H-Huang
committed
remove ownership_tokens logic
H-Huang
committed
rebase
H-Huang
committed

Commits on Jan 22, 2026

fix merge
H-Huang
committed