Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
254 Open 1,184 Closed
254 Open 1,184 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix GPU memory leak during in-process restart
#2875 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
handle 'step' state in checkpoint save
#2874 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
1
ci(fix): Release version
#2873 opened Jan 8, 2026 by ko3n1g Loading…
6 tasks
Core 0.16
Fix stale parameter index map in DistributedOptimizer
#2872 opened Jan 8, 2026 by ahmadki • Draft
6 tasks
1
1
Add a logprobs test with real gpt model. Expert Review Apply this label to indicate that your PR is ready for expert review.
#2870 opened Jan 8, 2026 by yobibyte Loading…
6 tasks
1
[WIP Feat] Split-K Indexer Kernels community-request
#2869 opened Jan 8, 2026 by laixinn • Draft
7 of 17 tasks
1
Reapply "[Dev] Use the latest Hybrid-EP (#2423)"
#2867 opened Jan 8, 2026 by ko3n1g Loading…
6 tasks
Core 0.16
Only build datasets on the required ranks
#2865 opened Jan 8, 2026 by asolergi-nv Loading…
1
Remove cross-rank synchronization during checkpoint load & deprecate torch.distributed.checkpoint.state_dict_loader.load_state_dict
#2864 opened Jan 8, 2026 by asolergi-nv Loading…
1
Change oncall team name
#2861 opened Jan 8, 2026 by Phlip79 Loading…
6 tasks
Core 0.16
2
Update Slack user group when oncall changes
#2859 opened Jan 8, 2026 by Phlip79 Loading…
6 tasks
Core 0.16
2
Use global user buffer when the bucket size does not fit FixedPoolAllocator
#2857 opened Jan 7, 2026 by shengf-nv Loading…
6 tasks
1
NCCL_DEBUG
#2849 opened Jan 7, 2026 by ko3n1g Loading…
6 tasks
Core 0.16
Initialize M-FSDP Optimizer(DistOpt v2) with DTensor Parameter Support
#2848 opened Jan 7, 2026 by shjwudp • Draft
6 tasks
1
ci: Onboard GB200
#2847 opened Jan 7, 2026 by ko3n1g Loading…
6 tasks
Core 0.16
[Dev] Add Qwen3-VL support with Megatron-FSDP dev branch Dev branch related issues and development
#2842 opened Jan 7, 2026 by xuwchen Loading…
6 tasks
1
Add Qwen3-VL support with Megatron-FSDP
#2841 opened Jan 7, 2026 by xuwchen Loading…
6 tasks
1
[Dev] Support EP with HSDP community-request
#2840 opened Jan 7, 2026 by wplf Loading…
6 tasks
1
Improve memory logging
#2839 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
Support DDP overlap for models with repeated parameters
#2837 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
2
Add retry loop with exponential backoff in dataloader as a form of in-application fault tolerance complexity: low
#2836 opened Jan 7, 2026 by deepakn94 Loading… Core 0.16
5
Cherry-pick optimizer override refactor from #2723
#2835 opened Jan 6, 2026 by yaoyu-33 Loading… Core 0.16
4
Refactor spec modification/introspection to make references to Submodules typed community-request
#2834 opened Jan 6, 2026 by nschank Loading…
6 tasks
5
fsdp: avoid double sharding of MoE experts when EP is enabled community-request
#2833 opened Jan 6, 2026 by CodersAcademy006 Loading…
1
1
Supporting inference when called within an asyncio loop (Pythonic)
#2831 opened Jan 6, 2026 by tdene • Draft
6 tasks
3
ProTip! Updated in the last three days: updated:>2026-01-05.