Checklist
Describe the bug
GDN model spec dec topk > 1 path has bug and can generate garbage output. The easiest repro test is this: https://github.com/sgl-project/sglang/blob/main/test/registered/4-gpu-models/test_qwen3_next_models_mtp.py#L30
The threshold for mtp should be the same as non-mtp, at "kl_div": 0.0025, instead of currently 0.008.
Reproduction
- update kl threshold to 0.0025, same as non-mtp threshold https://github.com/sgl-project/sglang/blob/main/test/registered/4-gpu-models/test_qwen3_next_models_mtp.py#L30
- run
TestQwen3NextMTP
Environment
main default environment
Checklist
Describe the bug
GDN model spec dec topk > 1 path has bug and can generate garbage output. The easiest repro test is this: https://github.com/sgl-project/sglang/blob/main/test/registered/4-gpu-models/test_qwen3_next_models_mtp.py#L30
The threshold for mtp should be the same as non-mtp, at
"kl_div": 0.0025, instead of currently 0.008.Reproduction
TestQwen3NextMTPEnvironment
main default environment