Add Experts4bit for 4-bit quantization of fused MoE experts#1965
Draft
pjordanandrsn wants to merge 7 commits into
Draft
Add Experts4bit for 4-bit quantization of fused MoE experts#1965pjordanandrsn wants to merge 7 commits into
pjordanandrsn wants to merge 7 commits into