File tree Expand file tree Collapse file tree
src/llmcompressor/modifiers Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -181,8 +181,9 @@ class AWQMapping:
181181 ),
182182]
183183
184- # AFMOE uses dual normalization: pre_mlp_layernorm feeds the MLP (not post_attention_layernorm)
185- # and attention has its own gate_proj for gating mechanism
184+ # AFMOE uses dual normalization: pre_mlp_layernorm feeds the MLP
185+ # (not post_attention_layernorm) and attention has its own gate_proj
186+ # for gating mechanism
186187_afmoe_mappings = [
187188 AWQMapping (
188189 "re:.*input_layernorm$" ,
Original file line number Diff line number Diff line change 6666 ),
6767]
6868
69- # AFMOE uses dual normalization: pre_mlp_layernorm feeds the MLP (not post_attention_layernorm)
70- # and attention has its own gate_proj for gating mechanism
7169AFMOE_SMOOTHQUANT_MAPPINGS : list [LayerMap ] = [
7270 LayerMap (
7371 balance_layers = [
You can’t perform that action at this time.
0 commit comments