Skip to content

Conversation

@sssshhhhhh
Copy link
Contributor

  • Add awq args to convert
  • use_residual does the +1 in kernel with fp32
  • Don't write the quant type if it's the default ct2

@jordimas
Copy link
Collaborator

Thanks!

@jordimas jordimas merged commit ee0a539 into OpenNMT:master Jan 23, 2026
17 checks passed
@BBC-Esq
Copy link
Contributor

BBC-Esq commented Jan 23, 2026

Oof, was that a miatake in my code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants