quad-torch 0.5.0

What's Changed

• Add PSGD-Procrustes 🎉
• Add helpful notes to readme
• Add unit tests

quad-torch 0.4.5

What's Changed

• fixed preconditioner init scale to be correct wrt noise scale, note from @lixilinx
• various small improvements, formatting
• some notes added to readme and code

quad-torch 0.4.0

What's Changed

• remove mu-p and normalize_grads options
• use multi_dot for updates, note from @lixilinx
• clip update norm in case of surprisingly large gradient, note from @lixilinx
• various other improvements

quad-torch 0.3.0

What's Changed:

• make noise scale configurable, better defaults
• improved init scale
• more accurate adam lr scaling
• no torch.cond
• revert to original update style
• fix missing add_noise call

quad-torch 0.2.0

What's Changed

• Couple small improvements including noising grads, lower min precond LR, replacing einsum, more accurate adam LR scaling