Search results

Compare to filter "none" vs. EM, EMA

Status: Open.

#16 In ironjr/grokfast;

· hoangthangta opened on Apr 6, 2025

Has anyone validated it on SFT?

Status: Open.

#14 In ironjr/grokfast;

· YajieW99 opened on Dec 3, 2024

gradfilter_ema for Keras/Tensorflow

Status: Open.

#13 In ironjr/grokfast;

· snik007 opened on Sep 3, 2024

How to use Grokfast with FP16 mixed precision training?

Status: Open.

#10 In ironjr/grokfast;

· peterjc123 opened on Jul 3, 2024

Help to find hyper parameters for LLama 2

Status: Open.

#7 In ironjr/grokfast;

· 50Bytes-dev opened on Jun 27, 2024

Any experiments / gotchas to be aware of when using schedulefree optimizer?

Status: Open.

#4 In ironjr/grokfast;

· dawood95 opened on Jun 24, 2024

Anyone already working on including this in transformers?

Status: Open.

#2 In ironjr/grokfast;

· l4b4r4b4b4 opened on Jun 22, 2024