About GPU memory

[xlbjy]

Hi, nice work. Is one Nvidia RTX 3090 GPU (24GB) enough for training?

[exitudio]

Hi, thank you for your interest.
It should be fine. It uses around ~17 GB, 1GPU, with batchsize 128 (in 2nd stage) for training.