Evaluation code of the VQVAE

[whwjdqls]

hi, great work!

I was wondering if there is an evaluation code for the VQVAE.

I tested with another codebase, and I could not get the same results as the paper.

It will be great if you can share the code for evaluating the vqvae.

[exitudio]

Hi,
Thank you for your interest. We don't have the evaluation code using test set for VQ. However, you can easily modify the train_vq code.

1. Change the evaluation from eval to test set in the train_vq.
2. Load trained model
3. Move Eval code to before training

P.s. the good result from 1st stage may not transfer 2nd stage. It's better to evaluate the 2nd stage.

[andyl-flwls]

Hi, Thank you for your interest. We don't have the evaluation code using test set for VQ. However, you can easily modify the train_vq code.

1. Change the evaluation from eval to test set in the train_vq.
2. Load trained model
3. Move Eval code to before training

P.s. the good result from 1st stage may not transfer 2nd stage. It's better to evaluate the 2nd stage.

Hi, I would like ask, i found out from the training log, the FID will get very low early in the training stage, and then, it fluctuate from 0.05 to 0.1 for the remaining training time. Should I stop earlier and shift to stage 2, or continue the training until the end based on your experience? Do you feel even the fid might not be the optimal for stage 1, but longer training time will still make stage 2 performance better?