Training time

[emlcpfx]

How long did it take to train the model. What GPU(s) did you use?

[filby89]

Hey,
we trained the model on an RTX 3090. Approximately 2 - 3 days for both pretraining and training should be enough.

[weihaosky]

Hey, we trained the model on an RTX 3090. Approximately 2 - 3 days for both pretraining and training should be enough.

In the config_pretrain.yaml, it writes num_epochs: 300, which would take a much longer time than 2-3 days. So how many epochs does the pertraining need? Similarly, how many epochs does the core training need?