What is the device of the experiment

[LongLiveForFreedom]

Hi, thank you for your great work! Could you please tell me what kind of experimental device you used for this work and how many GPUs can make the model run? Thank you!

[GentleSmile]

We use 8 * 3090 GPUs. The training stage requires ~ 17 GB GPU memory, and takes ~ 3 days for 24 epochs on 8× 3090 GPUS

[LongLiveForFreedom]

Thank you

[Linqingh]

We use 8 * 3090 GPUs. The training stage requires ~ 17 GB GPU memory, and takes ~ 3 days for 24 epochs on 8× 3090 GPUS

Thanks for your great work.What do your meaning is 17GB for every GPU memory?