CUDA out of memory

[Dan1900]

When inference stage2,raise a CUDA out of memory error! I use 4090 and the CUDA memory is about 24G.

[alphazhugit]

The page says that inference requires only 10G of VRAM, but in actual testing, the second_stage requires 28G of VRAM😫

[CorradoF]

The page says that inference requires only 10G of VRAM, but in actual testing, the second_stage requires 28G of VRAM😫

How much better the 2nd stage is compared to the 1st?

[2hiTee]

When inference stage2,raise a CUDA out of memory error! I use 4090 and the CUDA memory is about 24G.

When I training the first stage, a single RTX 4090 also raised CUDA out of memory