Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OutOfMemoryError #42

Open
SOTArt opened this issue Nov 13, 2024 · 2 comments
Open

OutOfMemoryError #42

SOTArt opened this issue Nov 13, 2024 · 2 comments

Comments

@SOTArt
Copy link

SOTArt commented Nov 13, 2024

I used 4 pieces of 4090 to train the model, and I set the bathc_size as 1 in the file of ./config/base/surroundocc.py. However, the memory is still not enough. I am not sure whether the changed batch_size is correct or not. How can I solve this problem?
Uploading 1731485749712.jpg…

@SOTArt
Copy link
Author

SOTArt commented Nov 13, 2024

image
I only have 24GB VRAM. And I use the command of "CUDA_VISIBLE_DEVICES=0,1,2,3 python train.py --py-config config/nuscenes_gs25600_solid.py --work-dir out/nuscenes_gs25600_solid" to train the model.

@huang-yh
Copy link
Owner

This is weird because it only takes ~16GB on my 4090.🤔
I think it might have something to do with the environment, e.g. CUDA, torch, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants