Skip to content
This repository has been archived by the owner on Jan 5, 2024. It is now read-only.

reduce memory requirements #18

Open
mschrimpf opened this issue Nov 19, 2019 · 0 comments
Open

reduce memory requirements #18

mschrimpf opened this issue Nov 19, 2019 · 0 comments

Comments

@mschrimpf
Copy link
Member

running large models like ResNet takes insane amounts of memory (~450GB).
This is probably due to us collecting all the layer activations across batches, and could be optimized by continuously writing batches to disk
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mschrimpf