Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix high data consumption issue #76

Merged
merged 1 commit into from
Nov 6, 2023
Merged

Conversation

rounakdatta
Copy link
Owner

@rounakdatta rounakdatta commented Nov 5, 2023

The root cause of the very high data consumption (about ~5GB per hour) is as follows:

  • The Immich machine learning container downloads a face recognition model of about 600MBs.
  • Now, although it wouldn't try to fit the entire model into memory, but still it derives inference using the model.
  • However, the container has been assigned only the default of 300MB of memory. And hence if there is any load at all, it would crash.
  • The container restarting means it would download the same model again.
  • This happening multiple times in an hour led to the very high data wastage.

To mitigate, we have temporarily given the machine learning model enough memory (~2GB dedicated for now), which we'll re-evaluate later. Also, we have disabled MongoDB, Cronicle and NTFY, given we are no longer using these services actively.

@rounakdatta rounakdatta marked this pull request as ready for review November 6, 2023 15:31
@rounakdatta rounakdatta merged commit 6342bb9 into main Nov 6, 2023
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant