Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HLA Metadata Dictionary - Introduce sliding cache #1357

Open
Tracked by #1280
daria-sorokina-da opened this issue Aug 14, 2024 · 0 comments
Open
Tracked by #1280

HLA Metadata Dictionary - Introduce sliding cache #1357

daria-sorokina-da opened this issue Aug 14, 2024 · 0 comments
Assignees
Labels
hla-metadata-dictionary Work relates to the "HLA Metadata Dictionary", a data store used to assist with hla nomenclature
Milestone

Comments

@daria-sorokina-da
Copy link
Contributor

Currently, HLA Metadata Dictionary values get stored in the memory of the Matching Algorithm function for 24 hours.
For large result sets (i.e. 100.000 donors) this may take ~2.5 GB RAM.
This causes the searches that have large result sets to fail (10 attempts are made, all interrupting because the function is restarting).

Scaling up the service plan (from EP1 to EP2 for AN LIVE, i.e.) helps these particular searches because there's not enough place in memory for all the values of the HLA Metadata Dictionary.

We need to introduce the ability to set sliding expiration for the DLA Metadata Dictionary values so that we only store in the cache the values that are hit often. The lifetime of the sliding cache should be configurable

@daria-sorokina-da daria-sorokina-da self-assigned this Aug 14, 2024
@daria-sorokina-da daria-sorokina-da converted this from a draft issue Aug 14, 2024
@daria-sorokina-da daria-sorokina-da added the hla-metadata-dictionary Work relates to the "HLA Metadata Dictionary", a data store used to assist with hla nomenclature label Aug 14, 2024
@daria-sorokina-da daria-sorokina-da modified the milestones: 2.2.0, 2.4.0 Aug 14, 2024
SergeyEzh added a commit that referenced this issue Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hla-metadata-dictionary Work relates to the "HLA Metadata Dictionary", a data store used to assist with hla nomenclature
Projects
Status: In Progress
Development

No branches or pull requests

2 participants