Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve storage of organisation's IP ranges in documents #662

Closed
mmo opened this issue Oct 11, 2021 · 1 comment
Closed

Improve storage of organisation's IP ranges in documents #662

mmo opened this issue Oct 11, 2021 · 1 comment
Assignees
@jma
Labels
enhancement Enhancement of an existing feature f: search Elasticseach configuration, result page, facets p-High To set a high priority! performance Issues on the performance of the application

Comments

@mmo
Copy link
Collaborator

mmo commented Oct 11, 2021 •
edited
Loading

Documents currently contain the complete/expanded list of all IP adresses corresponding to the IP mask of the organisation.

Improvement: store the restricted IP masks in the document, instead of the corresponding complete/expanded IP list in the document. ES is able to manage this kind of field efficiently.

Also: create a CLI allowing to reindex only the restricted documents when the list of allowed IPs is modified.
@mmo mmo added the enhancement Enhancement of an existing feature label Oct 11, 2021
@mmo mmo added f: search Elasticseach configuration, result page, facets p-High To set a high priority! performance Issues on the performance of the application and removed enhancement Enhancement of an existing feature labels Feb 8, 2022
@mmo mmo assigned jma Feb 8, 2022
@mmo mmo changed the title Improve storage of IP ranges for masked documents Improve storage of organisation's IP ranges in documents Feb 8, 2022
@mmo
Copy link
Collaborator Author

mmo commented Feb 8, 2022

⚠️ This problem has become critical: it severely overloads the servers, and leads some OAI-PMH requests to produce 500 Internal server error messages.

@PascalRepond PascalRepond added the enhancement Enhancement of an existing feature label Mar 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jma jma

Labels
enhancement Enhancement of an existing feature f: search Elasticseach configuration, result page, facets p-High To set a high priority! performance Issues on the performance of the application
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mmo @jma @PascalRepond