Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compactor Blog Post Updates #3

Merged
merged 3 commits into from
Apr 10, 2024
Merged

Compactor Blog Post Updates #3

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
166554e
goal rewording, renamed section to Test Scenario
kevinrr888 Apr 10, 2024
98a3513
small grammatical error in Goal
kevinrr888 Apr 10, 2024
f98b1d1
Update _posts/blog/2024-04-09-does-a-compactor-return-memory-to-OS.md
DomGarguilo Apr 10, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions _posts/blog/2024-04-09-does-a-compactor-return-memory-to-OS.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ author: Dominic Garguilo, Kevin Rathbun
---

## Goal
We need to determine if, once a compactor process is finished using memory, will it give the unused memory back to the OS?
We need to determine, once an Accumulo process is finished using memory, will the JVM release this unused memory back to the OS? To determine this, we will specifically be observing a Compactor process during out tests, but the findings should apply to any Accumulo Server process.

### Why does it matter?
### Test Scenario
There could be a scenario where the amount of memory on a machine limits the number of compactors that can be run. For example, on a machine with 32G of memory, if each compactor process uses 6G of memory, we can only "fit" 5 compactors on that machine (32/6=5.333). Since each compactor process only runs on a single core, we would only be utilizing 5 cores on that machine where we would like to be using as many as we can.

If the compactor process does not return the memory to the OS, then we are stuck with only using the following number of compactor processes:
Expand Down