Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

measure memory usage #9

Open
jangorecki opened this issue Jun 14, 2018 · 1 comment
Open

measure memory usage #9

jangorecki opened this issue Jun 14, 2018 · 1 comment
Milestone
2.2.0

Comments

@jangorecki
Copy link
Contributor

One of tools is currently failing on 1e9 due to lack of memory, 126GB is not enough to aggregate 50GB csv. This requires use bigger machine to run 1e9 grouping benchmark. Still memory usage should be investigated and probably added to report.
@jangorecki
Copy link
Contributor Author

R's solution to call system("ps -o RSS") happens to be sub-optimal in terms of impact on benchmarks timings. It has been turned off as of now. We need to find reliable way to measure memory.

@jangorecki jangorecki reopened this Dec 15, 2018
@jangorecki jangorecki mentioned this issue Dec 15, 2018
Closed
@jangorecki jangorecki mentioned this issue Feb 13, 2021
Closed
@jangorecki jangorecki mentioned this issue May 9, 2021
Closed
@jangorecki jangorecki added this to the 2.2.0 milestone May 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
2.2.0
Development

No branches or pull requests
1 participant
@jangorecki