Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

StringTable in extractor uses a lot of memory #14

Closed
DennisOSRM opened this issue Oct 4, 2011 · 4 comments
Closed

StringTable in extractor uses a lot of memory #14

DennisOSRM opened this issue Oct 4, 2011 · 4 comments

Comments

@DennisOSRM
Copy link
Collaborator

Extractor uses a hash table to keep track of previously encountered strings to only store them once. Unfortunately, that table uses a lot of RAM on large extracts.

@sivetic
Copy link
Contributor

sivetic commented Oct 4, 2011

Have you considered the unordered_map branch of stxxl (link: https://stxxl.svn.sourceforge.net/svnroot/stxxl/branches/unordered_map/)? Not sure how stable the branch is.

@DennisOSRM
Copy link
Collaborator Author

Last time I checked with the student it was more or less running fine,
but not yet in production quality. One of the maintainers of stxxl just
left our group and I am not sure if active development is still taking
place or not.

Have you considered the unordered_map branch of stxxl (link: https://stxxl.svn.sourceforge.net/svnroot/stxxl/branches/unordered_map/)? Not sure how stable the branch is.

This was referenced Nov 25, 2011
@DennisOSRM
Copy link
Collaborator Author

Flagging this as feature request since there is at least no leak.

@DennisOSRM
Copy link
Collaborator Author

Fixed. It was an unnecessary memory allocation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants