Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Which files are needed for MLD table API #5974

Closed
rnarayana opened this issue Mar 7, 2021 · 2 comments
Closed

Which files are needed for MLD table API #5974

rnarayana opened this issue Mar 7, 2021 · 2 comments
Labels

Comments

@rnarayana
Copy link

rnarayana commented Mar 7, 2021

I have requirement to only run table API, and need to optimize the RAM requirements. I have the NA datasetand processed with OSRM 5.24, and I can see that ~40GB of RAM is used on startup. There are the files I have, and their sizes. Is there any scope for optimization by excluding any files, considering I will run only table API? (I saw a similar thread for CH)

  0K - north-america-latest.osrm                           # Replaced with empty file
 17G - north-america-latest.osrm.cell_metrics
112M - north-america-latest.osrm.cells
 68K - north-america-latest.osrm.datasource_names
1.7G - north-america-latest.osrm.ebg_nodes
1.8G - north-america-latest.osrm.edges
5.7G - north-america-latest.osrm.fileIndex             # I read this is not loaded into RAM
6.3G - north-america-latest.osrm.geometry
1.1G - north-america-latest.osrm.icd
6.5K - north-america-latest.osrm.maneuver_overrides
6.4G - north-america-latest.osrm.mldgr
 56M - north-america-latest.osrm.names
3.3G - north-america-latest.osrm.nbg_nodes
1.1G - north-america-latest.osrm.partition
6.0K - north-america-latest.osrm.properties
 24M - north-america-latest.osrm.ramIndex
3.5K - north-america-latest.osrm.timestamp
 16K - north-america-latest.osrm.tld
 30K - north-america-latest.osrm.tls
525M - north-america-latest.osrm.turn_duration_penalties
525M - north-america-latest.osrm.turn_weight_penalties
@jcoupey
Copy link

jcoupey commented Mar 8, 2021

This is somehow similar to #5838. Being able to switch off using some of the files would be ideal to lower RAM consumption for specific use-cases.

From what I can tell, there is no easy way to achieve a "don't load that file" effect. I remember trying to fiddle with the loading code to simply do this but there are many intricacies within the various plugins that make use of the loaded files.

This is something I'd be able to spend some time on, if anyone with a better knowledge of the codebase could give any pointers, or ideas for a better approach!

Copy link

github-actions bot commented Jul 8, 2024

This issue seems to be stale. It will be closed in 30 days if no further activity occurs.

@github-actions github-actions bot added the Stale label Jul 8, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants