Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

confusing messages about "parallel-parsing" : true setting #1600

Open
pfps opened this issue Nov 5, 2024 · 0 comments
Open

confusing messages about "parallel-parsing" : true setting #1600

pfps opened this issue Nov 5, 2024 · 0 comments

Comments

@pfps
Copy link

pfps commented Nov 5, 2024

I'm trying to load Wikidata using the wikidata.settings.json file in the current version of QLever. I'm seeing some confusing messages when the load starts:

2024-11-05 08:46:58.294 - INFO: QLever IndexBuilder, compiled on Mon Nov  4 07:47:39 PM EST 2024 using git hash e52848
2024-11-05 08:46:58.296 - INFO: You specified "locale = en_US" and "ignore-punctuation = 1"
2024-11-05 08:46:58.296 - INFO: You specified "ascii-prefixes-only = true", which enables faster parsing for well-behaved TTL files
2024-11-05 08:46:58.296 - INFO: You specified "parallel-parsing = true", which enables faster parsing for TTL files with a well-behaved use of newlines
2024-11-05 08:46:58.296 - INFO: You specified "num-triples-per-batch = 10,000,000", choose a lower value if the index builder runs out of memory
2024-11-05 08:46:58.296 - INFO: By default, integers that cannot be represented by QLever will throw an exception
2024-11-05 08:46:58.296 - INFO: Processing triples from /dev/stdin ...
2024-11-05 08:46:58.296 - WARN: Parallel parsing set to `true` in the `.settings.json` file; this is deprecated, please use the command-line  option --parse-parallel or -p instead
2024-11-05 08:46:58.296 - INFO: Parsing input triples and creating partial vocabularies, one per batch ...
2024-11-05 09:00:02.723 - INFO: Triples parsed: 1,650,000,000 [average speed 2.1 M/s, last batch 2.0 M/s, fastest 3.4 M/s, slowest 1.9 M/s] 

Should the settings file be changed? In any case, it seems weird to have QLever produce a message about the setting that kind of indicates that the setting works and later say that it won't work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant