ParquetLoader ERRORS

[aycaramba1224]

Discussed in #3040

^{Originally posted by aycaramba1224 June 28, 2024}

'https://unpkg.com/@loaders.gl/parquet@4.2.1/dist/parquet-worker.js' is wrong url!
'https://unpkg.com/@loaders.gl/parquet@4.2.1/dist/workers/parquet-worker.js' is correct url!

[Beiusxzw]

I also encountered this. How should I fix this issue?

[aycaramba1224]

I can't fix it.

[belom88]

parquet-loader-worker.js is not built because of CommonJS relationships in code.
As a temporary solution you can set worker: false option:

  const result = load(data, ParquetLoader, {worker: false})

[shaunakv1]

@belom88 @ibgreen
Performance is taking a serious hit when worker is turned to false for me. Is there anyway to get a pre-compiled parquet-loader-worker.js temporarily? Or will this ever be fixed in the code?

[ibgreen]

@shaunakv1

Performance is taking a serious hit when worker is turned to false for me.

Hmm, was the JavaScript parquet worker loader ever functional? Even if it was, hard to see how it would be faster.
Or is this just a statement that perf is not a good enough using the default JavaScript based loader?

The path to good performance for Parquet is to use the WASM library via ParquetWASMLoader. That is where effort is being put for now.

[ibgreen]

For repo hygiene reasons, we don't discuss in closed tickets. Please open a GitHub discussion if there is more to discuss.

[shaunakv1]

thanks for the response @ibgreen .

Is there any documentation on ParquetWASMLoader that I can refer to? I am not seeing it in the list of loaders at

https://loaders.gl/docs/modules/parquet/api-reference/parquet-loader

Also will I still be able to use it with Deck.gl?

[ibgreen]

As I said, further conversation in the discussions tab, please.