You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#17957 optimizes ingest of multiple Parquet files, using an internal thread pool to issue read requests. Parallelism of the read operations is already implemented in kvikIO, so we should not need to launch these reads from multiple threads.
With an async read interface, we could read all footers in a loop from a single thread.
The text was updated successfully, but these errors were encountered:
#17957 optimizes ingest of multiple Parquet files, using an internal thread pool to issue read requests. Parallelism of the read operations is already implemented in kvikIO, so we should not need to launch these reads from multiple threads.
With an async read interface, we could read all footers in a loop from a single thread.
The text was updated successfully, but these errors were encountered: