Concurrent data file fetching and parallel RecordBatch processing#515

Merged

liurenjie1024 merged 2 commits intoapache:mainfrom sdd:concurrent-data-file-record-batch-processing

Aug 14, 2024

+167-59

Commits on Aug 13, 2024

feat: concurrent data file fetches, parallel RecordBatch processing
sdd
committed
refactor: centralize infallible available_parallelism fn. Use better channel size limit in arrow read
sdd
committed