Skip to content

Latest commit

 

History

History
17 lines (13 loc) · 1.02 KB

README.md

File metadata and controls

17 lines (13 loc) · 1.02 KB
Raw

1B rides NYC taxi native benchmark

This repository reflects progress of performance and design study for 1B ride NYC taxi benchamarks.

Compilation

Build Status

  1. Install and activate miniconda
  2. Create development environment: conda env create -n arrow-def -f conda/default-env.yml
  3. Activate this environment: conda activate arrow-def
  4. Configure: cmake -GNinja -DCMAKE_BUILD_TYPE=release -S . -B ../build
  5. Build: cmake --build ../build
  6. Allocate huge memory pages: sudo bash -c 'echo 30000 > /proc/sys/vm/nr_hugepages'
  7. Download trips.xaa.csv.gz, gzip -d it
  8. Run ../build/bench_all for a single run of all execution nodes.
  9. Adjust and run bash run-aff-bsz.sh for collecting times of CSV reader in different modes.