BlockBench

BlockBench is the first benchmarking framework for private blockchain systems. It serves as a fair means of comparison for different platforms and enables deeper understanding of different system design choices.

BlockBench comes with both macro benchmark workloads for evaluating the overall performance and micro benchmark workloads for evaluating performance of individual layers.

Workloads

Macro-benchmark

• YCSB (KVStore).
• SmallBank (OLTP).

Micro-benchmark

• DoNothing (consensus layer).
• IOHeavy (data model layer, read/write oriented).
• Analytics (data model layer, analytical query oriented).
• CPUHeavy (execution layer).

Source file structure

• Smart contract sources are in benchmark/contracts directory.
• Instructions and scripts to run benchmarks for Ethereum, Hyperledger , Parity and Quorum are in ethereum, hyperledger , parity , quorum_raft and quorum_vote directories respectively.
• Drivers for benchmark workloads are in src directory.

Dependency

C++ libraries

• restclient-cpp

  Note: we patched this library to include the "Expect: " header in POST requests, which considerably improves the speed for processing RPC request at Parity.

  • The patch file is include in benchmark/parity folder.

  • To patch: go to top-level directory of restclient-cpp, then:

    patch -p4 < $BLOCK_BENCH_HOME/benchmark/parity/patch_restclient

  • The installation can then proceed as normal.

• libcurl

• Docker-Container The container folder contains a Dockerfile that creates a Docker container with all required C++ dependencies. You can use this Container to build the kvstore workload

Node.js libraries

Go to micro directory and use npm install to install the dependency libraries

• Web3.js
• zipfian
• bignumber.js

Blockchain

• geth(ethereum)
• geth(parity)
• geth(quorum)
• hyperledger