feat: gperftools

[ludamad]

Did this a bit ago and didn't find it super useful, but for just reporting memory usage might be useful enough to get in

Example run

Load Average: 4.45, 7.50, 6.81
Dumping heap profile to ./ultra_honk_bench.0001.heap (100 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0002.heap (205 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0003.heap (305 MB currently in use)
------------------------------------------------------------------------------------------------
Benchmark                                                      Time             CPU   Iterations
------------------------------------------------------------------------------------------------
construct_proof_ultra/sha256/10/repeats:1                    292 ms          232 ms            3
Dumping heap profile to ./ultra_honk_bench.0004.heap (410 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0005.heap (516 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0006.heap (620 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0007.heap (724 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0008.heap (881 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0009.heap (981 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0010.heap (1082 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0011.heap (4536 MB allocated cumulatively, 908 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0012.heap (1186 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0013.heap (1289 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0014.heap (1393 MB currently in use)
construct_proof_ultra/keccak/10/repeats:1                    682 ms          462 ms            2
Dumping heap profile to ./ultra_honk_bench.0015.heap (7705 MB allocated cumulatively, 1117 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0016.heap (1501 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0017.heap (1613 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0018.heap (1725 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0019.heap (1837 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0020.heap (1941 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0021.heap (2069 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0022.heap (2170 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0023.heap (2271 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0024.heap (2375 MB currently in use)
Dumping heap profile to ./ultra_honk_bench.0025.heap (2479 MB currently in use)
construct_proof_ultra/ecdsa_verification/10/repeats:1       1161 ms          765 ms            1
Dumping heap profile to ./ultra_honk_bench.0026.heap (11195 MB allocated cumulatively, 1275 MB currently in use)
construct_proof_ultra/merkle_membership/10/repeats:1         218 ms          180 ms            4
Dumping heap profile to ./ultra_honk_bench.0027.heap (Exiting, 1218 MB in use)
File: ultra_honk_bench
Type: inuse_space
Showing nodes accounting for 1424773.03kB, 99.87% of 1426698.52kB total
Dropped 117 nodes (cum <= 7133.49kB)
      flat  flat%   sum%        cum   cum%
805340.70kB 56.45% 56.45% 805340.70kB 56.45%  std::vector::_M_realloc_insert
234258.12kB 16.42% 72.87% 234258.12kB 16.42%  barretenberg::scalar_multiplication::pippenger_runtime_state::pippenger_runtime_state
172033.31kB 12.06% 84.93% 172033.31kB 12.06%  barretenberg::Polynomial::operator=
172033.28kB 12.06% 96.98% 172033.28kB 12.06%  barretenberg::Polynomial::Polynomial
32896.03kB  2.31% 99.29% 32896.03kB  2.31%  barretenberg::scalar_multiplication::point_table_alloc
    8192kB  0.57% 99.86%    24576kB  1.72%  proof_system::CircuitBuilderBase::add_variable
   14.66kB 0.001% 99.86% 11857.81kB  0.83%  proof_system::UltraCircuitBuilder_::create_new_range_constraint
    2.44kB 0.00017% 99.86% 611271.87kB 42.85%  proof_system::honk::UltraComposer_::create_instance
    1.66kB 0.00012% 99.86% 262193.34kB 18.38%  proof_system::honk::ProverInstance_::compute_proving_key
    0.39kB 2.7e-05% 99.87% 1424833.58kB 99.87%  benchmark::internal::BenchmarkRunner::DoNIterations
    0.20kB 1.4e-05% 99.87% 267154.41kB 18.73%  proof_system::honk::UltraComposer_::compute_commitment_key
    0.16kB 1.1e-05% 99.87%    11843kB  0.83%  proof_system::UltraCircuitBuilder_::create_range_list
    0.05kB 3.3e-06% 99.87% 32896.08kB  2.31%  barretenberg::srs::factories::FileCrsFactory::get_prover_crs
    0.03kB 2.2e-06% 99.87% 1424837.85kB 99.87%  benchmark::RunSpecifiedBenchmarks
         0     0% 99.87% 1426698.52kB   100%  __libc_start_main
         0     0% 99.87% 1426698.52kB   100%  _start
         0     0% 99.87% 96284.88kB  6.75%  barretenberg::constexpr_for
         0     0% 99.87% 32896.03kB  2.31%  barretenberg::srs::factories::FileProverCrs::FileProverCrs
         0     0% 99.87% 1424833.18kB 99.87%  bench_utils::construct_proof_with_specified_num_iterations
         0     0% 99.87% 625033.88kB 43.81%  bench_utils::generate_keccak_test_circuit
         0     0% 99.87% 188524.32kB 13.21%  bench_utils::generate_sha256_test_circuit
         0     0% 99.87% 1424833.07kB 99.87%  bench_utils::get_prover
         0     0% 99.87% 1424833.19kB 99.87%  benchmark::internal::(anonymous namespace)::RunInThread
         0     0% 99.87% 1424833.19kB 99.87%  benchmark::internal::BenchmarkInstance::Run
         0     0% 99.87% 1424833.58kB 99.87%  benchmark::internal::BenchmarkRunner::DoOneRepetition
         0     0% 99.87% 1424837.85kB 99.87%  main
         0     0% 99.87%    21068kB  1.48%  proof_system::UltraCircuitBuilder_::create_big_mul_gate
         0     0% 99.87% 11842.84kB  0.83%  proof_system::UltraCircuitBuilder_::create_dummy_constraints
         0     0% 99.87% 780018.88kB 54.67%  proof_system::UltraCircuitBuilder_::create_gates_from_plookup_accumulators
         0     0% 99.87% 12052.66kB  0.84%  proof_system::UltraCircuitBuilder_::decompose_into_default_range
         0     0% 99.87% 16384.12kB  1.15%  proof_system::compute_first_and_last_lagrange_polynomials
         0     0% 99.87% 90112.69kB  6.32%  proof_system::construct_selector_polynomials
         0     0% 99.87% 32768.34kB  2.30%  proof_system::construct_wire_polynomials_base
         0     0% 99.87% 344114.02kB 24.12%  proof_system::honk::ProverInstance_::ProverInstance_
         0     0% 99.87% 81920.69kB  5.74%  proof_system::honk::ProverInstance_::compute_witness
         0     0% 99.87% 122880.94kB  8.61%  proof_system::honk::flavor::ProvingKey_::ProvingKey_
         0     0% 99.87%    21068kB  1.48%  proof_system::plonk::stdlib::field_t::add_two
         0     0% 99.87% 12052.66kB  0.84%  proof_system::plonk::stdlib::field_t::create_range_constraint
         0     0% 99.87%   362656kB 25.42%  proof_system::plonk::stdlib::keccak::chi
         0     0% 99.87% 624759.88kB 43.79%  proof_system::plonk::stdlib::keccak::hash
         0     0% 99.87%   141312kB  9.90%  proof_system::plonk::stdlib::keccak::iota
         0     0% 99.87% 237596.88kB 16.65%  proof_system::plonk::stdlib::keccak::normalize_and_rotate
         0     0% 99.87% 623561.03kB 43.71%  proof_system::plonk::stdlib::keccak::sponge_absorb
         0     0% 99.87% 23308.16kB  1.63%  proof_system::plonk::stdlib::keccak::theta
         0     0% 99.87% 542532.19kB 38.03%  proof_system::plonk::stdlib::plookup_read::get_lookup_accumulators
         0     0% 99.87% 83341.19kB  5.84%  proof_system::plonk::stdlib::plookup_read::read_from_1_to_2_table
         0     0% 99.87% 188524.32kB 13.21%  proof_system::plonk::stdlib::sha256
         0     0% 99.87%    32384kB  2.27%  proof_system::plonk::stdlib::sha256_plookup::choose
         0     0% 99.87%    50025kB  3.51%  proof_system::plonk::stdlib::sha256_plookup::extend_witness
         0     0% 99.87%    94208kB  6.60%  proof_system::plonk::stdlib::sha256_plookup::majority
         0     0% 99.87% 188524.32kB 13.21%  proof_system::plonk::stdlib::sha256_plookup::sha256
         0     0% 99.87% 188504.19kB 13.21%  proof_system::plonk::stdlib::sha256_plookup::sha256_block
         0     0% 99.87% 267154.20kB 18.73%  std::_Sp_counted_ptr_inplace::_Sp_counted_ptr_inplace

[AztecBot]

Benchmark results

No metrics with a significant change found.

Detailed results

All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.

This benchmark source data is available in JSON format on S3 here.

Values are compared against data from master at commit d707d4e3 and shown if the difference exceeds 1%.

L2 block published to L1

Each column represents the number of txs on an L2 block published to L1.

Metric	8 txs	32 txs	128 txs
l1_rollup_calldata_size_in_bytes	45,444	179,588	716,132
l1_rollup_calldata_gas	222,996	868,064	3,449,540
l1_rollup_execution_gas	842,083	3,595,172	22,204,909
l2_block_processing_time_in_ms	2,008 (+1%)	7,559 (-1%)	29,715 (-1%)
note_successful_decrypting_time_in_ms	294 (-1%)	876 (-1%)	3,164 (-2%)
note_trial_decrypting_time_in_ms	97.0 (-3%)	86.0 (-11%)	134
l2_block_building_time_in_ms	13,151 (-1%)	52,313 (-1%)	208,363 (-1%)
l2_block_rollup_simulation_time_in_ms	11,826 (-1%)	47,058 (-1%)	187,500 (-1%)
l2_block_public_tx_process_time_in_ms	1,285 (-1%)	5,122 (-2%)	20,378 (-3%)

L2 chain processing

Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric	5 blocks	10 blocks
node_history_sync_time_in_ms	21,324 (-2%)	41,685 (-2%)
note_history_successful_decrypting_time_in_ms	1,983 (-2%)	3,872 (-2%)
note_history_trial_decrypting_time_in_ms	121 (+1%)	143
node_database_size_in_bytes	1,628,407	1,095,422 (-1%)
pxe_database_size_in_bytes	29,748	59,307

Circuits stats

Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit	circuit_simulation_time_in_ms	circuit_input_size_in_bytes	circuit_output_size_in_bytes
private-kernel-init	772	61,697	18,905
private-kernel-ordering	123	24,297	8,153
base-rollup	1,772	656,311	814
root-rollup	77.8	4,072	1,097
private-kernel-inner	789	81,568	18,905
public-kernel-private-input	41.4 (-1%)	41,519	18,841
public-kernel-non-first-iteration	26.1 (-1%)	41,497	18,841
merge-rollup	0.971 (+5%)	2,592	873

Miscellaneous

Transaction sizes based on how many contracts are deployed in the tx.

Metric	0 deployed contracts	1 deployed contracts
tx_size_in_bytes	8,787	27,547

[ludamad]

@codygunton any reason you see for this not to go in as-is? It's not hugely important, I guess is the main detractor I see

[codygunton]

Sorry for the delay I tried running the script and hit an error:

Dumping heap profile to ./ultra_honk_rounds_bench.0001.heap (100 MB currently in use)
---------------------------------------------------------------------------------------
Benchmark                                             Time             CPU   Iterations
---------------------------------------------------------------------------------------
ROUND_PREAMBLE/iterations:1                       0.174 ms        0.166 ms            1
ROUND_WIRE_COMMITMENTS/iterations:1                15.1 ms         8.76 ms            1
Dumping heap profile to ./ultra_honk_rounds_bench.0002.heap (1215 MB allocated cumulatively, 177 MB currently in use)
ROUND_SORTED_LIST_ACCUMULATOR/iterations:1         20.8 ms         14.0 ms            1
ROUND_GRAND_PRODUCT_COMPUTATION/iterations:1       39.4 ms         19.7 ms            1
Dumping heap profile to ./ultra_honk_rounds_bench.0003.heap (2241 MB allocated cumulatively, 97 MB currently in use)
ROUND_RELATION_CHECK                                110 ms         82.0 ms            9
Dumping heap profile to ./ultra_honk_rounds_bench.0004.heap (3265 MB allocated cumulatively, 4 MB currently in use)
Dumping heap profile to ./ultra_honk_rounds_bench.0005.heap (4290 MB allocated cumulatively, 141 MB currently in use)
ROUND_ZEROMORPH                                     109 ms         96.1 ms            7
Dumping heap profile to ./ultra_honk_rounds_bench.0006.heap (Exiting, 2 kB in use)
Downloading and installing Go...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100    80  100    80    0     0    575      0 --:--:-- --:--:-- --:--:--   579
tar: This does not look like a tar archive

gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now

[ludamad]

Hmm odd, guess my curl usage was wrong, hopefully fixed now, not sure how it worked before

[codygunton]

I ran the script.