Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Import snailtracer benchmark #320

Closed
wants to merge 2 commits into from
Closed

Import snailtracer benchmark #320

wants to merge 2 commits into from

Conversation

axic
Copy link
Member

@axic axic commented May 11, 2021

@axic
Copy link
Member Author

axic commented May 11, 2021

Do not merge yet, want to actually commit the changed sources to https://github.com/axic/snailtracer so we can refer to it.

@codecov
Copy link

codecov bot commented May 11, 2021

Codecov Report

Merging #320 (3687c0f) into master (d20c2da) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #320   +/-   ##
=======================================
  Coverage   99.78%   99.78%           
=======================================
  Files          30       30           
  Lines        4144     4144           
=======================================
  Hits         4135     4135           
  Misses          9        9           
Flag Coverage Δ
consensus 91.51% <ø> (ø)
unittests 99.78% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Base automatically changed from bench_mocked_host to master May 13, 2021 10:41
@axic
Copy link
Member Author

axic commented Jun 30, 2021

Rebased. Before merged, I'd still want to point the commit to a commithash in the source repo.

@chfast do you remember what else was blocking this?

@chfast
Copy link
Member

chfast commented Jun 30, 2021

-------------------------------------------------------------------------------------------------------------
Benchmark                                                   Time             CPU   Iterations UserCounters...
-------------------------------------------------------------------------------------------------------------
advanced/analyse/main/snailtracer_mean                   96.3 us         96.3 us           20 rate=184.084M/s size=17.73k
advanced/analyse/main/snailtracer_median                 96.3 us         96.3 us           20 rate=184.065M/s size=17.73k
advanced/analyse/main/snailtracer_stddev                0.059 us        0.059 us           20 rate=112.918k/s size=0
baseline/analyse/main/snailtracer_mean                   12.6 us         12.6 us           20 rate=1.4106G/s size=17.73k
baseline/analyse/main/snailtracer_median                 12.6 us         12.6 us           20 rate=1.41027G/s size=17.73k
baseline/analyse/main/snailtracer_stddev                0.066 us        0.066 us           20 rate=7.41335M/s size=0
advanced/execute/main/snailtracer/benchmark_mean        51780 us        51779 us           20 gas_rate=4.44572G/s gas_used=230.193M
advanced/execute/main/snailtracer/benchmark_median      51735 us        51734 us           20 gas_rate=4.44951G/s gas_used=230.193M
advanced/execute/main/snailtracer/benchmark_stddev        208 us          208 us           20 gas_rate=17.5997M/s gas_used=0
baseline/execute/main/snailtracer/benchmark_mean        44518 us        44518 us           20 gas_rate=5.17079G/s gas_used=230.193M
baseline/execute/main/snailtracer/benchmark_median      44520 us        44520 us           20 gas_rate=5.1706G/s gas_used=230.193M
baseline/execute/main/snailtracer/benchmark_stddev       17.0 us         17.0 us           20 gas_rate=1.98M/s gas_used=0
advanced/total/main/snailtracer/benchmark_mean          57670 us        57669 us           20 gas_rate=3.99168G/s gas_used=230.193M
advanced/total/main/snailtracer/benchmark_median        57687 us        57687 us           20 gas_rate=3.9904G/s gas_used=230.193M
advanced/total/main/snailtracer/benchmark_stddev          263 us          263 us           20 gas_rate=18.0965M/s gas_used=0
baseline/total/main/snailtracer/benchmark_mean          45215 us        45215 us           20 gas_rate=5.09119G/s gas_used=230.193M
baseline/total/main/snailtracer/benchmark_median        45166 us        45167 us           20 gas_rate=5.09653G/s gas_used=230.193M
baseline/total/main/snailtracer/benchmark_stddev          210 us          210 us           20 gas_rate=23.2184M/s gas_used=0

The gas_rate is screwed because a lot of EVM memory is used.

@chfast
Copy link
Member

chfast commented Dec 20, 2022

Done in ipsilon/evm-benchmarks#12.

@chfast chfast closed this Dec 20, 2022
@chfast chfast deleted the snailtracer branch December 20, 2022 10:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants