Skip to content

2020 08 11 bench results

LesnyRumcajs edited this page Aug 11, 2020 · 1 revision

Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM

Benchmark duration per suite: 300s

1 CPU Server

----------------------------------------------------------------------------
| name               |   req/s |   avg. latency | avg. cpu |   avg. memory |
----------------------------------------------------------------------------
| rust_tonic_st      |   47300 |        1.00 ms |  100.43% |      4.72 MiB |
| rust_tonic_mt      |   33151 |        1.46 ms |  101.44% |      4.79 MiB |
| cpp_grpc_st        |   29693 |        1.64 ms |  102.32% |      3.28 MiB |
| dotnet_grpc        |   22964 |        2.11 ms |  101.28% |      72.3 MiB |
| lua_grpc_st        |   18770 |        2.62 ms |  101.66% |      12.7 MiB |
| java_grpc          |   12955 |        3.79 ms |  102.02% |    339.71 MiB |
| node_grpc_st       |   12355 |        3.95 ms |  101.44% |     45.66 MiB |
| java_micronaut     |   12274 |        4.00 ms |  102.16% |    439.34 MiB |
| go_grpc            |   11588 |        4.24 ms |  101.77% |     14.19 MiB |
| cpp_grpc_mt        |   10702 |        4.60 ms |  101.56% |      8.64 MiB |
| kotlin_grpc        |    7996 |        6.18 ms |  102.03% |    208.58 MiB |
| node_grpcjs_st     |    7376 |        6.68 ms |   101.3% |     63.42 MiB |
| dart_grpc          |    6851 |        7.24 ms |  101.92% |     28.78 MiB |
| rust_thruster      |    6639 |        7.46 ms |   33.18% |      1.63 MiB |
| csharp_grpc        |    5718 |        8.67 ms |  101.46% |     72.41 MiB |
| swift_grpc_st      |    4659 |       10.64 ms |  101.27% |      3.62 MiB |
| java_aot           |    3369 |       14.75 ms |  101.67% |     335.2 MiB |
| python_grpc        |    2373 |       20.99 ms |  102.14% |     18.63 MiB |
| ruby_grpc          |    1976 |       25.20 ms |   102.2% |     18.05 MiB |
| php_grpc           |    1971 |       25.28 ms |  101.43% |      38.7 MiB |
| crystal_grpc       |    1946 |       25.58 ms |   15.77% |      6.11 MiB |
| scala_akka         |    1515 |       32.90 ms |  101.35% |    278.12 MiB |
| elixir_grpc        |    1333 |       37.39 ms |  101.14% |     76.09 MiB |
----------------------------------------------------------------------------

2 CPU Server

----------------------------------------------------------------------------
| name               |   req/s |   avg. latency | avg. cpu |   avg. memory |
----------------------------------------------------------------------------
| rust_tonic_st      |   48631 |        0.97 ms |  101.21% |      4.58 MiB |
| rust_tonic_mt      |   42218 |        1.13 ms |  196.55% |      5.54 MiB |
| dotnet_grpc        |   38755 |        1.24 ms |  199.17% |      89.4 MiB |
| cpp_grpc_st        |   29489 |        1.65 ms |  102.55% |      3.03 MiB |
| go_grpc            |   28361 |        1.70 ms |  205.31% |     14.13 MiB |
| cpp_grpc_mt        |   27781 |        1.74 ms |  204.92% |      8.58 MiB |
| java_grpc          |   26776 |        1.81 ms |  205.31% |    383.46 MiB |
| java_micronaut     |   24789 |        1.96 ms |  205.69% |    288.98 MiB |
| lua_grpc_st        |   19011 |        2.58 ms |  101.54% |      9.63 MiB |
| kotlin_grpc        |   16850 |        2.90 ms |   204.4% |    195.06 MiB |
| csharp_grpc        |   16098 |        3.04 ms |  204.57% |     75.82 MiB |
| node_grpc_st       |   11889 |        4.11 ms |  103.31% |     45.72 MiB |
| node_grpcjs_st     |    9857 |        4.98 ms |  118.09% |     64.56 MiB |
| java_aot           |    8341 |        5.91 ms |  204.26% |    337.51 MiB |
| dart_grpc          |    8049 |        6.16 ms |  109.39% |     28.34 MiB |
| rust_thruster      |    6117 |        8.10 ms |   55.91% |      1.97 MiB |
| php_grpc           |    4691 |       10.59 ms |  204.65% |     38.91 MiB |
| swift_grpc_st      |    4670 |       10.61 ms |  101.26% |      3.78 MiB |
| scala_akka         |    4590 |       10.81 ms |  203.22% |    520.24 MiB |
| python_grpc        |    4367 |       11.38 ms |  150.65% |     18.81 MiB |
| elixir_grpc        |    3413 |       14.57 ms |  202.62% |     77.61 MiB |
| ruby_grpc          |    2684 |       18.53 ms |  135.77% |     18.43 MiB |
| crystal_grpc       |    1896 |       26.27 ms |   15.34% |      6.11 MiB |
----------------------------------------------------------------------------

3 CPU Server (it's the best we could do with our resources, still it was not enough to properly stress all implementations)

----------------------------------------------------------------------------
| name               |   req/s |   avg. latency | avg. cpu |   avg. memory |
----------------------------------------------------------------------------
| rust_tonic_mt      |   50256 |        0.94 ms |  271.14% |      5.42 MiB |
| dotnet_grpc        |   48399 |        0.98 ms |  280.63% |     98.93 MiB |
| go_grpc            |   47609 |        1.00 ms |  309.01% |     14.21 MiB |
| rust_tonic_st      |   47076 |        1.01 ms |   100.2% |      4.75 MiB |
| cpp_grpc_mt        |   45282 |        1.05 ms |  308.76% |      9.28 MiB |
| java_grpc          |   36125 |        1.33 ms |  308.72% |    367.83 MiB |
| java_micronaut     |   35467 |        1.35 ms |  307.27% |    288.71 MiB |
| cpp_grpc_st        |   30264 |        1.60 ms |  102.38% |      3.32 MiB |
| csharp_grpc        |   27387 |        1.77 ms |  308.34% |     76.34 MiB |
| kotlin_grpc        |   25953 |        1.87 ms |  307.67% |    220.85 MiB |
| lua_grpc_st        |   18607 |        2.64 ms |  101.67% |     13.34 MiB |
| java_aot           |   14108 |        3.47 ms |  306.19% |    336.96 MiB |
| node_grpc_st       |   12528 |        3.90 ms |  102.17% |     45.97 MiB |
| node_grpcjs_st     |    9808 |        5.01 ms |  117.95% |     64.36 MiB |
| scala_akka         |    8486 |        5.82 ms |  306.83% |    458.49 MiB |
| php_grpc           |    7848 |        6.31 ms |  309.49% |     39.31 MiB |
| dart_grpc          |    7416 |        6.69 ms |  109.11% |     28.71 MiB |
| rust_thruster      |    7016 |        7.05 ms |   81.92% |      2.03 MiB |
| elixir_grpc        |    5703 |        8.69 ms |  304.63% |     77.81 MiB |
| swift_grpc_st      |    4653 |       10.65 ms |  101.17% |      3.58 MiB |
| python_grpc        |    4430 |       11.22 ms |  151.14% |     18.81 MiB |
| ruby_grpc          |    2684 |       18.54 ms |  135.58% |     18.29 MiB |
| crystal_grpc       |    1935 |       25.74 ms |   15.41% |      6.07 MiB |
----------------------------------------------------------------------------