Skip to content

Commit

Permalink
NFR Test Results for NGF version edge (#2262)
Browse files Browse the repository at this point in the history
Co-authored-by: Luca Comellini <luca.com@gmail.com>
  • Loading branch information
nginx-bot and lucacome authored Jul 24, 2024
1 parent e686708 commit 536ab0f
Show file tree
Hide file tree
Showing 34 changed files with 176 additions and 3,943 deletions.
42 changes: 21 additions & 21 deletions tests/results/dp-perf/edge/edge-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,19 +7,19 @@ NGINX Plus: false
GKE Cluster:

- Node count: 12
- k8s version: v1.29.4-gke.1043004
- k8s version: v1.29.6-gke.1038001
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
- Zone: us-east1-b
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 986.95µs
Latencies [min, mean, 50, 90, 95, 99, max] 562.91µs, 940.576µs, 912.579µs, 1.141ms, 1.212ms, 1.375ms, 12.402ms
Requests [total, rate, throughput] 30000, 1000.03, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 624.318µs
Latencies [min, mean, 50, 90, 95, 99, max] 496.907µs, 666.131µs, 651.971µs, 742.531µs, 778.713µs, 872.635µs, 11.772ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -30,35 +30,35 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 29999, 1000.00, 999.97
Duration [total, attack, wait] 30s, 29.999s, 947.18µs
Latencies [min, mean, 50, 90, 95, 99, max] 602.01µs, 984.263µs, 961.474µs, 1.162ms, 1.221ms, 1.367ms, 16.033ms
Bytes In [total, mean] 4799840, 160.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 697.125µs
Latencies [min, mean, 50, 90, 95, 99, max] 520.741µs, 681.361µs, 670.45µs, 761.428µs, 795.946µs, 884.223µs, 9.626ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 29999, 1000.03, 1000.00
Duration [total, attack, wait] 29.999s, 29.998s, 875.67µs
Latencies [min, mean, 50, 90, 95, 99, max] 596.74µs, 998.15µs, 983.222µs, 1.188ms, 1.249ms, 1.386ms, 11.616ms
Bytes In [total, mean] 5039832, 168.00
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 29.999s, 753.834µs
Latencies [min, mean, 50, 90, 95, 99, max] 523.903µs, 693.564µs, 681.217µs, 776.952µs, 817.06µs, 913.016µs, 6.02ms
Bytes In [total, mean] 5040000, 168.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.97
Duration [total, attack, wait] 30.001s, 30s, 1.139ms
Latencies [min, mean, 50, 90, 95, 99, max] 611.07µs, 1.005ms, 983.916µs, 1.193ms, 1.257ms, 1.41ms, 19.537ms
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 680.402µs
Latencies [min, mean, 50, 90, 95, 99, max] 511.054µs, 680.638µs, 669.25µs, 763.254µs, 800.238µs, 900.815µs, 5.474ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -69,9 +69,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 967.36µs
Latencies [min, mean, 50, 90, 95, 99, max] 595.57µs, 999.204µs, 982.831µs, 1.192ms, 1.255ms, 1.392ms, 14.948ms
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 726.41µs
Latencies [min, mean, 50, 90, 95, 99, max] 511.128µs, 684.525µs, 671.866µs, 765.429µs, 801.43µs, 904.838µs, 10.938ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
44 changes: 22 additions & 22 deletions tests/results/dp-perf/edge/edge-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,20 +7,20 @@ NGINX Plus: true
GKE Cluster:

- Node count: 12
- k8s version: v1.29.4-gke.1043004
- k8s version: v1.29.6-gke.1038001
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
- Zone: us-east1-b
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 997.807µs
Latencies [min, mean, 50, 90, 95, 99, max] 711.69µs, 957.047µs, 931.487µs, 1.041ms, 1.089ms, 1.247ms, 18.096ms
Bytes In [total, mean] 4800000, 160.00
Duration [total, attack, wait] 30.001s, 30s, 766.8µs
Latencies [min, mean, 50, 90, 95, 99, max] 535.083µs, 732.524µs, 709.951µs, 801.487µs, 837.721µs, 978.661µs, 19.138ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -30,10 +30,10 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 899.626µs
Latencies [min, mean, 50, 90, 95, 99, max] 726.964µs, 985.028µs, 967.197µs, 1.079ms, 1.118ms, 1.252ms, 19.94ms
Bytes In [total, mean] 4830000, 161.00
Requests [total, rate, throughput] 30000, 1000.02, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 750.962µs
Latencies [min, mean, 50, 90, 95, 99, max] 569.894µs, 751.471µs, 737.453µs, 830.219µs, 865.522µs, 975.891µs, 13.021ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -43,10 +43,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 917.947µs
Latencies [min, mean, 50, 90, 95, 99, max] 721.266µs, 993.472µs, 973.023µs, 1.101ms, 1.164ms, 1.321ms, 20.914ms
Bytes In [total, mean] 5070000, 169.00
Requests [total, rate, throughput] 30000, 1000.00, 999.98
Duration [total, attack, wait] 30.001s, 30s, 795.267µs
Latencies [min, mean, 50, 90, 95, 99, max] 566.893µs, 746.284µs, 731.685µs, 821.144µs, 856.146µs, 949.534µs, 18.228ms
Bytes In [total, mean] 5040000, 168.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -56,23 +56,23 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 29999, 1000.00, 999.97
Duration [total, attack, wait] 30s, 29.999s, 1.08ms
Latencies [min, mean, 50, 90, 95, 99, max] 708.277µs, 986.926µs, 970.493µs, 1.103ms, 1.15ms, 1.274ms, 19.021ms
Bytes In [total, mean] 4739842, 158.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 733.608µs
Latencies [min, mean, 50, 90, 95, 99, max] 545.997µs, 736.79µs, 725.161µs, 816.5µs, 852.368µs, 950.282µs, 9.048ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.98
Duration [total, attack, wait] 30s, 29.999s, 1.022ms
Latencies [min, mean, 50, 90, 95, 99, max] 724.839µs, 981.279µs, 965.573µs, 1.107ms, 1.169ms, 1.299ms, 6.315ms
Bytes In [total, mean] 4740000, 158.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 743.446µs
Latencies [min, mean, 50, 90, 95, 99, max] 553.99µs, 726.832µs, 715.508µs, 802.061µs, 835.171µs, 926.755µs, 8.575ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
26 changes: 13 additions & 13 deletions tests/results/ngf-upgrade/edge/edge-oss.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,39 +7,39 @@ NGINX Plus: false
GKE Cluster:

- Node count: 12
- k8s version: v1.29.4-gke.1043004
- k8s version: v1.29.6-gke.1038001
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
- Zone: us-east1-b
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.991s, 878.01µs
Latencies [min, mean, 50, 90, 95, 99, max] 687.75µs, 1.202ms, 1.174ms, 1.401ms, 1.463ms, 1.613ms, 12.928ms
Bytes In [total, mean] 960000, 160.00
Duration [total, attack, wait] 59.991s, 59.99s, 799.917µs
Latencies [min, mean, 50, 90, 95, 99, max] 450.094µs, 821.717µs, 823.258µs, 951.13µs, 997.824µs, 1.126ms, 11.934ms
Bytes In [total, mean] 920025, 153.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http.png](http.png)
![https.png](https.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 966.11µs
Latencies [min, mean, 50, 90, 95, 99, max] 603.69µs, 1.182ms, 1.153ms, 1.384ms, 1.449ms, 1.623ms, 12.779ms
Bytes In [total, mean] 920039, 153.34
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 794.113µs
Latencies [min, mean, 50, 90, 95, 99, max] 618.014µs, 872.17µs, 856.784µs, 991.181µs, 1.038ms, 1.148ms, 12.075ms
Bytes In [total, mean] 960000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https.png](https.png)
![http.png](http.png)
28 changes: 14 additions & 14 deletions tests/results/ngf-upgrade/edge/edge-plus.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,39 +7,39 @@ NGINX Plus: true
GKE Cluster:

- Node count: 12
- k8s version: v1.29.4-gke.1043004
- k8s version: v1.29.6-gke.1038001
- vCPUs per node: 16
- RAM per node: 65855012Ki
- Max pods per node: 110
- Zone: us-east1-b
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.99s, 1.631ms
Latencies [min, mean, 50, 90, 95, 99, max] 908.3µs, 1.36ms, 1.329ms, 1.511ms, 1.57ms, 1.795ms, 14.259ms
Bytes In [total, mean] 955989, 159.33
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 867.428µs
Latencies [min, mean, 50, 90, 95, 99, max] 653.414µs, 901.844µs, 879.015µs, 1.006ms, 1.051ms, 1.18ms, 12.8ms
Bytes In [total, mean] 919993, 153.33
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http-plus.png](http-plus.png)
![https-plus.png](https-plus.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.99s, 1.671ms
Latencies [min, mean, 50, 90, 95, 99, max] 968.82µs, 1.388ms, 1.338ms, 1.558ms, 1.632ms, 1.973ms, 14.346ms
Bytes In [total, mean] 912000, 152.00
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 839.172µs
Latencies [min, mean, 50, 90, 95, 99, max] 421.992µs, 816.859µs, 820.308µs, 942.646µs, 983.206µs, 1.111ms, 11.939ms
Bytes In [total, mean] 960000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https-plus.png](https-plus.png)
![http-plus.png](http-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/cpu-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/cpu-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/memory-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/memory-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/ttr-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPRoutes/ttr-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/cpu-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/cpu-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/memory-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/memory-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/ttr-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_HTTPSListeners/ttr-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/cpu-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/cpu-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/memory-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/memory-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/ttr-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_Listeners/ttr-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_UpstreamServers/cpu-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_UpstreamServers/cpu-plus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_UpstreamServers/memory-oss.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/scale/edge/TestScale_UpstreamServers/memory-plus.png
Loading

0 comments on commit 536ab0f

Please sign in to comment.