From fbdae5b73efce34944150c911d86eadebbd61bc5 Mon Sep 17 00:00:00 2001 From: Ubuntu Date: Tue, 9 Apr 2019 02:05:56 +0000 Subject: [PATCH] Update performance test results --- performance/benchmarks/summary.csv | 80 ++++++++++++++++----------- performance/benchmarks/summary.md | 89 ++++++++++++++++++------------ 2 files changed, 104 insertions(+), 65 deletions(-) diff --git a/performance/benchmarks/summary.csv b/performance/benchmarks/summary.csv index 9f4c4de849d1..67e7901d40e0 100644 --- a/performance/benchmarks/summary.csv +++ b/performance/benchmarks/summary.csv @@ -1,31 +1,49 @@ -Scenario Name,Heap Size,Concurrent Users,Message Size (Bytes),Back-end Service Delay (ms),Label,# Samples,Error Count,Error %,Throughput (Requests/sec),Average Response Time (ms),Standard Deviation of Response Time (ms),Minimum Response Time (ms),Maximum Response Time (ms),75th Percentile of Response Time (ms),90th Percentile of Response Time (ms),95th Percentile of Response Time (ms),98th Percentile of Response Time (ms),99th Percentile of Response Time (ms),99.9th Percentile of Response Time (ms),Received (KB/sec),Sent (KB/sec),Ballerina GC Throughput (%),Ballerina Memory Footprint (M),Average Ballerina Memory Footprint After Full GC (M),Standard Deviation of Ballerina Memory Footprint After Full GC (M),Ballerina Load Average - Last 1 minute,Ballerina Load Average - Last 5 minutes,Ballerina Load Average - Last 15 minutes -Passthrough HTTP2 (HTTPS) service,2G,100,50,0,HTTP2 Request,9393471,0,0,15665.63,6.2,8.26,0,270,6,11,19,34,47,81,1789.92,0,99.53,2045,24.109,0,7.45,10.55,9.57 -Passthrough HTTP2 (HTTPS) service,2G,100,1024,0,HTTP2 Request,8749780,0,0,14593.18,6.63,8.21,0,231,7,13,20,34,45,79,1695.89,0,99.58,2045,24.712,0,6.30,10.48,10.52 -Passthrough HTTP2 (HTTPS) service,2G,300,50,0,HTTP2 Request,9561031,0,0,15944.22,18.34,16.45,0,269,23,36,50,71,85,132,1821.75,0,98.99,2041.5,24.979,0,10.96,12.02,11.46 -Passthrough HTTP2 (HTTPS) service,2G,300,1024,0,HTTP2 Request,9038739,0,0,15075.02,19.29,15.56,0,293,25,37,48,66,80,126,1751.88,0,99.1,2041.5,25.166,0,10.13,12.52,12.05 -Passthrough HTTP2 (HTTPS) service,2G,1000,50,0,HTTP2 Request,4024443,215812,5.36,6711.43,148.46,215.5,0,2818,126,433,667,891,1023,1335,757.7,0,98.23,2033.5,25.711,0,6.97,9.89,10.63 -Passthrough HTTP2 (HTTPS) service,2G,1000,1024,0,HTTP2 Request,5699896,108112,1.9,9504.14,103.83,162.46,0,3529,94,159,357,723,931,1519,1099.56,0,98.02,2035,25.968,0,10.36,10.91,10.74 -Passthrough HTTPS service,2G,100,50,0,HTTP Request,10849339,0,0,18081.3,5.49,7.77,0,249,5,10,16,28,43,86,3248.98,4114.2,99.46,2045,24.449,0,8.99,9.34,8.84 -Passthrough HTTPS service,2G,100,1024,0,HTTP Request,8535860,0,0,14225.89,6.98,5.78,0,216,9,14,18,23,27,54,16115.26,16795.99,99.53,2045,24.471,0,6.60,8.37,8.44 -Passthrough HTTPS service,2G,300,50,0,HTTP Request,11105072,0,0,18507.84,16.15,13.64,0,262,19,29,39,61,77,124,3325.63,4211.26,98.83,2042,24.938,0,7.02,9.27,9.04 -Passthrough HTTPS service,2G,300,1024,0,HTTP Request,8840640,0,0,14733.57,20.29,11.6,0,288,25,34,41,52,62,90,16690.37,17395.39,98.96,2041,25.046,0,5.40,8.31,8.62 -Passthrough HTTPS service,2G,1000,50,0,HTTP Request,7807821,18259,0.23,12385.44,76.84,1453.07,0,32361,8,14,18,25,31,30079,2304.03,2811.58,89.4,2044,1421.063,179.487,3.49,7.10,8.11 -Passthrough HTTPS service,2G,1000,1024,0,HTTP Request,6066973,18218,0.3,9630.47,98.68,1645.7,0,32100,10,16,21,27,32,30079,10960.35,11336.2,88.76,2043.5,1433.613,174.886,3.64,6.79,7.69 -Passthrough HTTP service,2G,100,50,0,HTTP Request,11905599,0,0,19841.41,5,6.73,0,214,5,7,11,22,40,78,3565.25,4514.7,99.46,2045,,,3.22,5.57,4.15 -Passthrough HTTP service,2G,100,1024,0,HTTP Request,11083444,0,0,18470.96,5.37,6.7,0,235,5,7,12,24,39,78,20924.13,21808,99.51,2045,,,3.26,6.12,5.74 -Passthrough HTTP service,2G,300,50,0,HTTP Request,13116267,0,0,21858.84,13.67,11.55,0,289,15,21,28,43,68,140,3927.76,4973.74,98.72,2041.5,,,1.01,5.15,6.18 -Passthrough HTTP service,2G,300,1024,0,HTTP Request,12154620,0,0,20256.05,14.75,12.46,0,274,16,23,31,51,74,141,22946.3,23915.59,98.83,2041.5,,,2.43,6.42,6.90 -Passthrough HTTP service,2G,1000,50,0,HTTP Request,12666324,0,0,21109.8,47.29,23.87,1,391,55,71,85,113,144,238,3793.17,4803.3,96.14,2033,,,1.28,6.01,7.14 -Passthrough HTTP service,2G,1000,1024,0,HTTP Request,11963420,0,0,19936.21,50.09,25.49,0,443,58,76,92,124,154,244,22583.99,23537.97,96.51,2032.5,,,3.35,7.83,8.17 -JSON to XML transformation HTTPS service,2G,100,50,0,HTTP Request,6937718,0,0,11562.34,8.61,8.14,0,220,9,14,19,29,45,95,2393.77,2608.3,99.12,2044.5,23.769,0,5.46,6.93,7.46 -JSON to XML transformation HTTPS service,2G,100,1024,0,HTTP Request,4716166,0,0,7860.13,12.65,10.49,0,230,14,22,31,46,59,102,14875.91,9264.82,99.12,2043,23.784,0,11.35,10.36,9.16 -JSON to XML transformation HTTPS service,2G,300,50,0,HTTP Request,7553311,0,0,12588.22,23.78,16.47,0,340,27,38,49,72,95,171,2606.16,2839.73,97.82,2043,24.23,0,5.29,8.30,8.74 -JSON to XML transformation HTTPS service,2G,300,1024,0,HTTP Request,4931783,0,0,8219.21,36.44,19.95,2,360,43,59,73,94,113,185,15555.5,9688.08,97.81,2041,24.284,0,10.32,10.66,9.88 -JSON to XML transformation HTTPS service,2G,1000,50,0,HTTP Request,3406513,18873,0.55,5408.41,176.11,2242.64,0,32281,6,9,15,30,58,30463,1200.12,1213.3,70.6,2044,1650.731,202.1,4.07,6.02,7.67 -JSON to XML transformation HTTPS service,2G,1000,1024,0,HTTP Request,1739088,20569,1.18,2789.66,338.99,3065.47,0,56640,9,15,22,46,30079,31231,5309.08,3249.32,61.36,2042.5,1795.115,250.284,3.85,5.37,6.82 -JSON to XML transformation HTTP service,2G,100,50,0,HTTP Request,8112357,0,0,13519.63,7.36,8.8,0,243,7,13,18,28,44,109,2798.99,3049.84,99.07,2045.5,24.005,0,3.89,6.54,7.08 -JSON to XML transformation HTTP service,2G,100,1024,0,HTTP Request,5703793,0,0,9505.48,10.47,10.17,0,283,12,18,24,36,55,120,17989.87,11204.22,99.11,2044,24.037,0,7.15,8.22,7.88 -JSON to XML transformation HTTP service,2G,300,50,0,HTTP Request,8715450,0,0,14524.64,20.6,11.51,0,337,23,31,37,47,61,148,3007.05,3276.55,97.42,2041.5,24.357,0,4.30,7.19,7.64 -JSON to XML transformation HTTP service,2G,300,1024,0,HTTP Request,6151999,0,0,10253.01,29.2,11.9,0,297,33,41,48,58,68,151,19404.62,12085.33,97.58,2039,24.235,0,8.65,8.87,8.38 -JSON to XML transformation HTTP service,2G,1000,50,0,HTTP Request,7950020,0,0,13248.71,75.41,18.76,0,344,87,100,108,120,131,183,2742.9,2988.72,92.87,2034.5,25.265,0,5.62,8.14,8.28 -JSON to XML transformation HTTP service,2G,1000,1024,0,HTTP Request,5777831,0,0,9628.53,103.77,21.38,13,446,120,133,141,152,161,198,18222.75,11349.25,91.69,2032,25.303,0,8.38,8.78,8.56 +Scenario Name,Heap Size,Concurrent Users,Message Size (Bytes),Back-end Service Delay (ms),Label,# Samples,Error Count,Error %,Throughput (Requests/sec),Average Response Time (ms),Standard Deviation of Response Time (ms),Minimum Response Time (ms),Maximum Response Time (ms),75th Percentile of Response Time (ms),90th Percentile of Response Time (ms),95th Percentile of Response Time (ms),98th Percentile of Response Time (ms),99th Percentile of Response Time (ms),99.9th Percentile of Response Time (ms),Received (KB/sec),Sent (KB/sec),Ballerina GC Throughput (%),Ballerina Memory Footprint (M),Average Ballerina Memory Footprint After Full GC (M),Standard Deviation of Ballerina Memory Footprint After Full GC (M),Netty Service GC Throughput (%),Netty Service Memory Footprint (M),Average Netty Service Memory Footprint After Full GC (M),Standard Deviation of Netty Service Memory Footprint After Full GC (M),JMeter Client GC Throughput (%),JMeter Client Memory Footprint (M),Average JMeter Client Memory Footprint After Full GC (M),Standard Deviation of JMeter Client Memory Footprint After Full GC (M),JMeter Server 1 GC Throughput (%),JMeter Server 1 Memory Footprint (M),Average JMeter Server 1 Memory Footprint After Full GC (M),Standard Deviation of JMeter Server 1 Memory Footprint After Full GC (M),JMeter Server 2 GC Throughput (%),JMeter Server 2 Memory Footprint (M),Average JMeter Server 2 Memory Footprint After Full GC (M),Standard Deviation of JMeter Server 2 Memory Footprint After Full GC (M),Ballerina Load Average - Last 1 minute,Ballerina Load Average - Last 5 minutes,Ballerina Load Average - Last 15 minutes,Netty Service Load Average - Last 1 minute,Netty Service Load Average - Last 5 minutes,Netty Service Load Average - Last 15 minutes,JMeter Client Load Average - Last 1 minute,JMeter Client Load Average - Last 5 minutes,JMeter Client Load Average - Last 15 minutes,JMeter Server 1 Load Average - Last 1 minute,JMeter Server 1 Load Average - Last 5 minutes,JMeter Server 1 Load Average - Last 15 minutes,JMeter Server 2 Load Average - Last 1 minute,JMeter Server 2 Load Average - Last 5 minutes,JMeter Server 2 Load Average - Last 15 minutes +Passthrough HTTP service (h1c -> h1c),2G,100,50,0,HTTP Request,11731905,0,0,19551.06,5.08,6.8,0,231,5,7,12,23,40,79,3513.08,4448.63,99.32,2045,17.932,0,99.99,4091.5,,,99.95,2048,,,99.1,4096,10076.5,2837.62,99.1,4096,9786,3248.449,2.56,5.64,4.34,0.31,0.32,0.25,0.26,0.20,0.18,0.57,1.00,0.72,0.72,0.94,0.66 +Passthrough HTTP service (h1c -> h1c),2G,100,1024,0,HTTP Request,10961115,0,0,18266.21,5.43,6.89,0,212,5,8,12,25,42,77,20692.19,21566.26,99.3,2045,18.296,0,99.99,4091.5,,,99.95,2048,,,99.11,4096,13.05,1810.193,99.14,4096,11.3,724.077,5.71,6.89,6.13,0.26,0.38,0.33,0.20,0.20,0.18,1.94,1.21,0.95,1.35,1.27,1.09 +Passthrough HTTP service (h1c -> h1c),2G,300,50,0,HTTP Request,12607073,0,0,21009.27,14.23,11.91,0,282,16,23,31,48,71,133,3775.1,4780.43,98.71,2041,21.28,0,99.99,4092,,,99.95,2048,,,99.01,4096,12.8,1448.155,98.98,4096,15.1,4779.335,1.83,6.13,6.70,0.53,0.45,0.38,0.28,0.24,0.21,1.27,1.77,1.55,1.09,2.13,1.83 +Passthrough HTTP service (h1c -> h1c),2G,300,1024,0,HTTP Request,11564424,0,0,19273.65,15.51,12.19,0,280,17,25,34,53,72,125,21833.44,22755.71,98.69,2041,19.311,0,99.99,4091.5,,,99.95,2048,,,99.06,4096,14.35,3693.219,99.07,4096,11.4,579.12,3.49,7.33,7.55,0.30,0.37,0.36,0.11,0.15,0.19,1.88,2.50,2.09,4.13,2.64,2.09 +Passthrough HTTP service (h1c -> h1c),2G,1000,50,0,HTTP Request,11757823,0,0,19593.92,50.97,26.11,0,456,60,78,94,125,154,253,3520.78,4458.38,96.44,2036,17.535,0,99.99,4091,,,99.95,2048,,,98.99,4096,14.3,3620.387,98.97,4096,18.75,10064.958,3.70,8.17,8.48,0.36,0.48,0.42,0.19,0.19,0.18,1.51,2.07,2.07,2.51,2.21,2.02 +Passthrough HTTP service (h1c -> h1c),2G,1000,1024,0,HTTP Request,11163018,0,0,18602.3,53.69,26.91,0,428,63,82,100,131,157,251,21072.92,21963.07,96.68,2034.5,17.71,0,99.99,4090,,,99.95,2048,,,99.01,4096,14.55,3982.425,99.03,4096,11.9,144.957,3.31,8.07,8.75,0.14,0.24,0.31,0.30,0.21,0.19,1.61,1.93,1.99,3.15,2.81,2.30 +JSON to XML transformation HTTP service,2G,100,50,0,HTTP Request,8028438,0,0,13379.95,7.43,8.04,0,257,8,13,17,26,39,100,2770.07,3018.33,99.18,2045.5,24.48,0,99.99,4088,,,99.96,2048,,,99.38,4096,10.9,1303.198,99.38,4096,10.599,1738.776,4.52,6.70,7.56,0.14,0.19,0.20,0.15,0.13,0.11,0.45,0.76,1.05,0.80,1.07,1.25 +JSON to XML transformation HTTP service,2G,100,1024,0,HTTP Request,5884972,0,0,9807.53,10.15,9.97,0,286,11,18,24,36,56,113,18561.53,11560.25,99.21,2044.5,24.376,0,99.99,4085.5,,,99.97,2048,,,99.53,4096,10.357,2088.793,99.5,4096,14.8,4344.464,8.69,8.67,8.08,0.07,0.20,0.19,0.13,0.15,0.13,0.54,0.51,0.67,0.36,0.43,0.66 +JSON to XML transformation HTTP service,2G,300,50,0,HTTP Request,8861315,0,0,14767.97,20.26,12.69,1,296,23,31,38,51,73,151,3057.43,3331.45,97.98,2042,24.443,0,99.99,4088.5,,,99.96,2048,,,99.29,4096,15.25,4996.417,99.29,4096,11.55,362.039,5.41,7.77,7.81,0.35,0.26,0.20,0.20,0.20,0.15,1.40,1.52,1.14,0.96,1.53,1.30 +JSON to XML transformation HTTP service,2G,300,1024,0,HTTP Request,6308131,0,0,10512.62,28.48,16.4,1,324,33,43,53,70,94,181,19895.96,12391.34,97.96,2040,24.497,0,99.99,4086,,,99.97,2048,,,99.49,4096,11.85,72.832,99.49,4096,10.052,2530.735,4.39,8.22,8.43,0.17,0.17,0.18,0.07,0.10,0.13,1.87,1.82,1.47,0.85,1.07,1.16 +JSON to XML transformation HTTP service,2G,1000,50,0,HTTP Request,8240538,0,0,13732.49,72.73,22.87,0,397,84,98,110,129,151,231,2843.05,3097.86,94.09,2035,25.217,0,99.99,4086,,,99.96,2048,,,99.31,4096,11.6,289.207,99.28,4096,12.25,651.952,6.94,8.71,8.64,0.28,0.23,0.19,0.28,0.14,0.10,2.41,2.08,1.84,2.67,2.02,1.47 +JSON to XML transformation HTTP service,2G,1000,1024,0,HTTP Request,6027226,0,0,10043.84,99.46,29.51,1,485,115,135,150,172,192,285,19008.75,11838.78,93.38,2032.5,25.184,0,99.99,4083.5,,,99.97,2048,,,99.44,4096,14.9,4489.421,99.44,4096,13.65,2679.228,5.43,9.22,9.34,0.30,0.26,0.20,0.21,0.15,0.10,2.37,1.60,1.62,0.73,0.95,1.15 +Passthrough HTTPS service (h1 -> h1),2G,100,50,0,HTTP Request,10256998,0,0,17094.23,5.81,6.39,0,240,7,13,18,24,30,67,3071.62,3889.6,99.45,2045,23.688,0,99.99,4090.5,,,99.96,2048,,,99.2,4096,11.9,144.957,99.21,4096,11.3,724.077,7.51,8.54,8.64,0.55,0.43,0.37,0.20,0.16,0.17,1.30,1.48,1.58,1.16,1.19,1.43 +Passthrough HTTPS service (h1 -> h1),2G,100,1024,0,HTTP Request,7134397,0,0,11890.07,8.36,6.19,0,128,11,16,20,25,28,52,13469.22,14038.18,99.54,2045,23.655,0,99.99,4085.5,,,99.96,2048,,,99.41,4096,14.7,4199.507,99.42,4096,12.95,1665.236,5.52,8.06,8.30,0.32,0.32,0.34,0.11,0.12,0.15,1.11,1.09,1.30,1.20,1.08,1.18 +Passthrough HTTPS service (h1 -> h1),2G,300,50,0,HTTP Request,10327542,0,0,17211.22,17.37,12.73,0,267,21,30,39,56,71,114,3092.64,3916.23,98.85,2041.5,23.963,0,99.99,4090,,,99.96,2048,,,99.19,4096,14.3,3620.387,99.15,4096,17.1,7675.644,4.35,8.17,8.48,0.58,0.45,0.39,0.04,0.11,0.14,1.74,2.10,1.81,2.19,2.17,1.70 +Passthrough HTTPS service (h1 -> h1),2G,300,1024,0,HTTP Request,7306715,0,0,12177.19,24.57,11.45,0,172,31,39,45,53,60,87,13794.47,14377.17,99.05,2040.5,24.27,0,99.99,4085,,,99.97,2048,,,99.38,4096,19.05,10.253,99.39,4096,14.9,4489.421,7.90,8.44,8.41,0.22,0.29,0.33,0.05,0.13,0.16,0.66,1.76,1.88,1.16,1.72,1.79 +Passthrough HTTPS service (h1 -> h1),2G,1000,50,0,HTTP Request,9306835,0,0,15508.13,64.41,29.08,2,429,78,102,120,144,162,216,2786.62,3528.71,96.87,2032,25.175,0,99.99,4087,,,99.96,2048,,,99.2,4096,25.45,19.304,99.18,4096,28.75,23.971,6.75,9.71,9.34,0.24,0.47,0.43,0.23,0.17,0.16,0.74,1.92,2.13,1.34,1.46,1.46 +Passthrough HTTPS service (h1 -> h1),2G,1000,1024,0,HTTP Request,6926399,0,0,11540.54,86.57,28.75,4,445,103,124,139,157,170,213,13073.26,13625.5,97.33,2030.5,25.178,0,99.99,4082.5,,,99.97,2048,,,99.37,4096,26.55,20.86,99.36,4096,25.95,20.011,10.15,9.33,9.06,0.26,0.22,0.27,0.05,0.08,0.13,1.15,1.37,1.58,6.15,2.55,1.85 +JSON to XML transformation HTTPS service,2G,100,50,0,HTTP Request,6871350,0,0,11451.14,8.69,7.72,0,262,9,14,19,29,45,86,2370.74,2583.22,99.2,2044.5,23.657,0,99.99,4085.5,,,99.97,2048,,,99.45,4096,14.5,3910.3,99.46,4096,11.15,941.159,6.03,7.26,7.99,0.15,0.23,0.20,0.00,0.10,0.13,0.82,0.89,1.08,1.09,1.16,1.10 +JSON to XML transformation HTTPS service,2G,100,1024,0,HTTP Request,4283229,0,0,7138.12,13.96,8.89,1,186,17,23,30,41,50,79,13509.45,8413.78,99.26,2043.5,23.649,0,99.99,4081.5,,,99.97,2048,,,99.65,4096,11.9,144.957,99.63,4096,13.95,3113.391,4.87,8.20,8.41,0.17,0.19,0.18,0.04,0.08,0.10,0.67,0.65,0.75,0.46,0.58,0.74 +JSON to XML transformation HTTPS service,2G,300,50,0,HTTP Request,7558666,0,0,12596.14,23.76,15.49,0,300,27,38,48,69,89,160,2607.79,2841.51,98.07,2040,23.952,0,99.99,4086,,,99.97,2048,,,99.38,4096,19.7,11.172,99.38,4096,16.55,6878.735,6.17,8.24,8.56,0.13,0.22,0.21,0.17,0.16,0.11,1.79,1.51,1.20,2.33,2.02,1.46 +JSON to XML transformation HTTPS service,2G,300,1024,0,HTTP Request,4391256,0,0,7318.24,40.93,20.81,1,342,49,66,80,100,116,166,13850.33,8626.08,98.22,2037,24.199,0,99.99,4080.5,,,99.97,2048,,,99.61,4096,18.9,10.041,99.6,4096,17.55,8326.889,12.52,11.76,10.34,0.12,0.15,0.16,0.02,0.05,0.08,0.65,0.93,1.03,1.71,1.13,1.13 +JSON to XML transformation HTTPS service,2G,1000,50,0,HTTP Request,7097981,0,0,11827.86,84.48,34.53,5,450,100,124,144,176,208,301,2448.74,2668.2,94.48,2029,25.248,0,99.99,4082.5,,,99.97,2048,,,99.38,4096,25.25,19.021,99.38,4096,23.85,17.042,6.92,9.18,9.54,0.25,0.29,0.24,0.15,0.14,0.10,1.95,1.41,1.16,1.32,1.21,1.16 +JSON to XML transformation HTTPS service,2G,1000,1024,0,HTTP Request,4176621,0,0,6959.06,143.61,53.62,2,736,173,213,242,279,305,393,13170.57,8202.72,94.66,2026,25.286,0,99.99,4078.5,,,99.98,2048,,,99.61,4096,22.35,14.92,99.58,4096,27.3,21.92,14.90,13.01,11.41,0.08,0.15,0.18,0.01,0.04,0.07,1.43,1.21,1.08,0.42,0.69,0.86 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,100,50,0,HTTP2 Request,9687951,0,0,16156.52,6.04,8.36,0,230,6,13,19,32,45,84,1846.01,0,99.47,2045.5,24.616,0,99.99,4090.5,,,99.96,2048,,,99.23,4096,13.45,2534.271,99.23,4096,11.75,72.125,5.82,8.60,8.72,0.40,0.33,0.29,0.24,0.19,0.18,2.18,2.97,5.25,3.51,3.35,4.61 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,100,1024,0,HTTP2 Request,9356979,0,0,15604.33,6.15,7.15,0,178,7,14,20,27,35,63,1813.39,0,99.44,2046,24.625,0,99.99,4090,,,99.93,2048,,,99.24,4096,10.482,1763.524,99.21,4096,12.8,1593.112,4.64,7.97,8.47,0.26,0.23,0.22,0.17,0.25,0.21,5.68,5.01,4.84,2.72,3.55,3.90 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,300,50,0,HTTP2 Request,9876706,0,0,16468.83,17.88,14.04,0,286,22,31,42,63,78,125,1881.69,0,98.86,2042.5,24.831,0,99.99,4090.5,,,99.96,2048,,,99.13,4096,15.8,5937.576,99.15,4096,10.559,1652.509,3.83,8.23,8.81,0.25,0.28,0.22,0.08,0.17,0.18,4.98,4.82,4.54,4.36,4.29,3.98 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,300,1024,0,HTTP2 Request,9479941,0,0,15810.44,18.19,13.39,0,236,22,32,42,59,72,116,1837.35,0,98.76,2042.5,25.072,0,99.99,4090.5,,,99.92,2048,,,99.1,4096,12.65,1375.323,99.08,4096,12.35,941.159,8.07,9.44,9.31,0.29,0.26,0.20,0.41,0.33,0.28,13.53,9.47,7.34,6.09,8.14,6.80 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,1000,50,0,HTTP2 Request,9195842,0,0,15332.36,64.45,29.44,0,422,78,101,120,146,166,225,1751.84,0,96.51,2034.5,25.738,0,99.99,4088.5,,,99.96,2048,,,98.9,4096,13.95,3258.348,98.86,4096,17.3,8109.808,6.00,9.03,9.37,0.60,0.56,0.41,0.21,0.18,0.22,9.89,8.63,7.55,7.19,8.05,7.41 +Passthrough HTTP/2(over TLS) service (h2 -> h1c),2G,1000,1024,0,HTTP2 Request,8795129,0,0,14665.88,65.97,30.56,0,452,80,104,123,151,171,232,1704.34,0,96.9,2034,25.742,0,99.99,4088.5,,,99.93,2048,,,98.71,4096,11.15,796.909,98.67,4096,11.8,144.957,4.74,8.71,9.30,0.25,0.32,0.34,0.19,0.26,0.26,20.59,18.10,14.10,24.64,25.14,17.81 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,100,50,0,HTTP2 Request,8587809,0,0,14321.75,6.84,6.27,0,189,9,15,19,24,29,58,1636.37,0,99.38,2045,24.638,0,99.99,4089,,,99.96,2048,,,99.34,4096,10.588,1610.082,99.3,4096,13.2,2172.232,8.51,9.09,9.01,0.46,0.42,0.42,0.17,0.19,0.22,2.75,2.94,6.27,1.83,2.54,6.52 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,100,1024,0,HTTP2 Request,7034672,0,0,11731.18,8.34,6.1,0,197,11,16,20,25,29,46,1363.29,0,99.53,2044.5,24.632,0,99.99,4087,,,99.94,2048,,,99.42,4096,10.85,1231.073,99.4,4096,11.45,362.039,5.80,8.15,8.46,0.22,0.24,0.30,0.17,0.19,0.18,2.23,2.43,3.75,2.05,2.18,3.58 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,300,50,0,HTTP2 Request,8855404,0,0,14767.84,20,12.22,0,210,25,34,42,55,66,98,1687.34,0,98.86,2041.5,24.857,0,99.99,4088.5,,,99.96,2048,,,99.24,4096,12.75,1520.28,99.19,4096,15.35,5285.623,4.15,7.87,8.45,0.33,0.34,0.33,0.20,0.17,0.17,3.15,3.63,3.71,3.75,4.06,3.74 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,300,1024,0,HTTP2 Request,7084514,0,0,11813.71,24.85,11.84,0,268,31,40,47,56,63,87,1372.88,0,98.96,2040,25.034,0,99.99,4086,,,99.94,2048,,,99.31,4096,13.4,2461.439,99.32,4096,10.652,1517.451,7.29,8.44,8.45,0.43,0.33,0.29,0.35,0.21,0.19,8.05,6.04,4.82,4.01,4.98,4.17 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,1000,50,0,HTTP2 Request,8171748,0,0,13623.51,72.79,30.49,0,386,88,112,130,153,171,222,1556.59,0,96.71,2030,25.758,0,99.99,4085.5,,,99.96,2048,,,99.03,4096,13.45,2534.271,98.98,4096,16.35,6733.778,5.24,8.30,8.54,0.50,0.48,0.37,0.18,0.16,0.17,11.99,9.21,6.77,6.14,6.25,5.39 +Passthrough HTTP/2(over TLS) service (h2 -> h1),2G,1000,1024,0,HTTP2 Request,6733351,0,0,11227.17,87.72,30.2,0,414,105,127,142,162,177,224,1304.72,0,97.01,2030,25.736,0,99.99,4082.5,,,99.94,2048,,,99.03,4096,11.65,72.832,98.99,4096,14,3330.473,9.33,9.05,8.70,0.52,0.40,0.34,0.34,0.23,0.19,14.45,12.41,10.04,13.83,9.41,7.58 +HTTP/2 client and server downgrade service (h2 -> h2),2G,100,50,0,HTTP Request,10740516,0,0,17899.31,5.54,8.28,0,221,5,11,17,30,46,89,3216.28,4072.79,99.48,2045.5,24.47,0,99.99,4091.5,,,99.95,2048,,,99.19,4096,11.7,144.957,99.18,4096,11.2,869.034,3.49,7.87,8.80,0.54,0.49,0.41,0.18,0.20,0.19,1.37,1.97,5.60,1.21,1.99,6.70 +HTTP/2 client and server downgrade service (h2 -> h2),2G,100,1024,0,HTTP Request,9538554,0,0,15896.56,6.24,6.9,0,352,8,15,19,26,31,65,18007.82,18768.49,99.54,2045.5,24.526,0,99.99,4089.5,,,99.96,2048,,,99.24,4096,15.25,4996.417,99.23,4096,14.95,4561.546,6.93,8.74,8.89,0.39,0.54,0.47,0.05,0.14,0.17,0.88,1.27,2.78,0.57,1.12,3.03 +HTTP/2 client and server downgrade service (h2 -> h2),2G,300,50,0,HTTP Request,11020608,0,0,18365.9,16.28,13.96,0,299,19,29,40,62,78,126,3300.12,4178.96,98.91,2041.5,24.677,0,99.99,4091,,,99.95,2048,,,99.13,4096,15.1,4779.335,99.13,4096,14.8,4344.464,5.92,9.11,9.08,0.31,0.37,0.40,0.22,0.22,0.19,1.93,1.84,1.98,1.32,1.50,2.02 +HTTP/2 client and server downgrade service (h2 -> h2),2G,300,1024,0,HTTP Request,9590010,0,0,15981.57,18.71,12.85,0,310,23,32,41,57,71,114,18104.12,18868.86,99.07,2041.5,24.67,0,99.99,4089.5,,,99.96,2048,,,99.22,4096,15.3,5068.541,99.23,4096,14.2,3475.43,4.30,8.73,9.28,0.25,0.38,0.36,0.11,0.16,0.19,2.08,2.36,2.13,1.83,2.22,2.12 +HTTP/2 client and server downgrade service (h2 -> h2),2G,1000,50,0,HTTP Request,9915810,0,0,16522.52,60.44,29.01,0,405,73,96,116,142,162,225,2968.89,3759.52,97.07,2033,25.624,0,99.99,4088,,,99.96,2048,,,99.11,4096,28.25,23.264,99.15,4096,26.95,21.425,10.38,10.81,10.31,0.45,0.41,0.39,0.22,0.19,0.18,1.88,1.94,1.93,1.09,1.99,2.02 +HTTP/2 client and server downgrade service (h2 -> h2),2G,1000,1024,0,HTTP Request,9153475,0,0,15252.08,65.49,28.68,1,363,79,102,120,144,161,219,17277.75,18007.58,97.31,2032,25.738,0,99.99,4087,,,99.96,2048,,,99.2,4096,22.3,14.849,99.18,4096,25.8,19.799,7.40,9.23,9.56,0.70,0.53,0.47,0.14,0.16,0.17,1.97,2.07,1.94,2.31,1.99,1.91 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,100,50,0,HTTP2 Request,9646946,0,0,16086.72,6.05,7.55,0,189,6,11,16,29,42,82,1838.03,0,99.54,2045.5,24.646,0,99.99,4095,14.126,0,99.96,2048,,,99.22,4096,13.25,2244.357,99.24,4096,10.295,2034.346,6.08,8.57,9.47,0.51,0.46,0.34,0.02,0.07,0.08,1.88,2.72,2.21,2.92,2.42,1.85 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,100,1024,0,HTTP2 Request,9344541,0,0,15583.4,6.15,7.62,0,279,6,12,17,29,42,82,1810.96,0,99.58,2045.5,24.647,0,99.99,4094.5,13.889,0,99.93,2048,,,99.24,4096,10.62,1564.12,99.21,4096,13.15,2099.4,4.55,8.45,9.01,0.48,0.60,0.48,0.29,0.29,0.21,5.48,4.74,3.52,5.40,4.65,3.54 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,300,50,0,HTTP2 Request,10318644,0,0,17206.23,17.02,13.62,0,3175,21,30,40,60,75,121,1965.95,0,99.09,2042.5,24.903,0,99.99,4095,15.052,0,99.96,2048,,,99.14,4096,10.95,1086.116,99.07,4096,15.55,5575.537,3.27,7.86,8.83,0.51,0.53,0.48,0.15,0.17,0.18,6.04,4.53,3.88,3.87,4.28,4.11 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,300,1024,0,HTTP2 Request,9765117,0,0,16283.55,17.58,13.54,0,252,22,31,41,60,73,120,1892.33,0,99.14,2042.5,25.06,0,99.99,4095,15.034,0,99.92,2048,,,99.08,4096,12.3,869.034,99.05,4096,13.2,2172.232,7.57,9.50,9.39,0.68,0.79,0.65,0.29,0.30,0.27,8.92,9.67,7.61,10.36,11.17,8.58 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,1000,50,0,HTTP2 Request,10078409,0,0,16804.94,58.5,29.14,0,2148,70,90,109,137,158,227,1920.1,0,97.29,2036.5,25.746,0,99.99,4094.5,15.1,0,99.95,2048,,,98.82,4096,11.45,362.039,98.75,4096,14.95,4706.503,5.90,9.10,9.27,0.77,0.60,0.57,0.10,0.18,0.22,6.84,9.41,8.64,11.85,12.08,10.39 +Passthrough HTTP/2(over TLS) service (h2 -> h2),2G,1000,1024,0,HTTP2 Request,9522130,0,0,15878.26,61.45,34.3,0,2890,74,98,118,147,168,234,1845.23,0,97.48,2036,25.756,0,99.99,4094.5,15.042,0,99.92,2048,,,98.61,4096,11.05,941.159,98.55,4096,14.35,3837.469,4.71,8.71,9.19,0.58,0.57,0.54,0.39,0.35,0.29,14.90,16.81,14.31,31.75,22.58,15.93 diff --git a/performance/benchmarks/summary.md b/performance/benchmarks/summary.md index 77482e6711eb..d98471538500 100644 --- a/performance/benchmarks/summary.md +++ b/performance/benchmarks/summary.md @@ -4,11 +4,14 @@ During each release, we execute various automated performance test scenarios and | Test Scenarios | Description | | --- | --- | -| Passthrough HTTP service | An HTTP Service, which forwards all requests to a back-end service. | -| Passthrough HTTPS service | An HTTPS Service, which forwards all requests to an HTTPS back-end service. | -| JSON to XML transformation HTTP service | An HTTP Service, which transforms JSON requests to XML and then forwards all requests to a back-end service. | +| Passthrough HTTP service (h1c -> h1c) | An HTTP Service, which forwards all requests to an HTTP back-end service. | +| Passthrough HTTPS service (h1 -> h1) | An HTTPS Service, which forwards all requests to an HTTPS back-end service. | +| JSON to XML transformation HTTP service | An HTTP Service, which transforms JSON requests to XML and then forwards all requests to an HTTP back-end service. | | JSON to XML transformation HTTPS service | An HTTPS Service, which transforms JSON requests to XML and then forwards all requests to an HTTPS back-end service. | -| Passthrough HTTP2 (HTTPS) service | An HTTPS Service exposed over HTTP2 protocol, which forwards all requests to a back-end service. | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | An HTTPS Service exposed over HTTP/2 protocol, which forwards all requests to an HTTP/2(over TLS) back-end service. | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | An HTTPS Service exposed over HTTP/2 protocol, which forwards all requests to an HTTPS back-end service. | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | An HTTPS Service exposed over HTTP/2 protocol, which forwards all requests to an HTTP back-end service. | +| HTTP/2 client and server downgrade service (h2 -> h2) | An HTTP/2(with TLS) server accepts requests from an HTTP/1.1(with TLS) client and the HTTP/2(with TLS) client sends requests to an HTTP/1.1(with TLS) back-end service. Both the upstream and the downgrade connection is downgraded to HTTP/1.1(with TLS). | Our test client is [Apache JMeter](https://jmeter.apache.org/index.html). We test each scenario for a fixed duration of time. We split the test results into warmup and measurement parts and use the measurement part to compute the @@ -58,33 +61,51 @@ The following is the summary of performance test results collected for the measu | Scenario Name | Concurrent Users | Message Size (Bytes) | Back-end Service Delay (ms) | Error % | Throughput (Requests/sec) | Average Response Time (ms) | Standard Deviation of Response Time (ms) | 99th Percentile of Response Time (ms) | Ballerina GC Throughput (%) | Average Ballerina Memory Footprint After Full GC (M) | |---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| -| Passthrough HTTP2 (HTTPS) service | 100 | 50 | 0 | 0 | 15665.63 | 6.2 | 8.26 | 47 | 99.53 | 24.109 | -| Passthrough HTTP2 (HTTPS) service | 100 | 1024 | 0 | 0 | 14593.18 | 6.63 | 8.21 | 45 | 99.58 | 24.712 | -| Passthrough HTTP2 (HTTPS) service | 300 | 50 | 0 | 0 | 15944.22 | 18.34 | 16.45 | 85 | 98.99 | 24.979 | -| Passthrough HTTP2 (HTTPS) service | 300 | 1024 | 0 | 0 | 15075.02 | 19.29 | 15.56 | 80 | 99.1 | 25.166 | -| Passthrough HTTP2 (HTTPS) service | 1000 | 50 | 0 | 5.36 | 6711.43 | 148.46 | 215.5 | 1023 | 98.23 | 25.711 | -| Passthrough HTTP2 (HTTPS) service | 1000 | 1024 | 0 | 1.9 | 9504.14 | 103.83 | 162.46 | 931 | 98.02 | 25.968 | -| Passthrough HTTPS service | 100 | 50 | 0 | 0 | 18081.3 | 5.49 | 7.77 | 43 | 99.46 | 24.449 | -| Passthrough HTTPS service | 100 | 1024 | 0 | 0 | 14225.89 | 6.98 | 5.78 | 27 | 99.53 | 24.471 | -| Passthrough HTTPS service | 300 | 50 | 0 | 0 | 18507.84 | 16.15 | 13.64 | 77 | 98.83 | 24.938 | -| Passthrough HTTPS service | 300 | 1024 | 0 | 0 | 14733.57 | 20.29 | 11.6 | 62 | 98.96 | 25.046 | -| Passthrough HTTPS service | 1000 | 50 | 0 | 0.23 | 12385.44 | 76.84 | 1453.07 | 31 | 89.4 | 1421.063 | -| Passthrough HTTPS service | 1000 | 1024 | 0 | 0.3 | 9630.47 | 98.68 | 1645.7 | 32 | 88.76 | 1433.613 | -| Passthrough HTTP service | 100 | 50 | 0 | 0 | 19841.41 | 5 | 6.73 | 40 | 99.46 | | -| Passthrough HTTP service | 100 | 1024 | 0 | 0 | 18470.96 | 5.37 | 6.7 | 39 | 99.51 | | -| Passthrough HTTP service | 300 | 50 | 0 | 0 | 21858.84 | 13.67 | 11.55 | 68 | 98.72 | | -| Passthrough HTTP service | 300 | 1024 | 0 | 0 | 20256.05 | 14.75 | 12.46 | 74 | 98.83 | | -| Passthrough HTTP service | 1000 | 50 | 0 | 0 | 21109.8 | 47.29 | 23.87 | 144 | 96.14 | | -| Passthrough HTTP service | 1000 | 1024 | 0 | 0 | 19936.21 | 50.09 | 25.49 | 154 | 96.51 | | -| JSON to XML transformation HTTPS service | 100 | 50 | 0 | 0 | 11562.34 | 8.61 | 8.14 | 45 | 99.12 | 23.769 | -| JSON to XML transformation HTTPS service | 100 | 1024 | 0 | 0 | 7860.13 | 12.65 | 10.49 | 59 | 99.12 | 23.784 | -| JSON to XML transformation HTTPS service | 300 | 50 | 0 | 0 | 12588.22 | 23.78 | 16.47 | 95 | 97.82 | 24.23 | -| JSON to XML transformation HTTPS service | 300 | 1024 | 0 | 0 | 8219.21 | 36.44 | 19.95 | 113 | 97.81 | 24.284 | -| JSON to XML transformation HTTPS service | 1000 | 50 | 0 | 0.55 | 5408.41 | 176.11 | 2242.64 | 58 | 70.6 | 1650.731 | -| JSON to XML transformation HTTPS service | 1000 | 1024 | 0 | 1.18 | 2789.66 | 338.99 | 3065.47 | 30079 | 61.36 | 1795.115 | -| JSON to XML transformation HTTP service | 100 | 50 | 0 | 0 | 13519.63 | 7.36 | 8.8 | 44 | 99.07 | 24.005 | -| JSON to XML transformation HTTP service | 100 | 1024 | 0 | 0 | 9505.48 | 10.47 | 10.17 | 55 | 99.11 | 24.037 | -| JSON to XML transformation HTTP service | 300 | 50 | 0 | 0 | 14524.64 | 20.6 | 11.51 | 61 | 97.42 | 24.357 | -| JSON to XML transformation HTTP service | 300 | 1024 | 0 | 0 | 10253.01 | 29.2 | 11.9 | 68 | 97.58 | 24.235 | -| JSON to XML transformation HTTP service | 1000 | 50 | 0 | 0 | 13248.71 | 75.41 | 18.76 | 131 | 92.87 | 25.265 | -| JSON to XML transformation HTTP service | 1000 | 1024 | 0 | 0 | 9628.53 | 103.77 | 21.38 | 161 | 91.69 | 25.303 | +| Passthrough HTTP service (h1c -> h1c) | 100 | 50 | 0 | 0 | 19551.06 | 5.08 | 6.8 | 40 | 99.32 | 17.932 | +| Passthrough HTTP service (h1c -> h1c) | 100 | 1024 | 0 | 0 | 18266.21 | 5.43 | 6.89 | 42 | 99.3 | 18.296 | +| Passthrough HTTP service (h1c -> h1c) | 300 | 50 | 0 | 0 | 21009.27 | 14.23 | 11.91 | 71 | 98.71 | 21.28 | +| Passthrough HTTP service (h1c -> h1c) | 300 | 1024 | 0 | 0 | 19273.65 | 15.51 | 12.19 | 72 | 98.69 | 19.311 | +| Passthrough HTTP service (h1c -> h1c) | 1000 | 50 | 0 | 0 | 19593.92 | 50.97 | 26.11 | 154 | 96.44 | 17.535 | +| Passthrough HTTP service (h1c -> h1c) | 1000 | 1024 | 0 | 0 | 18602.3 | 53.69 | 26.91 | 157 | 96.68 | 17.71 | +| JSON to XML transformation HTTP service | 100 | 50 | 0 | 0 | 13379.95 | 7.43 | 8.04 | 39 | 99.18 | 24.48 | +| JSON to XML transformation HTTP service | 100 | 1024 | 0 | 0 | 9807.53 | 10.15 | 9.97 | 56 | 99.21 | 24.376 | +| JSON to XML transformation HTTP service | 300 | 50 | 0 | 0 | 14767.97 | 20.26 | 12.69 | 73 | 97.98 | 24.443 | +| JSON to XML transformation HTTP service | 300 | 1024 | 0 | 0 | 10512.62 | 28.48 | 16.4 | 94 | 97.96 | 24.497 | +| JSON to XML transformation HTTP service | 1000 | 50 | 0 | 0 | 13732.49 | 72.73 | 22.87 | 151 | 94.09 | 25.217 | +| JSON to XML transformation HTTP service | 1000 | 1024 | 0 | 0 | 10043.84 | 99.46 | 29.51 | 192 | 93.38 | 25.184 | +| Passthrough HTTPS service (h1 -> h1) | 100 | 50 | 0 | 0 | 17094.23 | 5.81 | 6.39 | 30 | 99.45 | 23.688 | +| Passthrough HTTPS service (h1 -> h1) | 100 | 1024 | 0 | 0 | 11890.07 | 8.36 | 6.19 | 28 | 99.54 | 23.655 | +| Passthrough HTTPS service (h1 -> h1) | 300 | 50 | 0 | 0 | 17211.22 | 17.37 | 12.73 | 71 | 98.85 | 23.963 | +| Passthrough HTTPS service (h1 -> h1) | 300 | 1024 | 0 | 0 | 12177.19 | 24.57 | 11.45 | 60 | 99.05 | 24.27 | +| Passthrough HTTPS service (h1 -> h1) | 1000 | 50 | 0 | 0 | 15508.13 | 64.41 | 29.08 | 162 | 96.87 | 25.175 | +| Passthrough HTTPS service (h1 -> h1) | 1000 | 1024 | 0 | 0 | 11540.54 | 86.57 | 28.75 | 170 | 97.33 | 25.178 | +| JSON to XML transformation HTTPS service | 100 | 50 | 0 | 0 | 11451.14 | 8.69 | 7.72 | 45 | 99.2 | 23.657 | +| JSON to XML transformation HTTPS service | 100 | 1024 | 0 | 0 | 7138.12 | 13.96 | 8.89 | 50 | 99.26 | 23.649 | +| JSON to XML transformation HTTPS service | 300 | 50 | 0 | 0 | 12596.14 | 23.76 | 15.49 | 89 | 98.07 | 23.952 | +| JSON to XML transformation HTTPS service | 300 | 1024 | 0 | 0 | 7318.24 | 40.93 | 20.81 | 116 | 98.22 | 24.199 | +| JSON to XML transformation HTTPS service | 1000 | 50 | 0 | 0 | 11827.86 | 84.48 | 34.53 | 208 | 94.48 | 25.248 | +| JSON to XML transformation HTTPS service | 1000 | 1024 | 0 | 0 | 6959.06 | 143.61 | 53.62 | 305 | 94.66 | 25.286 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 100 | 50 | 0 | 0 | 16156.52 | 6.04 | 8.36 | 45 | 99.47 | 24.616 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 100 | 1024 | 0 | 0 | 15604.33 | 6.15 | 7.15 | 35 | 99.44 | 24.625 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 300 | 50 | 0 | 0 | 16468.83 | 17.88 | 14.04 | 78 | 98.86 | 24.831 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 300 | 1024 | 0 | 0 | 15810.44 | 18.19 | 13.39 | 72 | 98.76 | 25.072 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 1000 | 50 | 0 | 0 | 15332.36 | 64.45 | 29.44 | 166 | 96.51 | 25.738 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1c) | 1000 | 1024 | 0 | 0 | 14665.88 | 65.97 | 30.56 | 171 | 96.9 | 25.742 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 100 | 50 | 0 | 0 | 14321.75 | 6.84 | 6.27 | 29 | 99.38 | 24.638 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 100 | 1024 | 0 | 0 | 11731.18 | 8.34 | 6.1 | 29 | 99.53 | 24.632 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 300 | 50 | 0 | 0 | 14767.84 | 20 | 12.22 | 66 | 98.86 | 24.857 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 300 | 1024 | 0 | 0 | 11813.71 | 24.85 | 11.84 | 63 | 98.96 | 25.034 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 1000 | 50 | 0 | 0 | 13623.51 | 72.79 | 30.49 | 171 | 96.71 | 25.758 | +| Passthrough HTTP/2(over TLS) service (h2 -> h1) | 1000 | 1024 | 0 | 0 | 11227.17 | 87.72 | 30.2 | 177 | 97.01 | 25.736 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 100 | 50 | 0 | 0 | 17899.31 | 5.54 | 8.28 | 46 | 99.48 | 24.47 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 100 | 1024 | 0 | 0 | 15896.56 | 6.24 | 6.9 | 31 | 99.54 | 24.526 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 300 | 50 | 0 | 0 | 18365.9 | 16.28 | 13.96 | 78 | 98.91 | 24.677 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 300 | 1024 | 0 | 0 | 15981.57 | 18.71 | 12.85 | 71 | 99.07 | 24.67 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 1000 | 50 | 0 | 0 | 16522.52 | 60.44 | 29.01 | 162 | 97.07 | 25.624 | +| HTTP/2 client and server downgrade service (h2 -> h2) | 1000 | 1024 | 0 | 0 | 15252.08 | 65.49 | 28.68 | 161 | 97.31 | 25.738 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 100 | 50 | 0 | 0 | 16086.72 | 6.05 | 7.55 | 42 | 99.54 | 24.646 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 100 | 1024 | 0 | 0 | 15583.4 | 6.15 | 7.62 | 42 | 99.58 | 24.647 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 300 | 50 | 0 | 0 | 17206.23 | 17.02 | 13.62 | 75 | 99.09 | 24.903 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 300 | 1024 | 0 | 0 | 16283.55 | 17.58 | 13.54 | 73 | 99.14 | 25.06 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 1000 | 50 | 0 | 0 | 16804.94 | 58.5 | 29.14 | 158 | 97.29 | 25.746 | +| Passthrough HTTP/2(over TLS) service (h2 -> h2) | 1000 | 1024 | 0 | 0 | 15878.26 | 61.45 | 34.3 | 168 | 97.48 | 25.756 |