Weekly benchmark report - 2022 #85

fcollonval · 2022-01-04T08:00:22Z

This issue gathers the results of the weekly scheduled benchmark tests.

Those test are run against JupyterLab master comparing the HEAD to the commit one week older than the HEAD; so every benchmark test is the evolution compared to the previous test.

For more information please refer to the documentation.

Older reports are in: #80

Report of January 2nd 2022

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1489 <- [1536 - 1558 - 1576] -> 2354	1021 <- [1110 - 1170 - 1205] -> 1415	1382 <- [1436 - 1452 - 1469] -> 1619	1654 <- [1708 - 1727 - 1753] -> 2094
expected	1511 <- [1547 - 1567 - 1586] -> 1751	1072 <- [1129 - 1185 - 1218] -> 1297	1389 <- [1440 - 1454 - 1469] -> 1516	1625 <- [1694 - 1719 - 1743] -> 2134
Mean relative change	-0.1% ± 1.2%	-1.1% ± 1.5%	0.0% ± 0.5%	1.0% ± 1.2%
switch-from-copy
`chromium`
actual	112 <- [145 - 181 - 226] -> 1678	53 <- [68 - 89 - 335] -> 503	54 <- [70 - 84 - 299] -> 565	34 <- [55 - 65 - 119] -> 250
expected	114 <- [149 - 185 - 222] -> 385	51 <- [66 - 81 - 292] -> 464	56 <- [72 - 83 - 415] -> 590	34 <- [54 - 62 - 119] -> 260
Mean relative change	11.1% ± 10.5%	5.7% ± 13.6%	-0.1% ± 14.8%	3.5% ± 9.7%
switch-to-copy
`chromium`
actual	112 <- [146 - 171 - 189] -> 262	48 <- [67 - 76 - 105] -> 262	51 <- [68 - 79 - 88] -> 224	29 <- [50 - 59 - 76] -> 190
expected	118 <- [144 - 175 - 189] -> 216	47 <- [63 - 70 - 82] -> 225	54 <- [67 - 75 - 83] -> 224	33 <- [52 - 59 - 70] -> 160
Mean relative change	0.9% ± 2.6%	18.1% ± 8.8%	5.5% ± 3.8%	0.7% ± 6.1%
switch-from-txt
`chromium`
actual	53 <- [116 - 147 - 162] -> 236	52 <- [63 - 69 - 83] -> 181	54 <- [67 - 75 - 84] -> 199	30 <- [55 - 63 - 75] -> 176
expected	65 <- [114 - 142 - 158] -> 201	53 <- [62 - 67 - 75] -> 144	54 <- [66 - 75 - 83] -> 186	30 <- [55 - 62 - 75] -> 163
Mean relative change	3.3% ± 3.3%	7.4% ± 4.0%	2.1% ± 3.4%	1.3% ± 5.5%
switch-to-txt
`chromium`
actual	40 <- [53 - 62 - 70] -> 233	36 <- [52 - 65 - 72] -> 142	49 <- [72 - 84 - 103] -> 220	23 <- [38 - 46 - 53] -> 93
expected	41 <- [51 - 62 - 71] -> 197	39 <- [53 - 66 - 73] -> 115	52 <- [73 - 85 - 102] -> 184	23 <- [40 - 49 - 56] -> 106
Mean relative change	3.2% ± 7.0%	-0.8% ± 3.7%	1.7% ± 5.3%	-6.6% ± 3.7%
close
`chromium`
actual	463 <- [558 - 577 - 599] -> 677	374 <- [395 - 410 - 421] -> 570	670 <- [687 - 695 - 710] -> 772	187 <- [197 - 204 - 214] -> 285
expected	469 <- [572 - 587 - 601] -> 658	379 <- [401 - 410 - 419] -> 442	670 <- [680 - 691 - 698] -> 746	184 <- [193 - 197 - 208] -> 281
Mean relative change	-1.2% ± 1.9%	0.8% ± 1.4%	1.3% ± 0.7%	2.4% ± 3.1%

Changes are computed with expected as reference.

Expected = 26335b4d936925a7cbbdf31a86fa8bd4495efa83 | Actual = 602b05399b0ca762613c8f560a49b15abdefee39
Go to action log
Changelog covered

Originally posted by @github-actions[bot] in #80 (comment)

The text was updated successfully, but these errors were encountered:

github-actions · 2022-01-09T05:47:13Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1761 <- [1793 - 1809 - 1833] -> 2097	1185 <- [1289 - 1341 - 1416] -> 1815	1600 <- [1644 - 1665 - 1688] -> 1932	1849 <- [1915 - 1939 - 1976] -> 2375
expected	1720 <- [1765 - 1788 - 1868] -> 2121	1189 <- [1296 - 1362 - 1431] -> 1689	1570 <- [1626 - 1643 - 1673] -> 1749	1888 <- [1953 - 1978 - 2022] -> 2435
Mean relative change	0.3% ± 0.9%	-0.3% ± 2.1%	1.2% ± 0.7%	-2.9% ± 1.3%
switch-from-copy
`chromium`
actual	138 <- [167 - 207 - 239] -> 471	58 <- [97 - 202 - 308] -> 567	58 <- [83 - 92 - 184] -> 616	42 <- [63 - 83 - 148] -> 267
expected	136 <- [181 - 202 - 231] -> 323	59 <- [87 - 172 - 295] -> 489	58 <- [81 - 89 - 200] -> 658	44 <- [63 - 81 - 149] -> 310
Mean relative change	2.4% ± 3.6%	5.7% ± 10.3%	-2.1% ± 15.0%	1.2% ± 8.4%
switch-to-copy
`chromium`
actual	96 <- [160 - 198 - 212] -> 280	58 <- [82 - 117 - 164] -> 348	56 <- [80 - 87 - 99] -> 256	34 <- [60 - 67 - 96] -> 204
expected	125 <- [162 - 190 - 204] -> 285	54 <- [79 - 92 - 139] -> 247	58 <- [77 - 85 - 94] -> 221	34 <- [58 - 64 - 84] -> 209
Mean relative change	2.1% ± 2.5%	14.0% ± 8.9%	5.6% ± 4.3%	3.5% ± 6.8%
switch-from-txt
`chromium`
actual	74 <- [167 - 175 - 182] -> 281	53 <- [72 - 81 - 113] -> 215	59 <- [79 - 85 - 91] -> 198	29 <- [60 - 66 - 84] -> 172
expected	72 <- [161 - 170 - 179] -> 215	56 <- [71 - 79 - 87] -> 204	58 <- [76 - 83 - 90] -> 120	31 <- [57 - 64 - 85] -> 190
Mean relative change	3.3% ± 1.6%	12.6% ± 5.7%	3.1% ± 2.5%	1.5% ± 6.2%
switch-to-txt
`chromium`
actual	47 <- [57 - 63 - 71] -> 253	44 <- [63 - 69 - 76] -> 220	54 <- [77 - 87 - 101] -> 247	24 <- [33 - 43 - 54] -> 147
expected	47 <- [59 - 64 - 74] -> 251	43 <- [64 - 70 - 79] -> 212	54 <- [76 - 85 - 105] -> 202	24 <- [33 - 41 - 50] -> 126
Mean relative change	-0.9% ± 7.1%	-2.9% ± 4.7%	1.5% ± 5.3%	5.6% ± 6.3%
close
`chromium`
actual	523 <- [653 - 671 - 685] -> 782	430 <- [447 - 470 - 494] -> 558	764 <- [792 - 800 - 810] -> 877	199 <- [216 - 232 - 253] -> 318
expected	536 <- [636 - 652 - 677] -> 737	419 <- [439 - 462 - 486] -> 536	737 <- [775 - 788 - 805] -> 857	200 <- [229 - 240 - 274] -> 331
Mean relative change	1.9% ± 1.9%	2.3% ± 1.9%	1.3% ± 0.8%	-4.4% ± 3.4%

Changes are computed with expected as reference.

Expected = ac52c5298601253c470fa5e9e010e7499d81cc4b | Actual = 4a9c1d52c760bde51e0af0ec60a46ac3053cb78c
Go to action log
Changelog covered

github-actions · 2022-01-23T05:05:43Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	1824 <- [1923 - 1974 - 2009] -> 2112	6687 <- [6946 - 7014 - 7104] -> 7555	10213 <- [11411 - 11510 - 11609] -> 12611	628 <- [750 - 761 - 769] -> 811
expected	1857 <- [1932 - 1960 - 1988] -> 2107	6760 <- [6950 - 7010 - 7092] -> 7558	10313 <- [11373 - 11476 - 11608] -> 12537	619 <- [749 - 763 - 770] -> 819
Mean relative change	0.1% ± 0.8%	0.3% ± 0.5%	-0.1% ± 1.1%	0.3% ± 1.3%

Changes are computed with expected as reference.

Expected = 50fa0047d63287005a2c3b1d8f5bfedfe56cde7e | Actual = 6d147b45ff340aa2517927ffce6e9761c3fcff38
Go to action log
Changelog covered

github-actions · 2022-01-23T06:10:39Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1892 <- [1984 - 2025 - 2091] -> 2356	1343 <- [1454 - 1529 - 1608] -> 1922	1852 <- [1944 - 1980 - 2037] -> 2321	2075 <- [2191 - 2223 - 2279] -> 2775
expected	2039 <- [2086 - 2120 - 2147] -> 2268	1386 <- [1513 - 1574 - 1641] -> 1771	1867 <- [1933 - 1961 - 2012] -> 2236	2121 <- [2210 - 2254 - 2315] -> 2702
Mean relative change	-3.2% ± 1.0%	-2.6% ± 1.7%	1.5% ± 1.1%	-0.7% ± 1.5%
switch-from-copy
`chromium`
actual	59 <- [92 - 220 - 267] -> 1820	64 <- [84 - 150 - 484] -> 662	63 <- [88 - 97 - 257] -> 724	43 <- [74 - 149 - 207] -> 437
expected	64 <- [87 - 215 - 278] -> 1782	62 <- [89 - 148 - 473] -> 742	66 <- [88 - 98 - 258] -> 793	48 <- [75 - 155 - 205] -> 369
Mean relative change	1.7% ± 11.0%	3.3% ± 12.7%	-1.1% ± 15.6%	0.2% ± 8.3%
switch-to-copy
`chromium`
actual	57 <- [78 - 93 - 161] -> 338	57 <- [79 - 124 - 268] -> 590	64 <- [85 - 91 - 99] -> 342	47 <- [69 - 79 - 143] -> 255
expected	58 <- [82 - 110 - 168] -> 285	55 <- [80 - 92 - 160] -> 510	66 <- [84 - 91 - 97] -> 307	47 <- [70 - 80 - 161] -> 254
Mean relative change	-7.1% ± 6.7%	14.4% ± 13.6%	3.2% ± 5.3%	-6.4% ± 7.2%
switch-from-txt
`chromium`
actual	55 <- [72 - 79 - 86] -> 243	53 <- [75 - 87 - 123] -> 346	68 <- [85 - 92 - 99] -> 249	45 <- [72 - 92 - 142] -> 235
expected	55 <- [76 - 81 - 91] -> 259	57 <- [79 - 87 - 110] -> 283	68 <- [83 - 90 - 96] -> 246	49 <- [71 - 95 - 146] -> 220
Mean relative change	-8.7% ± 5.3%	1.6% ± 7.5%	5.6% ± 3.7%	0.1% ± 6.6%
switch-to-txt
`chromium`
actual	43 <- [67 - 74 - 81] -> 340	40 <- [61 - 68 - 77] -> 301	52 <- [71 - 80 - 105] -> 235	22 <- [33 - 40 - 51] -> 151
expected	49 <- [67 - 73 - 80] -> 283	44 <- [63 - 70 - 78] -> 253	54 <- [73 - 81 - 107] -> 213	24 <- [34 - 41 - 54] -> 299
Mean relative change	3.5% ± 8.3%	-3.3% ± 8.0%	0.9% ± 5.1%	-10.2% ± 7.5%
close
`chromium`
actual	601 <- [680 - 733 - 767] -> 869	497 <- [538 - 551 - 573] -> 649	810 <- [863 - 878 - 905] -> 1005	232 <- [252 - 264 - 291] -> 377
expected	630 <- [694 - 768 - 787] -> 849	510 <- [553 - 574 - 587] -> 610	801 <- [877 - 892 - 913] -> 965	227 <- [254 - 272 - 302] -> 403
Mean relative change	-2.8% ± 2.2%	-2.4% ± 1.3%	-0.9% ± 1.1%	-2.6% ± 3.3%

Changes are computed with expected as reference.

Expected = 50fa0047d63287005a2c3b1d8f5bfedfe56cde7e | Actual = 6d147b45ff340aa2517927ffce6e9761c3fcff38
Go to action log
Changelog covered

github-actions · 2022-01-30T05:01:26Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	1700 <- [1828 - 1915 - 2427] -> 2814	6513 <- [6742 - 6809 - 6901] -> 7714	8163 <- [11256 - 11362 - 12206] -> 12763	602 <- [744 - 753 - 763] -> 814
expected	1761 <- [1867 - 1913 - 1949] -> 2056	6471 <- [6728 - 6781 - 6870] -> 7546	9203 <- [11156 - 11319 - 11514] -> 12458	618 <- [744 - 751 - 765] -> 791
Mean relative change	9.4% ± 3.6%	0.4% ± 0.6%	1.6% ± 1.8%	0.5% ± 1.2%

Changes are computed with expected as reference.

Expected = 8182f1e21635d7abfd295c17bc026144cf40531b | Actual = fb111de14646affddc972578abf3a5a3766a383d
Go to action log
Changelog covered

github-actions · 2022-01-30T05:12:59Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1501 <- [1525 - 1544 - 1564] -> 1872	1039 <- [1133 - 1168 - 1216] -> 1393	1397 <- [1440 - 1456 - 1477] -> 1702	1624 <- [1685 - 1716 - 1748] -> 1913
expected	1472 <- [1520 - 1536 - 1556] -> 1804	1062 <- [1121 - 1167 - 1212] -> 1328	1398 <- [1436 - 1452 - 1472] -> 1530	1612 <- [1679 - 1706 - 1728] -> 1899
Mean relative change	1.0% ± 0.8%	0.4% ± 1.4%	1.2% ± 0.8%	0.9% ± 0.8%
switch-from-copy
`chromium`
actual	49 <- [71 - 84 - 231] -> 1910	46 <- [66 - 81 - 398] -> 601	51 <- [77 - 85 - 335] -> 658	34 <- [56 - 67 - 144] -> 321
expected	49 <- [65 - 75 - 218] -> 1555	46 <- [64 - 75 - 387] -> 497	57 <- [73 - 83 - 432] -> 626	34 <- [55 - 65 - 137] -> 281
Mean relative change	26.1% ± 25.6%	9.2% ± 15.8%	-8.1% ± 13.6%	2.6% ± 10.0%
switch-to-copy
`chromium`
actual	47 <- [64 - 73 - 86] -> 271	47 <- [65 - 74 - 84] -> 522	54 <- [73 - 79 - 88] -> 233	32 <- [56 - 62 - 87] -> 178
expected	47 <- [64 - 70 - 77] -> 258	49 <- [62 - 69 - 78] -> 376	53 <- [69 - 77 - 84] -> 229	33 <- [52 - 59 - 78] -> 158
Mean relative change	13.8% ± 7.2%	13.1% ± 12.6%	6.9% ± 3.9%	8.9% ± 6.5%
switch-from-txt
`chromium`
actual	46 <- [63 - 72 - 78] -> 255	48 <- [61 - 70 - 81] -> 255	53 <- [72 - 78 - 86] -> 132	34 <- [56 - 65 - 77] -> 174
expected	45 <- [61 - 68 - 73] -> 187	46 <- [58 - 66 - 76] -> 213	55 <- [68 - 77 - 83] -> 175	35 <- [54 - 63 - 74] -> 162
Mean relative change	7.5% ± 4.2%	6.9% ± 6.7%	6.3% ± 2.7%	4.9% ± 5.1%
switch-to-txt
`chromium`
actual	37 <- [63 - 75 - 85] -> 283	36 <- [57 - 66 - 76] -> 257	52 <- [73 - 84 - 94] -> 152	20 <- [41 - 50 - 57] -> 84
expected	40 <- [60 - 75 - 82] -> 239	35 <- [53 - 63 - 75] -> 209	50 <- [72 - 83 - 94] -> 158	23 <- [44 - 50 - 55] -> 92
Mean relative change	5.4% ± 6.0%	3.8% ± 6.2%	0.2% ± 3.5%	-1.5% ± 3.4%
close
`chromium`
actual	476 <- [576 - 595 - 616] -> 726	387 <- [410 - 421 - 433] -> 544	669 <- [690 - 704 - 720] -> 793	191 <- [201 - 208 - 222] -> 292
expected	469 <- [573 - 589 - 603] -> 704	373 <- [400 - 412 - 419] -> 510	656 <- [684 - 696 - 703] -> 730	186 <- [199 - 204 - 212] -> 283
Mean relative change	2.2% ± 2.1%	3.0% ± 1.6%	1.6% ± 0.8%	5.6% ± 3.0%

Changes are computed with expected as reference.

Expected = 8182f1e21635d7abfd295c17bc026144cf40531b | Actual = fb111de14646affddc972578abf3a5a3766a383d
Go to action log
Changelog covered

github-actions · 2022-02-06T04:43:21Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	1584 <- [1671 - 1707 - 1728] -> 1806	5919 <- [6175 - 6450 - 6658] -> 6813	8691 <- [10449 - 10499 - 10581] -> 10737	607 <- [703 - 717 - 728] -> 751
expected	1596 <- [1692 - 1719 - 1745] -> 1788	5898 <- [6301 - 6411 - 6497] -> 6677	8584 <- [8768 - 9622 - 10492] -> 10701	608 <- [708 - 720 - 735] -> 774
Mean relative change	-0.8% ± 0.7%	0.6% ± 0.9%	7.9% ± 1.8%	-0.9% ± 1.1%

Changes are computed with expected as reference.

Expected = 70099bf9c3a26a842f391b3d476af8c8fe810080 | Actual = 917ea14b7c43850c52b7e46126bb8a2720021473
Go to action log
Changelog covered

github-actions · 2022-02-06T05:47:41Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1687 <- [1756 - 1770 - 1794] -> 1978	1207 <- [1303 - 1350 - 1405] -> 1691	1546 <- [1612 - 1630 - 1656] -> 1858	1816 <- [1880 - 1911 - 1934] -> 2159
expected	1714 <- [1778 - 1799 - 1825] -> 2003	1190 <- [1322 - 1369 - 1419] -> 1686	1583 <- [1634 - 1660 - 1691] -> 1808	1835 <- [1902 - 1925 - 1968] -> 2304
Mean relative change	-1.4% ± 0.7%	-0.5% ± 1.8%	-1.3% ± 0.8%	-1.4% ± 1.0%
switch-from-copy
`chromium`
actual	55 <- [80 - 153 - 250] -> 1848	59 <- [80 - 124 - 367] -> 602	63 <- [84 - 96 - 223] -> 665	44 <- [70 - 122 - 189] -> 305
expected	53 <- [85 - 167 - 252] -> 2108	60 <- [79 - 119 - 367] -> 664	65 <- [86 - 100 - 230] -> 642	37 <- [70 - 118 - 186] -> 316
Mean relative change	4.0% ± 20.4%	2.6% ± 12.7%	4.1% ± 15.5%	2.7% ± 8.4%
switch-to-copy
`chromium`
actual	54 <- [73 - 81 - 92] -> 295	49 <- [78 - 87 - 116] -> 538	60 <- [83 - 91 - 101] -> 219	43 <- [67 - 77 - 130] -> 220
expected	59 <- [73 - 82 - 90] -> 302	55 <- [78 - 90 - 117] -> 521	58 <- [81 - 90 - 98] -> 375	32 <- [64 - 74 - 120] -> 213
Mean relative change	-0.6% ± 7.7%	1.2% ± 12.2%	2.0% ± 3.7%	5.3% ± 7.7%
switch-from-txt
`chromium`
actual	50 <- [71 - 77 - 85] -> 226	53 <- [75 - 84 - 99] -> 315	66 <- [82 - 88 - 97] -> 198	45 <- [66 - 75 - 126] -> 214
expected	54 <- [70 - 78 - 84] -> 200	54 <- [73 - 83 - 96] -> 307	61 <- [81 - 88 - 97] -> 147	33 <- [64 - 76 - 121] -> 187
Mean relative change	0.4% ± 3.8%	4.2% ± 6.8%	1.5% ± 2.5%	5.0% ± 6.9%
switch-to-txt
`chromium`
actual	45 <- [67 - 76 - 84] -> 273	38 <- [62 - 70 - 79] -> 202	52 <- [79 - 87 - 96] -> 234	22 <- [33 - 41 - 53] -> 201
expected	48 <- [66 - 74 - 82] -> 308	42 <- [61 - 68 - 77] -> 255	54 <- [77 - 86 - 95] -> 232	22 <- [32 - 42 - 52] -> 134
Mean relative change	-2.4% ± 6.3%	3.3% ± 6.1%	2.2% ± 4.3%	1.3% ± 6.4%
close
`chromium`
actual	538 <- [647 - 668 - 686] -> 726	419 <- [459 - 472 - 491] -> 575	731 <- [780 - 796 - 819] -> 865	205 <- [231 - 244 - 258] -> 365
expected	554 <- [655 - 676 - 696] -> 747	431 <- [452 - 469 - 482] -> 578	746 <- [772 - 786 - 804] -> 870	210 <- [229 - 246 - 268] -> 350
Mean relative change	-1.1% ± 1.7%	0.7% ± 1.7%	1.3% ± 1.0%	-0.9% ± 3.3%

Changes are computed with expected as reference.

Expected = 70099bf9c3a26a842f391b3d476af8c8fe810080 | Actual = 917ea14b7c43850c52b7e46126bb8a2720021473
Go to action log
Changelog covered

github-actions · 2022-02-13T05:11:50Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	1828 <- [2163 - 2295 - 2363] -> 2494	6409 <- [6589 - 6684 - 6768] -> 6979	9868 <- [11854 - 12102 - 12293] -> 12979	611 <- [741 - 757 - 766] -> 785
expected	1890 <- [2152 - 2295 - 2358] -> 2498	6230 <- [6477 - 6584 - 6710] -> 6961	9908 <- [11847 - 12085 - 12301] -> 12704	619 <- [745 - 754 - 765] -> 796
Mean relative change	0.2% ± 2.0%	1.3% ± 0.6%	0.2% ± 1.4%	0.7% ± 1.3%

Changes are computed with expected as reference.

Expected = fc73254325aaf445678c411d53e736d3027f81a2 | Actual = c5df985383964b027e475e667d69a7e8facf42bb
Go to action log
Changelog covered

fcollonval · 2022-02-16T08:51:57Z

Benchmark tests have failed this weekend due to job timeout. After investigating this, the reason is due to a slow test machine rather than a performance degradation. This call for a different split up of the benchmark test (probably by doing all test for a given files but less files per batch).

github-actions · 2022-02-20T04:34:35Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	1520 <- [1569 - 1598 - 1625] -> 1710	5467 <- [5654 - 5812 - 5899] -> 6206	7781 <- [9440 - 9522 - 9606] -> 10007	593 <- [680 - 711 - 725] -> 749
expected	1506 <- [1576 - 1600 - 1621] -> 1770	5433 <- [5676 - 5787 - 5890] -> 6195	7715 <- [9379 - 9441 - 9504] -> 9660	579 <- [682 - 707 - 723] -> 742
Mean relative change	-0.1% ± 0.7%	0.2% ± 0.8%	1.9% ± 1.4%	0.9% ± 1.7%

Changes are computed with expected as reference.

Expected = 282a55461c81896778cb5841baed583efbd123b0 | Actual = 047fbe7c2772bc34503207b7724216f9e0bbcfc3
Go to action log
Changelog covered

github-actions · 2022-02-20T07:26:52Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1711 <- [1762 - 1789 - 1830] -> 2150	1180 <- [1337 - 1390 - 1457] -> 1805	1639 <- [1718 - 1763 - 1825] -> 2124	1741 <- [1845 - 1889 - 1943] -> 2457
expected	1761 <- [1822 - 1870 - 1925] -> 2273	1201 <- [1336 - 1390 - 1464] -> 1741	1610 <- [1674 - 1706 - 1753] -> 2046	1809 <- [1878 - 1909 - 1990] -> 2414
Mean relative change	-4.4% ± 1.3%	-0.8% ± 2.1%	3.3% ± 1.4%	-1.2% ± 1.8%
switch-from-copy
`chromium`
actual	47 <- [70 - 141 - 248] -> 1502	44 <- [58 - 87 - 388] -> 680	50 <- [70 - 78 - 259] -> 762	27 <- [40 - 48 - 178] -> 449
expected	42 <- [70 - 134 - 250] -> 1721	45 <- [60 - 84 - 383] -> 648	51 <- [68 - 77 - 255] -> 708	28 <- [39 - 61 - 159] -> 326
Mean relative change	-10.0% ± 16.3%	2.9% ± 15.3%	4.6% ± 17.4%	3.2% ± 13.3%
switch-to-copy
`chromium`
actual	47 <- [65 - 75 - 134] -> 264	40 <- [62 - 71 - 117] -> 465	45 <- [65 - 71 - 78] -> 246	29 <- [39 - 46 - 62] -> 239
expected	45 <- [64 - 76 - 141] -> 305	41 <- [61 - 72 - 123] -> 458	47 <- [66 - 71 - 78] -> 243	28 <- [39 - 46 - 57] -> 238
Mean relative change	-6.5% ± 7.7%	-6.5% ± 13.0%	-0.3% ± 6.0%	7.6% ± 10.0%
switch-from-txt
`chromium`
actual	42 <- [63 - 72 - 78] -> 245	39 <- [59 - 69 - 77] -> 292	47 <- [66 - 71 - 77] -> 199	27 <- [37 - 45 - 65] -> 189
expected	44 <- [62 - 69 - 76] -> 220	38 <- [59 - 70 - 78] -> 227	46 <- [65 - 70 - 75] -> 196	28 <- [37 - 44 - 63] -> 168
Mean relative change	3.5% ± 6.3%	-2.2% ± 7.7%	0.3% ± 3.6%	5.5% ± 7.4%
switch-to-txt
`chromium`
actual	38 <- [62 - 69 - 80] -> 358	35 <- [52 - 65 - 73] -> 238	43 <- [72 - 81 - 99] -> 235	22 <- [33 - 40 - 51] -> 160
expected	39 <- [63 - 71 - 81] -> 313	37 <- [53 - 66 - 74] -> 218	53 <- [74 - 83 - 107] -> 247	25 <- [34 - 42 - 53] -> 161
Mean relative change	0.5% ± 8.4%	0.7% ± 6.7%	-4.4% ± 5.0%	-1.5% ± 5.8%
close
`chromium`
actual	560 <- [650 - 692 - 745] -> 830	450 <- [488 - 507 - 545] -> 708	740 <- [780 - 800 - 831] -> 958	225 <- [242 - 254 - 272] -> 360
expected	549 <- [640 - 685 - 723] -> 808	450 <- [485 - 513 - 537] -> 663	727 <- [761 - 787 - 828] -> 961	224 <- [240 - 252 - 269] -> 336
Mean relative change	2.6% ± 2.6%	1.3% ± 2.5%	1.5% ± 1.6%	1.2% ± 2.6%

Changes are computed with expected as reference.

Expected = 282a55461c81896778cb5841baed583efbd123b0 | Actual = 047fbe7c2772bc34503207b7724216f9e0bbcfc3
Go to action log
Changelog covered

github-actions · 2022-02-27T06:06:56Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
search
`chromium`
actual	2028 <- [3513 - 3946 - 4120] -> 4474	8458 <- [8968 - 9204 - 9418] -> 10210	10425 <- [12720 - 12987 - 13969] -> 14534	665 <- [803 - 820 - 833] -> 896
expected	1985 <- [2122 - 2403 - 3924] -> 4228	8146 <- [9074 - 9191 - 9285] -> 9562	10163 <- [12647 - 12891 - 13898] -> 14155	637 <- [780 - 813 - 829] -> 862
Mean relative change	24.8% ± 8.8%	0.8% ± 1.0%	-0.1% ± 1.8%	1.9% ± 1.8%

Changes are computed with expected as reference.

Expected = c7b14eee863dc2b764378be5e9533ea2e7714d89 | Actual = 3aeb2747f886bdd59396af130bd060bf46861d28
Go to action log
Changelog covered

github-actions · 2022-02-27T07:31:54Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook	large_md_100_notebook	longOutput - A single output with 100x100 divs	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1716 <- [1854 - 1899 - 1972] -> 2339	1330 <- [1411 - 1462 - 1547] -> 1964	1583 <- [1710 - 1746 - 1797] -> 1981	1894 <- [2003 - 2063 - 2123] -> 2668
expected	1777 <- [1883 - 1923 - 1995] -> 2067	1254 <- [1431 - 1501 - 1579] -> 1872	1625 <- [1703 - 1748 - 1800] -> 2060	1882 <- [1994 - 2037 - 2104] -> 2342
Mean relative change	-0.7% ± 1.3%	-1.9% ± 2.2%	-0.1% ± 1.2%	1.7% ± 1.6%
switch-from-copy
`chromium`
actual	55 <- [76 - 163 - 275] -> 1981	47 <- [73 - 134 - 375] -> 596	57 <- [71 - 79 - 208] -> 699	31 <- [54 - 74 - 188] -> 367
expected	54 <- [76 - 156 - 273] -> 1831	53 <- [77 - 165 - 377] -> 688	58 <- [73 - 79 - 196] -> 710	28 <- [58 - 78 - 186] -> 340
Mean relative change	14.8% ± 19.5%	-2.6% ± 11.5%	1.0% ± 16.2%	1.3% ± 11.0%
switch-to-copy
`chromium`
actual	52 <- [73 - 145 - 205] -> 316	47 <- [70 - 78 - 132] -> 534	57 <- [69 - 74 - 80] -> 281	29 <- [45 - 64 - 89] -> 246
expected	52 <- [75 - 138 - 156] -> 302	47 <- [70 - 80 - 139] -> 485	57 <- [68 - 74 - 79] -> 280	30 <- [47 - 65 - 89] -> 239
Mean relative change	9.5% ± 8.4%	2.0% ± 12.0%	6.2% ± 6.4%	0.8% ± 9.2%
switch-from-txt
`chromium`
actual	51 <- [68 - 74 - 82] -> 247	46 <- [67 - 74 - 100] -> 226	58 <- [69 - 74 - 79] -> 258	28 <- [43 - 67 - 82] -> 244
expected	55 <- [70 - 75 - 82] -> 284	46 <- [67 - 75 - 106] -> 246	58 <- [69 - 74 - 80] -> 226	30 <- [55 - 69 - 91] -> 198
Mean relative change	2.1% ± 7.3%	-4.2% ± 6.8%	-0.7% ± 4.5%	-6.6% ± 7.4%
switch-to-txt
`chromium`
actual	49 <- [67 - 74 - 93] -> 309	41 <- [62 - 70 - 79] -> 287	57 <- [75 - 85 - 114] -> 255	23 <- [35 - 41 - 51] -> 185
expected	51 <- [66 - 73 - 82] -> 379	44 <- [63 - 71 - 82] -> 259	53 <- [76 - 87 - 123] -> 249	23 <- [33 - 41 - 55] -> 234
Mean relative change	3.5% ± 8.8%	-2.5% ± 7.2%	-3.9% ± 6.0%	-1.0% ± 8.3%
close
`chromium`
actual	595 <- [694 - 723 - 749] -> 899	421 <- [485 - 503 - 526] -> 571	758 <- [818 - 842 - 866] -> 983	230 <- [254 - 268 - 295] -> 356
expected	581 <- [695 - 731 - 756] -> 847	450 <- [484 - 504 - 530] -> 633	762 <- [825 - 847 - 886] -> 945	222 <- [250 - 270 - 292] -> 365
Mean relative change	-0.4% ± 1.8%	-0.9% ± 1.8%	-1.1% ± 1.4%	0.2% ± 2.8%

Changes are computed with expected as reference.

Expected = c7b14eee863dc2b764378be5e9533ea2e7714d89 | Actual = 3aeb2747f886bdd59396af130bd060bf46861d28
Go to action log
Changelog covered

github-actions · 2022-03-11T15:05:01Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1e4x100_notebook
open
`chromium`
actual	6339 <- [6339 - 6339 - 6339] -> 6339
expected	6339 <- [6339 - 6339 - 6339] -> 6339
Mean relative change	NaN% ± NaN%
switch-from-copy
`chromium`
actual	26 <- [31 - 37 - 78] -> 120
expected	26 <- [31 - 37 - 78] -> 120
Mean relative change	-129.3% ± NaN%
switch-to-copy
`chromium`
actual	85 <- [417 - 750 - 766] -> 782
expected	85 <- [417 - 750 - 766] -> 782
Mean relative change	-143.6% ± NaN%
switch-from-txt
`chromium`
actual	30 <- [32 - 33 - 37] -> 41
expected	30 <- [32 - 33 - 37] -> 41
Mean relative change	18.2% ± 63.0%
switch-to-txt
`chromium`
actual	40 <- [42 - 45 - 50] -> 55
expected	40 <- [42 - 45 - 50] -> 55
Mean relative change	19.3% ± 65.1%
close
`chromium`
actual	1496 <- [1496 - 1496 - 1496] -> 1496
expected	1496 <- [1496 - 1496 - 1496] -> 1496
Mean relative change	NaN% ± NaN%

Changes are computed with expected as reference.

Expected = 0e7268fdb753a90c70b34206fa954d83e5e6d0f2 | Actual = 5f4e3fabf33bed101e41708021a245ca59410511
Go to action log
Changelog covered

github-actions · 2022-03-11T16:09:21Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
actual	1985 <- [2085 - 2134 - 2216] -> 2399
expected	2027 <- [2107 - 2155 - 2218] -> 2421
Mean relative change	-0.6% ± 1.1%
switch-from-copy
`chromium`
actual	30 <- [41 - 66 - 206] -> 369
expected	30 <- [40 - 51 - 221] -> 466
Mean relative change	-1.0% ± 14.3%
switch-to-copy
`chromium`
actual	505 <- [507 - 509 - 513] -> 556
expected	505 <- [507 - 508 - 512] -> 559
Mean relative change	-0.0% ± 0.2%
switch-from-txt
`chromium`
actual	29 <- [39 - 43 - 54] -> 130
expected	29 <- [37 - 43 - 55] -> 209
Mean relative change	-3.3% ± 6.1%
switch-to-txt
`chromium`
actual	27 <- [37 - 43 - 48] -> 139
expected	26 <- [37 - 44 - 50] -> 146
Mean relative change	-4.2% ± 5.3%
search
`chromium`
actual	634 <- [743 - 807 - 828] -> 871
expected	640 <- [743 - 805 - 828] -> 896
Mean relative change	0.0% ± 2.3%
close
`chromium`
actual	255 <- [305 - 318 - 337] -> 398
expected	241 <- [303 - 318 - 339] -> 398
Mean relative change	0.4% ± 2.5%

Changes are computed with expected as reference.

Expected = 0e7268fdb753a90c70b34206fa954d83e5e6d0f2 | Actual = 5f4e3fabf33bed101e41708021a245ca59410511
Go to action log
Changelog covered

github-actions · 2022-03-11T16:47:44Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
actual	1052 <- [1177 - 1235 - 1281] -> 1407
expected	1097 <- [1216 - 1256 - 1300] -> 1406
Mean relative change	-1.9% ± 1.5%
switch-from-copy
`chromium`
actual	50 <- [66 - 77 - 227] -> 747
expected	49 <- [68 - 77 - 175] -> 596
Mean relative change	8.6% ± 15.9%
switch-to-copy
`chromium`
actual	504 <- [508 - 512 - 517] -> 594
expected	505 <- [509 - 512 - 516] -> 568
Mean relative change	0.2% ± 0.3%
switch-from-txt
`chromium`
actual	39 <- [52 - 64 - 71] -> 158
expected	41 <- [52 - 63 - 71] -> 139
Mean relative change	1.1% ± 3.2%
switch-to-txt
`chromium`
actual	39 <- [54 - 65 - 72] -> 112
expected	37 <- [53 - 63 - 70] -> 127
Mean relative change	1.6% ± 3.2%
search
`chromium`
actual	6934 <- [8437 - 8959 - 10058] -> 10736
expected	8054 <- [9449 - 9849 - 10089] -> 11678
Mean relative change	-5.6% ± 2.2%
close
`chromium`
actual	417 <- [483 - 499 - 512] -> 619
expected	424 <- [484 - 499 - 514] -> 722
Mean relative change	-1.4% ± 2.1%

Changes are computed with expected as reference.

Expected = 0e7268fdb753a90c70b34206fa954d83e5e6d0f2 | Actual = 5f4e3fabf33bed101e41708021a245ca59410511
Go to action log
Changelog covered

github-actions · 2022-03-11T17:18:06Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
actual	1729 <- [1783 - 1821 - 1853] -> 2116
expected	1694 <- [1770 - 1798 - 1829] -> 2370
Mean relative change	1.2% ± 1.1%
switch-from-copy
`chromium`
actual	49 <- [73 - 132 - 322] -> 2160
expected	49 <- [70 - 84 - 273] -> 1981
Mean relative change	35.2% ± 26.7%
switch-to-copy
`chromium`
actual	505 <- [510 - 515 - 527] -> 589
expected	505 <- [509 - 514 - 518] -> 559
Mean relative change	1.0% ± 0.4%
switch-from-txt
`chromium`
actual	50 <- [63 - 71 - 77] -> 228
expected	47 <- [63 - 69 - 76] -> 194
Mean relative change	7.4% ± 5.5%
switch-to-txt
`chromium`
actual	47 <- [65 - 72 - 82] -> 409
expected	45 <- [65 - 71 - 78] -> 236
Mean relative change	11.5% ± 7.3%
search
`chromium`
actual	2556 <- [3329 - 5392 - 6967] -> 9739
expected	2308 <- [2706 - 2970 - 3722] -> 6718
Mean relative change	64.1% ± 14.7%
close
`chromium`
actual	621 <- [688 - 720 - 781] -> 1828
expected	627 <- [684 - 742 - 808] -> 995
Mean relative change	-0.7% ± 3.9%

Changes are computed with expected as reference.

Expected = 0e7268fdb753a90c70b34206fa954d83e5e6d0f2 | Actual = 5f4e3fabf33bed101e41708021a245ca59410511
Go to action log
Changelog covered

github-actions · 2022-03-11T18:37:21Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
actual	1868 <- [1962 - 2066 - 2151] -> 2617
expected	1943 <- [2066 - 2110 - 2155] -> 2344
Mean relative change	-1.4% ± 1.6%
switch-from-copy
`chromium`
actual	66 <- [80 - 123 - 214] -> 677
expected	61 <- [80 - 124 - 205] -> 564
Mean relative change	6.3% ± 11.0%
switch-to-copy
`chromium`
actual	507 <- [523 - 537 - 557] -> 689
expected	507 <- [527 - 535 - 548] -> 636
Mean relative change	0.9% ± 0.7%
switch-from-txt
`chromium`
actual	61 <- [73 - 80 - 99] -> 319
expected	62 <- [72 - 78 - 84] -> 268
Mean relative change	17.3% ± 7.3%
switch-to-txt
`chromium`
actual	57 <- [81 - 100 - 144] -> 338
expected	63 <- [79 - 87 - 136] -> 284
Mean relative change	13.0% ± 8.1%
search
`chromium`
actual	19493 <- [22308 - 23729 - 25038] -> 27307
expected	11478 <- [23479 - 24218 - 25459] -> 26614
Mean relative change	-1.8% ± 2.2%
close
`chromium`
actual	876 <- [929 - 964 - 1033] -> 1156
expected	902 <- [976 - 1001 - 1024] -> 1094
Mean relative change	-1.7% ± 1.5%

Changes are computed with expected as reference.

Expected = 0e7268fdb753a90c70b34206fa954d83e5e6d0f2 | Actual = 5f4e3fabf33bed101e41708021a245ca59410511
Go to action log
Changelog covered

github-actions · 2022-12-04T03:54:12Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	4831 <- [5239 - 5376 - 5506] -> 6189
expected	4785 <- [5210 - 5361 - 5464] -> 5950
Mean relative change	0.9% ± 1.3%
switch-from-copy
`chromium`
head	203 <- [259 - 300 - 513] -> 1604
expected	206 <- [247 - 272 - 452] -> 1223
Mean relative change	12.8% ± 11.2%
switch-to-copy
`chromium`
head	504 <- [505 - 507 - 511] -> 1098
expected	504 <- [507 - 509 - 517] -> 993
Mean relative change	-0.1% ± 2.3%
switch-from-txt
`chromium`
head	116 <- [138 - 151 - 165] -> 575
expected	100 <- [130 - 140 - 152] -> 192
Mean relative change	9.0% ± 2.9%
switch-to-txt
`chromium`
head	109 <- [128 - 143 - 162] -> 231
expected	98 <- [125 - 134 - 146] -> 207
Mean relative change	9.6% ± 2.6%
close
`chromium`
head	297 <- [337 - 355 - 387] -> 552
expected	274 <- [331 - 347 - 367] -> 1023
Mean relative change	4.3% ± 5.0%

Changes are computed with expected as reference.

Expected = e0310f67a7c42a969b4dd433afe2ceb7114c9b3a | Actual = 6efbd56dcc8b58e799036760d4a7862233803037
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-04 03:54:12.209078000 +0000
+++ /dev/fd/62	2022-12-04 03:54:12.209078000 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-04T05:27:52Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1265 <- [1337 - 1384 - 1442] -> 1635
expected	1290 <- [1351 - 1380 - 1424] -> 1602
Mean relative change	0.4% ± 1.4%
switch-from-copy
`chromium`
head	729 <- [791 - 840 - 907] -> 1228
expected	764 <- [817 - 859 - 907] -> 1239
Mean relative change	-1.0% ± 1.5%
switch-to-copy
`chromium`
head	832 <- [902 - 944 - 1001] -> 1270
expected	847 <- [914 - 948 - 1013] -> 1263
Mean relative change	-1.1% ± 1.3%
switch-from-txt
`chromium`
head	159 <- [185 - 195 - 208] -> 367
expected	153 <- [182 - 192 - 205] -> 300
Mean relative change	1.8% ± 1.8%
switch-to-txt
`chromium`
head	686 <- [743 - 788 - 850] -> 1061
expected	697 <- [751 - 790 - 859] -> 1076
Mean relative change	-0.5% ± 1.5%
search
`chromium`
head	18966 <- [22637 - 22951 - 24457] -> 26575
expected	20843 <- [22908 - 23256 - 24498] -> 25580
Mean relative change	-1.2% ± 1.5%
close
`chromium`
head	268 <- [301 - 319 - 336] -> 394
expected	267 <- [313 - 324 - 336] -> 412
Mean relative change	-2.0% ± 2.1%

Changes are computed with expected as reference.

Expected = e0310f67a7c42a969b4dd433afe2ceb7114c9b3a | Actual = 6efbd56dcc8b58e799036760d4a7862233803037
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-04 05:27:51.825478347 +0000
+++ /dev/fd/62	2022-12-04 05:27:51.825478347 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-11T02:50:24Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
head	454 <- [498 - 514 - 533] -> 648
expected	449 <- [494 - 519 - 547] -> 686
Mean relative change	-1.2% ± 2.1%
switch-from-copy
`chromium`
head	113 <- [146 - 158 - 275] -> 440
expected	122 <- [143 - 159 - 275] -> 417
Mean relative change	2.1% ± 6.9%
switch-to-copy
`chromium`
head	503 <- [506 - 510 - 514] -> 543
expected	503 <- [505 - 509 - 513] -> 547
Mean relative change	0.2% ± 0.2%
switch-from-txt
`chromium`
head	60 <- [96 - 102 - 115] -> 160
expected	48 <- [93 - 101 - 113] -> 153
Mean relative change	3.5% ± 2.6%
switch-to-txt
`chromium`
head	95 <- [109 - 116 - 125] -> 186
expected	95 <- [110 - 117 - 125] -> 181
Mean relative change	0.3% ± 1.9%
search
`chromium`
head	653 <- [788 - 792 - 803] -> 858
expected	712 <- [787 - 791 - 804] -> 972
Mean relative change	-0.5% ± 1.1%
close
`chromium`
head	151 <- [176 - 192 - 217] -> 288
expected	151 <- [174 - 187 - 207] -> 282
Mean relative change	3.5% ± 4.3%

Changes are computed with expected as reference.

Expected = 9b48cdb6086a2bef9964da96e9d7f8fde214dcfe | Actual = e658b6f28e3501968e7fe8e211677c5378be14d0
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-11 02:50:24.142053581 +0000
+++ /dev/fd/62	2022-12-11 02:50:24.142053581 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-11T02:52:50Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
head	417 <- [456 - 472 - 498] -> 606
expected	425 <- [458 - 479 - 506] -> 579
Mean relative change	-1.2% ± 2.0%
switch-from-copy
`chromium`
head	111 <- [143 - 157 - 231] -> 606
expected	119 <- [145 - 159 - 238] -> 538
Mean relative change	-2.1% ± 6.8%
switch-to-copy
`chromium`
head	503 <- [506 - 508 - 512] -> 547
expected	502 <- [505 - 509 - 512] -> 544
Mean relative change	-0.0% ± 0.2%
switch-from-txt
`chromium`
head	41 <- [68 - 87 - 106] -> 153
expected	36 <- [66 - 82 - 102] -> 166
Mean relative change	1.7% ± 4.7%
switch-to-txt
`chromium`
head	86 <- [106 - 113 - 123] -> 222
expected	92 <- [105 - 112 - 119] -> 182
Mean relative change	1.2% ± 2.1%
search
`chromium`
head	621 <- [673 - 719 - 739] -> 876
expected	621 <- [673 - 720 - 743] -> 853
Mean relative change	-0.4% ± 2.3%
close
`chromium`
head	144 <- [169 - 187 - 210] -> 324
expected	151 <- [172 - 186 - 201] -> 268
Mean relative change	2.2% ± 4.5%

Changes are computed with expected as reference.

Expected = 9b48cdb6086a2bef9964da96e9d7f8fde214dcfe | Actual = e658b6f28e3501968e7fe8e211677c5378be14d0
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-11 02:52:50.538505837 +0000
+++ /dev/fd/62	2022-12-11 02:52:50.538505837 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-11T03:02:51Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
head	764 <- [859 - 907 - 942] -> 1113
expected	758 <- [840 - 897 - 935] -> 1108
Mean relative change	1.7% ± 2.1%
switch-from-copy
`chromium`
head	204 <- [240 - 264 - 343] -> 787
expected	202 <- [240 - 267 - 339] -> 728
Mean relative change	1.2% ± 5.0%
switch-to-copy
`chromium`
head	503 <- [509 - 514 - 519] -> 572
expected	505 <- [509 - 513 - 519] -> 537
Mean relative change	0.2% ± 0.2%
switch-from-txt
`chromium`
head	100 <- [144 - 152 - 162] -> 271
expected	112 <- [140 - 149 - 160] -> 242
Mean relative change	1.6% ± 2.0%
switch-to-txt
`chromium`
head	205 <- [228 - 242 - 260] -> 345
expected	201 <- [225 - 240 - 254] -> 343
Mean relative change	1.8% ± 1.7%
search
`chromium`
head	665 <- [779 - 912 - 951] -> 1112
expected	657 <- [740 - 916 - 948] -> 1088
Mean relative change	1.1% ± 3.7%
close
`chromium`
head	226 <- [301 - 323 - 349] -> 482
expected	257 <- [288 - 308 - 327] -> 496
Mean relative change	5.4% ± 4.3%

Changes are computed with expected as reference.

Expected = 9b48cdb6086a2bef9964da96e9d7f8fde214dcfe | Actual = e658b6f28e3501968e7fe8e211677c5378be14d0
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-11 03:02:50.800095862 +0000
+++ /dev/fd/62	2022-12-11 03:02:50.800095862 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-11T03:30:29Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	3729 <- [3823 - 3938 - 4029] -> 4829
expected	4084 <- [4275 - 4345 - 4407] -> 4687
Mean relative change	-9.2% ± 0.9%
switch-from-copy
`chromium`
head	36 <- [174 - 215 - 335] -> 1112
expected	33 <- [213 - 233 - 354] -> 1176
Mean relative change	-11.1% ± 10.5%
switch-to-copy
`chromium`
head	503 <- [507 - 511 - 517] -> 866
expected	503 <- [505 - 506 - 509] -> 908
Mean relative change	-0.8% ± 1.8%
switch-from-txt
`chromium`
head	51 <- [92 - 110 - 119] -> 164
expected	45 <- [107 - 114 - 123] -> 199
Mean relative change	-7.4% ± 2.8%
switch-to-txt
`chromium`
head	24 <- [44 - 66 - 107] -> 190
expected	30 <- [55 - 98 - 115] -> 150
Mean relative change	-12.3% ± 5.9%
close
`chromium`
head	232 <- [267 - 284 - 308] -> 434
expected	269 <- [295 - 308 - 321] -> 375
Mean relative change	-4.6% ± 2.9%

Changes are computed with expected as reference.

Expected = 9b48cdb6086a2bef9964da96e9d7f8fde214dcfe | Actual = e658b6f28e3501968e7fe8e211677c5378be14d0
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-11 03:30:28.506325735 +0000
+++ /dev/fd/62	2022-12-11 03:30:28.506325735 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-11T05:02:58Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1123 <- [1161 - 1179 - 1196] -> 1279
expected	1114 <- [1148 - 1165 - 1184] -> 1265
Mean relative change	1.0% ± 0.7%
switch-from-copy
`chromium`
head	659 <- [693 - 711 - 787] -> 918
expected	662 <- [688 - 704 - 776] -> 909
Mean relative change	0.9% ± 1.2%
switch-to-copy
`chromium`
head	774 <- [850 - 883 - 907] -> 963
expected	782 <- [857 - 886 - 905] -> 956
Mean relative change	-0.4% ± 0.7%
switch-from-txt
`chromium`
head	148 <- [166 - 172 - 181] -> 208
expected	148 <- [169 - 176 - 187] -> 239
Mean relative change	-2.6% ± 1.1%
switch-to-txt
`chromium`
head	602 <- [633 - 645 - 708] -> 789
expected	597 <- [627 - 641 - 703] -> 779
Mean relative change	0.7% ± 1.1%
search
`chromium`
head	18490 <- [21900 - 22009 - 22203] -> 24157
expected	18242 <- [22087 - 22206 - 22321] -> 24269
Mean relative change	-1.7% ± 1.3%
close
`chromium`
head	264 <- [286 - 301 - 310] -> 347
expected	256 <- [290 - 299 - 311] -> 346
Mean relative change	0.1% ± 1.7%

Changes are computed with expected as reference.

Expected = 9b48cdb6086a2bef9964da96e9d7f8fde214dcfe | Actual = e658b6f28e3501968e7fe8e211677c5378be14d0
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-11 05:02:57.898141803 +0000
+++ /dev/fd/62	2022-12-11 05:02:57.898141803 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "108.0.5359.29"

github-actions · 2022-12-18T02:55:27Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
head	511 <- [562 - 583 - 601] -> 804
expected	501 <- [542 - 557 - 581] -> 774
Mean relative change	4.8% ± 2.4%
switch-from-copy
`chromium`
head	155 <- [187 - 203 - 275] -> 711
expected	134 <- [178 - 192 - 250] -> 673
Mean relative change	6.5% ± 5.9%
switch-to-copy
`chromium`
head	504 <- [508 - 513 - 519] -> 582
expected	504 <- [507 - 512 - 517] -> 578
Mean relative change	0.3% ± 0.3%
switch-from-txt
`chromium`
head	98 <- [128 - 135 - 144] -> 279
expected	92 <- [121 - 129 - 138] -> 177
Mean relative change	6.6% ± 2.0%
switch-to-txt
`chromium`
head	102 <- [133 - 145 - 156] -> 226
expected	111 <- [127 - 137 - 149] -> 203
Mean relative change	5.9% ± 2.3%
search
`chromium`
head	632 <- [821 - 835 - 859] -> 969
expected	627 <- [817 - 834 - 848] -> 964
Mean relative change	0.3% ± 1.5%
close
`chromium`
head	206 <- [228 - 243 - 279] -> 362
expected	199 <- [223 - 232 - 247] -> 382
Mean relative change	6.3% ± 4.0%

Changes are computed with expected as reference.

Expected = 53f3ced235e1e8fddb2e6056faaae02aae4ba942 | Actual = f15709ff42dcde127fef1ccedc1ae6a078413d5e
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-18 02:55:27.298954199 +0000
+++ /dev/fd/62	2022-12-18 02:55:27.298954199 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-18T03:01:21Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
head	425 <- [472 - 485 - 509] -> 602
expected	438 <- [473 - 492 - 521] -> 632
Mean relative change	-1.8% ± 1.9%
switch-from-copy
`chromium`
head	296 <- [319 - 371 - 655] -> 1262
expected	281 <- [322 - 364 - 677] -> 1609
Mean relative change	-0.9% ± 8.2%
switch-to-copy
`chromium`
head	504 <- [515 - 522 - 532] -> 607
expected	505 <- [515 - 521 - 531] -> 621
Mean relative change	0.2% ± 0.6%
switch-from-txt
`chromium`
head	117 <- [141 - 153 - 180] -> 399
expected	117 <- [143 - 154 - 187] -> 334
Mean relative change	-0.3% ± 4.0%
switch-to-txt
`chromium`
head	151 <- [177 - 188 - 204] -> 390
expected	150 <- [173 - 184 - 199] -> 287
Mean relative change	2.2% ± 2.3%
search
`chromium`
head	673 <- [915 - 923 - 953] -> 1136
expected	708 <- [910 - 922 - 939] -> 1044
Mean relative change	1.3% ± 2.0%
close
`chromium`
head	192 <- [216 - 230 - 245] -> 403
expected	174 <- [210 - 226 - 238] -> 368
Mean relative change	5.1% ± 4.3%

Changes are computed with expected as reference.

Expected = 53f3ced235e1e8fddb2e6056faaae02aae4ba942 | Actual = f15709ff42dcde127fef1ccedc1ae6a078413d5e
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-18 03:01:21.417396821 +0000
+++ /dev/fd/62	2022-12-18 03:01:21.417396821 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-18T03:10:22Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
head	757 <- [850 - 889 - 927] -> 1212
expected	731 <- [817 - 847 - 893] -> 1179
Mean relative change	5.1% ± 2.5%
switch-from-copy
`chromium`
head	326 <- [381 - 428 - 630] -> 1149
expected	335 <- [378 - 426 - 628] -> 965
Mean relative change	0.4% ± 5.3%
switch-to-copy
`chromium`
head	506 <- [525 - 536 - 547] -> 650
expected	504 <- [526 - 535 - 548] -> 626
Mean relative change	-0.1% ± 0.5%
switch-from-txt
`chromium`
head	131 <- [167 - 183 - 330] -> 495
expected	136 <- [165 - 182 - 341] -> 428
Mean relative change	0.1% ± 6.2%
switch-to-txt
`chromium`
head	261 <- [301 - 319 - 399] -> 675
expected	256 <- [297 - 322 - 398] -> 622
Mean relative change	-0.3% ± 3.4%
search
`chromium`
head	1170 <- [1283 - 1334 - 1379] -> 1522
expected	1160 <- [1302 - 1332 - 1384] -> 1494
Mean relative change	-0.3% ± 1.5%
close
`chromium`
head	218 <- [256 - 267 - 282] -> 401
expected	220 <- [258 - 267 - 278] -> 392
Mean relative change	0.7% ± 2.6%

Changes are computed with expected as reference.

Expected = 53f3ced235e1e8fddb2e6056faaae02aae4ba942 | Actual = f15709ff42dcde127fef1ccedc1ae6a078413d5e
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-18 03:10:22.034305378 +0000
+++ /dev/fd/62	2022-12-18 03:10:22.034305378 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-18T03:33:26Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	4270 <- [4381 - 4510 - 4641] -> 4836
expected	4153 <- [4321 - 4407 - 4507] -> 4780
Mean relative change	2.1% ± 0.9%
switch-from-copy
`chromium`
head	165 <- [226 - 250 - 359] -> 1051
expected	145 <- [223 - 242 - 359] -> 1190
Mean relative change	1.6% ± 7.2%
switch-to-copy
`chromium`
head	504 <- [505 - 506 - 511] -> 905
expected	504 <- [505 - 506 - 511] -> 904
Mean relative change	0.8% ± 2.2%
switch-from-txt
`chromium`
head	76 <- [112 - 121 - 129] -> 151
expected	73 <- [108 - 116 - 125] -> 158
Mean relative change	2.9% ± 1.7%
switch-to-txt
`chromium`
head	38 <- [94 - 108 - 120] -> 176
expected	42 <- [93 - 106 - 118] -> 145
Mean relative change	2.3% ± 4.4%
close
`chromium`
head	267 <- [303 - 318 - 335] -> 396
expected	261 <- [296 - 314 - 325] -> 375
Mean relative change	2.5% ± 2.1%

Changes are computed with expected as reference.

Expected = 53f3ced235e1e8fddb2e6056faaae02aae4ba942 | Actual = f15709ff42dcde127fef1ccedc1ae6a078413d5e
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-18 03:33:25.734693044 +0000
+++ /dev/fd/62	2022-12-18 03:33:25.734693044 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-18T04:37:19Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1042 <- [1115 - 1140 - 1173] -> 1330
expected	1031 <- [1098 - 1121 - 1155] -> 1266
Mean relative change	1.4% ± 1.3%
switch-from-copy
`chromium`
head	605 <- [634 - 651 - 706] -> 821
expected	603 <- [636 - 655 - 705] -> 860
Mean relative change	-0.5% ± 1.1%
switch-to-copy
`chromium`
head	671 <- [697 - 707 - 721] -> 897
expected	666 <- [697 - 710 - 724] -> 807
Mean relative change	-0.2% ± 0.6%
switch-from-txt
`chromium`
head	116 <- [136 - 147 - 154] -> 218
expected	116 <- [135 - 147 - 154] -> 169
Mean relative change	0.7% ± 1.4%
switch-to-txt
`chromium`
head	562 <- [588 - 599 - 657] -> 776
expected	558 <- [589 - 601 - 650] -> 719
Mean relative change	0.0% ± 1.1%
search
`chromium`
head	17210 <- [18883 - 19000 - 20453] -> 21232
expected	17210 <- [18924 - 19061 - 20552] -> 20866
Mean relative change	-0.7% ± 1.4%
close
`chromium`
head	196 <- [234 - 245 - 254] -> 286
expected	200 <- [233 - 243 - 253] -> 273
Mean relative change	1.1% ± 2.0%

Changes are computed with expected as reference.

Expected = 53f3ced235e1e8fddb2e6056faaae02aae4ba942 | Actual = f15709ff42dcde127fef1ccedc1ae6a078413d5e
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-18 04:37:19.283023801 +0000
+++ /dev/fd/62	2022-12-18 04:37:19.283023801 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-25T02:53:55Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
head	495 <- [523 - 540 - 564] -> 718
expected	473 <- [521 - 547 - 564] -> 732
Mean relative change	-0.5% ± 2.3%
switch-from-copy
`chromium`
head	125 <- [169 - 185 - 267] -> 504
expected	129 <- [168 - 178 - 248] -> 496
Mean relative change	4.3% ± 5.3%
switch-to-copy
`chromium`
head	504 <- [506 - 511 - 516] -> 561
expected	504 <- [508 - 512 - 518] -> 546
Mean relative change	-0.2% ± 0.3%
switch-from-txt
`chromium`
head	84 <- [118 - 127 - 140] -> 326
expected	97 <- [114 - 120 - 128] -> 187
Mean relative change	10.7% ± 3.2%
switch-to-txt
`chromium`
head	100 <- [122 - 132 - 153] -> 279
expected	98 <- [119 - 129 - 139] -> 194
Mean relative change	8.1% ± 3.0%
search
`chromium`
head	632 <- [805 - 825 - 851] -> 978
expected	769 <- [798 - 805 - 823] -> 887
Mean relative change	2.2% ± 1.2%
close
`chromium`
head	182 <- [212 - 224 - 247] -> 341
expected	175 <- [198 - 210 - 230] -> 364
Mean relative change	7.6% ± 4.3%

Changes are computed with expected as reference.

Expected = 9809fd16741a16c996609bb06bea6e437b73d57f | Actual = 7b3d9e8588ba3426ddd51e6e888d2b80fb76d802
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-25 02:53:54.788687666 +0000
+++ /dev/fd/62	2022-12-25 02:53:54.788687666 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-25T02:59:00Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
head	423 <- [447 - 457 - 466] -> 538
expected	440 <- [473 - 493 - 519] -> 655
Mean relative change	-8.5% ± 1.7%
switch-from-copy
`chromium`
head	264 <- [295 - 334 - 612] -> 1071
expected	250 <- [303 - 334 - 625] -> 1096
Mean relative change	-2.4% ± 8.3%
switch-to-copy
`chromium`
head	503 <- [509 - 512 - 516] -> 563
expected	503 <- [508 - 511 - 516] -> 570
Mean relative change	0.1% ± 0.3%
switch-from-txt
`chromium`
head	88 <- [123 - 132 - 145] -> 265
expected	78 <- [119 - 128 - 140] -> 261
Mean relative change	4.2% ± 3.7%
switch-to-txt
`chromium`
head	140 <- [155 - 167 - 178] -> 294
expected	141 <- [156 - 168 - 179] -> 312
Mean relative change	-0.6% ± 1.9%
search
`chromium`
head	876 <- [889 - 905 - 930] -> 1045
expected	704 <- [895 - 910 - 934] -> 1102
Mean relative change	-0.1% ± 1.3%
close
`chromium`
head	151 <- [172 - 186 - 202] -> 236
expected	147 <- [183 - 195 - 208] -> 301
Mean relative change	-4.1% ± 2.9%

Changes are computed with expected as reference.

Expected = 9809fd16741a16c996609bb06bea6e437b73d57f | Actual = 7b3d9e8588ba3426ddd51e6e888d2b80fb76d802
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-25 02:59:00.413419960 +0000
+++ /dev/fd/62	2022-12-25 02:59:00.413419960 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-25T03:14:48Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
head	741 <- [871 - 910 - 940] -> 1243
expected	789 <- [870 - 904 - 945] -> 1318
Mean relative change	0.1% ± 2.7%
switch-from-copy
`chromium`
head	360 <- [395 - 443 - 636] -> 1105
expected	361 <- [393 - 441 - 650] -> 1086
Mean relative change	-0.1% ± 5.3%
switch-to-copy
`chromium`
head	506 <- [530 - 540 - 549] -> 693
expected	507 <- [529 - 540 - 550] -> 652
Mean relative change	-0.0% ± 0.6%
switch-from-txt
`chromium`
head	138 <- [173 - 187 - 343] -> 461
expected	140 <- [173 - 187 - 341] -> 435
Mean relative change	0.0% ± 6.1%
switch-to-txt
`chromium`
head	269 <- [307 - 325 - 405] -> 739
expected	263 <- [305 - 328 - 415] -> 641
Mean relative change	-0.5% ± 3.6%
search
`chromium`
head	1194 <- [1327 - 1386 - 1443] -> 1606
expected	1176 <- [1314 - 1354 - 1402] -> 1519
Mean relative change	2.3% ± 1.5%
close
`chromium`
head	248 <- [272 - 286 - 308] -> 425
expected	231 <- [273 - 285 - 301] -> 442
Mean relative change	-0.1% ± 3.8%

Changes are computed with expected as reference.

Expected = 9809fd16741a16c996609bb06bea6e437b73d57f | Actual = 7b3d9e8588ba3426ddd51e6e888d2b80fb76d802
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-25 03:14:48.272913653 +0000
+++ /dev/fd/62	2022-12-25 03:14:48.272913653 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-25T03:20:50Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	3624 <- [3727 - 3746 - 3773] -> 3923
expected	3708 <- [3774 - 3793 - 3828] -> 4094
Mean relative change	-1.4% ± 0.4%
switch-from-copy
`chromium`
head	32 <- [48 - 135 - 271] -> 665
expected	32 <- [49 - 72 - 277] -> 837
Mean relative change	-2.4% ± 12.5%
switch-to-copy
`chromium`
head	503 <- [506 - 508 - 513] -> 624
expected	503 <- [506 - 509 - 516] -> 640
Mean relative change	-0.6% ± 0.7%
switch-from-txt
`chromium`
head	36 <- [56 - 62 - 79] -> 415
expected	33 <- [57 - 62 - 81] -> 116
Mean relative change	-1.8% ± 5.2%
switch-to-txt
`chromium`
head	28 <- [43 - 48 - 52] -> 280
expected	26 <- [42 - 47 - 52] -> 120
Mean relative change	5.9% ± 6.0%
close
`chromium`
head	217 <- [232 - 242 - 251] -> 675
expected	217 <- [231 - 243 - 253] -> 292
Mean relative change	2.1% ± 4.0%

Changes are computed with expected as reference.

Expected = 9809fd16741a16c996609bb06bea6e437b73d57f | Actual = 7b3d9e8588ba3426ddd51e6e888d2b80fb76d802
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-25 03:20:49.954455551 +0000
+++ /dev/fd/62	2022-12-25 03:20:49.954455551 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2022-12-25T05:32:18Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1206 <- [1284 - 1323 - 1380] -> 1681
expected	1258 <- [1303 - 1335 - 1390] -> 1694
Mean relative change	-0.7% ± 1.7%
switch-from-copy
`chromium`
head	740 <- [796 - 862 - 906] -> 1168
expected	757 <- [796 - 839 - 908] -> 1208
Mean relative change	0.5% ± 1.5%
switch-to-copy
`chromium`
head	868 <- [928 - 969 - 1020] -> 1278
expected	889 <- [981 - 1008 - 1046] -> 1220
Mean relative change	-3.5% ± 0.9%
switch-from-txt
`chromium`
head	164 <- [185 - 193 - 204] -> 252
expected	167 <- [186 - 195 - 205] -> 262
Mean relative change	-0.9% ± 1.2%
switch-to-txt
`chromium`
head	655 <- [713 - 746 - 824] -> 987
expected	693 <- [724 - 759 - 839] -> 1040
Mean relative change	-1.5% ± 1.5%
search
`chromium`
head	22649 <- [25062 - 25329 - 26148] -> 28412
expected	21961 <- [25813 - 26011 - 27733] -> 29001
Mean relative change	-3.0% ± 1.4%
close
`chromium`
head	269 <- [300 - 312 - 329] -> 353
expected	278 <- [309 - 322 - 335] -> 391
Mean relative change	-2.5% ± 1.7%

Changes are computed with expected as reference.

Expected = 9809fd16741a16c996609bb06bea6e437b73d57f | Actual = 7b3d9e8588ba3426ddd51e6e888d2b80fb76d802
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2022-12-25 05:32:18.088803483 +0000
+++ /dev/fd/62	2022-12-25 05:32:18.088803483 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-01T02:52:07Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
head	456 <- [489 - 504 - 514] -> 648
expected	451 <- [484 - 501 - 517] -> 637
Mean relative change	1.2% ± 1.8%
switch-from-copy
`chromium`
head	118 <- [150 - 166 - 224] -> 442
expected	108 <- [146 - 160 - 206] -> 370
Mean relative change	5.2% ± 4.8%
switch-to-copy
`chromium`
head	503 <- [506 - 509 - 513] -> 543
expected	503 <- [506 - 509 - 513] -> 546
Mean relative change	0.0% ± 0.2%
switch-from-txt
`chromium`
head	71 <- [100 - 112 - 123] -> 205
expected	48 <- [97 - 107 - 117] -> 212
Mean relative change	4.7% ± 3.2%
switch-to-txt
`chromium`
head	96 <- [111 - 120 - 134] -> 282
expected	92 <- [110 - 117 - 129] -> 230
Mean relative change	2.7% ± 3.4%
search
`chromium`
head	713 <- [794 - 805 - 832] -> 941
expected	757 <- [788 - 802 - 824] -> 914
Mean relative change	0.6% ± 1.2%
close
`chromium`
head	153 <- [171 - 187 - 210] -> 336
expected	148 <- [171 - 183 - 195] -> 272
Mean relative change	3.7% ± 4.4%

Changes are computed with expected as reference.

Expected = 552cdfe9314365d668c029e0863cf2fdbbbee4df | Actual = edc294b06fe6607be80094dd590cb9f766ab83ff
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-01 02:52:07.266007127 +0000
+++ /dev/fd/62	2023-01-01 02:52:07.266007127 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-01T03:06:33Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
head	675 <- [744 - 774 - 795] -> 873
expected	680 <- [755 - 774 - 794] -> 913
Mean relative change	-0.2% ± 1.4%
switch-from-copy
`chromium`
head	297 <- [329 - 363 - 556] -> 835
expected	294 <- [325 - 365 - 564] -> 947
Mean relative change	-0.5% ± 5.8%
switch-to-copy
`chromium`
head	503 <- [509 - 515 - 519] -> 562
expected	503 <- [510 - 515 - 519] -> 574
Mean relative change	0.1% ± 0.3%
switch-from-txt
`chromium`
head	125 <- [143 - 153 - 273] -> 403
expected	118 <- [145 - 155 - 276] -> 425
Mean relative change	-2.1% ± 6.0%
switch-to-txt
`chromium`
head	219 <- [247 - 266 - 330] -> 468
expected	220 <- [249 - 270 - 333] -> 473
Mean relative change	-1.3% ± 3.3%
search
`chromium`
head	1058 <- [1180 - 1235 - 1265] -> 1372
expected	1092 <- [1196 - 1235 - 1289] -> 1402
Mean relative change	-1.2% ± 1.4%
close
`chromium`
head	190 <- [214 - 225 - 238] -> 311
expected	185 <- [215 - 231 - 243] -> 334
Mean relative change	-0.9% ± 2.3%

Changes are computed with expected as reference.

Expected = 552cdfe9314365d668c029e0863cf2fdbbbee4df | Actual = edc294b06fe6607be80094dd590cb9f766ab83ff
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-01 03:06:33.169755124 +0000
+++ /dev/fd/62	2023-01-01 03:06:33.169755124 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-01T03:07:59Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
head	471 <- [503 - 517 - 531] -> 636
expected	451 <- [491 - 507 - 521] -> 567
Mean relative change	2.4% ± 1.3%
switch-from-copy
`chromium`
head	305 <- [342 - 387 - 725] -> 1632
expected	305 <- [340 - 387 - 697] -> 1253
Mean relative change	4.3% ± 8.6%
switch-to-copy
`chromium`
head	508 <- [529 - 541 - 552] -> 636
expected	506 <- [523 - 532 - 542] -> 648
Mean relative change	1.7% ± 0.6%
switch-from-txt
`chromium`
head	131 <- [157 - 169 - 201] -> 506
expected	126 <- [152 - 164 - 206] -> 446
Mean relative change	1.9% ± 4.9%
switch-to-txt
`chromium`
head	171 <- [194 - 203 - 224] -> 431
expected	165 <- [189 - 196 - 214] -> 363
Mean relative change	4.7% ± 2.2%
search
`chromium`
head	689 <- [792 - 839 - 974] -> 1119
expected	679 <- [808 - 947 - 978] -> 1234
Mean relative change	-4.4% ± 3.4%
close
`chromium`
head	202 <- [244 - 259 - 270] -> 376
expected	190 <- [227 - 242 - 256] -> 339
Mean relative change	6.2% ± 2.7%

Changes are computed with expected as reference.

Expected = 552cdfe9314365d668c029e0863cf2fdbbbee4df | Actual = edc294b06fe6607be80094dd590cb9f766ab83ff
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-01 03:07:58.779345450 +0000
+++ /dev/fd/62	2023-01-01 03:07:58.779345450 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-01T03:23:30Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	3704 <- [3760 - 3786 - 3815] -> 4065
expected	3706 <- [3754 - 3774 - 3794] -> 3873
Mean relative change	0.6% ± 0.4%
switch-from-copy
`chromium`
head	32 <- [49 - 160 - 274] -> 732
expected	31 <- [52 - 151 - 273] -> 492
Mean relative change	8.8% ± 12.6%
switch-to-copy
`chromium`
head	503 <- [505 - 509 - 515] -> 747
expected	503 <- [505 - 509 - 514] -> 641
Mean relative change	-0.0% ± 0.8%
switch-from-txt
`chromium`
head	34 <- [57 - 64 - 83] -> 140
expected	35 <- [57 - 64 - 79] -> 182
Mean relative change	4.5% ± 4.9%
switch-to-txt
`chromium`
head	27 <- [43 - 49 - 55] -> 272
expected	29 <- [41 - 46 - 52] -> 136
Mean relative change	13.8% ± 6.9%
close
`chromium`
head	218 <- [241 - 254 - 291] -> 369
expected	211 <- [234 - 245 - 257] -> 291
Mean relative change	8.3% ± 3.2%

Changes are computed with expected as reference.

Expected = 552cdfe9314365d668c029e0863cf2fdbbbee4df | Actual = edc294b06fe6607be80094dd590cb9f766ab83ff
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-01 03:23:30.022654717 +0000
+++ /dev/fd/62	2023-01-01 03:23:30.022654717 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-01T04:42:58Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1026 <- [1079 - 1101 - 1158] -> 1293
expected	1024 <- [1076 - 1098 - 1156] -> 1248
Mean relative change	0.1% ± 1.4%
switch-from-copy
`chromium`
head	603 <- [641 - 666 - 713] -> 817
expected	611 <- [647 - 673 - 713] -> 807
Mean relative change	-0.4% ± 1.0%
switch-to-copy
`chromium`
head	670 <- [703 - 719 - 735] -> 973
expected	676 <- [707 - 722 - 735] -> 818
Mean relative change	-0.2% ± 0.6%
switch-from-txt
`chromium`
head	118 <- [138 - 151 - 157] -> 189
expected	120 <- [140 - 151 - 156] -> 198
Mean relative change	0.0% ± 1.4%
switch-to-txt
`chromium`
head	565 <- [592 - 607 - 669] -> 784
expected	563 <- [589 - 598 - 660] -> 738
Mean relative change	1.9% ± 1.2%
search
`chromium`
head	17313 <- [19087 - 19207 - 20635] -> 21111
expected	17434 <- [19070 - 19223 - 20676] -> 21605
Mean relative change	0.5% ± 1.3%
close
`chromium`
head	208 <- [235 - 247 - 258] -> 304
expected	205 <- [240 - 254 - 263] -> 283
Mean relative change	-1.4% ± 2.0%

Changes are computed with expected as reference.

Expected = 552cdfe9314365d668c029e0863cf2fdbbbee4df | Actual = edc294b06fe6607be80094dd590cb9f766ab83ff
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-01 04:42:57.608381551 +0000
+++ /dev/fd/62	2023-01-01 04:42:57.608381551 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-08T03:20:07Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	errorOutputs - 10x100 errors output collected
open
`chromium`
head	713 <- [800 - 850 - 892] -> 1285
expected	717 <- [786 - 814 - 856] -> 974
Mean relative change	4.1% ± 2.5%
switch-from-copy
`chromium`
head	182 <- [238 - 258 - 400] -> 774
expected	208 <- [238 - 258 - 366] -> 661
Mean relative change	3.0% ± 5.7%
switch-to-copy
`chromium`
head	505 <- [515 - 523 - 533] -> 832
expected	506 <- [517 - 523 - 531] -> 632
Mean relative change	0.5% ± 0.7%
switch-from-txt
`chromium`
head	128 <- [165 - 179 - 193] -> 391
expected	136 <- [168 - 178 - 192] -> 352
Mean relative change	-0.2% ± 2.7%
switch-to-txt
`chromium`
head	152 <- [189 - 200 - 216] -> 416
expected	156 <- [188 - 198 - 216] -> 373
Mean relative change	2.2% ± 2.8%
search
`chromium`
head	708 <- [884 - 905 - 932] -> 1140
expected	727 <- [886 - 916 - 964] -> 1086
Mean relative change	-1.9% ± 1.9%
close
`chromium`
head	258 <- [305 - 324 - 347] -> 467
expected	254 <- [295 - 318 - 345] -> 414
Mean relative change	3.7% ± 3.3%

Changes are computed with expected as reference.

Expected = aa0f16fcb7de07e97976cfa75b2e8e51b4804e97 | Actual = 6d208970f0b950a1c75c0c08960c651b32a3cc0b
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-08 03:20:06.773072484 +0000
+++ /dev/fd/62	2023-01-08 03:20:06.773072484 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-08T03:25:30Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_md_100_notebook
open
`chromium`
head	872 <- [944 - 969 - 1012] -> 1101
expected	833 <- [944 - 984 - 1032] -> 1208
Mean relative change	-1.2% ± 1.6%
switch-from-copy
`chromium`
head	374 <- [446 - 496 - 715] -> 1116
expected	398 <- [438 - 484 - 709] -> 1126
Mean relative change	1.4% ± 5.1%
switch-to-copy
`chromium`
head	515 <- [558 - 573 - 597] -> 735
expected	507 <- [551 - 567 - 584] -> 731
Mean relative change	2.1% ± 1.0%
switch-from-txt
`chromium`
head	141 <- [192 - 209 - 363] -> 511
expected	157 <- [185 - 204 - 399] -> 554
Mean relative change	-1.8% ± 6.1%
switch-to-txt
`chromium`
head	295 <- [353 - 386 - 497] -> 813
expected	296 <- [346 - 372 - 474] -> 715
Mean relative change	4.2% ± 3.8%
search
`chromium`
head	1257 <- [1422 - 1475 - 1545] -> 1696
expected	1289 <- [1399 - 1455 - 1517] -> 1710
Mean relative change	0.9% ± 1.8%
close
`chromium`
head	251 <- [288 - 303 - 319] -> 381
expected	250 <- [283 - 297 - 308] -> 376
Mean relative change	2.1% ± 2.1%

Changes are computed with expected as reference.

Expected = aa0f16fcb7de07e97976cfa75b2e8e51b4804e97 | Actual = 6d208970f0b950a1c75c0c08960c651b32a3cc0b
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-08 03:25:29.891022517 +0000
+++ /dev/fd/62	2023-01-08 03:25:29.891022517 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-08T03:32:47Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_code_100_notebook
open
`chromium`
head	591 <- [650 - 670 - 690] -> 816
expected	602 <- [645 - 669 - 693] -> 839
Mean relative change	0.3% ± 1.6%
switch-from-copy
`chromium`
head	444 <- [475 - 512 - 984] -> 1838
expected	445 <- [482 - 509 - 1013] -> 1762
Mean relative change	-1.8% ± 8.4%
switch-to-copy
`chromium`
head	528 <- [613 - 634 - 655] -> 795
expected	526 <- [615 - 640 - 661] -> 825
Mean relative change	-0.9% ± 0.9%
switch-from-txt
`chromium`
head	157 <- [189 - 205 - 253] -> 540
expected	156 <- [191 - 206 - 230] -> 605
Mean relative change	2.7% ± 5.1%
switch-to-txt
`chromium`
head	219 <- [255 - 269 - 290] -> 457
expected	218 <- [259 - 275 - 293] -> 539
Mean relative change	-1.6% ± 1.8%
search
`chromium`
head	976 <- [1033 - 1066 - 1103] -> 1400
expected	916 <- [1045 - 1074 - 1136] -> 1389
Mean relative change	-1.2% ± 1.8%
close
`chromium`
head	241 <- [298 - 311 - 328] -> 407
expected	258 <- [295 - 308 - 319] -> 428
Mean relative change	1.0% ± 2.4%

Changes are computed with expected as reference.

Expected = aa0f16fcb7de07e97976cfa75b2e8e51b4804e97 | Actual = 6d208970f0b950a1c75c0c08960c651b32a3cc0b
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-08 03:32:46.419834591 +0000
+++ /dev/fd/62	2023-01-08 03:32:46.419834591 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-08T03:57:20Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	large_metadata_1000x100_notebook
open
`chromium`
head	4963 <- [5162 - 5323 - 5471] -> 5701
expected	5157 <- [5360 - 5466 - 5588] -> 6117
Mean relative change	-3.1% ± 0.9%
switch-from-copy
`chromium`
head	231 <- [274 - 314 - 489] -> 920
expected	226 <- [273 - 327 - 491] -> 922
Mean relative change	-0.5% ± 6.8%
switch-to-copy
`chromium`
head	504 <- [507 - 509 - 516] -> 969
expected	504 <- [508 - 513 - 520] -> 957
Mean relative change	0.1% ± 2.8%
switch-from-txt
`chromium`
head	111 <- [138 - 148 - 157] -> 197
expected	108 <- [138 - 148 - 159] -> 208
Mean relative change	-0.9% ± 1.7%
switch-to-txt
`chromium`
head	112 <- [131 - 142 - 155] -> 211
expected	109 <- [133 - 144 - 156] -> 240
Mean relative change	-0.8% ± 1.8%
close
`chromium`
head	296 <- [356 - 374 - 394] -> 447
expected	307 <- [359 - 375 - 392] -> 440
Mean relative change	-0.4% ± 2.1%

Changes are computed with expected as reference.

Expected = aa0f16fcb7de07e97976cfa75b2e8e51b4804e97 | Actual = 6d208970f0b950a1c75c0c08960c651b32a3cc0b
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-08 03:57:19.458078981 +0000
+++ /dev/fd/62	2023-01-08 03:57:19.458078981 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

github-actions · 2023-01-08T05:06:00Z

Benchmark report

The execution time (in milliseconds) are grouped by test file, test type and browser.
For each case, the following values are computed: min <- [1st quartile - median - 3rd quartile] -> max.

The mean relative comparison is computed with 95% confidence.

Results table

Test file	longOutput - A single output with 100x100 divs
open
`chromium`
head	1113 <- [1165 - 1189 - 1223] -> 1349
expected	1122 <- [1154 - 1180 - 1217] -> 1310
Mean relative change	0.7% ± 1.2%
switch-from-copy
`chromium`
head	663 <- [703 - 738 - 800] -> 937
expected	669 <- [705 - 741 - 799] -> 930
Mean relative change	-0.0% ± 1.2%
switch-to-copy
`chromium`
head	755 <- [807 - 831 - 863] -> 950
expected	758 <- [804 - 827 - 858] -> 1092
Mean relative change	0.5% ± 0.8%
switch-from-txt
`chromium`
head	145 <- [168 - 176 - 182] -> 223
expected	150 <- [167 - 175 - 183] -> 223
Mean relative change	-0.1% ± 1.0%
switch-to-txt
`chromium`
head	590 <- [630 - 645 - 729] -> 822
expected	602 <- [627 - 643 - 723] -> 815
Mean relative change	0.5% ± 1.4%
search
`chromium`
head	20248 <- [22344 - 22539 - 22748] -> 24718
expected	20330 <- [22183 - 22427 - 24055] -> 24655
Mean relative change	-0.2% ± 1.3%
close
`chromium`
head	265 <- [295 - 305 - 316] -> 358
expected	246 <- [292 - 302 - 315] -> 361
Mean relative change	1.1% ± 1.7%

Changes are computed with expected as reference.

Expected = aa0f16fcb7de07e97976cfa75b2e8e51b4804e97 | Actual = 6d208970f0b950a1c75c0c08960c651b32a3cc0b
Go to action log
Changelog covered

❗ Test metadata have changed

--- /dev/fd/63	2023-01-08 05:05:59.948085777 +0000
+++ /dev/fd/62	2023-01-08 05:05:59.948085777 +0000
@@ -1,7 +1,7 @@
 {
   "benchmark": {
     "BENCHMARK_OUTPUTFILE": "lab-benchmark.json",
-    "BENCHMARK_REFERENCE": "head"
+    "BENCHMARK_REFERENCE": "actual"
   },
   "browsers": {
     "chromium": "109.0.5414.46"

fcollonval pinned this issue Jan 4, 2022

fcollonval added the documentation Improvements or additions to documentation label Jan 10, 2022

jupyterlab deleted a comment from github-actions bot Feb 14, 2022

jupyterlab deleted a comment from github-actions bot Mar 10, 2022

jupyterlab deleted a comment from github-actions bot Mar 12, 2022

fcollonval mentioned this issue Jan 11, 2023

Weekly benchmark report - 2023 #127

Open

fcollonval closed this as completed Jun 5, 2023

fcollonval unpinned this issue Jun 5, 2023

Weekly benchmark report - 2022 #85

Weekly benchmark report - 2022 #85

Comments

fcollonval commented Jan 4, 2022 • edited Loading

Benchmark report

github-actions bot commented Jan 9, 2022

Benchmark report

github-actions bot commented Jan 23, 2022

Benchmark report

github-actions bot commented Jan 23, 2022

Benchmark report

github-actions bot commented Jan 30, 2022

Benchmark report

github-actions bot commented Jan 30, 2022

Benchmark report

github-actions bot commented Feb 6, 2022

Benchmark report

github-actions bot commented Feb 6, 2022

Benchmark report

github-actions bot commented Feb 13, 2022

Benchmark report

fcollonval commented Feb 16, 2022

github-actions bot commented Feb 20, 2022

Benchmark report

github-actions bot commented Feb 20, 2022

Benchmark report

github-actions bot commented Feb 27, 2022

Benchmark report

github-actions bot commented Feb 27, 2022

Benchmark report

github-actions bot commented Mar 11, 2022

Benchmark report

github-actions bot commented Mar 11, 2022

Benchmark report

github-actions bot commented Mar 11, 2022

Benchmark report

github-actions bot commented Mar 11, 2022

Benchmark report

github-actions bot commented Mar 11, 2022

Benchmark report

github-actions bot commented Dec 4, 2022

Benchmark report

github-actions bot commented Dec 4, 2022

Benchmark report

github-actions bot commented Dec 11, 2022

Benchmark report

github-actions bot commented Dec 11, 2022

Benchmark report

github-actions bot commented Dec 11, 2022

Benchmark report

github-actions bot commented Dec 11, 2022

Benchmark report

github-actions bot commented Dec 11, 2022

Benchmark report

github-actions bot commented Dec 18, 2022

Benchmark report

github-actions bot commented Dec 18, 2022

Benchmark report

github-actions bot commented Dec 18, 2022

Benchmark report

github-actions bot commented Dec 18, 2022

Benchmark report

github-actions bot commented Dec 18, 2022

Benchmark report

github-actions bot commented Dec 25, 2022

Benchmark report

github-actions bot commented Dec 25, 2022

Benchmark report

github-actions bot commented Dec 25, 2022

Benchmark report

github-actions bot commented Dec 25, 2022

Benchmark report

github-actions bot commented Dec 25, 2022

Benchmark report

github-actions bot commented Jan 1, 2023

Benchmark report

github-actions bot commented Jan 1, 2023

Benchmark report

github-actions bot commented Jan 1, 2023

Benchmark report

fcollonval commented Jan 4, 2022 •

edited

Loading