Use artifact flow to report benchmarks results

[andrewiggins]

Instead of reporting results in each benchmark job (which requires coordinating updating the comment between the concurrent jobs), we'll collect all the results in an artifact and then report the results after the benchmarks have finished.

This change dramatically reduces the number GitHub APIs calls and so should reduce the likelihood of our action getting throttled. The action still does more API calls than I like but figured I get this update out first to reduce the current strain.

Further, this serves as a building block to setting up the flow to enable benchmark reports for PRs from forks!! :D

[coveralls]

Coverage remained the same at 99.44% when pulling 10178e0 on tachometer-reporter-artifact-flow into cbe3369 on master.

[github-actions]

Size Change: 0 B

Total Size: 42.1 kB

ℹ️ View Unchanged

Filename	Size	Change
compat/dist/compat.js	3.45 kB	0 B
compat/dist/compat.module.js	3.47 kB	0 B
compat/dist/compat.umd.js	3.51 kB	0 B
debug/dist/debug.js	2.99 kB	0 B
debug/dist/debug.module.js	2.98 kB	0 B
debug/dist/debug.umd.js	3.07 kB	0 B
devtools/dist/devtools.js	232 B	0 B
devtools/dist/devtools.module.js	240 B	0 B
devtools/dist/devtools.umd.js	308 B	0 B
dist/preact.js	3.93 kB	0 B
dist/preact.min.js	3.96 kB	0 B
dist/preact.module.js	3.96 kB	0 B
dist/preact.umd.js	4 kB	0 B
hooks/dist/hooks.js	1.13 kB	0 B
hooks/dist/hooks.module.js	1.15 kB	0 B
hooks/dist/hooks.umd.js	1.2 kB	0 B
jsx-runtime/dist/jsxRuntime.js	327 B	0 B
jsx-runtime/dist/jsxRuntime.module.js	335 B	0 B
jsx-runtime/dist/jsxRuntime.umd.js	405 B	0 B
test-utils/dist/testUtils.js	437 B	0 B
test-utils/dist/testUtils.module.js	439 B	0 B
test-utils/dist/testUtils.umd.js	515 B	0 B

_{compressed-size-action}

[github-actions]

📊 Tachometer Benchmark Results

Summary

duration

• 02_replace1k: unsure 🔍 -3% - +1% (-5.84ms - +1.10ms)
  ^{preact-local vs preact-master}
• 03_update10th1k_x16: unsure 🔍 -6% - +2% (-1.78ms - +0.47ms)
  ^{preact-local vs preact-master}
• 07_create10k: unsure 🔍 -0% - +0% (-5.46ms - +4.87ms)
  ^{preact-local vs preact-master}
• filter_list: unsure 🔍 -2% - +4% (-0.83ms - +1.56ms)
  ^{preact-local vs preact-master}
• hydrate1k: unsure 🔍 -2% - +2% (-2.02ms - +1.86ms)
  ^{preact-local vs preact-master}
• many_updates: unsure 🔍 -8% - +6% (-2.59ms - +2.15ms)
  ^{preact-local vs preact-master}
• text_update: unsure 🔍 -5% - +5% (-0.17ms - +0.17ms)
  ^{preact-local vs preact-master}

usedJSHeapSize

• 02_replace1k: unsure 🔍 -0% - +0% (-0.01ms - +0.00ms)
  ^{preact-local vs preact-master}
• 03_update10th1k_x16: unsure 🔍 -0% - +0% (-0.01ms - +0.00ms)
  ^{preact-local vs preact-master}
• 07_create10k: unsure 🔍 -0% - +0% (-0.00ms - +0.00ms)
  ^{preact-local vs preact-master}
• filter_list: unsure 🔍 -0% - +0% (-0.00ms - +0.00ms)
  ^{preact-local vs preact-master}
• hydrate1k: unsure 🔍 -0% - +0% (-0.00ms - +0.02ms)
  ^{preact-local vs preact-master}
• many_updates: unsure 🔍 -0% - +0% (-0.00ms - +0.00ms)
  ^{preact-local vs preact-master}
• text_update: unsure 🔍 -0% - +0% (-0.00ms - +0.00ms)
  ^{preact-local vs preact-master}

Results

02_replace1k

• Browser: chrome-headless 87.0.4280.88
• Sample size: 50
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	185.03ms - 189.83ms	-	unsure 🔍 -1% - +3% -1.10ms - +5.84ms
preact-local	182.56ms - 187.56ms	unsure 🔍 -3% - +1% -5.84ms - +1.10ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	3.59ms - 3.60ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.01ms
preact-local	3.59ms - 3.60ms	unsure 🔍 -0% - +0% -0.01ms - +0.00ms	-

run-warmup-0

Version	Avg time	vs preact-master	vs preact-local
preact-master	70.42ms - 72.68ms	-	unsure 🔍 -1% - +3% -0.86ms - +2.20ms
preact-local	69.84ms - 71.91ms	unsure 🔍 -3% - +1% -2.20ms - +0.86ms	-

run-warmup-1

Version	Avg time	vs preact-master	vs preact-local
preact-master	105.95ms - 108.74ms	-	unsure 🔍 -2% - +2% -1.89ms - +2.47ms
preact-local	105.39ms - 108.73ms	unsure 🔍 -2% - +2% -2.47ms - +1.89ms	-

run-warmup-2

Version	Avg time	vs preact-master	vs preact-local
preact-master	121.63ms - 126.15ms	-	unsure 🔍 -2% - +2% -3.10ms - +1.98ms
preact-local	123.28ms - 125.61ms	unsure 🔍 -2% - +3% -1.98ms - +3.10ms	-

run-warmup-3

Version	Avg time	vs preact-master	vs preact-local
preact-master	70.38ms - 73.75ms	-	unsure 🔍 -4% - +2% -2.64ms - +1.69ms
preact-local	71.19ms - 73.90ms	unsure 🔍 -2% - +4% -1.69ms - +2.64ms	-

run-warmup-4

Version	Avg time	vs preact-master	vs preact-local
preact-master	135.65ms - 141.72ms	-	unsure 🔍 -4% - +1% -6.15ms - +1.96ms
preact-local	138.09ms - 143.47ms	unsure 🔍 -1% - +4% -1.96ms - +6.15ms	-

run-final

Version	Avg time	vs preact-master	vs preact-local
preact-master	71.23ms - 73.62ms	-	unsure 🔍 -0% - +4% -0.26ms - +3.02ms
preact-local	69.92ms - 72.17ms	unsure 🔍 -4% - +0% -3.02ms - +0.26ms	-

03_update10th1k_x16

• Browser: chrome-headless 87.0.4280.88
• Sample size: 130
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	29.26ms - 30.88ms	-	unsure 🔍 -2% - +6% -0.47ms - +1.78ms
preact-local	28.64ms - 30.20ms	unsure 🔍 -6% - +2% -1.78ms - +0.47ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	3.52ms - 3.52ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.01ms
preact-local	3.51ms - 3.52ms	unsure 🔍 -0% - +0% -0.01ms - +0.00ms	-

07_create10k

• Browser: chrome-headless 87.0.4280.88
• Sample size: 50
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	1449.49ms - 1455.95ms	-	unsure 🔍 -0% - +0% -4.87ms - +5.46ms
preact-local	1448.40ms - 1456.46ms	unsure 🔍 -0% - +0% -5.46ms - +4.87ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	25.98ms - 25.99ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.00ms
preact-local	25.98ms - 25.99ms	unsure 🔍 -0% - +0% -0.00ms - +0.00ms	-

filter_list

• Browser: chrome-headless 87.0.4280.88
• Sample size: 60
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	34.64ms - 36.23ms	-	unsure 🔍 -4% - +2% -1.56ms - +0.83ms
preact-local	34.90ms - 36.70ms	unsure 🔍 -2% - +4% -0.83ms - +1.56ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	1.60ms - 1.60ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.00ms
preact-local	1.60ms - 1.60ms	unsure 🔍 -0% - +0% -0.00ms - +0.00ms	-

hydrate1k

• Browser: chrome-headless 87.0.4280.88
• Sample size: 50
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	115.70ms - 118.27ms	-	unsure 🔍 -2% - +2% -1.86ms - +2.02ms
preact-local	115.46ms - 118.36ms	unsure 🔍 -2% - +2% -2.02ms - +1.86ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	6.19ms - 6.19ms	-	unsure 🔍 -0% - +0% -0.02ms - +0.00ms
preact-local	6.19ms - 6.21ms	unsure 🔍 -0% - +0% -0.00ms - +0.02ms	-

many_updates

• Browser: chrome-headless 87.0.4280.88
• Sample size: 80
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	31.90ms - 35.69ms	-	unsure 🔍 -6% - +8% -2.15ms - +2.59ms
preact-local	32.15ms - 35.00ms	unsure 🔍 -8% - +6% -2.59ms - +2.15ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	4.84ms - 4.84ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.00ms
preact-local	4.84ms - 4.84ms	unsure 🔍 -0% - +0% -0.00ms - +0.00ms	-

text_update

• Browser: chrome-headless 87.0.4280.88
• Sample size: 60
• Built by: Benchmarks #6

• Commit: 34693c8

duration

Version	Avg time	vs preact-master	vs preact-local
preact-master	3.57ms - 3.78ms	-	unsure 🔍 -5% - +5% -0.17ms - +0.17ms
preact-local	3.54ms - 3.81ms	unsure 🔍 -5% - +5% -0.17ms - +0.17ms	-

usedJSHeapSize

Version	Avg time	vs preact-master	vs preact-local
preact-master	0.83ms - 0.83ms	-	unsure 🔍 -0% - +0% -0.00ms - +0.00ms
preact-local	0.83ms - 0.83ms	unsure 🔍 -0% - +0% -0.00ms - +0.00ms	-

_{tachometer-reporter-action v2 for Benchmarks}