Github workflows available locally

[mttschltz]

Goals

• Debug CD issues easily by being able to run Github workflows locally
• Bonus: If they're fast, add to pre-commit hooks

Initial investigation

On 2021-12-20 I tried to get act running locally.

Came across the following problems

• [Blocker] Some Loki visual regression tests failed despite them passing on Github and when running loki locally within WSL2. See below.
• With the 'Medium' act image, yarn isn't installed. You can install in a separate step with npm i -g yarn ([BUG] Can't use yarn nektos/act#280) but then...
• Caching (e.g. cache: 'yarn' in uses: actions/setup-node@v2) does not work. You can disable the cache when running act and use --reuse instead (actions/cache@v2 error: Cache Service Url not found, unable to restore cache nektos/act#285 (comment))

It only took act 1m27s from start to the point of failure with visual regression tests, and that job was not running in parallel but after the first (unit test) job. So it seems quite fast.

loki output within act

| WARN asset size limit: The following asset(s) exceed the recommended size limit (244 KiB).
| WARN This can impact web performance.
| WARN Assets: 
| WARN   vendors~main.8c347319.iframe.bundle.js (2.3 MiB)
| WARN entrypoint size limit: The following entrypoint(s) combined asset size exceeds the recommended limit (244 KiB). This can impact web performance.
| WARN Entrypoints:
| WARN   main (2.35 MiB)
| WARN       runtime~main.97d9166e.iframe.bundle.js
| WARN       vendors~main.8c347319.iframe.bundle.js
| WARN       main.bf0f3db5.iframe.bundle.js
| WARN 
| info => Output directory: /home/matt/projects/life/storybook-static
| loki test v0.28.1
| PASS chrome.docker/PREPARE
| PASS chrome.docker/START
| PASS chrome.docker/FETCH_STORIES
| PASS chrome.docker/chrome.laptop/Controls/Button/Kind
| PASS chrome.docker/chrome.laptop/Layout/Box/Align
| PASS chrome.docker/chrome.laptop/Layout/Box/Background
| FAIL chrome.docker/chrome.laptop/Layout/Box/Simple: Screenshot differs from reference, see .loki/difference/chrome_laptop_Layout_Box_Simple.png
| PASS chrome.docker/chrome.laptop/Layout/Box/Height
| FAIL chrome.docker/chrome.laptop/Layout/Box/Padding: Screenshot differs from reference, see .loki/difference/chrome_laptop_Layout_Box_Padding.png
| FAIL chrome.docker/chrome.laptop/Layout/Box/Margin: Screenshot differs from reference, see .loki/difference/chrome_laptop_Layout_Box_Margin.png
| PASS chrome.docker/chrome.laptop/Layout/Box/Width
| PASS chrome.docker/chrome.iphone7/Controls/Button/Kind
| PASS chrome.docker/chrome.iphone7/Layout/Box/Align
| FAIL chrome.docker/chrome.iphone7/Layout/Box/Simple: Screenshot differs from reference, see .loki/difference/chrome_iphone7_Layout_Box_Simple.png
| PASS chrome.docker/chrome.iphone7/Layout/Box/Background
| PASS chrome.docker/chrome.iphone7/Layout/Box/Height
| PASS chrome.docker/chrome.iphone7/Layout/Box/Width
| FAIL chrome.docker/chrome.iphone7/Layout/Box/Margin: Screenshot differs from reference, see .loki/difference/chrome_iphone7_Layout_Box_Margin.png
| FAIL chrome.docker/chrome.iphone7/Layout/Box/Padding: Screenshot differs from reference, see .loki/difference/chrome_iphone7_Layout_Box_Padding.png
| FAIL chrome.docker/TESTS: Some tasks failed to run
| FAIL chrome.docker: Some tasks failed to run
| Visual tests failed
| You can update the reference files with:
| loki update --storiesFilter="^Layout\\/Box Simple|Layout\\/Box Margin|Layout\\/Box Padding\$" --reactUri="file:./storybook-static"
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
[matt.fyi CD/Visual regression tests       ]   ❌  Failure - Visual regression tests
Error: exit with `FAILURE`: 1