release: v2.0.22 #3151
lint-and-test.yml
on: push
Determine Playwright container image
2s
Lint code
27s
Build package
42s
Lint commit messages
0s
Run unit tests
40s
Audit dependencies
2m 33s
Matrix: test-e2e
Matrix: test-visual-regression
Merge e2e test reports
19s
Merge visual regression reports
30s
Annotations
5 errors and 6 notices
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
1) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot
Error: Screenshot comparison failed:
Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-expanded-items/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari/accordion/with-expanded-items/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari/accordion/with-expanded-items/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
1) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-expanded-items/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari-retry1/accordion/with-expanded-items/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-acc-61799-ith-expanded-items-matches-the-saved-screenshot-react-tablet-safari-retry1/accordion/with-expanded-items/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1372px, received 1536px by 850px. 89320 pixels (ratio 0.05 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-custom-text › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
2) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-custom-text › matches the saved screenshot
Error: Screenshot comparison failed:
Expected an image 1536px by 1012px, received 1536px by 490px. 77970 pixels (ratio 0.06 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-custom-text/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-custom-text-matches-the-saved-screenshot-react-tablet-safari/accordion/with-custom-text/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-custom-text-matches-the-saved-screenshot-react-tablet-safari/accordion/with-custom-text/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1012px, received 1536px by 490px. 77970 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div class="govuk-accordion" data-module="govuk-accor…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1012px, received 1536px by 490px. 77970 pixels (ratio 0.06 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
Run visual regression tests (2/2)
Process completed with exit code 1.
|
Run visual regression tests (1/2)
The job was canceled because "_2_2" failed.
|
🎭 Playwright Run Summary
479 passed (2.2m)
|
🎭 Playwright Run Summary
478 passed (2.4m)
|
🎭 Playwright Run Summary
1 failed
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-expanded-items › matches the saved screenshot
1 flaky
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-custom-text › matches the saved screenshot
444 passed (2.8m)
|
🎭 Playwright Run Summary
446 passed (1.9m)
|
🎭 Playwright Run Summary
478 passed (3.6m)
|
🎭 Playwright Run Summary
478 passed (3.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
e2e-blob-reports-0
Expired
|
345 KB |
|
e2e-blob-reports-1
Expired
|
349 KB |
|
e2e-blob-reports-2
Expired
|
340 KB |
|
e2e-blob-reports-3
Expired
|
347 KB |
|
e2e-html-report-0
|
311 KB |
|
visual-regression-blob-reports-0
Expired
|
290 KB |
|
visual-regression-blob-reports-1
Expired
|
1.14 MB |
|
visual-regression-html-report-0
|
265 KB |
|