Skip to content

Release branch for 8.5.0 #2954

Release branch for 8.5.0

Release branch for 8.5.0 #2954

Re-run triggered November 13, 2024 09:32
Status Failure
Total duration 13m 42s
Artifacts 1

e2e-pw-pull-request.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 7 warnings, and 1 notice
[merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP: tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts#L173
1) [merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP Error: Screenshot comparison failed: Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency-on-boarding.spec.ts/Multi-currency-on-boarding-Geolocation-feature-83665-tch-by-geolocation-correctly-with-USD-and-GBP-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - element is not stable - retrying scroll into view action, attempt #1 - waiting for element to be stable - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. 171 | await expect( 172 | page.locator( '.wcpay-wizard-task.is-active' ) > 173 | ).toHaveScreenshot(); | ^ 174 | await page.getByTestId( 'enable_auto_currency' ).check(); 175 | await page.getByRole( 'button', { name: 'Preview' } ).click(); 176 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts:173:6
[merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP: tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts#L173
1) [merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency-on-boarding.spec.ts/Multi-currency-on-boarding-Geolocation-feature-83665-tch-by-geolocation-correctly-with-USD-and-GBP-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant-retry1/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant-retry1/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. 171 | await expect( 172 | page.locator( '.wcpay-wizard-task.is-active' ) > 173 | ).toHaveScreenshot(); | ^ 174 | await page.getByTestId( 'enable_auto_currency' ).check(); 175 | await page.getByRole( 'button', { name: 'Preview' } ).click(); 176 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts:173:6
[merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP: tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts#L173
1) [merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency-on-boarding.spec.ts/Multi-currency-on-boarding-Geolocation-feature-83665-tch-by-geolocation-correctly-with-USD-and-GBP-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant-retry2/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-on-boarding-fddc3--correctly-with-USD-and-GBP-merchant-retry2/Multi-currency-on-boarding-83665-orrectly-with-USD-and-GBP-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.wcpay-wizard-task.is-active') - locator resolved to <li class="wcpay-wizard-task is-active">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 652px by 288px, received 652px by 285px. 5264 pixels (ratio 0.03 of all image pixels) are different. 171 | await expect( 172 | page.locator( '.wcpay-wizard-task.is-active' ) > 173 | ).toHaveScreenshot(); | ^ 174 | await page.getByTestId( 'enable_auto_currency' ).check(); 175 | await page.getByRole( 'button', { name: 'Preview' } ).click(); 176 | at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency-on-boarding.spec.ts:173:6
[merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors: tests/e2e-pw/specs/merchant/multi-currency.spec.ts#L46
2) [merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors Error: Screenshot comparison failed: Expected an image 1080px by 416px, received 1080px by 412px. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency.spec.ts/Multi-currency-page-load-without-any-errors-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant/Multi-currency-page-load-without-any-errors-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant/Multi-currency-page-load-without-any-errors-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1080px by 416px, received 1080px by 412px. - waiting 100ms before taking screenshot - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1080px by 416px, received 1080px by 412px. 44 | await expect( 45 | page.locator( '.multi-currency-settings' ).last() > 46 | ).toHaveScreenshot(); | ^ 47 | } ); 48 | 49 | test( 'add the currency switcher to the sidebar', async () => { at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency.spec.ts:46:5
[merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors: tests/e2e-pw/specs/merchant/multi-currency.spec.ts#L46
2) [merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 1080px by 416px, received 1080px by 412px. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency.spec.ts/Multi-currency-page-load-without-any-errors-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant-retry1/Multi-currency-page-load-without-any-errors-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant-retry1/Multi-currency-page-load-without-any-errors-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1080px by 416px, received 1080px by 412px. - waiting 100ms before taking screenshot - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1080px by 416px, received 1080px by 412px. 44 | await expect( 45 | page.locator( '.multi-currency-settings' ).last() > 46 | ).toHaveScreenshot(); | ^ 47 | } ); 48 | 49 | test( 'add the currency switcher to the sidebar', async () => { at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency.spec.ts:46:5
[merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors: tests/e2e-pw/specs/merchant/multi-currency.spec.ts#L46
2) [merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: Expected an image 1080px by 416px, received 1080px by 412px. Expected: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/__snapshots__/multi-currency.spec.ts/Multi-currency-page-load-without-any-errors-1.png Received: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant-retry2/Multi-currency-page-load-without-any-errors-1-actual.png Diff: /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/test-results/multi-currency-Multi-currency-page-load-without-any-errors-merchant-retry2/Multi-currency-page-load-without-any-errors-1-diff.png Call log: - page._expectScreenshot with timeout 20000ms - verifying given screenshot expectation - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1080px by 416px, received 1080px by 412px. - waiting 100ms before taking screenshot - waiting for locator('.multi-currency-settings').last() - locator resolved to <div class="multi-currency-settings">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1080px by 416px, received 1080px by 412px. 44 | await expect( 45 | page.locator( '.multi-currency-settings' ).last() > 46 | ).toHaveScreenshot(); | ^ 47 | } ); 48 | 49 | test( 'add the currency switcher to the sidebar', async () => { at /home/runner/work/woocommerce-payments/woocommerce-payments/tests/e2e-pw/specs/merchant/multi-currency.spec.ts:46:5
WC - latest
Process completed with exit code 1.
Slow Test: [merchant] › merchant/merchant-disputes-respond.spec.ts#L1
[merchant] › merchant/merchant-disputes-respond.spec.ts took 1.4m
Slow Test: [merchant] › merchant/multi-currency-setup.spec.ts#L1
[merchant] › merchant/multi-currency-setup.spec.ts took 44.6s
Slow Test: [shopper] › shopper/shopper-checkout-purchase.spec.ts#L1
[shopper] › shopper/shopper-checkout-purchase.spec.ts took 23.1s
Slow Test: [shopper] › shopper/multi-currency-checkout.spec.ts#L1
[shopper] › shopper/multi-currency-checkout.spec.ts took 21.4s
Slow Test: [merchant] › merchant/merchant-disputes-view-details-via-order-notice.spec.ts#L1
[merchant] › merchant/merchant-disputes-view-details-via-order-notice.spec.ts took 16.4s
WC - latest
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "playwright-report". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
2 failed [merchant] › merchant/multi-currency-on-boarding.spec.ts:165:7 › Multi-currency on-boarding › Geolocation features › should preview currency switch by geolocation correctly with USD and GBP [merchant] › merchant/multi-currency.spec.ts:38:6 › Multi-currency › page load without any errors 1 skipped 39 passed (7.2m)

Artifacts

Produced during runtime
Name Size
playwright-report Expired
291 MB