1) app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support ─── Error: Screenshot comparison failed: 943 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support/unsupported-browser-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support/unsupported-browser-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 943 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 943 pixels (ratio 0.01 of all image pixels) are different. 19 | await expect(header).toBeVisible(); 20 | > 21 | await expect(page).toMatchScreenshot("unsupported-browser.png"); | ^ 22 | }); 23 | 24 | test(`shows error page if browser lacks WebAssembly support`, async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:21:24

1) app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support ─── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 943 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-retry1/unsupported-browser-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-retry1/unsupported-browser-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 943 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 943 pixels (ratio 0.01 of all image pixels) are different. 19 | await expect(header).toBeVisible(); 20 | > 21 | await expect(page).toMatchScreenshot("unsupported-browser.png"); | ^ 22 | }); 23 | 24 | test(`shows error page if browser lacks WebAssembly support`, async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:21:24

1) app-loading/feature-detection.spec.ts:11:5 › shows error page if browser lacks Intl support ─── Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 943 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-retry2/unsupported-browser-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-9c13b--browser-lacks-Intl-support-retry2/unsupported-browser-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 943 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 943 pixels (ratio 0.01 of all image pixels) are different. 19 | await expect(header).toBeVisible(); 20 | > 21 | await expect(page).toMatchScreenshot("unsupported-browser.png"); | ^ 22 | }); 23 | 24 | test(`shows error page if browser lacks WebAssembly support`, async ({ page }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:21:24

2) app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support Error: Screenshot comparison failed: 3035 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support/unsupported-browser-CompatibilityView-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support/unsupported-browser-CompatibilityView-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3035 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3035 pixels (ratio 0.01 of all image pixels) are different. 31 | await expect(header).toBeVisible(); 32 | > 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png"); | ^ 34 | }); 35 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:33:24

2) app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3035 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-retry1/unsupported-browser-CompatibilityView-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-retry1/unsupported-browser-CompatibilityView-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3035 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3035 pixels (ratio 0.01 of all image pixels) are different. 31 | await expect(header).toBeVisible(); 32 | > 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png"); | ^ 34 | }); 35 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:33:24

2) app-loading/feature-detection.spec.ts:24:5 › shows error page if browser lacks WebAssembly support Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 3035 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/app-loading/feature-detection.spec.ts/unsupported-browser-CompatibilityView-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-retry2/unsupported-browser-CompatibilityView-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/app-loading-feature-detect-0cb56-r-lacks-WebAssembly-support-retry2/unsupported-browser-CompatibilityView-diff.png Call log: - expect.toHaveScreenshot(unsupported-browser-CompatibilityView.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 3035 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 3035 pixels (ratio 0.01 of all image pixels) are different. 31 | await expect(header).toBeVisible(); 32 | > 33 | await expect(page).toMatchScreenshot("unsupported-browser-CompatibilityView.png"); | ^ 34 | }); 35 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/app-loading/feature-detection.spec.ts:33:24

3) audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme Error: Screenshot comparison failed: 229 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/audio-player/audio-player.spec.ts/Selected-EventTile-of-audio-player--light-theme--irc-layout-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-diff.png Call log: - expect.toHaveScreenshot(Selected-EventTile-of-audio-player--light-theme--irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$-AAI0-jgHUIz1iR68FiqOCShS5I_pJASBwz1tC0KnNA" data-scroll-tokens="$-AAI0-jgHUIz1iR68FiqOCShS5I_pJASBwz1tC0KnNA" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 229 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$-AAI0-jgHUIz1iR68FiqOCShS5I_pJASBwz1tC0KnNA" data-scroll-tokens="$-AAI0-jgHUIz1iR68FiqOCShS5I_pJASBwz1tC0KnNA" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 229 pixels (ratio 0.01 of all image pixels) are different. 97 | 98 | // Take a snapshot of mx_EventTile_last on IRC layout > 99 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 100 | `${detail.replaceAll(" ", "-")}-irc-layout.png`, 101 | screenshotOptions, 102 | ); at takeSnapshots (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:99:58) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:139:9

3) audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 229 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/audio-player/audio-player.spec.ts/Selected-EventTile-of-audio-player--light-theme--irc-layout-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme-retry1/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme-retry1/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-diff.png Call log: - expect.toHaveScreenshot(Selected-EventTile-of-audio-player--light-theme--irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$WZ_wo5JgZxrK0EL3HdAK2G7Ma-0V-NLsDRpvoO_t-iU" data-scroll-tokens="$WZ_wo5JgZxrK0EL3HdAK2G7Ma-0V-NLsDRpvoO_t-iU" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 229 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$WZ_wo5JgZxrK0EL3HdAK2G7Ma-0V-NLsDRpvoO_t-iU" data-scroll-tokens="$WZ_wo5JgZxrK0EL3HdAK2G7Ma-0V-NLsDRpvoO_t-iU" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 229 pixels (ratio 0.01 of all image pixels) are different. 97 | 98 | // Take a snapshot of mx_EventTile_last on IRC layout > 99 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 100 | `${detail.replaceAll(" ", "-")}-irc-layout.png`, 101 | screenshotOptions, 102 | ); at takeSnapshots (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:99:58) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:139:9

3) audio-player/audio-player.spec.ts:137:9 › Audio player › should be correctly rendered - light theme Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 229 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/audio-player/audio-player.spec.ts/Selected-EventTile-of-audio-player--light-theme--irc-layout-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme-retry2/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--29600-ctly-rendered---light-theme-retry2/Selected-EventTile-of-audi-f207e-light-theme--irc-layout-diff.png Call log: - expect.toHaveScreenshot(Selected-EventTile-of-audio-player--light-theme--irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$AMiPg9k0nExcAXiDIhoTPASQNmnDDhDoPajTOa1l9Vw" data-scroll-tokens="$AMiPg9k0nExcAXiDIhoTPASQNmnDDhDoPajTOa1l9Vw" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 229 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$AMiPg9k0nExcAXiDIhoTPASQNmnDDhDoPajTOa1l9Vw" data-scroll-tokens="$AMiPg9k0nExcAXiDIhoTPASQNmnDDhDoPajTOa1l9Vw" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 229 pixels (ratio 0.01 of all image pixels) are different. 97 | 98 | // Take a snapshot of mx_EventTile_last on IRC layout > 99 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 100 | `${detail.replaceAll(" ", "-")}-irc-layout.png`, 101 | screenshotOptions, 102 | ); at takeSnapshots (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:99:58) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:139:9

4) audio-player/audio-player.spec.ts:142:9 › Audio player › should be correctly rendered - light theme with monospace font Error: Screenshot comparison failed: 5 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/audio-player/audio-player.spec.ts/Selected-EventTile-of-audio-player--light-theme--monospace-font--irc-layout-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--e1830-t-theme-with-monospace-font/Selected-EventTile-of-audi-9febc-ospace-font--irc-layout-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/audio-player-audio-player--e1830-t-theme-with-monospace-font/Selected-EventTile-of-audi-9febc-ospace-font--irc-layout-diff.png Call log: - expect.toHaveScreenshot(Selected-EventTile-of-audio-player--light-theme--monospace-font--irc-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$edjBeR7Ed7JemZj8ir5sC96C8-u7Trx_-ZXVrk5AgLc" data-scroll-tokens="$edjBeR7Ed7JemZj8ir5sC96C8-u7Trx_-ZXVrk5AgLc" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 5 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" data-layout="irc" aria-atomic="true" data-has-reply="false" data-event-id="$edjBeR7Ed7JemZj8ir5sC96C8-u7Trx_-ZXVrk5AgLc" data-scroll-tokens="$edjBeR7Ed7JemZj8ir5sC96C8-u7Trx_-ZXVrk5AgLc" class="mx_EventTile mx_EventTile_selected mx_EventTile_last mx_EventTile_lastInSection">…</li> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 5 pixels (ratio 0.01 of all image pixels) are different. 97 | 98 | // Take a snapshot of mx_EventTile_last on IRC layout > 99 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot( | ^ 100 | `${detail.replaceAll(" ", "-")}-irc-layout.png`, 101 | screenshotOptions, 102 | ); at takeSnapshots (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:99:58) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/audio-player/audio-player.spec.ts:145:9

matrix-react-sdk/composer/RTE.spec.ts took 1.2m

matrix-react-sdk/crypto/event-shields.spec.ts took 1.1m

matrix-react-sdk/crypto/decryption-failure-messages.spec.ts took 53.5s

matrix-react-sdk/crypto/device-verification.spec.ts took 49.4s

matrix-react-sdk/integration-manager/kick.spec.ts took 39.8s