Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests

End to End Tests #8080

Triggered via workflow run March 18, 2024 13:13
@RiotRobotRiotRobot
completed 3c6fd58
Status Success
Total duration 18m 42s
Artifacts 9

end-to-end-tests.yaml

on: workflow_run
Prepare
2s
Prepare
Matrix: tests
Report results
45s
Report results
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 7 warnings, and 1 notice
Report results
Pull Request not found!
Report results
The template is not valid. matrix-org/pr-details-action/v1.3/action.yml (Line: 15, Col: 12): Error reading JToken from JsonReader. Path '', line 0, position 0.,matrix-org/pr-details-action/v1.3/action.yml (Line: 18, Col: 12): Error reading JToken from JsonReader. Path '', line 0, position 0.,matrix-org/pr-details-action/v1.3/action.yml (Line: 21, Col: 12): Error reading JToken from JsonReader. Path '', line 0, position 0.
[Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A: matrix-react-sdk/playwright/e2e/room/room.spec.ts#L100
1) [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A Error: Timed out 5000ms waiting for expect(locator).toBeInViewport() Locator: locator('.mx_MTextBody .mx_EventTile_body').getByText('test0') Expected: in viewport Received: outside viewport Call log: - expect.toBeInViewport with timeout 5000ms - waiting for locator('.mx_MTextBody .mx_EventTile_body').getByText('test0') 98 | // The timeline should display the first message 99 | // The previous position before switching to Room B should be remembered > 100 | await expect(page.locator(".mx_MTextBody .mx_EventTile_body").getByText("test0")).toBeInViewport(); | ^ 101 | }); 102 | }); 103 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/room/room.spec.ts:100:91
[Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog: matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts#L48
2) [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog Error: Screenshot comparison failed: 129 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/user-onboarding/user-onboarding-new.spec.ts/User-Onboarding-new-user-app-download-dialog-1-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboarding-new-User-Onboarding-new-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/user-onboarding-user-onboarding-new-User-Onboarding-new-user-app-download-dialog-Legacy-Crypto/User-Onboarding-new-user-app-download-dialog-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 129 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_Dialog') - locator resolved to <div class="mx_Dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 129 pixels (ratio 0.01 of all image pixels) are different. 46 | page.getByRole("dialog").getByRole("heading", { level: 1, name: "Download Element" }), 47 | ).toBeVisible(); > 48 | await expect(page.locator(".mx_Dialog")).toMatchScreenshot(); | ^ 49 | }); 50 | 51 | test("using find friends action should increase progress", async ({ page, homeserver }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/user-onboarding/user-onboarding-new.spec.ts:48:50
[Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM: matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts#L1
3) [Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM Test timeout of 30000ms exceeded.
[Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM: matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts#L355
3) [Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM Error: jsHandle.evaluateHandle: Test timeout of 30000ms exceeded. 353 | */ 354 | async function awaitVerifier(botVerificationRequest: JSHandle<VerificationRequest>): Promise<JSHandle<Verifier>> { > 355 | return botVerificationRequest.evaluateHandle(async (verificationRequest) => { | ^ 356 | while (!verificationRequest.verifier) { 357 | await new Promise((r) => verificationRequest.once("change" as any, r)); 358 | } at awaitVerifier (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:355:35) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:287:35
[Rust Crypto] › read-receipts/reactions.spec.ts:24:17 › Read receipts › reactions › in the main timeline › Receiving a reaction to a message does not make a room unread: matrix-react-sdk/playwright/e2e/read-receipts/reactions.spec.ts#L1
4) [Rust Crypto] › read-receipts/reactions.spec.ts:24:17 › Read receipts › reactions › in the main timeline › Receiving a reaction to a message does not make a room unread Test finished within timeout of 30000ms, but tearing down "homeserver" ran out of time. Please allow more time for the test, since teardown is attributed towards the test timeout budget.
Prepare
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e, bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 6.0m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.3m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.6m
Slow Test: [Legacy Crypto] › read-receipts/high-level.spec.ts#L1
[Legacy Crypto] › read-receipts/high-level.spec.ts took 3.4m
🎭 Playwright Run Summary
4 flaky [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A [Legacy Crypto] › user-onboarding/user-onboarding-new.spec.ts:43:9 › User Onboarding (new user) › app download dialog [Rust Crypto] › crypto/verification.spec.ts:245:9 › User verification › can receive a verification request when there is no existing DM [Rust Crypto] › read-receipts/reactions.spec.ts:24:17 › Read receipts › reactions › in the main timeline › Receiving a reaction to a message does not make a room unread 121 skipped 663 passed (15.8m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
1.05 MB
all-blob-reports-2 Expired
619 KB
all-blob-reports-3 Expired
5.92 MB
all-blob-reports-4 Expired
4 MB
all-blob-reports-5 Expired
6.34 MB
all-blob-reports-6 Expired
588 KB
all-blob-reports-7 Expired
3.72 MB
all-blob-reports-8 Expired
1.12 MB
html-report--attempt-1 Expired
18.4 MB