matrix-react-sdk End to End Tests #957
downstream-end-to-end-tests.yml
on: merge_group
Playwright
/
Build Element-Web
2m 23s
Matrix: Playwright / playwright
Playwright
/
end-to-end-tests
38s
Annotations
4 errors, 38 warnings, and 8 notices
[Rust Crypto] › sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly:
matrix-react-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts#L26
1) [Rust Crypto] › sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly
Test timeout of 30000ms exceeded while running "beforeEach" hook.
24 | let roomId: string;
25 |
> 26 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => {
| ^
27 | roomId = await app.client.createRoom({ name: "Test Room" });
28 | });
29 |
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts:26:10
|
[Rust Crypto] › sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly:
matrix-react-sdk/playwright/pages/client.ts#L161
1) [Rust Crypto] › sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly
Error: jsHandle.evaluate: Test timeout of 30000ms exceeded.
at ../pages/client.ts:161
159 | public async createRoom(options: ICreateRoomOpts): Promise<string> {
160 | const client = await this.prepareClient();
> 161 | return await client.evaluate(async (cli, options) => {
| ^
162 | const resp = await cli.createRoom(options);
163 | const roomId = resp.room_id;
164 | if (!cli.getRoom(roomId)) {
at Client.createRoom (/home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/pages/client.ts:161:29)
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/e2e/sliding-sync/sliding-sync.spec.ts:27:18
|
[Rust Crypto] › timeline/timeline.spec.ts:926:13 › Timeline › message sending › should display a reply chain:
matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts#L1033
2) [Rust Crypto] › timeline/timeline.spec.ts:926:13 › Timeline › message sending › should display a reply chain
Error: Screenshot comparison failed:
103 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/snapshots/timeline/timeline.spec.ts/event-tile-reply-chains-bubble-layout-linux.png
Received: /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-801c1-hould-display-a-reply-chain-Rust-Crypto/event-tile-reply-chains-bubble-layout-actual.png
Diff: /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-801c1-hould-display-a-reply-chain-Rust-Crypto/event-tile-reply-chains-bubble-layout-diff.png
Call log:
- expect.toHaveScreenshot(event-tile-reply-chains-bubble-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" a…>…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 103 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" a…>…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 103 pixels (ratio 0.01 of all image pixels) are different.
1031 |
1032 | // Take a snapshot on bubble layout
> 1033 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1034 | "event-tile-reply-chains-bubble-layout.png",
1035 | screenshotOptions,
1036 | );
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts:1033:62
|
[Rust Crypto] › crypto/migration.spec.ts:39:5 › migration › Should support migration from legacy crypto:
matrix-react-sdk/playwright/e2e/crypto/migration.spec.ts#L67
1) [Rust Crypto] › crypto/migration.spec.ts:39:5 › migration › Should support migration from legacy crypto
Error: expect(received).toBeGreaterThan(expected)
Expected: > 50
Received: NaN
Call Log:
- Timeout 60000ms exceeded while waiting on the predicate
65 | { timeout: 60000 },
66 | )
> 67 | .toBeGreaterThan(50);
| ^
68 |
69 | // Eventually, we should get a normal matrix chat
70 | await page.waitForSelector(".mx_MatrixChat", { timeout: 120000 });
at /home/runner/work/matrix-js-sdk/matrix-js-sdk/matrix-react-sdk/playwright/e2e/crypto/migration.spec.ts:67:14
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/high-level.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/high-level.spec.ts took 3.5m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/new-messages.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/new-messages.spec.ts took 3.4m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/editing-messages.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/editing-messages.spec.ts took 3.0m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › polls/polls.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › polls/polls.spec.ts took 42.8s
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/new-messages.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/high-level.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/high-level.spec.ts took 3.8m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/editing-messages.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/editing-messages.spec.ts took 3.4m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › polls/polls.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › polls/polls.spec.ts took 49.0s
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › timeline/timeline.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › timeline/timeline.spec.ts took 2.8m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › spotlight/spotlight.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › spotlight/spotlight.spec.ts took 2.1m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.5m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › spaces/spaces.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › spaces/spaces.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › threads/threads.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › threads/threads.spec.ts took 41.3s
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › spotlight/spotlight.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › spotlight/spotlight.spec.ts took 2.1m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › spaces/spaces.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › spaces/spaces.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › threads/threads.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › threads/threads.spec.ts took 37.9s
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › settings/general-user-settings-tab.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › settings/general-user-settings-tab.spec.ts took 34.0s
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/redactions.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.2m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/reactions.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/reactions.spec.ts took 2.1m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › read-receipts/read-receipts.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › read-receipts/read-receipts.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › room/room-header.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › room/room-header.spec.ts took 56.5s
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › settings/appearance-user-settings-tab.spec.ts took 55.1s
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/redactions.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/redactions.spec.ts took 5.8m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/reactions.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/reactions.spec.ts took 2.3m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › read-receipts/read-receipts.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › read-receipts/read-receipts.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › room/room-header.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › room/room-header.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › settings/appearance-user-settings-tab.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › settings/appearance-user-settings-tab.spec.ts took 1.0m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › crypto/verification.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › crypto/verification.spec.ts took 2.7m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › crypto/crypto.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › crypto/crypto.spec.ts took 2.1m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › audio-player/audio-player.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › audio-player/audio-player.spec.ts took 1.3m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › composer/composer.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › composer/composer.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/[Legacy Crypto] › crypto/staged-rollout.spec.ts#L1
matrix-react-sdk/[Legacy Crypto] › crypto/staged-rollout.spec.ts took 1.1m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › crypto/verification.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › crypto/verification.spec.ts took 2.9m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › crypto/crypto.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › crypto/crypto.spec.ts took 2.9m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › audio-player/audio-player.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › audio-player/audio-player.spec.ts took 1.4m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › composer/composer.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › composer/composer.spec.ts took 1.2m
|
Slow Test:
matrix-react-sdk/[Rust Crypto] › integration-manager/kick.spec.ts#L1
matrix-react-sdk/[Rust Crypto] › integration-manager/kick.spec.ts took 40.0s
|
🎭 Playwright Run Summary
44 skipped
60 passed (10.9m)
|
🎭 Playwright Run Summary
44 skipped
60 passed (12.0m)
|
🎭 Playwright Run Summary
12 skipped
89 passed (12.9m)
|
🎭 Playwright Run Summary
2 flaky
[Rust Crypto] › sliding-sync/sliding-sync.spec.ts:186:9 › Sliding Sync › should update user settings promptly
[Rust Crypto] › timeline/timeline.spec.ts:926:13 › Timeline › message sending › should display a reply chain
13 skipped
86 passed (13.4m)
|
🎭 Playwright Run Summary
3 skipped
98 passed (13.6m)
|
🎭 Playwright Run Summary
3 skipped
98 passed (15.3m)
|
🎭 Playwright Run Summary
8 skipped
94 passed (16.1m)
|
🎭 Playwright Run Summary
1 flaky
[Rust Crypto] › crypto/migration.spec.ts:39:5 › migration › Should support migration from legacy crypto
7 skipped
94 passed (18.5m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-1
Expired
|
1.49 MB |
|
all-blob-reports-2
Expired
|
653 KB |
|
all-blob-reports-3
Expired
|
999 KB |
|
all-blob-reports-4
Expired
|
1.04 MB |
|
all-blob-reports-5
Expired
|
8.53 MB |
|
all-blob-reports-6
Expired
|
616 KB |
|
all-blob-reports-7
Expired
|
944 KB |
|
all-blob-reports-8
Expired
|
7.51 MB |
|
html-report
Expired
|
16.7 MB |
|
webapp
Expired
|
38.6 MB |
|