Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert "chore(test runner): remove fake skipped test results (#27762)" #28360

Merged
merged 1 commit into from
Nov 28, 2023

Conversation

dgozman
Copy link
Contributor

@dgozman dgozman commented Nov 27, 2023

This reverts commit 210168e.

Fixes #28321.

Copy link
Contributor

Test results for "tests 1"

4 flaky ⚠️ [firefox] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [playwright-test] › ui-mode-test-screencast.spec.ts:21:5 › should show screenshots
⚠️ [webkit] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks

26148 passed, 612 skipped
✔️✔️✔️

Merge workflow run.

@dgozman dgozman merged commit f61e445 into microsoft:main Nov 28, 2023
30 checks passed
yury-s pushed a commit to yury-s/playwright that referenced this pull request Nov 28, 2023
dgozman added a commit that referenced this pull request Apr 25, 2024
There are plenty of edge cases in this area:
- interrupted test run;
- did not run because of serial mode failure;
- failed before `test.skip()` call (e.g. in `beforeEach`) in one of the
retries;
- and more...

Related issues: #28322, #28321, #27455, #17652.
Prior changes: #27762, #26385, #28360, probably more.

There is still some duplication between `outcome()` and similar logic in
`base.ts`, which might be deduped in a follow-up.

Fixes #28322.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Ambiguous test outcome and status for serial mode
3 participants