Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update-backlog: promote subtests when full test promotion isn't possible #107

Open
ErichDonGubler opened this issue May 30, 2024 · 2 comments
Assignees
Labels
A-webgpu-cts enhancement New feature or request

Comments

@ErichDonGubler
Copy link
Collaborator

@nical and I have observed that there are quite a few tests—particularly tests for parsing and parameterized API tests not associated with textures specifically—that actually run within the wptrunner timeout window on Firefox, but have a small subset of tests that do not pass. We're not sure if those subcases are trivial to resolve. We can, however, cut the Gordian knot by empowering ourselves to promote the subtests that do perma-PASS, get them locked into tier 2, and move on with other triage.

@ErichDonGubler ErichDonGubler added enhancement New feature or request A-webgpu-cts labels May 30, 2024
@ErichDonGubler
Copy link
Collaborator Author

Estimate: M (~3 days; ~2 days to implement, 1 to triage affected tests).

@ErichDonGubler
Copy link
Collaborator Author

ErichDonGubler commented May 30, 2024

I'm guessing we'll yield a couple dozen promoted tests, with many subtests promoted. We will want to start representing our tier promotion progress with test and subtest counts from the point that we do this.

@ErichDonGubler ErichDonGubler self-assigned this May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-webgpu-cts enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant