Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Iterate on new test icons experiments #17197

Closed
5 tasks done
luabud opened this issue Sep 1, 2021 · 2 comments
Closed
5 tasks done

Iterate on new test icons experiments #17197

luabud opened this issue Sep 1, 2021 · 2 comments
Assignees
Labels
area-testing feature-request Request for new features or functionality verified Verification succeeded

Comments

@luabud
Copy link
Member

luabud commented Sep 1, 2021

These experiments enable icons for "run all failed tests" and "refresh tests" in the test explorer. We have a hypothesis that these are useful actions to have in the test explorer, so with the experiments we will be able see if it holds true with all kinds of users.

image

  • Turn "run all failed tests" to 100% of insider and 10% of stable users
  • Turn "run all failed tests" to 50% of stable users (provided we see good results)
  • Turn "run all failed tests" to 100% of stable users (provided we see good results)
  • Turn "refresh tests" to 100% of insiders and 50% of stable users
  • Turn "refresh tests" to 100% of stable users (provided we see good results)
@luabud luabud added feature-request Request for new features or functionality triage-needed Needs assignment to the proper sub-team needs decision and removed triage-needed Needs assignment to the proper sub-team labels Sep 1, 2021
@luabud luabud self-assigned this Sep 1, 2021
@luabud luabud added this to the September 2021 milestone Sep 1, 2021
@luabud luabud closed this as completed Sep 28, 2021
@luabud
Copy link
Member Author

luabud commented Sep 28, 2021

To verify just clone https://github.com/luabud/sample_project, open a Python file and open the test explorer:

image

@luabud luabud added the verification-needed Verification of issue is requested label Sep 28, 2021
@aeschli
Copy link

aeschli commented Sep 29, 2021

I verified that I see the two actions in the tests view. Please reopen if there's more to verify.

Python v2021.9.1246542782, with insiders (daily)

@aeschli aeschli added verified Verification succeeded and removed verification-needed Verification of issue is requested labels Sep 29, 2021
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Dec 1, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-testing feature-request Request for new features or functionality verified Verification succeeded
Projects
None yet
Development

No branches or pull requests

2 participants