Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add integration tests using WebdriverIO #2322

Closed
23 of 24 tasks
traeok opened this issue Jun 2, 2023 · 3 comments · Fixed by #2927
Closed
23 of 24 tasks

Add integration tests using WebdriverIO #2322

traeok opened this issue Jun 2, 2023 · 3 comments · Fixed by #2927
Assignees
Labels
enhancement New feature or request priority-medium Not functioning - next quarter if capacity permits Research Needed Technical Debt Includes Architecture, Code, Testing, Automation debt

Comments

@traeok
Copy link
Member

traeok commented Jun 2, 2023

Is your feature request related to a problem? Please describe.

Currently, our tests consist of unit tests and snapshots. We also have some Selenium tests for the Theia environment, but we don't have a set of integration tests for testing how the extension behaves within VS Code.

We might not be able to add these integration tests to our automated pipelines (as VS Code needs a display to show its UI), but it would help to run this locally when adding new features or addressing bugs to make sure that all features work as intended.

Describe the solution you'd like

Leverage the WebdriverIO framework to create a preliminary set of integration tests for Zowe Explorer.

Describe alternatives you've considered

I'm not aware of other frameworks for testing the user interface for VS Code extensions, but if an alternative exists, we should compare our options and pick the best framework for our use cases.

Tasks

  1. Tests enhancement priority-medium
@traeok traeok added enhancement New feature or request Technical Debt Includes Architecture, Code, Testing, Automation debt labels Jun 2, 2023
@github-actions
Copy link

github-actions bot commented Jun 2, 2023

Thank you for raising this enhancement request.
The community has 90 days to vote on it.
If the enhancement receives at least 10 upvotes, it is added to our development backlog.
If it receives fewer votes, the issue is closed.

@JTonda JTonda added the priority-medium Not functioning - next quarter if capacity permits label Aug 31, 2023
@JTonda
Copy link

JTonda commented Oct 2, 2023

Test Plan:

  • Set up framework
  • Duplicate/model Thea tests - initial set of tests (not all inclusive)
  • Add to PR checklist
  • Documentation - Dev Docs

@adam-wolfe adam-wolfe mentioned this issue Oct 2, 2023
31 tasks
@traeok traeok self-assigned this Apr 18, 2024
@traeok traeok changed the title Consider adding integration tests using vscode-extension-tester Add integration tests using vscode-extension-tester Apr 24, 2024
@traeok
Copy link
Member Author

traeok commented Apr 30, 2024

Here are the branches I've created for my research - each branch contains a sample test that uses the given framework.

WebdriverIO: test/wdio
ExTester: test/ExTester
Nightwatch.js: test/Nightwatch.js

Link to research: https://ent.box.com/s/m32dgpfnt5bvwsiuvxr85kesvh3ty8mn

@traeok traeok changed the title Add integration tests using vscode-extension-tester Add integration tests using WebdriverIO May 1, 2024
@traeok traeok linked a pull request May 28, 2024 that will close this issue
21 tasks
@JTonda JTonda closed this as completed Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request priority-medium Not functioning - next quarter if capacity permits Research Needed Technical Debt Includes Architecture, Code, Testing, Automation debt
Projects
Status: Closed
Development

Successfully merging a pull request may close this issue.

2 participants