Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run release tests with parallel option #313

Merged
merged 3 commits into from
Mar 9, 2022
Merged

Run release tests with parallel option #313

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
0d0d57d
Move CLI test steps global lets to CustomWorld
f1ames Mar 4, 2022
419f640
Retry on getting runner PID
f1ames Mar 4, 2022
88670a8
Split release tests into parallel and not parallel supported
f1ames Mar 4, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions .github/workflows/release-test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,11 @@ jobs:
- name: Start sth
run: scramjet-transform-hub >> scramjet.log 2>&1 &

- name: Run BDD npm tests
run: SCRAMJET_TEST_LOG=1 SCRAMJET_HOST_BASE_URL="http://127.0.0.1:8000/api/v1" NO_HOST=1 yarn test:bdd-ci
- name: Run BDD npm tests (parallel)
run: SCRAMJET_TEST_LOG=1 SCRAMJET_HOST_BASE_URL="http://127.0.0.1:8000/api/v1" NO_HOST=1 yarn test:bdd-ci --tags="not @no-parallel" --parallel=2 --format=summary

- name: Run BDD npm tests (no-parallel)
run: SCRAMJET_TEST_LOG=1 SCRAMJET_HOST_BASE_URL="http://127.0.0.1:8000/api/v1" NO_HOST=1 yarn test:bdd-ci --tags="@no-parallel"

- name: Show logs
if: always()
Expand Down
6 changes: 4 additions & 2 deletions bdd/features/e2e/E2E-010-cli.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -199,7 +199,8 @@ Feature: CLI tests
Then confirm data named "hello-input-out-10" received
* stop host

@ci @cli
# This tests writes and uses shared config file so it may fail if run in parallel
@ci @cli @no-parallel
Scenario: E2E-010 TC-022 Check minus set/remove
Given I execute CLI with "seq select abc" arguments
And I execute CLI with "inst select def" arguments
Expand All @@ -208,7 +209,8 @@ Feature: CLI tests
And The sequence id equals "abc"
And The instance id equals "def"

@ci @cli
# This tests writes and uses shared config file so it may fail if run in parallel
@ci @cli @no-parallel
Scenario: E2E-010 TC-023 Check minus replacements with a sequence
Given host is running
When I execute CLI with "pack ../dist/reference-apps/checksum-sequence" arguments
Expand Down
Loading