Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(test-tooling): fix flaky rustc-container-target-bundler #1626

Open
petermetz opened this issue Dec 3, 2021 · 0 comments
Open

test(test-tooling): fix flaky rustc-container-target-bundler #1626

petermetz opened this issue Dec 3, 2021 · 0 comments
Labels
bug Something isn't working dependencies Pull requests that update a dependency file Flaky-Test-Automation Issues related to test stability (which is a long running issue that can never fully be solved) Tests Anything related to tests be that automatic or manual, integration or unit, etc.

Comments

@petermetz
Copy link
Contributor

Describe the bug

Fix the flaky test, e.g. make it stable so that it always either fails or always succeeds.
The test file: packages/cactus-test-tooling/src/test/typescript/integration/rustc-container/rustc-container-target-bundler.test.ts

To Reproduce

Run it enough times to make it fail. (most of the time it succeeds)

Expected behavior

The test should be stable.

Logs/Stack traces

CI logs: logs_11658.zip

2021-12-02T20:08:05.9467759Z     not ok 9 Error: Docker Exec timed out after 300000ms
2021-12-02T20:08:05.9469564Z       ---
2021-12-02T20:08:05.9470295Z         operator: error
2021-12-02T20:08:05.9480137Z         at: bound (/home/runner/work/cactus/cactus/node_modules/tape-promise/node_modules/onetime/index.js:30:12)
2021-12-02T20:08:05.9481438Z         stack: |-
2021-12-02T20:08:05.9482654Z           Error: Docker Exec timed out after 300000ms
2021-12-02T20:08:05.9484739Z               at Timeout._onTimeout (/home/runner/work/cactus/cactus/packages/cactus-test-tooling/src/main/typescript/common/containers.ts:102:13)
2021-12-02T20:08:05.9486349Z               at listOnTimeout (internal/timers.js:557:17)
2021-12-02T20:08:05.9487290Z               at processTimers (internal/timers.js:500:7)
2021-12-02T20:08:05.9488081Z       ...
2021-12-02T20:08:16.1465640Z     
2021-12-02T20:08:16.1487921Z     Bail out! Error: Docker Exec timed out after 300000ms
2021-12-02T20:08:16.1613711Z Bail out! Error: Docker Exec timed out after 300000ms

Cloud provider or hardware configuration:

Github Action Runner

Operating system name, version, build:

Ubuntu 20.04

Hyperledger Cactus release version or commit (git rev-parse --short HEAD):

1.0.0-rc.2

Hyperledger Cactus Plugins/Connectors Used

N/A

@petermetz petermetz added bug Something isn't working dependencies Pull requests that update a dependency file Flaky-Test-Automation Issues related to test stability (which is a long running issue that can never fully be solved) Tests Anything related to tests be that automatic or manual, integration or unit, etc. labels Dec 3, 2021
outSH added a commit to outSH/cactus that referenced this issue Jul 4, 2022
- Remove flaky tests from main CI execution.
- Add separate TAP and jest configuration for running only flaky tests.
- Add test:*:flaky scripts in the main package.json
- Add new step to github CI script to run flaky tests as optional
  (i.e. don't fail if flaky test fails)

Closes: hyperledger-cacti#2112

Related: hyperledger-cacti#2104
Related: hyperledger-cacti#1626
Related: hyperledger-cacti#2019
Related: hyperledger-cacti#1625
Related: hyperledger-cacti#1543
Related: hyperledger-cacti#1598
Related: hyperledger-cacti#1528
Related: hyperledger-cacti#1521
Related: hyperledger-cacti#1495
Related: hyperledger-cacti#1485
Related: hyperledger-cacti#1473
Related: hyperledger-cacti#1471
Related: hyperledger-cacti#1469
Related: hyperledger-cacti#1150

Signed-off-by: Michal Bajer <michal.bajer@fujitsu.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dependencies Pull requests that update a dependency file Flaky-Test-Automation Issues related to test stability (which is a long running issue that can never fully be solved) Tests Anything related to tests be that automatic or manual, integration or unit, etc.
Projects
None yet
Development

No branches or pull requests

1 participant