Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI Reliability 2022-02-21 #209

Open
20 tasks
github-actions bot opened this issue Feb 21, 2022 · 1 comment
Open
20 tasks

CI Reliability 2022-02-21 #209

github-actions bot opened this issue Feb 21, 2022 · 1 comment

Comments

@github-actions
Copy link

Failures in node-test-pull-request/42605 to node-test-pull-request/42701 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-02-21 00:09 1 26 7 2 64 26.80%

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 10 (nodejs/node#42002, nodejs/node#42011, nodejs/node#41999, nodejs/node#41907, nodejs/node#41996, nodejs/node#42001, nodejs/node#42014, nodejs/node#42010, nodejs/node#36510, nodejs/node#41992)
Appeared test-equinix-centos7_container-arm64-2, test-equinix-ubuntu2004_container-arm64-2, test-osuosl-aix72-ppc64_be-3, test-osuosl-aix72-ppc64_be-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42607/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42667/
Example 
java.io.IOException: Backing channel 'JNLP4-connect connection from 139.178.85.13/139.178.85.13:59368' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
Reason Build timed out (after 30 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 5 (nodejs/node#42021, nodejs/node#42010, nodejs/node#41975, nodejs/node#42032, nodejs/node#41992)
Appeared test-rackspace-win2012r2_vs2019-x64-3, test-rackspace-win2012r2_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42641/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42668/
Example 
Build timed out (after 30 minutes). Marking the build as failed.
Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (nodejs/node#41956, nodejs/node#41861, nodejs/node#42021)
Appeared test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42619/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42636/
Example 
Build timed out (after 15 minutes). Marking the build as failed.

Build Failure

Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 5 (nodejs/node#42001, nodejs/node#41996, nodejs/node#42002, nodejs/node#41956, nodejs/node#42015)
Appeared test-osuosl-aix72-ppc64_be-2, test-equinix-centos7_container-arm64-2, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42608/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42623/
Example 
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-aix/nodes=aix72-ppc64 #40035
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com ashley.cripps@ibm.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

JSTest Failure

Reason parallel/test-module-readonly
Type JS_TEST_FAILURE
Failed PR 13 (nodejs/node#42002, nodejs/node#41956, nodejs/node#41861, nodejs/node#41962, nodejs/node#42021, nodejs/node#42010, nodejs/node#40349, nodejs/node#41975, nodejs/node#41992, nodejs/node#41947, nodejs/node#41782, nodejs/node#42055, nodejs/node#42049)
Appeared test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42618/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42701/
Example 
not ok 461 parallel/test-module-readonly
  ---
  duration_ms: 0.970
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:991
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: Cannot find module '..\.tmp.456\readOnlyMod'
    Require stack:
    - c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js:48:8)
        at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
        at Function.Module._load (node:internal/modules/cjs/loader:778:27)
        at Module.require (node:internal/modules/cjs/loader:999:19)
        at require (node:internal/modules/cjs/helpers:102:18)
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js:36:3)
        at Module._compile (node:internal/modules/cjs/loader:1097:14)
        at...
Reason parallel/test-crypto-dh-leak
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#40349, nodejs/node#35025, nodejs/node#41758, nodejs/node#42053)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_davglass-debian10-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42657/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42690/
Example 
not ok 160 parallel/test-crypto-dh-leak
  ---
  duration_ms: 240.74
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason sequential/test-cpu-prof-worker-argv
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#42045, nodejs/node#41992, nodejs/node#41782, nodejs/node#42046)
Appeared test-digitalocean-freebsd12-x64-2, test-digitalocean-freebsd12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42666/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42700/
Example 
not ok 3455 sequential/test-cpu-prof-worker-argv
  ---
  duration_ms: 0.651
  severity: fail
  exitcode: 1
  stack: |-
    
    [
      {
        id: 1,
        callFrame: {
          functionName: '(root)',
          scriptId: '0',
          url: '',
          lineNumber: -1,
          columnNumber: -1
        },
        hitCount: 0,
        children: [ 2, 3, 4, 11 ]
      },
      {
        id: 2,
        callFrame: {
          functionName: '(program)',
          scriptId: '0',
          url: '',
          lineNumber: -1,
          columnNumber: -1
        },
        hitCount: 0
      },
      {
        id: 3,
        callFrame: {
          functionName: '(garbage collector)',
          scriptId: '0',
          url: '',
          lineNumber: -1,
          columnNumber: -1
        },
        hitCount: 2
      },
      {
        id: 4,
        callFrame: {
          functionName: 'exports.emitMessage',
          scriptId: '8',
          url: 'node:internal/per_context/messageport',
          lineNumber: 18,
...
Reason parallel/test-child-process-fork-closed-channel-segfault
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#40349, nodejs/node#42055, nodejs/node#42054)
Appeared test-requireio_davglass-debian10-arm64_pi3-1, test-requireio_securogroup-debian10-arm64_pi3-2, test-requireio_williamkapke-debian10-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42657/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42692/
Example 
not ok 104 parallel/test-child-process-fork-closed-channel-segfault
  ---
  duration_ms: 3.480
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-child-process-fork-closed-channel-segfault.js:83
                throw err;
                ^
    
    Error: write EPIPE
        at ChildProcess.target._send (node:internal/child_process:864:20)
        at ChildProcess.<anonymous> (node:internal/child_process:667:16)
        at ChildProcess.emit (node:events:539:35)
        at emit (node:internal/child_process:936:14)
        at processTicksAndRejections (node:internal/process/task_queues:83:21) {
      errno: -32,
      code: 'EPIPE',
      syscall: 'write'
    }
    
    Node.js v18.0.0-pre
  ...
Reason parallel/test-fs-rmdir-recursive
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#42062, nodejs/node#42061, nodejs/node#42057)
Appeared test-requireio_jasnell-debian10-armv7l_pi2-1, test-requireio_davglass-debian10-arm64_pi3-1, test-requireio_mcollina-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42695/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42698/
Example 
not ok 296 parallel/test-fs-rmdir-recursive
  ---
  duration_ms: 241.250
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    (node:25791) [DEP0147] DeprecationWarning: In future versions of Node.js, fs.rmdir(path, { recursive: true }) will be removed. Use fs.rm(path, { recursive: true }) instead
    (Use `node --trace-deprecation ...` to show where the warning was created)
  ...
Reason parallel/test-http-header-overflow
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#42002, nodejs/node#41962, nodejs/node#41947)
Appeared test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42618/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42674/
Example 
not ok 312 parallel/test-http-header-overflow
  ---
  duration_ms: 0.250
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:635
          throw err;
          ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      Comparison {
    +   bytesParsed: 10642,
    -   bytesParsed: 16402,
        code: 'HPE_HEADER_OVERFLOW',
        message: 'Parse Error: Header overflow',
        name: 'Error',
    +   rawPacket: Buffer(10645) [Uint8Array] [
    ...
Reason parallel/test-net-connect-memleak
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#41861, nodejs/node#41782, nodejs/node#42055)
Appeared test-rackspace-win2012r2_vs2013-x64-1, test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/42626/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42687/
Example 
not ok 468 parallel/test-net-connect-memleak
  ---
  duration_ms: 0.249
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:375:10)
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-connect-memleak.js:33:40)
        at Module._compile (node:internal/modules/cjs/loader:1097:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1151:10)
        at Module.load (node:internal/modules/cjs/loader:975:32)
        at Function.Module._load (node:internal/modules/cjs/loader:822:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
        at node:internal/main/run_main_module:17:47
  ...
Reason sequential/test-cpu-prof-name
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#42010, nodejs/node#36510, nodejs/node#41782)
Appeared test-digitalocean-freebsd12-x64-1, test-ibm-rhel7-s390x-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42621/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42675/
Example 
not ok 3476 sequential/test-cpu-prof-name
  ---
  duration_ms: 0.647
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":3,"error":{"code":-32000,"message":"Cannot change sampling interval when profiling."}}
    EndStartedProfilers
    V8CpuProfilerConnection::End(), ending = false
    Dispatching message { "id": 4, "method": "Profiler.stop" }
    Receive CPU profile message
    Writing profile response (id = 4)
    Written result to /usr/home/iojs/node-tmp/.tmp.3475/test.cpuprofile
    
    [
      {
        id: 1,
        callFrame: {
          functionName: '(root)',
          scriptId: '0',
          url: '',
          lineNumbe...
Reason node-api/test_threadsafe_function/test
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#41992, nodejs/node#42032)
Appeared test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42667/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42671/
Example 
not ok 3360 node-api/test_threadsafe_function/test
  ---
  duration_ms: 240.95
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-common-expect-warning
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#41950, nodejs/node#42032)
Appeared test-equinix-centos7_container-arm64-2, test-equinix-ubuntu2004_container-arm64-2, test-equinix-centos7_container-arm64-1, test-equinix-ubuntu1804_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42625/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42671/
Example 
not ok 320 parallel/test-common-expect-warning
  ---
  duration_ms: 0.321
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:1026
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The input did not match the regular expression /Unexpected extra warning received/. Input:
    
    ''
    
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-arm/test/parallel/test-common-expect-warning.js:41:14)
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-arm/test/common/index.js:417:15)
        at ChildProcess.emit (node:events:527:28)
        at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
      expected: /Unexpected extra warning received/,
      operator: 'match'
    }
    
    Node.js v18.0.0-pre
  ...
Reason parallel/test-crypto-classes
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#40349, nodejs/node#42032)
Appeared test-requireio_ceejbot-debian10-armv7l_pi2-1, test-requireio_joeyvandijk-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42657/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42678/
Example 
not ok 211 parallel/test-crypto-classes
  ---
  duration_ms: 240.154
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-crypto-dh
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#42062, nodejs/node#42061)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_ceejbot-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42695/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42696/
Example 
not ok 199 parallel/test-crypto-dh
  ---
  duration_ms: 245.342
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-crypto-dh-odd-key
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#42032, nodejs/node#42054)
Appeared test-requireio_mcollina-debian10-armv7l_pi2-1, test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_mininodes-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42664/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42699/
Example 
not ok 206 parallel/test-crypto-dh-odd-key
  ---
  duration_ms: 240.179
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-fs-write-stream-file-handle
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#42010, nodejs/node#42054)
Appeared test-requireio_mcollina-debian10-armv7l_pi2-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/42654/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42699/
Example 
not ok 274 parallel/test-fs-write-stream-file-handle
  ---
  duration_ms: 45.493
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: /home/iojs/tmp/.tmp.273
    Files blocking: [ '.nfs0000000000000ce300006803' ]
    Note: ".nfs*" might be files that were open and unlinked but not closed.
    See http://nfs.sourceforge.net/#faq_d2 for details.
    
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'hello world'
        at WriteStream.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-write-stream-file-handle.js:19:12)
        at WriteStream.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:417:15)
        at WriteStream.emit (node:events:527:28)
        at emitCloseNT (node:internal/streams/destroy:145:10)
        at processTicksAndRejections (node:internal/process/task_queues:81:21) {
      gener...
Reason sequential/test-tls-session-timeout
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#42014, nodejs/node#42062)
Appeared test-requireio_davglass-debian10-arm64_pi3-1, test-requireio_svincent-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42620/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42695/
Example 
not ok 856 sequential/test-tls-session-timeout
  ---
  duration_ms: 9.858
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + 'New'
    - 'Reused'
        at /home/iojs/build/workspace/node-test-binary-arm/test/sequential/test-tls-session-timeout.js:124:16
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/sequential/test-tls-session-timeout.js:108:7)
        at ChildProcess.emit (node:events:527:28)
        at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 'New',
      expected: 'Reused',
      operator: 'strictEqual'
    }
    
    Node.js v18.0.0-pre
  ...
Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#42021, nodejs/node#40349)
Appeared test-azure_msft-win10_vs2019-x64-1, test-macstadium-macos11.0-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42632/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42657/
Example 
not ok 848 sequential/test-worker-prof
  ---
  duration_ms: 4.53
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with non-zero status:                      {
      status: 3221226505,
      signal: null,
      output: [ null, '', '' ],
      pid: 13336,
      stdout: '',
      stderr: ''
    }
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:61:10)
        at Module._compile (node:internal/modules/cjs/loader:1097:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1151:10)
        at Module.load (node:internal/modules/cjs/loader:975:32)
        at Function.Module._load (node:internal/modules/cjs/loader:822:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
        at node:internal/main/run_main_module:17:47 {
      generatedMessage: false,
      code: 'ER...

Progress

  • Backing channel 'JNLP4-connect connection from ... is disconnected. (10)
  • Build timed out (after 30 minutes). Marking the build as failed. (5)
  • Build timed out (after 15 minutes). Marking the build as failed. (3)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (5)
  • parallel/test-module-readonly (13)
  • parallel/test-crypto-dh-leak (4)
  • sequential/test-cpu-prof-worker-argv (4)
  • parallel/test-child-process-fork-closed-channel-segfault (3)
  • parallel/test-fs-rmdir-recursive (3)
  • parallel/test-http-header-overflow (3)
  • parallel/test-net-connect-memleak (3)
  • sequential/test-cpu-prof-name (3)
  • node-api/test_threadsafe_function/test (2)
  • parallel/test-common-expect-warning (2)
  • parallel/test-crypto-classes (2)
  • parallel/test-crypto-dh (2)
  • parallel/test-crypto-dh-odd-key (2)
  • parallel/test-fs-write-stream-file-handle (2)
  • sequential/test-tls-session-timeout (2)
  • sequential/test-worker-prof (2)
@wbt
Copy link

wbt commented Feb 21, 2022

@nodejs-github-bot While "multiple PRs failed on this reason" might be a somewhat useful signal, it's also relatively noisy...how about noting that the failure was happening on the base branch that the PR was trying to merge into, thus making the CI run not a good measure of whether the PR introduced a new issue?
It would also be nice to have a button for even non-collaborators to re-run a CI job suffering from unreliability issues even when run on the base branch (usually master/main).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@wbt