CI Reliability 2020-07-30

[github-actions]

Failures in node-test-pull-request/32451 to node-test-pull-request/32548 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time	RUNNING	SUCCESS	UNSTABLE	ABORTED	FAILURE	Green Rate
2020-07-30 00:32	2	41	0	19	38	51.90%

JSTest Failure

Reason	parallel/test-net-dns-error
Type	JS_TEST_FAILURE
Failed PR	3 (nodejs/node#34336, nodejs/node#34540, nodejs/node#34542)
Appeared	test-azure_msft-win10_vcbt2015-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/32512/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32532/

Example

not ok 335 parallel/test-net-dns-error
  ---
  duration_ms: 0.264
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:84
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Input A expected to strictly equal input B:
    + expected - actual
    
    - 'EAI_FAIL'
    + 'ENOTFOUND'
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-dns-error.js:37:10)
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:379:15)
        at Socket.emit (events.js:198:13)
        at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1005:12)
        at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:56:17)
  ...

---

Reason	benchmark/test-benchmark-napi
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#34542, nodejs/node#28237)
Appeared	test-digitalocean-freebsd11-x64-2, test-joyent-alpine311_container-x64-1, test-joyent-alpine312_container-x64-1, test-softlayer-centos7-x64-1, test-digitalocean-debian9-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-fedora30-x64-2, test-rackspace-ubuntu1604-x64-2, test-digitalocean-ubuntu1804-x64-1, test-orka-macos10.14-x64-2, test-nearform-macos10.15-x64-3, test-osuosl-centos7-ppc64_le-1, test-joyent-smartos18-x64-4, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6, test-joyent-ubuntu1804_sharedlibs_container-x64-1, test-packetnet-centos7-arm64-2, test-ibm-rhel7-s390x-1, test-ibm-aix71-ppc64_be-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_williamkapke-debian10-arm64_pi3-1, test-digitalocean-freebsd11-x64-1, test-digitalocean-alpine311_container-x64-1, test-softlayer-alpine312_container-x64-1, test-rackspace-centos7-x64-1, test-orka-macos10.14-x64-1, test-nearform-macos10.15-x64-2, test-joyent-smartos18-x64-3, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-packetnet-centos7-arm64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/32529/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32530/

Example

not ok 2906 benchmark/test-benchmark-napi
  ---
  duration_ms: 1.793
  severity: fail
  exitcode: 1
  stack: |-
    internal/modules/cjs/loader.js:1102
      throw err;
      ^
    
    Error: Cannot find module '/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/benchmark/napi/type-tag'
        at Function.Module._resolveFilename (internal/modules/cjs/loader.js:1099:15)
        at Function.Module._load (internal/modules/cjs/loader.js:942:27)
        at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:60:12)
        at internal/main/run_main_module.js:17:47 {
      code: 'MODULE_NOT_FOUND',
      requireStack: []
    }
    assert.js:103
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/benchmark.js:30:12)
        at ChildProcess.emit (events.j...

---

Reason	parallel/test-policy-integrity
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#34372, nodejs/node#34404)
Appeared	test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-digitalocean-debian9-x64-1, test-joyent-smartos18-x64-4, test-packetnet-centos7-arm64-2, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2013-x64-1, test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-rackspace-fedora27-x64-1, test-digitalocean-freebsd11-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-azure_msft-win10_vs2019-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/32544/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32548/

Example

not ok 1756 parallel/test-policy-integrity
  ---
  duration_ms: 121.833
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...

---

Jenkins Failure

Reason	Backing channel 'JNLP4-connect connection from ... is disconnected.
Type	JENKINS_FAILURE
Failed PR	6 (nodejs/node#34057, nodejs/node#34394, nodejs/node#34499, nodejs/node#34336, nodejs/node#34342, nodejs/node#34542)
Appeared	test-requireio_svincent-debian10-armv7l_pi2-3, test-orka-macos10.14-x64-2, test-orka-macos10.15-x64-2, test-orka-macos10.14-x64-1, test-orka-macos10.15-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/32460/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32543/

Example

java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:50186' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy96.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

---

Reason	Build timed out (after 120 minutes). Marking the build as failed.
Type	JENKINS_FAILURE
Failed PR	2 (nodejs/node#34375, nodejs/node#34542)
Appeared	test-digitalocean-fedora27-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/32505/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32532/

Example

Build timed out (after 120 minutes). Marking the build as failed.

---

Git Failure

Build Failure

Reason	ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type	BUILD_FAILURE
Failed PR	3 (nodejs/node#34057, nodejs/node#34499, nodejs/node#34542)
Appeared	test-osuosl-centos7-ppc64_le-1, test-orka-macos10.14-x64-2, test-orka-macos10.15-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/32462/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32529/

Example

ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-plinux/nodes=centos7-ppcle #34179
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

---

Reason	fatal error: ld terminated with signal 9 [Killed]
Type	BUILD_FAILURE
Failed PR	2 (nodejs/node#34498, nodejs/node#34541)
Appeared	test-joyent-ubuntu1804_sharedlibs_container-x64-4
First CI	https://ci.nodejs.org/job/node-test-pull-request/32516/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/32525/

Example

fatal error: ld terminated with signal 9 [Killed]

---

undefined

Progress

• parallel/test-net-dns-error (3)
• benchmark/test-benchmark-napi (2)
• parallel/test-policy-integrity (2)
• Backing channel 'JNLP4-connect connection from ... is disconnected. (6)
• Build timed out (after 120 minutes). Marking the build as failed. (2)
• ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ... (3)
• fatal error: ld terminated with signal 9 [Killed] (2)

[mmarchini]

just fyi, I ran the previous one manually, that's why we had two issues opened in a short span of time. Moving forward those will be created once a day.

[bmeck]

test/parallel/test-policy-integrity is failing because when testing for missing package.json in the test tmp directory is crawling up the fs and sees file:///home/iojs/node-tmp/package.json , is there a location on disk we can write files to that do not have a package.json above them?

Error [ERR_MANIFEST_ASSERT_INTEGRITY]: The content of "file:///home/iojs/node-tmp/package.json" does not match the expected integrity. The resource was not found in the policy.
at new NodeError (internal/errors.js:253:15)
at Manifest.assertIntegrity (internal/policy/manifest.js:252:19)
at Object.read (internal/modules/package_json_reader.js:25:28)
at readPackage (internal/modules/cjs/loader.js:276:36)
at readPackageScope (internal/modules/cjs/loader.js:315:19)
at shouldUseESMLoader (internal/modules/run_main.js:36:15)
at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:55:24)
at MessagePort. (internal/main/worker_thread.js:169:24)
at MessagePort.[nodejs.internal.kHybridDispatch] (internal/event_target.js:352:41)
at MessagePort.exports.emitMessage (internal/per_context/messageport.js:18:26)

/home/iojs/build/workspace/node-test-commit-arm/nodes/centos7-arm64-gcc8/test/parallel/test-policy-integrity.js:116
throw e;

It also appears not all machines have these files so some distros pass the test.