t/live.t may fail

[eserte]

Every now and then t/live.t fails like this:

No route to host at t/live.t line 28.
# Looks like your test exited with 65 before it could output anything.
t/live.t ............... 
Dubious, test returned 65 (wstat 16640, 0x4100)
Failed 6/6 subtests 

or

Operation timed out at t/live.t line 28.
# Looks like your test exited with 60 before it could output anything.
t/live.t ............... 
Dubious, test returned 60 (wstat 15360, 0x3c00)
Failed 6/6 subtests 

or

Connection timed out at t/live.t line 28.
# Looks like your test exited with 110 before it could output anything.
t/live.t ............... 
Dubious, test returned 110 (wstat 28160, 0x6e00)
Failed 6/6 subtests 

Maybe neverssl.com is not reliable anymore?

[jkeenan]

@oalders and crew, I endorse what @eserte posted last month. I was about to file a new Issue here when I saw that Slaven had (as usual) beaten me to it. Here is the message I had prepared:

Today I had occasion to try to install a large number of CPAN libraries against a perl built from the HEAD of Perl's main development branch, "blead." I conducted this exercise on both Debian Linux and FreeBSD-14. I was surprised to get test failures in Net-HTTP on 2 distinct runs on the FreeBSD machine. Another veteran CPANtester, DCANTRELL, also got a failure in Net-HTTP.

You can see the list of reports here.

One of my failure reports is here. Excerpt:

t/00-report-prereqs.t .. ok
t/http-nb.t ............ ok
t/http.t ............... ok
t/live-https.t ......... ok
Operation timed out at t/live.t line 28.
# Looks like your test exited with 60 before it could output anything.
t/live.t ............... 
Dubious, test returned 60 (wstat 15360, 0x3c00)
Failed 6/6 subtests 
t/socket-class.t ....... ok

Test Summary Report
-------------------
t/live.t             (Wstat: 15360 (exited 60) Tests: 0 Failed: 0)
  Non-zero exit status: 60
  Parse errors: Bad plan.  You planned 6 tests but ran 0.

I couldn't recall getting FAILs in Net-HTTP before. I was particularly concerned when I saw

Operation timed out at t/live.t line 28.

... because we made some changes to the Time-HiRes library in blead a few days before these failure reports.

I then took a look at t/live.t. Is it possible that with a Timeout => 15 setting, the test program simply can't connect to www.neverssl.com quickly enough? Should we raise the Timeout value to avoid false negatives?

[oalders]

New version is on its way to CPAN. Thanks @eserte and @jkeenan!