System.Net.Http.Functional.Tests failures on coreclr windows x64 Debug

[radical]

Build, and log:

    System.Net.Http.Functional.Tests.Http1SingleChunkResponseStreamZeroByteReadTest.ZeroByteRead_IssuesZeroByteReadOnUnderlyingStream(readMode: SyncSpan, useSsl: True) [FAIL]
      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/ResponseStreamZeroByteReadTests.cs(117,0): at System.Net.Http.Functional.Tests.Http1ResponseStreamZeroByteReadTestBase.ZeroByteRead_IssuesZeroByteReadOnUnderlyingStream(ReadWriteMode readMode, Boolean useSsl)
        --- End of stack trace from previous location ---

    System.Net.Http.Functional.Tests.SocksProxyTest_Http1_Async.TestLoopbackAsync(scheme: "socks4", useSsl: True, useAuth: True, host: "localhost") [FAIL]
      System.AggregateException : One or more errors occurred. (Early EOF)
      ---- System.Exception : Early EOF
      Stack Trace:
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(325,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.DisposeAsync()
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocksProxyTest.cs(58,0): at System.Net.Http.Functional.Tests.SocksProxyTest.<>c__DisplayClass3_0.<<TestLoopbackAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(120,0): at System.Threading.Tasks.TaskTimeoutExtensions.GetRealException(Task task)
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(90,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Net/Http/GenericLoopbackServer.cs(38,0): at System.Net.Test.Common.LoopbackServerFactory.<>c__DisplayClass5_0.<<CreateClientAndServerAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Net/Http/LoopbackServer.cs(101,0): at System.Net.Test.Common.LoopbackServer.CreateServerAsync(Func`2 funcAsync, Options options)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocksProxyTest.cs(37,0): at System.Net.Http.Functional.Tests.SocksProxyTest.TestLoopbackAsync(String scheme, Boolean useSsl, Boolean useAuth, String host)
        --- End of stack trace from previous location ---
        ----- Inner Stack Trace -----
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(77,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.ProcessRequest(Socket clientSocket, NetworkStream ns)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(55,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.<>c__DisplayClass8_0.<<-ctor>b__1>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(315,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.DisposeAsync()
StatusCode: 200, ReasonPhrase: 'OK', Version: 1.1, Content: System.Net.Http.HttpConnectionResponseContent, Headers:
{
  Connection: Close
  Date: Fri, 25 Mar 2022 19:54:58 GMT
  Content-Length: 0
}
StatusCode: 200, ReasonPhrase: 'OK', Version: 1.1, Content: System.Net.Http.HttpConnectionResponseContent, Headers:
{
  Connection: Close
  Date: Fri, 25 Mar 2022 19:54:58 GMT
  Content-Length: 0
}

[ghost]

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build, and log:

    System.Net.Http.Functional.Tests.Http1SingleChunkResponseStreamZeroByteReadTest.ZeroByteRead_IssuesZeroByteReadOnUnderlyingStream(readMode: SyncSpan, useSsl: True) [FAIL]
      System.TimeoutException : The operation has timed out.
      Stack Trace:
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/ResponseStreamZeroByteReadTests.cs(117,0): at System.Net.Http.Functional.Tests.Http1ResponseStreamZeroByteReadTestBase.ZeroByteRead_IssuesZeroByteReadOnUnderlyingStream(ReadWriteMode readMode, Boolean useSsl)
        --- End of stack trace from previous location ---

    System.Net.Http.Functional.Tests.SocksProxyTest_Http1_Async.TestLoopbackAsync(scheme: "socks4", useSsl: True, useAuth: True, host: "localhost") [FAIL]
      System.AggregateException : One or more errors occurred. (Early EOF)
      ---- System.Exception : Early EOF
      Stack Trace:
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(325,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.DisposeAsync()
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocksProxyTest.cs(58,0): at System.Net.Http.Functional.Tests.SocksProxyTest.<>c__DisplayClass3_0.<<TestLoopbackAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(120,0): at System.Threading.Tasks.TaskTimeoutExtensions.GetRealException(Task task)
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Threading/Tasks/TaskTimeoutExtensions.cs(90,0): at System.Threading.Tasks.TaskTimeoutExtensions.WhenAllOrAnyFailed(Task[] tasks)
        /_/src/libraries/Common/tests/System/Net/Http/GenericLoopbackServer.cs(38,0): at System.Net.Test.Common.LoopbackServerFactory.<>c__DisplayClass5_0.<<CreateClientAndServerAsync>b__0>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/Common/tests/System/Net/Http/LoopbackServer.cs(101,0): at System.Net.Test.Common.LoopbackServer.CreateServerAsync(Func`2 funcAsync, Options options)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/SocksProxyTest.cs(37,0): at System.Net.Http.Functional.Tests.SocksProxyTest.TestLoopbackAsync(String scheme, Boolean useSsl, Boolean useAuth, String host)
        --- End of stack trace from previous location ---
        ----- Inner Stack Trace -----
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(77,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.ProcessRequest(Socket clientSocket, NetworkStream ns)
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(55,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.<>c__DisplayClass8_0.<<-ctor>b__1>d.MoveNext()
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Http/tests/FunctionalTests/LoopbackSocksServer.cs(315,0): at System.Net.Http.Functional.Tests.LoopbackSocksServer.DisposeAsync()
StatusCode: 200, ReasonPhrase: 'OK', Version: 1.1, Content: System.Net.Http.HttpConnectionResponseContent, Headers:
{
  Connection: Close
  Date: Fri, 25 Mar 2022 19:54:58 GMT
  Content-Length: 0
}
StatusCode: 200, ReasonPhrase: 'OK', Version: 1.1, Content: System.Net.Http.HttpConnectionResponseContent, Headers:
{
  Connection: Close
  Date: Fri, 25 Mar 2022 19:54:58 GMT
  Content-Length: 0
}

Author:	radical
Assignees:	-
Labels:	area-System.Net.Http, blocking-clean-ci
Milestone:	-

[karelz]

Triage: If it failed on rerun, we should keep it open. @rzikm can you please check?

[rzikm]

I can't find any information about retries in the job log or in the test reports. Strangely, it is reported as failure of the job itself, not individual tests (https://dev.azure.com/dnceng/public/_build/results?buildId=1682418&view=ms.vss-test-web.build-test-results-tab&runId=46071392&resultId=198765&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab), so it does not even show in the CI TestResults DB queries. I think that is because the entire job timed out.

I think this is just something environmental, so I will close this issue, we can reopen it if it happens more frequently.