Archery Integration Test with c# failing on main #6577

alamb · 2024-10-16T21:28:22Z

Describe the bug
archery integration test is failing on main : https://github.com/apache/arrow-rs/actions/runs/11363774836/job/31608436255

 ################# FAILURES #################
  FAILED TEST: primitive Rust producing,  C# consuming
  <class 'RuntimeError'>: Command failed: /__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest client --port 44909 --path /tmp/arrow-integration-hk4dbqi4/generated_primitive.json
  With output:
  --------------
  Unhandled exception: Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error connecting to subchannel.", DebugException="System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')")
   ---> System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')
     at System.Net.Dns.GetHostEntryOrAddressesCoreAsync(String hostName, Boolean justReturnParsedIp, Boolean throwOnIIPAny, Boolean justAddresses, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Dns.GetHostAddressesAsync(String hostNameOrAddress, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Sockets.SocketAsyncEventArgs.DnsConnectAsync(DnsEndPoint endPoint, SocketType socketType, ProtocolType protocolType)
     at System.Net.Sockets.Socket.ConnectAsync(SocketAsyncEventArgs e, Boolean userSocket, Boolean saeaCancelable)
     at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ConnectAsync(Socket socket)
     at System.Net.Sockets.Socket.ConnectAsync(EndPoint remoteEP, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.OnConnect(Socket socket, DnsEndPoint endpoint, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.TryConnectAsync(ConnectContext context, Int32 attempt)
     --- End of inner exception stack trace ---
     at Grpc.Net.Client.Internal.HttpContentClientStreamReader`2.MoveNextCore(CancellationToken cancellationToken)
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadSchemaAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 74
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadNextRecordBatchAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 118
     at Apache.Arrow.Flight.FlightRecordBatchStreamReader.MoveNext(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/FlightRecordBatchStreamReader.cs:line 64
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.ConsumeFlightLocation(FlightClient client, FlightTicket ticket, RecordBatch[] batches) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 160
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.RunClient(Int32 serverPort) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 109
     at Apache.Arrow.Flight.IntegrationTest.FlightClientCommand.Execute() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/FlightClientCommand.cs:line 45
     at Apache.Arrow.Flight.IntegrationTest.Program.<>c.<<Main>b__0_0>d.MoveNext() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Program.cs:line 50

To Reproduce

Expected behavior
Should pass

Additional context
Not sure if this is related to #6568 or not

The text was updated successfully, but these errors were encountered:

itsjunetime · 2024-10-18T18:31:19Z

I think #6585 might fix this as well

alamb · 2024-10-20T11:21:57Z

I think #6585 might fix this as well

Thanks @itsjunetime -- unfortunately it seems like the tests are still failing even with #6585 (recent example) . I'll see what I can do

alamb · 2024-10-20T11:26:28Z

I poked around in the arrow repo. There are two PRs that went in around the same time this test started failing that could be related

GH-44360: [C#] Fix Flight DoExchange incompatibility with C++ implementation arrow#44424
GH-44361: [C#][Integration] Include .NET in Flight integration tests arrow#44377

apache/arrow#44377 specifically looks related as this test appears to be new. I will ask some questions there and make a PR to disable this test in arrow-rs while we investigate more

alamb · 2024-10-20T11:30:30Z

Here is another more specific message from the logs https://github.com/apache/arrow-rs/actions/runs/11409436304/job/31749661931

 ======================================================================
  Testing file null
  Traceback (most recent call last):
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/util.py", line 136, in run_cmd
      output = subprocess.check_output(cmd, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 466, in check_output
      return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 571, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['/__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest', 'client', '--port', '46599', '--path', '/tmp/arrow-integration-2gthhuy4/generated_null.json']' returned non-zero exit status 1.
  
  During handling of the above exception, another exception occurred:
  
  Traceback (most recent call last):
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/runner.py", line 435, in _run_flight_test_case
      consumer.flight_request(port, **client_args)
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/tester_csharp.py", line 218, in flight_request
      run_cmd(cmd)
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/util.py", line 145, in run_cmd
      raise RuntimeError(sio.getvalue())
  RuntimeError: Command failed: /__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest client --port 46599 --path /tmp/arrow-integration-2gthhuy4/generated_null.json
  With output:
  --------------
  Unhandled exception: Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error connecting to subchannel.", DebugException="System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')")
   ---> System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')
     at System.Net.Dns.GetHostEntryOrAddressesCoreAsync(String hostName, Boolean justReturnParsedIp, Boolean throwOnIIPAny, Boolean justAddresses, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Dns.GetHostAddressesAsync(String hostNameOrAddress, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Sockets.SocketAsyncEventArgs.DnsConnectAsync(DnsEndPoint endPoint, SocketType socketType, ProtocolType protocolType)
     at System.Net.Sockets.Socket.ConnectAsync(SocketAsyncEventArgs e, Boolean userSocket, Boolean saeaCancelable)
     at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ConnectAsync(Socket socket)
     at System.Net.Sockets.Socket.ConnectAsync(EndPoint remoteEP, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.OnConnect(Socket socket, DnsEndPoint endpoint, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.TryConnectAsync(ConnectContext context, Int32 attempt)
     --- End of inner exception stack trace ---
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadSchemaAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 74
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadNextRecordBatchAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 118
     at Apache.Arrow.Flight.FlightRecordBatchStreamReader.MoveNext(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/FlightRecordBatchStreamReader.cs:line 64
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.ConsumeFlightLocation(FlightClient client, FlightTicket ticket, RecordBatch[] batches) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 160
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.RunClient(Int32 serverPort) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 109
     at Apache.Arrow.Flight.IntegrationTest.FlightClientCommand.Execute() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/FlightClientCommand.cs:line 45
     at Apache.Arrow.Flight.IntegrationTest.Program.<>c.<<Main>b__0_0>d.MoveNext() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Program.cs:line 50
  --- End of stack trace from previous location ---
     at System.CommandLine.Invocation.AnonymousCommandHandler.InvokeAsync(InvocationContext context)
     at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass17_0.<<UseParseErrorReporting>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass12_0.<<UseHelp>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseVersionOption>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass19_0.<<UseTypoCorrections>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__18_0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass16_0.<<UseParseDirective>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__5_0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass8_0.<<UseExceptionHandler>b__0>d.MoveNext()
  
  --------------

alamb · 2024-10-20T11:41:00Z

Here is the job definition:

arrow-rs/.github/workflows/integration.yml

Lines 50 to 114 in 1666a4d

 jobs: 

 integration: 

 name: Archery test With other arrows 

 runs-on: ubuntu-latest 

 container: 

 image: apache/arrow-dev:amd64-conda-integration 

 env: 

 ARROW_USE_CCACHE: OFF 

 ARROW_CPP_EXE_PATH: /build/cpp/debug 

 ARROW_NANOARROW_PATH: /build/nanoarrow 

 ARROW_RUST_EXE_PATH: /build/rust/debug 

 BUILD_DOCS_CPP: OFF 

 ARROW_INTEGRATION_CPP: ON 

 ARROW_INTEGRATION_CSHARP: ON 

 ARROW_INTEGRATION_GO: ON 

 ARROW_INTEGRATION_JAVA: ON 

 ARROW_INTEGRATION_JS: ON 

 ARCHERY_INTEGRATION_TARGET_IMPLEMENTATIONS: "rust" 

 # Disable nanoarrow integration, due to https://github.com/apache/arrow-rs/issues/5052 

 ARCHERY_INTEGRATION_WITH_NANOARROW: "0" 

 # https://github.com/apache/arrow/pull/38403/files#r1371281630 

 ARCHERY_INTEGRATION_WITH_RUST: "1" 

 # These are necessary because the github runner overrides $HOME 

 # https://github.com/actions/runner/issues/863 

 RUSTUP_HOME: /root/.rustup 

 CARGO_HOME: /root/.cargo 

 defaults: 

 run: 

 shell: bash 

 steps: 

 # This is necessary so that actions/checkout can find git 

 - name: Export conda path 

 run: echo "/opt/conda/envs/arrow/bin" >> $GITHUB_PATH 

 # This is necessary so that Rust can find cargo 

 - name: Export cargo path 

 run: echo "/root/.cargo/bin" >> $GITHUB_PATH 

 - name: Check rustup 

 run: which rustup 

 - name: Check cmake 

 run: which cmake 

 - name: Checkout Arrow 

 uses: actions/checkout@v4 

 with: 

 repository: apache/arrow 

 submodules: true 

 fetch-depth: 0 

 - name: Checkout Arrow Rust 

 uses: actions/checkout@v4 

 with: 

 path: rust 

 fetch-depth: 0 

 - name: Checkout Arrow nanoarrow 

 uses: actions/checkout@v4 

 with: 

 repository: apache/arrow-nanoarrow 

 path: nanoarrow 

 fetch-depth: 0 

 # Workaround https://github.com/rust-lang/rust/issues/125067 

 - name: Downgrade rust 

 working-directory: rust 

 run: rustup override set 1.77 

 - name: Build 

 run: conda run --no-capture-output ci/scripts/integration_arrow_build.sh $PWD /build 

 - name: Run 

 run: conda run --no-capture-output ci/scripts/integration_arrow.sh $PWD /build

alamb · 2024-10-20T11:41:36Z

Posted upstream on apache/arrow#44377 (comment) to see if we can get any hints on how to fix this

alamb · 2024-10-21T16:07:27Z

Here is a fix: #6611 but it is not clear if it is the right one

alamb added the bug label Oct 16, 2024

This was referenced Oct 17, 2024

Use c_char instead of i8 to compile on platforms where c_char = u8 #6572

Merged

Minor: Document SIMD rationale and tips #6554

Merged

alamb mentioned this issue Oct 20, 2024

Temporarily disable C# Arrow Integration Test #6598

Merged

alamb mentioned this issue Oct 20, 2024

GH-44361: [C#][Integration] Include .NET in Flight integration tests apache/arrow#44377

Merged

alamb linked a pull request Oct 21, 2024 that will close this issue

Re-enable C# arrow flight integration test #6611

Open

alamb self-assigned this Oct 21, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Archery Integration Test with c# failing on main #6577

Archery Integration Test with c# failing on main #6577

alamb commented Oct 16, 2024

itsjunetime commented Oct 18, 2024

alamb commented Oct 20, 2024 •

edited

Loading

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 21, 2024

Archery Integration Test with c# failing on main #6577

Archery Integration Test with c# failing on main #6577

Comments

alamb commented Oct 16, 2024

itsjunetime commented Oct 18, 2024

alamb commented Oct 20, 2024 • edited Loading

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 21, 2024

alamb commented Oct 20, 2024 •

edited

Loading