Archery Integration Test with c# failing on main #6577

alamb · 2024-10-16T21:28:22Z

Describe the bug
archery integration test is failing on main : https://github.com/apache/arrow-rs/actions/runs/11363774836/job/31608436255

 ################# FAILURES #################
  FAILED TEST: primitive Rust producing,  C# consuming
  <class 'RuntimeError'>: Command failed: /__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest client --port 44909 --path /tmp/arrow-integration-hk4dbqi4/generated_primitive.json
  With output:
  --------------
  Unhandled exception: Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error connecting to subchannel.", DebugException="System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')")
   ---> System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')
     at System.Net.Dns.GetHostEntryOrAddressesCoreAsync(String hostName, Boolean justReturnParsedIp, Boolean throwOnIIPAny, Boolean justAddresses, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Dns.GetHostAddressesAsync(String hostNameOrAddress, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Sockets.SocketAsyncEventArgs.DnsConnectAsync(DnsEndPoint endPoint, SocketType socketType, ProtocolType protocolType)
     at System.Net.Sockets.Socket.ConnectAsync(SocketAsyncEventArgs e, Boolean userSocket, Boolean saeaCancelable)
     at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ConnectAsync(Socket socket)
     at System.Net.Sockets.Socket.ConnectAsync(EndPoint remoteEP, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.OnConnect(Socket socket, DnsEndPoint endpoint, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.TryConnectAsync(ConnectContext context, Int32 attempt)
     --- End of inner exception stack trace ---
     at Grpc.Net.Client.Internal.HttpContentClientStreamReader`2.MoveNextCore(CancellationToken cancellationToken)
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadSchemaAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 74
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadNextRecordBatchAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 118
     at Apache.Arrow.Flight.FlightRecordBatchStreamReader.MoveNext(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/FlightRecordBatchStreamReader.cs:line 64
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.ConsumeFlightLocation(FlightClient client, FlightTicket ticket, RecordBatch[] batches) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 160
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.RunClient(Int32 serverPort) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 109
     at Apache.Arrow.Flight.IntegrationTest.FlightClientCommand.Execute() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/FlightClientCommand.cs:line 45
     at Apache.Arrow.Flight.IntegrationTest.Program.<>c.<<Main>b__0_0>d.MoveNext() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Program.cs:line 50

To Reproduce

Expected behavior
Should pass

Additional context
Not sure if this is related to #6568 or not

The text was updated successfully, but these errors were encountered:

itsjunetime · 2024-10-18T18:31:19Z

I think #6585 might fix this as well

alamb · 2024-10-20T11:21:57Z

I think #6585 might fix this as well

Thanks @itsjunetime -- unfortunately it seems like the tests are still failing even with #6585 (recent example) . I'll see what I can do

alamb · 2024-10-20T11:26:28Z

I poked around in the arrow repo. There are two PRs that went in around the same time this test started failing that could be related

GH-44360: [C#] Fix Flight DoExchange incompatibility with C++ implementation arrow#44424
GH-44361: [C#][Integration] Include .NET in Flight integration tests arrow#44377

apache/arrow#44377 specifically looks related as this test appears to be new. I will ask some questions there and make a PR to disable this test in arrow-rs while we investigate more

alamb · 2024-10-20T11:30:30Z

Here is another more specific message from the logs https://github.com/apache/arrow-rs/actions/runs/11409436304/job/31749661931

 ======================================================================
  Testing file null
  Traceback (most recent call last):
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/util.py", line 136, in run_cmd
      output = subprocess.check_output(cmd, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 466, in check_output
      return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 571, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['/__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest', 'client', '--port', '46599', '--path', '/tmp/arrow-integration-2gthhuy4/generated_null.json']' returned non-zero exit status 1.
  
  During handling of the above exception, another exception occurred:
  
  Traceback (most recent call last):
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/runner.py", line 435, in _run_flight_test_case
      consumer.flight_request(port, **client_args)
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/tester_csharp.py", line 218, in flight_request
      run_cmd(cmd)
    File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/util.py", line 145, in run_cmd
      raise RuntimeError(sio.getvalue())
  RuntimeError: Command failed: /__w/arrow-rs/arrow-rs/csharp/artifacts/Apache.Arrow.Flight.IntegrationTest/Debug/net8.0/Apache.Arrow.Flight.IntegrationTest client --port 46599 --path /tmp/arrow-integration-2gthhuy4/generated_null.json
  With output:
  --------------
  Unhandled exception: Grpc.Core.RpcException: Status(StatusCode="Unavailable", Detail="Error connecting to subchannel.", DebugException="System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')")
   ---> System.ArgumentException: IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName')
     at System.Net.Dns.GetHostEntryOrAddressesCoreAsync(String hostName, Boolean justReturnParsedIp, Boolean throwOnIIPAny, Boolean justAddresses, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Dns.GetHostAddressesAsync(String hostNameOrAddress, AddressFamily family, CancellationToken cancellationToken)
     at System.Net.Sockets.SocketAsyncEventArgs.DnsConnectAsync(DnsEndPoint endPoint, SocketType socketType, ProtocolType protocolType)
     at System.Net.Sockets.Socket.ConnectAsync(SocketAsyncEventArgs e, Boolean userSocket, Boolean saeaCancelable)
     at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ConnectAsync(Socket socket)
     at System.Net.Sockets.Socket.ConnectAsync(EndPoint remoteEP, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.OnConnect(Socket socket, DnsEndPoint endpoint, CancellationToken cancellationToken)
     at Grpc.Net.Client.Balancer.Internal.SocketConnectivitySubchannelTransport.TryConnectAsync(ConnectContext context, Int32 attempt)
     --- End of inner exception stack trace ---
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadSchemaAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 74
     at Apache.Arrow.Flight.Internal.RecordBatchReaderImplementation.ReadNextRecordBatchAsync(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/Internal/RecordBatchReaderImplementation.cs:line 118
     at Apache.Arrow.Flight.FlightRecordBatchStreamReader.MoveNext(CancellationToken cancellationToken) in /__w/arrow-rs/arrow-rs/csharp/src/Apache.Arrow.Flight/FlightRecordBatchStreamReader.cs:line 64
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.ConsumeFlightLocation(FlightClient client, FlightTicket ticket, RecordBatch[] batches) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 160
     at Apache.Arrow.Flight.IntegrationTest.Scenarios.JsonTestScenario.RunClient(Int32 serverPort) in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Scenarios/JsonTestScenario.cs:line 109
     at Apache.Arrow.Flight.IntegrationTest.FlightClientCommand.Execute() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/FlightClientCommand.cs:line 45
     at Apache.Arrow.Flight.IntegrationTest.Program.<>c.<<Main>b__0_0>d.MoveNext() in /__w/arrow-rs/arrow-rs/csharp/test/Apache.Arrow.Flight.IntegrationTest/Program.cs:line 50
  --- End of stack trace from previous location ---
     at System.CommandLine.Invocation.AnonymousCommandHandler.InvokeAsync(InvocationContext context)
     at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass17_0.<<UseParseErrorReporting>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass12_0.<<UseHelp>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseVersionOption>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass19_0.<<UseTypoCorrections>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__18_0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass16_0.<<UseParseDirective>b__0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__5_0>d.MoveNext()
  --- End of stack trace from previous location ---
     at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass8_0.<<UseExceptionHandler>b__0>d.MoveNext()
  
  --------------

alamb · 2024-10-20T11:41:00Z

Here is the job definition:

arrow-rs/.github/workflows/integration.yml

Lines 50 to 114 in 1666a4d

    
           jobs: 
        
             integration: 
        
               name: Archery test With other arrows 
        
               runs-on: ubuntu-latest 
        
               container: 
        
                 image: apache/arrow-dev:amd64-conda-integration 
        
               env: 
        
                 ARROW_USE_CCACHE: OFF 
        
                 ARROW_CPP_EXE_PATH: /build/cpp/debug 
        
                 ARROW_NANOARROW_PATH: /build/nanoarrow 
        
                 ARROW_RUST_EXE_PATH: /build/rust/debug 
        
                 BUILD_DOCS_CPP: OFF 
        
                 ARROW_INTEGRATION_CPP: ON 
        
                 ARROW_INTEGRATION_CSHARP: ON 
        
                 ARROW_INTEGRATION_GO: ON 
        
                 ARROW_INTEGRATION_JAVA: ON 
        
                 ARROW_INTEGRATION_JS: ON 
        
                 ARCHERY_INTEGRATION_TARGET_IMPLEMENTATIONS: "rust" 
        
                 # Disable nanoarrow integration, due to https://github.com/apache/arrow-rs/issues/5052 
        
                 ARCHERY_INTEGRATION_WITH_NANOARROW: "0" 
        
                 # https://github.com/apache/arrow/pull/38403/files#r1371281630 
        
                 ARCHERY_INTEGRATION_WITH_RUST: "1" 
        
                 # These are necessary because the github runner overrides $HOME 
        
                 # https://github.com/actions/runner/issues/863 
        
                 RUSTUP_HOME: /root/.rustup 
        
                 CARGO_HOME: /root/.cargo 
        
               defaults: 
        
                 run: 
        
                   shell: bash 
        
               steps: 
        
                 # This is necessary so that actions/checkout can find git 
        
                 - name: Export conda path 
        
                   run: echo "/opt/conda/envs/arrow/bin" >> $GITHUB_PATH 
        
                 # This is necessary so that Rust can find cargo 
        
                 - name: Export cargo path 
        
                   run: echo "/root/.cargo/bin" >> $GITHUB_PATH 
        
                 - name: Check rustup 
        
                   run: which rustup 
        
                 - name: Check cmake 
        
                   run: which cmake 
        
                 - name: Checkout Arrow 
        
                   uses: actions/checkout@v4 
        
                   with: 
        
                     repository: apache/arrow 
        
                     submodules: true 
        
                     fetch-depth: 0 
        
                 - name: Checkout Arrow Rust 
        
                   uses: actions/checkout@v4 
        
                   with: 
        
                     path: rust 
        
                     fetch-depth: 0 
        
                 - name: Checkout Arrow nanoarrow 
        
                   uses: actions/checkout@v4 
        
                   with: 
        
                     repository: apache/arrow-nanoarrow 
        
                     path: nanoarrow 
        
                     fetch-depth: 0 
        
                 # Workaround https://github.com/rust-lang/rust/issues/125067 
        
                 - name: Downgrade rust 
        
                   working-directory: rust 
        
                   run: rustup override set 1.77 
        
                 - name: Build 
        
                   run: conda run --no-capture-output ci/scripts/integration_arrow_build.sh $PWD /build 
        
                 - name: Run 
        
                   run: conda run --no-capture-output ci/scripts/integration_arrow.sh $PWD /build

alamb · 2024-10-20T11:41:36Z

Posted upstream on apache/arrow#44377 (comment) to see if we can get any hints on how to fix this

alamb · 2024-10-21T16:07:27Z

Here is a fix: #6611 but it is not clear if it is the right one

alamb · 2024-11-16T14:31:45Z

label_issue.py automatically added labels {'documentation'} from #6554

alamb · 2024-11-16T14:31:48Z

label_issue.py automatically added labels {'arrow'} from #6554

alamb added the bug label Oct 16, 2024

This was referenced Oct 17, 2024

Use c_char instead of i8 to compile on platforms where c_char = u8 #6572

Merged

Minor: Document SIMD rationale and tips #6554

Merged

alamb mentioned this issue Oct 20, 2024

Temporarily disable C# Arrow Integration Test #6598

Merged

alamb mentioned this issue Oct 20, 2024

GH-44361: [C#][Integration] Include .NET in Flight integration tests apache/arrow#44377

Merged

alamb mentioned this issue Oct 21, 2024

Re-enable C# arrow flight integration test #6611

Merged

alamb self-assigned this Oct 21, 2024

alamb closed this as completed in #6611 Oct 24, 2024

alamb added the documentation Improvements or additions to documentation label Nov 16, 2024

alamb added the arrow Changes to the arrow crate label Nov 16, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Archery Integration Test with c# failing on main #6577

Archery Integration Test with c# failing on main #6577

alamb commented Oct 16, 2024

itsjunetime commented Oct 18, 2024

alamb commented Oct 20, 2024 •

edited

Loading

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 21, 2024

alamb commented Nov 16, 2024

alamb commented Nov 16, 2024

Archery Integration Test with c# failing on main #6577

Archery Integration Test with c# failing on main #6577

Comments

alamb commented Oct 16, 2024

itsjunetime commented Oct 18, 2024

alamb commented Oct 20, 2024 • edited Loading

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 20, 2024

alamb commented Oct 21, 2024

alamb commented Nov 16, 2024

alamb commented Nov 16, 2024

alamb commented Oct 20, 2024 •

edited

Loading