You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Eric Erhardt (Jira)" <ji...@apache.org> on 2022/07/05 15:33:00 UTC
[jira] [Commented] (ARROW-16978) [C#] Intermittent Archery Failures
[ https://issues.apache.org/jira/browse/ARROW-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17562722#comment-17562722 ]
Eric Erhardt commented on ARROW-16978:
--------------------------------------
Can you provide steps on how to reproduce this locally?
Are there test cases being run in arrow-rs that aren't run in the apache/arrow repo? Are the date and times used in this test random/based on the current date/time?
In the log, I'm seeing this exception:
{code:java}
Unhandled exception: System.ArgumentOutOfRangeException: Specified argument was out of the range of valid values.
9512 at FlatBuffers.ByteBuffer.GetUshort(Int32 offset) in /arrow/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBuffer.cs:line 656
9513 at FlatBuffers.ByteBuffer.GetShort(Int32 offset) in /arrow/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/ByteBuffer.cs:line 649
9514 at FlatBuffers.Table.__offset(Int32 vtableOffset) in /arrow/csharp/src/Apache.Arrow/Flatbuf/FlatBuffers/Table.cs:line 37
9515 at Apache.Arrow.Flatbuf.Message.get_HeaderType() in /arrow/csharp/src/Apache.Arrow/Flatbuf/Message.cs:line 21
9516 at Apache.Arrow.Ipc.ArrowReaderImplementation.CreateArrowObjectFromMessage(Message message, ByteBuffer bodyByteBuffer, IMemoryOwner`1 memoryOwner) in /arrow/csharp/src/Apache.Arrow/Ipc/ArrowReaderImplementation.cs:line 108
9517 at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.<>c__DisplayClass8_0.<<ReadRecordBatchAsync>b__0>d.MoveNext() in /arrow/csharp/src/Apache.Arrow/Ipc/ArrowStreamReaderImplementation.cs:line 90
9518--- End of stack trace from previous location ---
9519 at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadRecordBatchAsync(CancellationToken cancellationToken) in /arrow/csharp/src/Apache.Arrow/Ipc/ArrowStreamReaderImplementation.cs:line 73
9520 at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadNextRecordBatchAsync(CancellationToken cancellationToken) in /arrow/csharp/src/Apache.Arrow/Ipc/ArrowStreamReaderImplementation.cs:line 48
9521 at Apache.Arrow.IntegrationTest.IntegrationCommand.StreamToFile() in /arrow/csharp/test/Apache.Arrow.IntegrationTest/IntegrationCommand.cs:line 575
9522 at Apache.Arrow.IntegrationTest.IntegrationCommand.Execute() in /arrow/csharp/test/Apache.Arrow.IntegrationTest/IntegrationCommand.cs:line 58
9523 at Apache.Arrow.IntegrationTest.Program.<>c.<<Main>b__0_0>d.MoveNext() in /arrow/csharp/test/Apache.Arrow.IntegrationTest/Program.cs:line 49
9524--- End of stack trace from previous location ---
9525 at System.CommandLine.Invocation.CommandHandler.GetExitCodeAsync(Object value, InvocationContext context)
9526 at System.CommandLine.Invocation.ModelBindingCommandHandler.InvokeAsync(InvocationContext context)
9527 at System.CommandLine.Invocation.InvocationPipeline.<>c__DisplayClass4_0.<<BuildInvocationChain>b__0>d.MoveNext()
9528--- End of stack trace from previous location ---
9529 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass23_0.<<UseParseErrorReporting>b__0>d.MoveNext()
9530--- End of stack trace from previous location ---
9531 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass16_0.<<UseHelp>b__0>d.MoveNext()
9532--- End of stack trace from previous location ---
9533 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass27_0.<<UseVersionOption>b__1>d.MoveNext()
9534--- End of stack trace from previous location ---
9535 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass25_0.<<UseTypoCorrections>b__0>d.MoveNext()
9536--- End of stack trace from previous location ---
9537 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<UseSuggestDirective>b__24_0>d.MoveNext()
9538--- End of stack trace from previous location ---
9539 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass22_0.<<UseParseDirective>b__0>d.MoveNext()
9540--- End of stack trace from previous location ---
9541 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass11_0.<<UseDebugDirective>b__0>d.MoveNext()
9542--- End of stack trace from previous location ---
9543 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c.<<RegisterWithDotnetSuggest>b__10_0>d.MoveNext()
9544--- End of stack trace from previous location ---
9545 at System.CommandLine.Builder.CommandLineBuilderExtensions.<>c__DisplayClass14_0.<<UseExceptionHandler>b__0>d.MoveNext() {code}
> [C#] Intermittent Archery Failures
> ----------------------------------
>
> Key: ARROW-16978
> URL: https://issues.apache.org/jira/browse/ARROW-16978
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Raphael Taylor-Davies
> Priority: Minor
>
> We are seeing intermittent archery failures in arrow-rs - [here|https://github.com/apache/arrow-rs/runs/6987393626?check_suite_focus=true]
> {code:java}
> FAILED TEST: datetime C# producing, C# consuming
> 1 failures
> File "/arrow/dev/archery/archery/integration/runner.py", line 246, in _run_ipc_test_case
> run_binaries(producer, consumer, test_case)
> File "/arrow/dev/archery/archery/integration/runner.py", line 100, in run_gold
> return self._run_gold(gold_dir, consumer, test_case)
> File "/arrow/dev/archery/archery/integration/runner.py", line 322, in _run_gold
> consumer.stream_to_file(consumer_stream_path, consumer_file_path)
> File "/arrow/dev/archery/archery/integration/tester_csharp.py", line 63, in stream_to_file
> self.run_shell_command(cmd)
> File "/arrow/dev/archery/archery/integration/tester.py", line 49, in run_shell_command
> subprocess.check_call(cmd, shell=True)
> File "/opt/conda/envs/arrow/lib/python3.10/subprocess.py", line 369, in check_call
> raise CalledProcessError(retcode, cmd)
> subprocess.CalledProcessError: Command '/arrow/csharp/artifacts/Apache.Arrow.IntegrationTest/Debug/net6.0/Apache.Arrow.IntegrationTest --mode stream-to-file -a /tmp/tmpnhaxwkhj/d72f0c1c_0.14.1_datetime.gold.consumer_stream_as_file < /arrow/testing/data/arrow-ipc-stream/integration/0.14.1/generated_datetime.stream' returned non-zero exit status 1. {code}
> It is possible that this is something to do with how we are running the archery tests, but I am at a loss as to how to debug this issue and would appreciate some input.
> I think it started around when [this|https://github.com/apache/arrow/pull/13279] was merged
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)