You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Antoine Pitrou (JIRA)" <ji...@apache.org> on 2019/06/03 12:13:00 UTC

[jira] [Updated] (ARROW-5410) [C++] Crash at arrow::internal::FileWrite

     [ https://issues.apache.org/jira/browse/ARROW-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Antoine Pitrou updated ARROW-5410:
----------------------------------
    Component/s: C++

> [C++] Crash at arrow::internal::FileWrite
> -----------------------------------------
>
>                 Key: ARROW-5410
>                 URL: https://issues.apache.org/jira/browse/ARROW-5410
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>         Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
>            Reporter: Tham
>            Priority: Major
>              Labels: parquet
>
> My applicationĀ is writing a bunch of parquet files and it often crashes. Most of the time it crashes when writing the first file, sometimes it can write the first file and crashing at the 2nd file. The file can always be opened. It only crashes at writeTable.
> As I tested, my application crashes when build with release mode, but don't crash with debug mode. It crashed only on one Windows machine, not others.
> Here is stack trace from dump file:
> {code:java}
> STACK_TEXT:  
> 0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230 00000000`00000033 00007ffc`032dbe21 : CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0
> 0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d 00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f
> 0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02 0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9
> 0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140 00000000`00000005 00000122`bbe61e30 : ucrtbase!_acrt_uninitialize_command_line+0x6fd4
> 0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000 0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d
> 0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153 00000122`bbe890e0 0000001e`10efe634 : CortexSync!arrow::internal::FileWrite+0x5e
> 0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004 0000733f`5e86f38c 00000122`bbe14c40 : CortexSync!arrow::io::OSFile::Write+0x1d5
> 0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522 00000122`bbffe6e0 00000000`ffffffff : CortexSync!arrow::io::FileOutputStream::Write+0x12
> 0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0 00000000`00000013 0000001e`10efe730 : CortexSync!parquet::ArrowOutputStream::Write+0x39
> 0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78 0000001e`10efe9c0 00000000`00000000 : CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f
> 0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450 00000000`00000002 00000122`bc0218d0 : CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f
> 0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250 00000000`00000000 00000122`b1680000 : CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5> >::WriteDictionaryPage+0x143
> 0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000 00000122`bbe3f540 00000122`b2439998 : CortexSync!parquet::ColumnWriterImpl::Close+0x47
> 0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0 00000122`bbec4bb0 00000122`b2439998 : CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting destructor'+0x100
> 0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0 00000122`bbe89390 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa
> 0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430 00000000`0000000f 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc
> 0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8 00000000`3f800000 00000000`00000000 : CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code}
> I tried a lot of ways to find out the root cause, but failed. Can anyone here give me some information/advice please, so that I can investigate more? Thanks!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)