You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2019/08/19 16:52:00 UTC

[jira] [Commented] (PARQUET-1640) [C++] parquet-encoding-benchmark crashes

    [ https://issues.apache.org/jira/browse/PARQUET-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910566#comment-16910566 ] 

Antoine Pitrou commented on PARQUET-1640:
-----------------------------------------

Also crashes in release mode ("free(): invalid pointer"). Backtrace:
{code:java}
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ffff55a8801 in __GI_abort () at abort.c:79
#2  0x00007ffff55f1897 in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7ffff571eb9a "%s\n") at ../sysdeps/posix/libc_fatal.c:181
#3  0x00007ffff55f890a in malloc_printerr (str=str@entry=0x7ffff571cd88 "free(): invalid pointer") at malloc.c:5350
#4  0x00007ffff55ffe1c in _int_free (have_lock=0, p=0x7ffff6dc2440 <guard variable for arrow::default_memory_pool()::default_memory_pool_>, 
    av=0x7ffff5953c40 <main_arena>) at malloc.c:4157
#5  __GI___libc_free (mem=0x7ffff6dc2450 <arrow::default_memory_pool()::default_memory_pool_>) at malloc.c:3124
#6  0x00007ffff712fb3a in __gnu_cxx::new_allocator<int>::deallocate (this=0x5555557dfc38, __p=<optimized out>) at /usr/include/c++/7/ext/new_allocator.h:125
#7  std::allocator_traits<std::allocator<int> >::deallocate (__a=..., __n=<optimized out>, __p=<optimized out>) at /usr/include/c++/7/bits/alloc_traits.h:462
#8  std::_Vector_base<int, std::allocator<int> >::_M_deallocate (this=0x5555557dfc38, __n=<optimized out>, __p=<optimized out>)
    at /usr/include/c++/7/bits/stl_vector.h:180
#9  std::_Vector_base<int, std::allocator<int> >::~_Vector_base (this=0x5555557dfc38, __in_chrg=<optimized out>) at /usr/include/c++/7/bits/stl_vector.h:162
#10 std::vector<int, std::allocator<int> >::~vector (this=0x5555557dfc38, __in_chrg=<optimized out>) at /usr/include/c++/7/bits/stl_vector.h:435
#11 arrow::internal::BinaryMemoTable::~BinaryMemoTable (this=0x5555557dfc00, __in_chrg=<optimized out>) at ../src/arrow/util/hashing.h:556
#12 arrow::internal::BinaryMemoTable::~BinaryMemoTable (this=0x5555557dfc00, __in_chrg=<optimized out>) at ../src/arrow/util/hashing.h:556
#13 0x00007ffff6534790 in std::default_delete<arrow::internal::MemoTable>::operator() (this=<optimized out>, __ptr=<optimized out>)
    at /usr/include/c++/7/bits/unique_ptr.h:78
#14 std::unique_ptr<arrow::internal::MemoTable, std::default_delete<arrow::internal::MemoTable> >::~unique_ptr (this=0x5555557e1a10, __in_chrg=<optimized out>)
    at /usr/include/c++/7/bits/unique_ptr.h:268
#15 arrow::internal::DictionaryMemoTable::DictionaryMemoTableImpl::~DictionaryMemoTableImpl (this=0x5555557e1a00, __in_chrg=<optimized out>)
    at ../src/arrow/array/builder_dict.cc:165
#16 std::default_delete<arrow::internal::DictionaryMemoTable::DictionaryMemoTableImpl>::operator() (this=<optimized out>, __ptr=0x5555557e1a00)
    at /usr/include/c++/7/bits/unique_ptr.h:78
#17 std::unique_ptr<arrow::internal::DictionaryMemoTable::DictionaryMemoTableImpl, std::default_delete<arrow::internal::DictionaryMemoTable::DictionaryMemoTableImpl> >::~unique_ptr (this=<optimized out>, __in_chrg=<optimized out>) at /usr/include/c++/7/bits/unique_ptr.h:268
#18 arrow::internal::DictionaryMemoTable::~DictionaryMemoTable (this=<optimized out>, __in_chrg=<optimized out>) at ../src/arrow/array/builder_dict.h:56
#19 0x00005555555773ec in std::default_delete<arrow::internal::DictionaryMemoTable>::operator() (this=<optimized out>, __ptr=0x5555557e1930)
    at /usr/include/c++/7/bits/unique_ptr.h:78
#20 std::unique_ptr<arrow::internal::DictionaryMemoTable, std::default_delete<arrow::internal::DictionaryMemoTable> >::~unique_ptr (this=0x5555557dfb20, 
    __in_chrg=<optimized out>) at /usr/include/c++/7/bits/unique_ptr.h:268
#21 arrow::internal::DictionaryBuilderBase<arrow::NumericBuilder<arrow::Int32Type>, arrow::BinaryType>::~DictionaryBuilderBase (this=0x5555557dfa90, 
    __in_chrg=<optimized out>) at ../src/arrow/array/builder_dict.h:140
#22 arrow::Dictionary32Builder<arrow::BinaryType>::~Dictionary32Builder (this=0x5555557dfa90, __in_chrg=<optimized out>) at ../src/arrow/array/builder_dict.h:383
#23 arrow::internal::BinaryDictionary32BuilderImpl<arrow::BinaryType>::~BinaryDictionary32BuilderImpl (this=0x5555557dfa90, __in_chrg=<optimized out>)
    at ../src/arrow/array/builder_dict.h:426
#24 arrow::BinaryDictionary32Builder::~BinaryDictionary32Builder (this=0x5555557dfa90, __in_chrg=<optimized out>) at ../src/arrow/array/builder_dict.h:457
#25 arrow::BinaryDictionary32Builder::~BinaryDictionary32Builder (this=0x5555557dfa90, __in_chrg=<optimized out>) at ../src/arrow/array/builder_dict.h:457
#26 0x000055555557a668 in std::default_delete<arrow::BinaryDictionary32Builder>::operator() (this=<optimized out>, __ptr=0x5555557dfa90)
    at /usr/include/c++/7/bits/unique_ptr.h:78
#27 std::unique_ptr<arrow::BinaryDictionary32Builder, std::default_delete<arrow::BinaryDictionary32Builder> >::~unique_ptr (this=<synthetic pointer>, 
    __in_chrg=<optimized out>) at /usr/include/c++/7/bits/unique_ptr.h:268
#28 parquet::BenchmarkDecodeArrow::DecodeArrowBenchmark<arrow::BinaryDictionary32Builder> (this=0x5555557da1a0, state=...) at ../src/parquet/encoding-benchmark.cc:312
#29 0x000055555557f5a4 in benchmark::RunSpecifiedBenchmarks(benchmark::BenchmarkReporter*, benchmark::BenchmarkReporter*) ()
#30 0x0000555555570540 in main ()
{code}

> [C++] parquet-encoding-benchmark crashes
> ----------------------------------------
>
>                 Key: PARQUET-1640
>                 URL: https://issues.apache.org/jira/browse/PARQUET-1640
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-cpp
>            Reporter: Antoine Pitrou
>            Priority: Major
>
> {code}
> [...]
> BM_DictDecodingByteArray/DecodeArrowNonNull_Dict/65536     42199236 ns   42186639 ns          1   8.91692MB/s
> pure virtual method called
> terminate called without an active exception
> {code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)