You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Brian Bowman <Br...@sas.com> on 2019/06/25 20:51:32 UTC
Need Help With Runtime ERROR in parquet::ColumnReader [C++]
Have any of you seen the following? It’s occurs intermittently in my test cases. FWIW - this is the only thread reading currently invoking Parquet code.
#0 std::move<std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&> (__t=...) at /usr/local/include/c++/7.3.0/bits/move.h:98
#1 0x00007f94c86eb8bc in std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>::operator=(std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&&) (this=0x7f94a0007968,
__r=<unknown type in /u/sasbpb/pp/parquet/tkext/com/laxnd/libparquet.so, CU 0xeb7c1, DIE 0x1601aa>) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:1213
#2 0x00007f94c86e806a in std::shared_ptr<parquet::Page>::operator=(std::shared_ptr<parquet::Page>&&) (this=0x7f94a0007968, __r=<unknown type in . . ./libparquet.so, CU 0xeb7c1, DIE 0x1628d2>)
at /usr/local/include/c++/7.3.0/bits/shared_ptr.h:319
#3 0x00007f94c8747af6 in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadNewPage (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.cc:324
#4 0x00007f94c873e04f in parquet::ColumnReader::HasNext (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.h:121
#5 0x00007f94c87472df in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadBatch (this=0x7f94a0007950, batch_size=5, def_levels=0x7f94a52535f8, rep_levels=0x0, values=0x7f94a5253020, values_read=0x7f94afb419d8)
at . . . /Arrow/cpp/src/parquet/column_reader.h:347
Thanks,
Brian
Re: Need Help With Runtime ERROR in parquet::ColumnReader [C++]
Posted by Brian Bowman <Br...@sas.com>.
Thanks Wes,
I’ve debugged further and the problem is in my layer.
—Brian
Sent from my iPhone
> On Jun 26, 2019, at 11:40 AM, Wes McKinney <we...@gmail.com> wrote:
>
> EXTERNAL
>
> Looks like memory corruption, have you tried running with valgrind?
>
>> On Tue, Jun 25, 2019 at 3:51 PM Brian Bowman <Br...@sas.com> wrote:
>>
>> Have any of you seen the following? It’s occurs intermittently in my test cases. FWIW - this is the only thread reading currently invoking Parquet code.
>>
>> #0 std::move<std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&> (__t=...) at /usr/local/include/c++/7.3.0/bits/move.h:98
>> #1 0x00007f94c86eb8bc in std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>::operator=(std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&&) (this=0x7f94a0007968,
>> __r=<unknown type in /u/sasbpb/pp/parquet/tkext/com/laxnd/libparquet.so, CU 0xeb7c1, DIE 0x1601aa>) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:1213
>> #2 0x00007f94c86e806a in std::shared_ptr<parquet::Page>::operator=(std::shared_ptr<parquet::Page>&&) (this=0x7f94a0007968, __r=<unknown type in . . ./libparquet.so, CU 0xeb7c1, DIE 0x1628d2>)
>> at /usr/local/include/c++/7.3.0/bits/shared_ptr.h:319
>> #3 0x00007f94c8747af6 in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadNewPage (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.cc:324
>> #4 0x00007f94c873e04f in parquet::ColumnReader::HasNext (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.h:121
>> #5 0x00007f94c87472df in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadBatch (this=0x7f94a0007950, batch_size=5, def_levels=0x7f94a52535f8, rep_levels=0x0, values=0x7f94a5253020, values_read=0x7f94afb419d8)
>> at . . . /Arrow/cpp/src/parquet/column_reader.h:347
>>
>>
>> Thanks,
>>
>>
>> Brian
Re: Need Help With Runtime ERROR in parquet::ColumnReader [C++]
Posted by Wes McKinney <we...@gmail.com>.
Looks like memory corruption, have you tried running with valgrind?
On Tue, Jun 25, 2019 at 3:51 PM Brian Bowman <Br...@sas.com> wrote:
>
> Have any of you seen the following? It’s occurs intermittently in my test cases. FWIW - this is the only thread reading currently invoking Parquet code.
>
> #0 std::move<std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&> (__t=...) at /usr/local/include/c++/7.3.0/bits/move.h:98
> #1 0x00007f94c86eb8bc in std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>::operator=(std::__shared_ptr<parquet::Page, (__gnu_cxx::_Lock_policy)2>&&) (this=0x7f94a0007968,
> __r=<unknown type in /u/sasbpb/pp/parquet/tkext/com/laxnd/libparquet.so, CU 0xeb7c1, DIE 0x1601aa>) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:1213
> #2 0x00007f94c86e806a in std::shared_ptr<parquet::Page>::operator=(std::shared_ptr<parquet::Page>&&) (this=0x7f94a0007968, __r=<unknown type in . . ./libparquet.so, CU 0xeb7c1, DIE 0x1628d2>)
> at /usr/local/include/c++/7.3.0/bits/shared_ptr.h:319
> #3 0x00007f94c8747af6 in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadNewPage (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.cc:324
> #4 0x00007f94c873e04f in parquet::ColumnReader::HasNext (this=0x7f94a0007950) at . . . /Arrow/cpp/src/parquet/column_reader.h:121
> #5 0x00007f94c87472df in parquet::TypedColumnReader<parquet::DataType<(parquet::Type::type)6> >::ReadBatch (this=0x7f94a0007950, batch_size=5, def_levels=0x7f94a52535f8, rep_levels=0x0, values=0x7f94a5253020, values_read=0x7f94afb419d8)
> at . . . /Arrow/cpp/src/parquet/column_reader.h:347
>
>
> Thanks,
>
>
> Brian