You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/06/08 03:29:46 UTC
[GitHub] [arrow] helloqingbing opened a new issue, #13339: parquet-cpp write a row done without column type exception ,but cause a segfault
helloqingbing opened a new issue, #13339:
URL: https://github.com/apache/arrow/issues/13339
Program terminated with signal 11, Segmentation fault.
#0 0x00007fef761c475f in apache::thrift::transport::TMemoryBuffer::borrowSlow(unsigned char*, unsigned int*) () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/thrift/lib64/libthrift-0.9.1.so
Missing separate debuginfos, use: debuginfo-install glibc-2.17-307.el7.1.x86_64 libevent-2.0.21-4.el7.x86_64 snappy-1.1.0-3.el7.x86_64
(gdb) bt
#0 0x00007fef761c475f in apache::thrift::transport::TMemoryBuffer::borrowSlow(unsigned char*, unsigned int*) () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/thrift/lib64/libthrift-0.9.1.so
#1 0x00007fef7057de7f in apache::thrift::protocol::TVirtualProtocol<apache::thrift::protocol::TCompactProtocolT<apache::thrift::transport::TMemoryBuffer>, apache::thrift::protocol::TProtocolDefaults>::writeBinary_virt(std::string const&) () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#2 0x00007fef7063019d in parquet::format::Statistics::write(apache::thrift::protocol::TProtocol*) const () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#3 0x00007fef70633eda in parquet::format::ColumnMetaData::write(apache::thrift::protocol::TProtocol*) const () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#4 0x00007fef706341e9 in parquet::format::ColumnChunk::write(apache::thrift::protocol::TProtocol*) const () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#5 0x00007fef706332bc in parquet::format::RowGroup::write(apache::thrift::protocol::TProtocol*) const () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#6 0x00007fef7063372c in parquet::format::FileMetaData::write(apache::thrift::protocol::TProtocol*) const () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#7 0x00007fef70625e22 in void parquet::ThriftSerializer::SerializeObject<parquet::format::FileMetaData>(parquet::format::FileMetaData const*) ()
from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#8 0x00007fef706291ad in parquet::FileMetaData::FileMetaDataImpl::WriteTo(arrow::io::OutputStream*, std::shared_ptr<parquet::Encryptor> const&) const ()
from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#9 0x00007fef70612a9d in parquet::WriteFileMetaData(parquet::FileMetaData const&, arrow::io::OutputStream*) () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#10 0x00007fef70616521 in parquet::FileSerializer::Close() () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#11 0x00007fef7061276f in parquet::ParquetFileWriter::Close() () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#12 0x00007fef7061287c in parquet::ParquetFileWriter::~ParquetFileWriter() () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/libs/libparquet.so.700
#13 0x00000000005cfa5c in operator() (this=<optimized out>, __ptr=0x7fef62505e80) at /opt/rh/devtoolset-7/root/usr/include/c++/7/bits/unique_ptr.h:78
#14 ~unique_ptr (this=0x7fef603fdf70, __in_chrg=<optimized out>) at /opt/rh/devtoolset-7/root/usr/include/c++/7/bits/unique_ptr.h:268
#15 ~StreamWriter (this=0x7fef603fdf50, __in_chrg=<optimized out>) at /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/include/parquet/stream_writer.h:74
#16 ParquetInputfile::BuildParquetInputfile (this=this@entry=0x7fef603fe370, type=type@entry=ROCKSDB_REDIS_HASH, table_name=..., columns=...)
at /data/smash-data/kv-1/yunzhe/redkvreplicator/rocksdb_replicator/parquet_inputfile.cpp:264
#17 0x00000000005afa91 in replicator::RocksDBReplicator::scanTable (this=<optimized out>, db_addr=..., table_info=...)
at /data/smash-data/kv-1/yunzhe/redkvreplicator/rocksdb_replicator/rocksdb_replicator.cpp:293
#18 0x0000000000584fc3 in ScanTable (params=..., table_name=...) at /data/smash-data/kv-1/yunzhe/redkvreplicator/rocksdb_replicator/ReplicatorAdmin.cpp:68
#19 ScanTableCommandHandler::Run (this=<optimized out>, args=..., output=0x7fef603febc0) at /data/smash-data/kv-1/yunzhe/redkvreplicator/rocksdb_replicator/ReplicatorAdmin.cpp:147
#20 0x00007fef741be28d in brpc::policy::ConsumeCommand (ctx=ctx@entry=0x7fef5ce8e070, args=..., flush_batched=flush_batched@entry=true, appender=appender@entry=0x7fef603fed00)
at src/brpc/policy/redis_protocol.cpp:99
#21 0x00007fef741bee0c in brpc::policy::ParseRedisMessage (source=0x7fef5cee56c0, socket=0x7fef5cee5640, read_eof=<optimized out>, arg=<optimized out>) at src/brpc/policy/redis_protocol.cpp:181
#22 0x00007fef740eac9e in brpc::InputMessenger::CutInputMessage (this=this@entry=0x7fef6c253c00, m=m@entry=0x7fef5cee5640, index=index@entry=0x7fef603feec0, read_eof=read_eof@entry=false)
at src/brpc/input_messenger.cpp:71
#23 0x00007fef740eb5c4 in brpc::InputMessenger::OnNewMessages (m=0x7fef5cee5640) at src/brpc/input_messenger.cpp:234
#24 0x00007fef7408b61d in brpc::Socket::ProcessEvent (arg=0x7fef5cee5640) at src/brpc/socket.cpp:1017
#25 0x00007fef73fdbfd7 in bthread::TaskGroup::task_runner (skip_remained=<optimized out>) at src/bthread/task_group.cpp:295
#26 0x00007fef73fe05e1 in bthread_make_fcontext () from /data/smash-data/kv-1/yunzhe/redkvreplicator/deps/incubator-brpc/lib/libbrpc.so
#27 0x0000000000000000 in ?? ()
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] helloqingbing closed issue #13339: [Urgent]parquet-cpp write a row done without column type exception ,but cause a segfault
Posted by GitBox <gi...@apache.org>.
helloqingbing closed issue #13339: [Urgent]parquet-cpp write a row done without column type exception ,but cause a segfault
URL: https://github.com/apache/arrow/issues/13339
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] helloqingbing commented on issue #13339: [Urgent]parquet-cpp write a row done without column type exception ,but cause a segfault
Posted by GitBox <gi...@apache.org>.
helloqingbing commented on issue #13339:
URL: https://github.com/apache/arrow/issues/13339#issuecomment-1152096235
1. You can only write 6 columns for thrift-0.9.1
2. To fix the issue, you need thrift-0.12.1+, then it can support more columns in parquet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org