You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (JIRA)" <ji...@apache.org> on 2019/08/17 14:15:00 UTC
[jira] [Updated] (IMPALA-7883)
TestScannersFuzzing::test_fuzz_decimal_tbl generates crash in
ParquetMetadataUtils::ValidateRowGroupColumn
[ https://issues.apache.org/jira/browse/IMPALA-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang updated IMPALA-7883:
-----------------------------------
Target Version: Impala 3.4.0 (was: Impala 3.3.0)
> TestScannersFuzzing::test_fuzz_decimal_tbl generates crash in ParquetMetadataUtils::ValidateRowGroupColumn
> ----------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-7883
> URL: https://issues.apache.org/jira/browse/IMPALA-7883
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.2.0
> Reporter: Joe McDonnell
> Assignee: Csaba Ringhofer
> Priority: Critical
> Labels: broken-build
>
> An exhaustive test run ran into a SIGSEGV when running TestScannersFuzzing::test_fuzz_decimal_tbl(). It produces the following stack:
> {noformat}
> #0 0x00007f0bda92f1f7 in raise () from /lib64/libc.so.6
> #1 0x00007f0bda9308e8 in abort () from /lib64/libc.so.6
> #2 0x00007f0bddb00185 in os::abort(bool) () from /usr/java/jdk1.8.0_144/jre/lib/amd64/server/libjvm.so
> #3 0x00007f0bddca2593 in VMError::report_and_die() () from /usr/java/jdk1.8.0_144/jre/lib/amd64/server/libjvm.so
> #4 0x00007f0bddb0568f in JVM_handle_linux_signal () from /usr/java/jdk1.8.0_144/jre/lib/amd64/server/libjvm.so
> #5 0x00007f0bddafbbe3 in signalHandler(int, siginfo*, void*) () from /usr/java/jdk1.8.0_144/jre/lib/amd64/server/libjvm.so
> #6 <signal handler called>
> #7 0x0000000002f0d254 in impala::ParquetMetadataUtils::ValidateRowGroupColumn (file_metadata=..., filename=0x1dab5d5b8 "hdfs://localhost:20500/test-warehouse/test_fuzz_decimal_tbl_4a8e12be.db/decimal_tbl/d6=1/copy2_6a476efdb58955a1-fcfa2ac500000000_1388116616_data.0.parq", row_group_idx=0, col_idx=3, schema_element=..., state=0x4fc1dee0) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/parquet-metadata-utils.cc:156
> #8 0x00000000022ad8c3 in impala::BaseScalarColumnReader::Reset (this=0x22877800, file_desc=..., col_chunk=..., row_group_idx=0) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/parquet-column-readers.cc:928
> #9 0x00000000022357b0 in impala::HdfsParquetScanner::InitScalarColumns (this=0x22608800) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:1501
> #10 0x000000000222d60f in impala::HdfsParquetScanner::NextRowGroup (this=0x22608800) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:626
> #11 0x000000000222bd26 in impala::HdfsParquetScanner::GetNextInternal (this=0x22608800, row_batch=0x505cbbc0) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:419
> #12 0x000000000222a249 in impala::HdfsParquetScanner::ProcessSplit (this=0x22608800) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-parquet-scanner.cc:336
> #13 0x00000000021ae94a in impala::HdfsScanNode::ProcessSplit (this=0x156b7000, filter_ctxs=..., expr_results_pool=0x7f0b22a61420, scan_range=0x22f64140, scanner_thread_reservation=0x7f0b22a61378) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-scan-node.cc:497
> #14 0x00000000021adb97 in impala::HdfsScanNode::ScannerThread (this=0x156b7000, first_thread=true, scanner_thread_reservation=40960) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-scan-node.cc:402
> #15 0x00000000021acf88 in impala::HdfsScanNode::<lambda()>::operator()(void) const (__closure=0x7f0b22a61ba8) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/exec/hdfs-scan-node.cc:323
> #16 0x00000000021af426 in boost::detail::function::void_function_obj_invoker0<impala::HdfsScanNode::ThreadTokenAvailableCb(impala::ThreadResourcePool*)::<lambda()>, void>::invoke(boost::detail::function::function_buffer &) (function_obj_ptr=...) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/Impala-Toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:153
> #17 0x0000000001cc7614 in boost::function0<void>::operator() (this=0x7f0b22a61ba0) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/Impala-Toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:767
> #18 0x00000000020fe391 in impala::Thread::SuperviseThread(std::string const&, std::string const&, boost::function<void ()>, impala::ThreadDebugInfo const*, impala::Promise<long, (impala::PromiseMode)0>*) (name=..., category=..., functor=..., parent_thread_info=0x7f0b2025c850, thread_started=0x7f0b2025b220) at /data/jenkins/workspace/impala-cdh6.1.0-exhaustive/repos/Impala/be/src/util/thread.cc:359{noformat}
> This reproduces fairly regularly (but not 100% consistently) on master when running:
> {noformat}
> export SCANNER_FUZZ_SEED=1542888792
> tests/run-tests.py --exploration_strategy=exhaustive query_test/test_scanners_fuzz.py::TestScannersFuzzing::test_fuzz_decimal_tbl{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org