You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2017/08/30 04:11:00 UTC
[jira] [Resolved] (IMPALA-5857) Crash in
impala::DiskIoMgr::ScanRange::Close-> tc_free while running concurrent
TPC-DS
[ https://issues.apache.org/jira/browse/IMPALA-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong resolved IMPALA-5857.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 2.10.0
IMPALA-5857: avoid invalid free of hedged read metrics
The libHdfs API documents that the output parameter is unchanged on
error, therefore we do not need to attempt to free it on error.
Testing:
The bug only reproduced under stress. I don't know how to trigger this
error path yet.
Change-Id: I93baf3b672429c0283d7f031ff302aca31e05be4
Reviewed-on: http://gerrit.cloudera.org:8080/7885
Reviewed-by: Sailesh Mukil <sa...@cloudera.com>
Reviewed-by: Matthew Jacobs <mj...@cloudera.com>
Tested-by: Impala Public Jenkins
---
> Crash in impala::DiskIoMgr::ScanRange::Close-> tc_free while running concurrent TPC-DS
> --------------------------------------------------------------------------------------
>
> Key: IMPALA-5857
> URL: https://issues.apache.org/jira/browse/IMPALA-5857
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Mostafa Mokhtar
> Assignee: Tim Armstrong
> Priority: Critical
> Fix For: Impala 2.10.0
>
>
> Crash in
> {code}
> #0 0x00000032fd832625 in raise () from /lib64/libc.so.6
> #1 0x00000032fd833e05 in abort () from /lib64/libc.so.6
> #2 0x0000000001c0571d in tcmalloc::Log(tcmalloc::LogMode, char const*, int, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem) ()
> #3 0x0000000001bff44d in ?? ()
> #4 0x0000000001c1e688 in tc_free ()
> #5 0x0000000000a2b355 in impala::DiskIoMgr::ScanRange::Close() ()
> #6 0x0000000000ce5833 in impala::ScannerContext::Stream::ReleaseCompletedResources(impala::RowBatch*, bool) ()
> #7 0x0000000000ce5b32 in impala::ScannerContext::ReleaseCompletedResources(impala::RowBatch*, bool) ()
> #8 0x0000000000c77125 in impala::HdfsParquetScanner::Open(impala::ScannerContext*) ()
> #9 0x0000000000c3df80 in impala::HdfsScanNodeBase::CreateAndOpenScanner(impala::HdfsPartitionDescriptor*, impala::ScannerContext*, boost::scoped_ptr<impala::HdfsScanner>*) ()
> #10 0x0000000000c39456 in impala::HdfsScanNode::ProcessSplit(std::vector<impala::FilterContext, std::allocator<impala::FilterContext> > const&, impala::DiskIoMgr::ScanRange*) ()
> #11 0x0000000000c3b4f1 in impala::HdfsScanNode::ScannerThread() ()
> #12 0x0000000000bd34c2 in impala::Thread::SuperviseThread(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*) ()
> #13 0x0000000000bd3c24 in boost::detail::thread_data<boost::_bi::bind_t<void, void (*)(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, boost::function<void ()()>, impala::Promise<long>*), boost::_bi::list4<boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<std::basic_string<char, std::char_traits<char>, std::allocator<char> > >, boost::_bi::value<boost::function<void ()()> >, boost::_bi::value<impala::Promise<long>*> > > >::run() ()
> #14 0x0000000000e5dc7a in ?? ()
> #15 0x00000032fdc07aa1 in start_thread () from /lib64/libpthread.so.0
> #16 0x00000032fd8e893d in clone () from /lib64/libc.so.6
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)