You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (Jira)" <ji...@apache.org> on 2020/03/03 00:05:00 UTC

[jira] [Resolved] (IMPALA-8774) Crash in AggregatorNode::Open() when computing statistics

     [ https://issues.apache.org/jira/browse/IMPALA-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong resolved IMPALA-8774.
-----------------------------------
    Resolution: Cannot Reproduce

I narrowed down the crashed query to happening during computing stats on kudu tables during data load. I looped computing stats on functional_kudu and tpch_kudu for a long time and didn't reproduce it.

{noformat}
while ./tests/util/compute_table_stats.py --db_names=functional_kudu,tpch_kudu; do date; if [[ $(pgrep impalad | wc -l) -ne 3 ]]; then break; fi ; done
{noformat}

> Crash in AggregatorNode::Open() when computing statistics
> ---------------------------------------------------------
>
>                 Key: IMPALA-8774
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8774
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 3.3.0
>            Reporter: Joe McDonnell
>            Assignee: Tim Armstrong
>            Priority: Critical
>         Attachments: 42585955-53b1-4fca-0e5a97ac-8f37eb08.dmp_dumped, logs_1700.tar.gz
>
>
> When testing a non-C++ change on upstream Jenkins ( [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6651/] ), the job failed computing statistics during dataload when an Impalad crashed with the following stack:
> {noformat}
> Thread 345 (crashed)
>  0  0x7f9c02c858f0
>     rax = 0x00007f9c02c858f0   rdx = 0x00007f9b6b792e80
>     rcx = 0x00007f9b6b792d80   rbx = 0x0000000000000001
>     rsi = 0x000000001b3f4fc0   rdi = 0x00007f9b6b792d80
>     rbp = 0x00007f9b6b792e10   rsp = 0x00007f9b6b792d08
>      r8 = 0x00007f9b6b792b80    r9 = 0x00007f9b6b792c10
>     r10 = 0x0000000000000000   r11 = 0x0000000000000206
>     r12 = 0x000000000da90780   r13 = 0x0000000000000001
>     r14 = 0x0000000000000001   r15 = 0x0000000000000001
>     rip = 0x00007f9c02c858f0
>     Found by: given as instruction pointer in context
>  1  impalad!impala::AggregationNode::Open(impala::RuntimeState*) [aggregation-node.cc : 70 + 0x47]
>     rbp = 0x00007f9b6b793240   rsp = 0x00007f9b6b792e20
>     rip = 0x000000000254113c
>     Found by: previous frame's frame pointer
>  2  impalad!impala::FragmentInstanceState::Open() [fragment-instance-state.cc : 348 + 0x37]
>     rbx = 0x0000000000000001   rbp = 0x00007f9b6b793610
>     rsp = 0x00007f9b6b793250   r12 = 0x0000000000000000
>     rip = 0x0000000002020c58
>     Found by: call frame info
>  3  impalad!impala::FragmentInstanceState::Exec() [fragment-instance-state.cc : 84 + 0x19]
>     rbx = 0x0000000000000000   rbp = 0x00007f9b6b793770
>     rsp = 0x00007f9b6b793620   r12 = 0x0000000000000000
>     r13 = 0x0000000000000001   rip = 0x000000000201d91c
>     Found by: call frame info
>  4  impalad!impala::QueryState::ExecFInstance(impala::FragmentInstanceState*) [query-state.cc : 650 + 0x19]
>     rbx = 0x0000000000000001   rbp = 0x00007f9b6b793880
>     rsp = 0x00007f9b6b793780   r12 = 0x0000000000000001
>     r13 = 0x0000000000000001   rip = 0x000000000203135f
>     Found by: call frame info
>  5  impalad!impala::QueryState::StartFInstances()::{lambda()#1}::operator()() const + 0x26
>     rbx = 0x000000000001ecf2   rbp = 0x00007f9b6b7938a0
>     rsp = 0x00007f9b6b793890   r12 = 0x0000000000000000
>     r13 = 0x00007f9b6e7988f0   r14 = 0x000000001e24bbc8
>     r15 = 0x000000001d5d6930   rip = 0x000000000202f62c
>     Found by: call frame info
> ...{noformat}
> I will attach the last few minutes of impalad logs and the compute stats output.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org