You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Antoni Ivanov (JIRA)" <ji...@apache.org> on 2018/09/11 08:39:00 UTC
[jira] [Commented] (IMPALA-5463) OOM during clone() causes crash in
libjvm.so!java_start()
[ https://issues.apache.org/jira/browse/IMPALA-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610282#comment-16610282 ]
Antoni Ivanov commented on IMPALA-5463:
---------------------------------------
Hi,
We are often seeing Impala Nodes which have 100% CPU Utilization and the Threads with highest CPU (please see attached stack-trace-threads-high-cpu.txt)
The stack trace is similar to those posted in this bug. GCTaskThread.
This is causing overall slow-down of all queries executing in Impala until we stop that node.
We've are using CentOS Linux 7.4.1708 (set vm.overcommit_memory = 1); Impala v2.8.0-cdh5.11.1
Any ideas how we can improve the situation?
> OOM during clone() causes crash in libjvm.so!java_start()
> ---------------------------------------------------------
>
> Key: IMPALA-5463
> URL: https://issues.apache.org/jira/browse/IMPALA-5463
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.8.0
> Reporter: Lars Volker
> Priority: Critical
> Attachments: stack-trace-threads-high-cpu.txt
>
>
> Running out of memory seems to cause a crash in libjvm.so!java_start() right after calling clone(). Here is the stack trace of the crashing thread from a minidump.
> {noformat}
> 0 libjvm.so!PSParallelCompact::MarkAndPushClosure::do_oop(oopDesc**) + 0x86
> 1 libjvm.so!OopMapSet::all_do(frame const*, RegisterMap const*, OopClosure*, void (*)(oopDesc**, oopDesc**), OopClosure*) + 0x2fb
> 2 libjvm.so!frame::oops_do_internal(OopClosure*, CLDClosure*, CodeBlobClosure*, RegisterMap*, bool) + 0xa2
> 3 libjvm.so!JavaThread::oops_do(OopClosure*, CLDClosure*, CodeBlobClosure*) + 0x161
> 4 libjvm.so!ThreadRootsMarkingTask::do_it(GCTaskManager*, unsigned int) + 0x106
> 5 libjvm.so!GCTaskThread::run() + 0x12f
> 6 libjvm.so!java_start(Thread*) + 0x108
> 7 libpthread-2.12.so!start_thread + 0xd1
> 8 libc-2.12.so!clone + 0x6d
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org