You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2018/07/05 22:19:00 UTC
[jira] [Assigned] (IMPALA-7252) Backport rate limiting of fadvise
calls into toolchain glog
[ https://issues.apache.org/jira/browse/IMPALA-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reassigned IMPALA-7252:
-----------------------------------
Assignee: Todd Lipcon
> Backport rate limiting of fadvise calls into toolchain glog
> -----------------------------------------------------------
>
> Key: IMPALA-7252
> URL: https://issues.apache.org/jira/browse/IMPALA-7252
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 3.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Major
>
> Currently, glog's default behavior is to call fadvise(FADV_DONTNEED) on the log file after each entry that is written. In many versions of the Linux kernel, each invocation of this call causes work to be scheduled on all other CPUs, causing up to one context switch per CPU for every log line. We saw this cause an extremely long GC pause in the catalogd in the case where the native side of the catalog was logging a lot of messages about publishing metadata updates at the same time that the Java side was running a GC. The GC spent almost all of its time in the kernel due to the high context switch rate causing a lot of TLB clears and misses, and instead of pausing the JVM for a couple of seconds took several minutes.
> This was identified and fixed upstream in glog here: https://github.com/google/glog/commit/dacd29679633c9b845708e7015bd2c79367a6ea2
> We should backport this fix into the version in the toolchain.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org