You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2016/12/12 03:13:58 UTC
[jira] [Resolved] (KUDU-1799) AsyncKuduClient.discoverTablets has
very expensive logging
[ https://issues.apache.org/jira/browse/KUDU-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved KUDU-1799.
-------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
> AsyncKuduClient.discoverTablets has very expensive logging
> ----------------------------------------------------------
>
> Key: KUDU-1799
> URL: https://issues.apache.org/jira/browse/KUDU-1799
> Project: Kudu
> Issue Type: Bug
> Reporter: Matthew Jacobs
> Assignee: Dan Burkert
> Priority: Critical
> Labels: impala
> Fix For: 1.2.0
>
>
> Impala finds that the following logging is causing extreme contention in concurrent planning of queries containing tables w/ a large number of partitions.
> {code}
> LOG.info("Learned about tablet {} for table '{}' with partition {}",
> rt.getTabletId(), tableName, rt.getPartition());
> {code}
> This stack dominates the cost of planning:
> {code}
> org.apache.log4j.Category.callAppenders(LoggingEvent) 165,411 6,692,346,585,303
> org.apache.log4j.Category.forcedLog(String, Priority, Object, Throwable) 165,411 6,692,346,585,303
> org.apache.log4j.Category.log(String, Priority, Object, Throwable) 165,411 6,692,346,585,303
> org.slf4j.impl.Log4jLoggerAdapter.info(String, Object[]) 165,411 6,692,346,585,303
> org.apache.kudu.client.AsyncKuduClient.discoverTablets(KuduTable, byte[], List, long) 165,411 6,692,346,585,303
> org.apache.kudu.client.AsyncKuduClient$MasterLookupCB.call(Master$GetTableLocationsResponsePB) 165,411 6,692,346,585,303
> org.apache.kudu.client.AsyncKuduClient$MasterLookupCB.call(Object) 165,411 6,692,346,585,303
> com.stumbleupon.async.Deferred.doCall(Callback) 165,411 6,692,346,585,303
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)