You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2018/12/04 06:40:00 UTC

[jira] [Updated] (HIVE-20999) LLAP IO: MutableQuantiles is contended heavily

     [ https://issues.apache.org/jira/browse/HIVE-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gopal V updated HIVE-20999:
---------------------------
    Labels: performance  (was: )

> LLAP IO: MutableQuantiles is contended heavily
> ----------------------------------------------
>
>                 Key: HIVE-20999
>                 URL: https://issues.apache.org/jira/browse/HIVE-20999
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>    Affects Versions: 3.1.1
>            Reporter: Gopal V
>            Priority: Major
>              Labels: performance
>
> MutableQuantiles::add() is synchronized across all threads.
> {code}
> IO-Elevator-Thread-0 [DAEMON] State: BLOCKED CPU usage on sample: 316ms
> org.apache.hadoop.metrics2.lib.MutableQuantiles.add(long) MutableQuantiles.java:133
> org.apache.hadoop.hive.llap.metrics.LlapDaemonIOMetrics.addDecodeBatchTime(long) LlapDaemonIOMetrics.java:98
> org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(EncodedColumnBatch) EncodedDataConsumer.java:89
> org.apache.hadoop.hive.llap.io.decode.EncodedDataConsumer.consumeData(Object) EncodedDataConsumer.java:34
> org.apache.hadoop.hive.ql.io.orc.encoded.EncodedReaderImpl.readEncodedColumns(int, StripeInformation, OrcProto$RowIndex[], List, List, boolean[], boolean[], Consumer) EncodedReaderImpl.java:530
> org.apache.hadoop.hive.llap.io.encoded.OrcEncodedDataReader.performDataRead() OrcEncodedDataReader.java:407
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)