You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sahil Takiar (JIRA)" <ji...@apache.org> on 2018/06/01 14:02:00 UTC
[jira] [Commented] (HIVE-19752) PerfLogger integration for critical
Hive-on-S3 paths
[ https://issues.apache.org/jira/browse/HIVE-19752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498029#comment-16498029 ]
Sahil Takiar commented on HIVE-19752:
-------------------------------------
This is probably useful in general too, not just for S3. Added PerLogger wrappers around {{getInputPaths}}, {{loadPartition}}, {{loadTable}}, {{loadDynamicPartitions}} and anywhere where files get moved to their final directory.
> PerfLogger integration for critical Hive-on-S3 paths
> ----------------------------------------------------
>
> Key: HIVE-19752
> URL: https://issues.apache.org/jira/browse/HIVE-19752
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
> Attachments: HIVE-19752.1.patch
>
>
> There are several areas where Hive performs a lot of S3 operations, it would be good to add PerfLogger statements around this so we can measure how long they take.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)