You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Rui Li (JIRA)" <ji...@apache.org> on 2016/05/19 07:24:12 UTC

[jira] [Commented] (HIVE-13789) Repeatedly checking configuration in TextRecordWriter/Reader hurts performance

    [ https://issues.apache.org/jira/browse/HIVE-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290614#comment-15290614 ] 

Rui Li commented on HIVE-13789:
-------------------------------

[~xuefuz] could you take a look at this? Thanks.

> Repeatedly checking configuration in TextRecordWriter/Reader hurts performance
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-13789
>                 URL: https://issues.apache.org/jira/browse/HIVE-13789
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>         Attachments: HIVE-13789.1.patch
>
>
> We check configuration to decide whether to escape certain characters each time write/read a record for custom scripts.
> In our benchmark this becomes a hot spot method. And fixing it improves the execution of the custom script by 7% (3TB TPCx-BB dataset).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)