You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Aasha Medhi (Jira)" <ji...@apache.org> on 2020/07/17 08:50:00 UTC

[jira] [Commented] (HIVE-23069) Memory efficient iterator should be used during replication.

    [ https://issues.apache.org/jira/browse/HIVE-23069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159781#comment-17159781 ] 

Aasha Medhi commented on HIVE-23069:
------------------------------------

+1

> Memory efficient iterator should be used during replication.
> ------------------------------------------------------------
>
>                 Key: HIVE-23069
>                 URL: https://issues.apache.org/jira/browse/HIVE-23069
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Pravin Sinha
>            Assignee: Pravin Sinha
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: HIVE-23069.01.patch, HIVE-23069.02.patch, HIVE-23069.03.patch
>
>          Time Spent: 6h
>  Remaining Estimate: 0h
>
> Currently the iterator used while copying table data is memory based. In case of a database with very large number of table/partitions, such iterator may cause HS2 process to go OOM.
> Also introduces a config option to run data copy tasks during repl load operation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)