[jira] [Commented] (HIVE-15522) REPL LOAD & DUMP support for incremental ALTER_TABLE/ALTER_PTN including renames

["Mithun Radhakrishnan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-15522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210115#comment-16210115 ] 

Mithun Radhakrishnan commented on HIVE-15522:
---------------------------------------------

With this change, {{AddPartitionMessage}} includes the full-fat {{api.Partition}} objects. At least in production at Yahoo, that number can run into the thousands. This isn't as big a problem for {{CreateTableMessage}}, {{CreateDatabaseMessage}}, etc. Depending on how the messages are transmitted (e.g. over JMS), the message-size can pose a challenge.
Note that the corresponding code in HCatalog leaves out the Thrift objects. I'll raise a separate JIRA to see if we can find middle-ground, with regard to the Thrift objects.

> REPL LOAD & DUMP support for incremental ALTER_TABLE/ALTER_PTN including renames
> --------------------------------------------------------------------------------
>
>                 Key: HIVE-15522
>                 URL: https://issues.apache.org/jira/browse/HIVE-15522
>             Project: Hive
>          Issue Type: Sub-task
>          Components: repl
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>             Fix For: 2.2.0
>
>         Attachments: HIVE-15522.2.patch, HIVE-15522.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)