You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Naveen Gangam <ng...@cloudera.com> on 2022/09/21 17:01:34 UTC

Re: External table replication in Hive

Typically, we do not introduce new features on maintenance branches. We
would not have many cycles to test new features. Sorry.

On Thu, Aug 25, 2022 at 10:36 AM Sungwoo Park <gl...@gmail.com> wrote:

> For 1, cherry-picking it to Hive 3 does not work. I tried to
> backport HIVE-20911 to Hive 3, but it did not work because of so many
> dependencies :-(
>
> --- Sungwoo
>
> On Thu, Aug 25, 2022 at 2:15 AM Bharathkrishna G M <bh...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I want to replicate the Hive metastore to create a separate instance (for
>> example, replicate the prod metadata to create a dev metastore).
>>
>> I'm using Hive version 3.1.2 and it only supports managed table
>> replication and lacks external table replication.
>>
>> I want to try and get external tables also replicate on Hive 3. A couple
>> of questions here:
>>
>> 1. I see the Pull request https://github.com/apache/hive/pull/506/files
>> for external table replication on Hive 4. Is it viable to cherry-pick it to
>> Hive 3, and is this something that has been tried out?
>>
>> 2. Also, I only want to replicate the metadata and not the data itself.
>>
>> 3. The replication commands seem to have changed with Hive 4, and I'm
>> unable to find the new commands (there's no documentation), the latest
>> documentation seen is
>> https://cwiki.apache.org/confluence/display/Hive/HiveReplicationv2Development
>> which does not cover the external tables.
>>
>> Kindly guide me on the above.
>>
>> Thanks,
>> Bharath
>>
>