You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Dip Kharod (JIRA)" <ji...@apache.org> on 2014/04/11 21:14:17 UTC
[jira] [Updated] (PIG-3883) Allow overwrite/append to external Hive
table (with partitions) via HCatStorer
[ https://issues.apache.org/jira/browse/PIG-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dip Kharod updated PIG-3883:
----------------------------
Description:
I'm using HCatStorer to write to external Hive table with partition from Pig and have the following different use cases:
1) Need to overwrite (aka, refresh) data into table: Currently I end up doing this outside (drop partition and delete HDFS folder) of Pig which is very painful and error-prone
2) Need to append (aka, add new file) data to the Hive external table/partition: Again, I end up doing this outside of Pig by copying file in appropriate folder
It would be very productive for the developers to have both options in HCatStorer.
was:
I'm using HCatStorer to write to external Hive table with partition from Pig and have the following different use cases:
1) Need to overwrite (aka, refresh) data into table: Currently I end up doing this outside (drop partition and delete HDFS folder) of Pig which is very painful and error-prone
2) Need to append (aka, add new file) data to the Hive external table/partition: Again, I end up doing this outside of Pig by copying file in appropriate folder
I would be very productive for the developers to have both options in HCatStorer.
> Allow overwrite/append to external Hive table (with partitions) via HCatStorer
> ------------------------------------------------------------------------------
>
> Key: PIG-3883
> URL: https://issues.apache.org/jira/browse/PIG-3883
> Project: Pig
> Issue Type: Improvement
> Components: impl, internal-udfs
> Affects Versions: 0.12.0
> Environment: Production
> Reporter: Dip Kharod
>
> I'm using HCatStorer to write to external Hive table with partition from Pig and have the following different use cases:
> 1) Need to overwrite (aka, refresh) data into table: Currently I end up doing this outside (drop partition and delete HDFS folder) of Pig which is very painful and error-prone
>
> 2) Need to append (aka, add new file) data to the Hive external table/partition: Again, I end up doing this outside of Pig by copying file in appropriate folder
> It would be very productive for the developers to have both options in HCatStorer.
--
This message was sent by Atlassian JIRA
(v6.2#6252)