You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@oozie.apache.org by "Santhosh Srinivasan (JIRA)" <ji...@apache.org> on 2011/09/15 03:56:08 UTC

[jira] [Commented] (OOZIE-561) Integrate Oozie with HCatalog

    [ https://issues.apache.org/jira/browse/OOZIE-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13105063#comment-13105063 ] 

Santhosh Srinivasan commented on OOZIE-561:
-------------------------------------------

Currently, HCatalog does not provide programmatic APIs to perform operations like drop partition, create partition, etc in a secure fashion. These operations can be realized by invoking the command line tool. The use of the command line tool does not blend with the philosophy of using programmatic APIs. An alternative approach to consider is to have Web Services API exposed by HCatalog.

Thoughts?  

> Integrate Oozie with HCatalog
> -----------------------------
>
>                 Key: OOZIE-561
>                 URL: https://issues.apache.org/jira/browse/OOZIE-561
>             Project: Oozie
>          Issue Type: New Feature
>            Reporter: Santhosh Srinivasan
>
> With the incubation of HCatalog, we have a mechanism to abstract data and storage on HDFS. A natural progression for Oozie is to interact with HCatalog to facilitate the interplay between MapReduce, Pig and Hive. In addition, the support for notification in HCatalog will alleviate (and not eliminate) the need to poll HDFS for data sets represented as tables and partitions.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira