You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zheng Shao (JIRA)" <ji...@apache.org> on 2010/01/27 06:18:34 UTC

[jira] Commented: (HIVE-1107) Generic parallel execution framework for Hive (and Pig, and ...)

    [ https://issues.apache.org/jira/browse/HIVE-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805351#action_12805351 ] 

Zheng Shao commented on HIVE-1107:
----------------------------------

Hadoop has the JobControl classes which can be generalized to support our need.

The current major limitations of JobControl are:
1. No way to add jobs that are non-mapreduce. Hive has a lot of other jobs as well, including MoveTask, etc.
2. No way to serialize the jobs and resume the progress at a later time.


> Generic parallel execution framework for Hive (and Pig, and ...)
> ----------------------------------------------------------------
>
>                 Key: HIVE-1107
>                 URL: https://issues.apache.org/jira/browse/HIVE-1107
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Query Processor
>            Reporter: Carl Steinbach
>
> Pig and Hive each have their own libraries for handling plan execution. As we prepare to invest more time improving Hive's plan execution mechanism we should also start to consider ways of building a generic plan execution mechanism that is capable of supporting the needs of Hive and Pig, as well as other Hadoop data flow programming environments. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.