You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Keren Ouaknine (JIRA)" <ji...@apache.org> on 2012/06/07 16:42:26 UTC
[jira] [Commented] (HIVE-1107) Generic parallel execution framework
for Hive (and Pig, and ...)
[ https://issues.apache.org/jira/browse/HIVE-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291044#comment-13291044 ]
Keren Ouaknine commented on HIVE-1107:
--------------------------------------
Hello, I would like to unify the execution layers of Pig and Hive. Greenplum hired me for this project and I will be working on it during this summer (June to September).
As part of this project, we would also like to integrate MRv2 logic and advantages to the MR plans generated by these query languages.
The idea is to choose a couple of operators, compare their execution and merge them (or merely choose one).
The advantage of this project is to have Pig and Hive developers working on a single compiler and optimizer
of the MR plan. I would love to hear your comments.
For more details on this project:
http://kereno.com/Plans_for_unification_of_Pig_and_Hive.pdf
> Generic parallel execution framework for Hive (and Pig, and ...)
> ----------------------------------------------------------------
>
> Key: HIVE-1107
> URL: https://issues.apache.org/jira/browse/HIVE-1107
> Project: Hive
> Issue Type: New Feature
> Components: Query Processor
> Reporter: Carl Steinbach
>
> Pig and Hive each have their own libraries for handling plan execution. As we prepare to invest more time improving Hive's plan execution mechanism we should also start to consider ways of building a generic plan execution mechanism that is capable of supporting the needs of Hive and Pig, as well as other Hadoop data flow programming environments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira