[jira] Commented: (HIVE-1541) More general dataflow execution backend

["Jeff Hammerbacher (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898654#action_12898654 ] 

Jeff Hammerbacher commented on HIVE-1541:
-----------------------------------------

In particular, it would be nice to avoid the startup overhead of Hadoop MapReduce with this backend.

> More general dataflow execution backend
> ---------------------------------------
>
>                 Key: HIVE-1541
>                 URL: https://issues.apache.org/jira/browse/HIVE-1541
>             Project: Hadoop Hive
>          Issue Type: New Feature
>            Reporter: Jeff Hammerbacher
>
> With the recent open source release of Mesos (http://github.com/mesos/mesos), experimentation at the query execution layer has become more feasible. Inspired by more general-purpose dataflow systems like Volcano, Dryad, and Dremel, it would be interesting to explore a more general-purpose dataflow execution system for Hive queries. One potential backend is the Hyracks project from UCI: http://code.google.com/p/hyracks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.