[jira] [Comment Edited] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

["Shannon Ladymon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392890#comment-15392890 ] 

Shannon Ladymon edited comment on HIVE-7926 at 7/26/16 12:05 AM:
-----------------------------------------------------------------

[~asears], thank you for creating the LLAP page and adding in an overview description of it.  I've gone ahead and copied the rest of the design document into it as well as made some edits to the overview:
* [LLAP | https://cwiki.apache.org/confluence/display/Hive/LLAP]

The page will need to be revised since it still reads like a design document and is missing a few sections, but it's a start.

[~sershe] and Andrew, feel free to make any modifications you'd like to what I added today to fix/clarify the information.


was (Author: sladymon):
[~asears], thank you for creating the LLAP page and adding in an overview description of it.  I've gone ahead and copied the rest of the design document into it as well as made some edits to the overview:
* [ LLAP | https://cwiki.apache.org/confluence/display/Hive/LLAP]

The page will need to be revised since it still reads like a design document and is missing a few sections, but it's a start.

[~sershe] and Andrew, feel free to make any modifications you'd like to what I added today to fix/clarify the information.

> long-lived daemons for query fragment execution, I/O and caching
> ----------------------------------------------------------------
>
>                 Key: HIVE-7926
>                 URL: https://issues.apache.org/jira/browse/HIVE-7926
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>              Labels: TODOC2.0
>             Fix For: 2.0.0
>
>         Attachments: LLAPdesigndocument.pdf
>
>
> We are proposing a new execution model for Hive that is a combination of existing process-based tasks and long-lived daemons running on worker nodes. These nodes can take care of efficient I/O, caching and query fragment execution, while heavy lifting like most joins, ordering, etc. can be handled by tasks.
> The proposed model is not a 2-system solution for small and large queries; neither it is a separate execution engine like MR or Tez. It can be used by any Hive execution engine, if support is added; in future even external products (e.g. Pig) can use it.
> The document with high-level design we are proposing will be attached shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)