You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Shannon Ladymon (JIRA)" <ji...@apache.org> on 2016/09/19 22:53:20 UTC
[jira] [Commented] (HIVE-7926) long-lived daemons for query
fragment execution, I/O and caching
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504935#comment-15504935 ]
Shannon Ladymon commented on HIVE-7926:
---------------------------------------
[~sershe], can you clarify why the # is used in #LLAP in the [design doc | https://issues.apache.org/jira/secure/attachment/12665704/LLAPdesigndocument.pdf]?
> long-lived daemons for query fragment execution, I/O and caching
> ----------------------------------------------------------------
>
> Key: HIVE-7926
> URL: https://issues.apache.org/jira/browse/HIVE-7926
> Project: Hive
> Issue Type: New Feature
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: LLAPdesigndocument.pdf
>
>
> We are proposing a new execution model for Hive that is a combination of existing process-based tasks and long-lived daemons running on worker nodes. These nodes can take care of efficient I/O, caching and query fragment execution, while heavy lifting like most joins, ordering, etc. can be handled by tasks.
> The proposed model is not a 2-system solution for small and large queries; neither it is a separate execution engine like MR or Tez. It can be used by any Hive execution engine, if support is added; in future even external products (e.g. Pig) can use it.
> The document with high-level design we are proposing will be attached shortly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)