[jira] [Commented] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

["Lefty Leverenz (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118991#comment-15118991 ] 

Lefty Leverenz commented on HIVE-12470:
---------------------------------------

Doc note:  This adds *hive.llap.client.consistent.splits* to HiveConf.java.  (It also changes the default of *hive.llap.daemon.service.hosts* from "" to null but that won't affect the wiki doc.  HIVE-11358 introduced *hive.llap.daemon.service.hosts* in release 2.0.0, which is the same as this issue's release.)

The documentation belongs in a new LLAP section of Configuration Properties that will be created for HIVE-11908.

* [HIVE-11908 doc note | https://issues.apache.org/jira/browse/HIVE-11908?focusedCommentId=15068885&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15068885]

> Allow splits to provide custom consistent locations, instead of being tied to data locality
> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-12470
>                 URL: https://issues.apache.org/jira/browse/HIVE-12470
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>              Labels: TODOC2.0
>             Fix For: 2.0.0
>
>         Attachments: HIVE-12470.1.txt, HIVE-12470.1.wip.txt, HIVE-12470.2.txt
>
>
> LLAP instances may not run on the same nodes as HDFS, or may run on a subset of the cluster.
> Using split locations based on FileSystem locality is not very useful in such cases - since that guarantees not getting any locality.
> Allow a split to map to a specific location - so that there's a chance of getting cache locality across different queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)