[jira] [Commented] (HIVE-12470) Allow splits to provide custom consistent locations, instead of being tied to data locality

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061291#comment-15061291 ] 

Sergey Shelukhin commented on HIVE-12470:
-----------------------------------------

Can you post a RB?
Why not store the list pre-sorted instead of sorting every time?
Also, what is the need for the cache of registries by name?

> Allow splits to provide custom consistent locations, instead of being tied to data locality
> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-12470
>                 URL: https://issues.apache.org/jira/browse/HIVE-12470
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: HIVE-12470.1.txt, HIVE-12470.1.wip.txt
>
>
> LLAP instances may not run on the same nodes as HDFS, or may run on a subset of the cluster.
> Using split locations based on FileSystem locality is not very useful in such cases - since that guarantees not getting any locality.
> Allow a split to map to a specific location - so that there's a chance of getting cache locality across different queries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)