You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2019/02/07 19:22:00 UTC

[jira] [Updated] (HIVE-21229) Tez: Provide a Node-Label split affinity provider

     [ https://issues.apache.org/jira/browse/HIVE-21229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gopal V updated HIVE-21229:
---------------------------
    Issue Type: Improvement  (was: Bug)

> Tez: Provide a Node-Label split affinity provider
> -------------------------------------------------
>
>                 Key: HIVE-21229
>                 URL: https://issues.apache.org/jira/browse/HIVE-21229
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Gopal V
>            Priority: Major
>
> When the queue has node-labels, the delays involved in waiting for node locality are a net-loss to the query.
> Asking for locality in a node which is not available to the current queue is slowing down YARN task allocations.
> Also specifically, for the 3-replica HDFS case, picking the replica that belongs within the node-label is more efficient than picking a non-available node & falling back to rack_local instead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)