You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Panagiotis Garefalakis (Jira)" <ji...@apache.org> on 2021/10/08 13:46:00 UTC
[jira] [Commented] (HIVE-25362) LLAP: ensure tasks with locality
have a chance to adjust delay
[ https://issues.apache.org/jira/browse/HIVE-25362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426197#comment-17426197 ]
Panagiotis Garefalakis commented on HIVE-25362:
-----------------------------------------------
Resolved via https://github.com/apache/hive/pull/2513
> LLAP: ensure tasks with locality have a chance to adjust delay
> --------------------------------------------------------------
>
> Key: HIVE-25362
> URL: https://issues.apache.org/jira/browse/HIVE-25362
> Project: Hive
> Issue Type: Sub-task
> Components: llap
> Reporter: Panagiotis Garefalakis
> Assignee: Panagiotis Garefalakis
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> HIVE-24914 introduced a short-circuit optimization when all nodes are busy returning DELAYED_RESOURCES and reseting locality delay for a given tasks.
> However, this may prevent tasks from adjusting their locality delay and being added to the DelayQueue leading sometimes to missed locality chances when all LLap resources are fully utilized.
> To address the issue we should handle the two cases separately.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)