[jira] [Commented] (TEZ-3353) Tez should adjust processor memory on demand

["Gunther Hagleitner (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383268#comment-15383268 ] 

Gunther Hagleitner commented on TEZ-3353:
-----------------------------------------

The request is to get a proper API. Setting "tez.task.scale.memory.reserve-fraction" based on a computation that has to involve various internal Tez variables (fraction of xmx to container, fraction reserved by default for processor, etc) is just bogus. Hive should just be able to tell Tez that it needs 500mb and tez can layout the mem as it sees fit with this in mind.

> Tez should adjust processor memory on demand
> --------------------------------------------
>
>                 Key: TEZ-3353
>                 URL: https://issues.apache.org/jira/browse/TEZ-3353
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Wei Zheng
>
> Hive requests some amount of memory for its map join, which sometimes is not allocated as much as expected. Tez should make adjustment and satisfy that request as is.
> This is related to HIVE-13934.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)