You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "David Kjerrumgaard (JIRA)" <ji...@apache.org> on 2014/09/25 18:49:36 UTC
[jira] [Updated] (HIVE-8255) Need additional properties to control
size of mapper and reducer containers independently for tez tasks.
[ https://issues.apache.org/jira/browse/HIVE-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
David Kjerrumgaard updated HIVE-8255:
-------------------------------------
Description:
There were 2 memory related configuration properties added in HIVE-6037, hive.tez.container.size & hive.tez.java.opts.
These settings apply to BOTH the mapper and reducer tasks in a TEZ job. Usually, the amount of memory required for your map tasks varies greatly from the memory requirements for your reducers. Therefore, it would be better if the hive.tez.container.size & hive.tez.java.opts properties were replaced with map and reduce specific ones, e.g.
hive.tez.map.container.size & hive.tez.map.java.opts
hive.tez.reduce.container.size & hive.tez.reduce.java.opts
> Need additional properties to control size of mapper and reducer containers independently for tez tasks.
> --------------------------------------------------------------------------------------------------------
>
> Key: HIVE-8255
> URL: https://issues.apache.org/jira/browse/HIVE-8255
> Project: Hive
> Issue Type: Improvement
> Components: Tez
> Affects Versions: 0.13.1
> Reporter: David Kjerrumgaard
> Priority: Minor
>
> There were 2 memory related configuration properties added in HIVE-6037, hive.tez.container.size & hive.tez.java.opts.
> These settings apply to BOTH the mapper and reducer tasks in a TEZ job. Usually, the amount of memory required for your map tasks varies greatly from the memory requirements for your reducers. Therefore, it would be better if the hive.tez.container.size & hive.tez.java.opts properties were replaced with map and reduce specific ones, e.g.
> hive.tez.map.container.size & hive.tez.map.java.opts
> hive.tez.reduce.container.size & hive.tez.reduce.java.opts
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)