You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zheng Shao (JIRA)" <ji...@apache.org> on 2009/05/31 01:32:07 UTC

[jira] Resolved: (HIVE-490) set mapred.reduce.tasks to -1 in hive-default.xml

     [ https://issues.apache.org/jira/browse/HIVE-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao resolved HIVE-490.
-----------------------------

       Resolution: Fixed
    Fix Version/s: 0.4.0
     Release Note: HIVE-490. Add missing configuration variables to hive-default.xml. (Yongqiang He via zshao)
     Hadoop Flags: [Reviewed]

Committed. Thanks Yongqiang.

> set mapred.reduce.tasks to -1 in hive-default.xml
> -------------------------------------------------
>
>                 Key: HIVE-490
>                 URL: https://issues.apache.org/jira/browse/HIVE-490
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Clients
>            Reporter: Joydeep Sen Sarma
>             Fix For: 0.4.0
>
>         Attachments: hive-490-2009-05-23-2.patch, hive-490-2009-05-23-3.patch, hive-490-2009-05-23.patch, hive-490-2009-05-26.patch
>
>
> this is profoundly irritating. we can estimate reducers. but since hadoop-default.xml sets this to '1' - by default we don't. if we expect most users to set this to -1 - then we might as well set it to -1 ourselves.
> to not shoot ourselves in the foot - we might want to cap number of reducers based on cluster size (like 2*Nodes).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.