You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Santhosh Srinivasan (JIRA)" <ji...@apache.org> on 2009/03/06 20:39:56 UTC
[jira] Created: (PIG-702) Computation of number of reducers in
order by has to change for a static cluster (Hadoop 20)
Computation of number of reducers in order by has to change for a static cluster (Hadoop 20)
--------------------------------------------------------------------------------------------
Key: PIG-702
URL: https://issues.apache.org/jira/browse/PIG-702
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: types_branch
Reporter: Santhosh Srinivasan
Fix For: types_branch
In Hadoop 20, a static cluster is shared amongst multiple queues. The computation of the number of reducers in order by queries when parallel keyword needs to change. Currently, the number of reducers is computed as a function of the number of reduce slots and the number of nodes in the cluster. Conservatively, this should revert to one reducer.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (PIG-702) Computation of number of reducers in
order by has to change for a static cluster (Hadoop 20)
Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olga Natkovich resolved PIG-702.
--------------------------------
Resolution: Fixed
> Computation of number of reducers in order by has to change for a static cluster (Hadoop 20)
> --------------------------------------------------------------------------------------------
>
> Key: PIG-702
> URL: https://issues.apache.org/jira/browse/PIG-702
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.2.0
> Reporter: Santhosh Srinivasan
>
> In Hadoop 20, a static cluster is shared amongst multiple queues. The computation of the number of reducers in order by queries when parallel keyword needs to change. Currently, the number of reducers is computed as a function of the number of reduce slots and the number of nodes in the cluster. Conservatively, this should revert to one reducer.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.