You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Liyin Liang (Created) (JIRA)" <ji...@apache.org> on 2011/12/26 07:06:30 UTC
[jira] [Created] (MAPREDUCE-3598) Old combiner doesn't support
counter, progress
Old combiner doesn't support counter, progress
----------------------------------------------
Key: MAPREDUCE-3598
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3598
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.205.0
Reporter: Liyin Liang
Priority: Blocker
After HADOOP-5382, old combiner's reduce is invoked with Reporter.NULL. So all the features in Reporter, e.g. counter, progress are not supported any more. The related code is as follows:
{code:}
while (values.more()) {
combiner.reduce(values.getKey(), values, combineCollector,
Reporter.NULL);
values.nextKey();
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3598) Old combiner doesn't support
counter, progress
Posted by "Subroto Sanyal (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175904#comment-13175904 ]
Subroto Sanyal commented on MAPREDUCE-3598:
-------------------------------------------
Hi Liyin,
Seems MAPREDUCE-3376 is same as this one. Can you take a look please?
> Old combiner doesn't support counter, progress
> ----------------------------------------------
>
> Key: MAPREDUCE-3598
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3598
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: Liyin Liang
> Priority: Blocker
>
> After HADOOP-5382, old combiner's reduce is invoked with Reporter.NULL. So all the features in Reporter, e.g. counter, progress are not supported any more. The related code is as follows:
> {code:}
> while (values.more()) {
> combiner.reduce(values.getKey(), values, combineCollector,
> Reporter.NULL);
> values.nextKey();
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3598) Old combiner doesn't support
counter, progress
Posted by "Harsh J (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175900#comment-13175900 ]
Harsh J commented on MAPREDUCE-3598:
------------------------------------
This should be fixed with MAPREDUCE-3376
> Old combiner doesn't support counter, progress
> ----------------------------------------------
>
> Key: MAPREDUCE-3598
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3598
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: Liyin Liang
> Priority: Blocker
>
> After HADOOP-5382, old combiner's reduce is invoked with Reporter.NULL. So all the features in Reporter, e.g. counter, progress are not supported any more. The related code is as follows:
> {code:}
> while (values.more()) {
> combiner.reduce(values.getKey(), values, combineCollector,
> Reporter.NULL);
> values.nextKey();
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3598) Old combiner doesn't support
counter, progress
Posted by "Liyin Liang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175912#comment-13175912 ]
Liyin Liang commented on MAPREDUCE-3598:
----------------------------------------
Gotit.
I think this bug is serious and cause some jobs failed in our product cluster. So it should be backported to 0.20.205 or 0.20.2.
> Old combiner doesn't support counter, progress
> ----------------------------------------------
>
> Key: MAPREDUCE-3598
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3598
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: Liyin Liang
> Priority: Blocker
>
> After HADOOP-5382, old combiner's reduce is invoked with Reporter.NULL. So all the features in Reporter, e.g. counter, progress are not supported any more. The related code is as follows:
> {code:}
> while (values.more()) {
> combiner.reduce(values.getKey(), values, combineCollector,
> Reporter.NULL);
> values.nextKey();
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3598) Old combiner doesn't support
counter, progress
Posted by "Arun C Murthy (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved MAPREDUCE-3598.
--------------------------------------
Resolution: Duplicate
Duplicate of MAPREDUCE-3376.
> Old combiner doesn't support counter, progress
> ----------------------------------------------
>
> Key: MAPREDUCE-3598
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3598
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: Liyin Liang
> Priority: Blocker
>
> After HADOOP-5382, old combiner's reduce is invoked with Reporter.NULL. So all the features in Reporter, e.g. counter, progress are not supported any more. The related code is as follows:
> {code:}
> while (values.more()) {
> combiner.reduce(values.getKey(), values, combineCollector,
> Reporter.NULL);
> values.nextKey();
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira