You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mahadev konar (JIRA)" <ji...@apache.org> on 2006/05/30 21:02:29 UTC
[jira] Created: (HADOOP-262) the reduce tasks do not report
progress if they the map output locations is empty.
the reduce tasks do not report progress if they the map output locations is empty.
----------------------------------------------------------------------------------
Key: HADOOP-262
URL: http://issues.apache.org/jira/browse/HADOOP-262
Project: Hadoop
Type: Bug
Components: mapred
Reporter: Mahadev konar
Assigned to: Mahadev konar
The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-262) the reduce tasks do not report
progress if they the map output locations is empty.
Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
Sameer Paranjpye updated HADOOP-262:
------------------------------------
Fix Version: 0.3
Version: 0.3
> the reduce tasks do not report progress if they the map output locations is empty.
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-262
> URL: http://issues.apache.org/jira/browse/HADOOP-262
> Project: Hadoop
> Type: Bug
> Components: mapred
> Versions: 0.3
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Fix For: 0.3
> Attachments: reduce_sleep.patch
>
> The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
Re: [jira] Resolved: (HADOOP-262) the reduce tasks do not report
progress if they the map output locations is empty.
Posted by Dennis Kubes <nu...@dragonflymc.com>.
Thanks for this. I have been banging up against errors caused by the
ReduceTasks failing because of waits for about a week now. This fixes it.
Dennis
Doug Cutting (JIRA) wrote:
> [ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
>
> Doug Cutting resolved HADOOP-262:
> ---------------------------------
>
> Fix Version: 0.3.1
> (was: 0.3.0)
> Resolution: Fixed
>
> I just committed this. Thanks, Mahadev.
>
>
>> the reduce tasks do not report progress if they the map output locations is empty.
>> ----------------------------------------------------------------------------------
>>
>> Key: HADOOP-262
>> URL: http://issues.apache.org/jira/browse/HADOOP-262
>> Project: Hadoop
>> Type: Bug
>>
>
>
>> Components: mapred
>> Versions: 0.3.0
>> Reporter: Mahadev konar
>> Assignee: Mahadev konar
>> Fix For: 0.3.1
>> Attachments: reduce_sleep.patch
>>
>> The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
>>
>
>
[jira] Resolved: (HADOOP-262) the reduce tasks do not report
progress if they the map output locations is empty.
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
Doug Cutting resolved HADOOP-262:
---------------------------------
Fix Version: 0.3.1
(was: 0.3.0)
Resolution: Fixed
I just committed this. Thanks, Mahadev.
> the reduce tasks do not report progress if they the map output locations is empty.
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-262
> URL: http://issues.apache.org/jira/browse/HADOOP-262
> Project: Hadoop
> Type: Bug
> Components: mapred
> Versions: 0.3.0
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Fix For: 0.3.1
> Attachments: reduce_sleep.patch
>
> The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Closed: (HADOOP-262) the reduce tasks do not report progress
if they the map output locations is empty.
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
Doug Cutting closed HADOOP-262:
-------------------------------
> the reduce tasks do not report progress if they the map output locations is empty.
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-262
> URL: http://issues.apache.org/jira/browse/HADOOP-262
> Project: Hadoop
> Type: Bug
> Components: mapred
> Versions: 0.3.0
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Fix For: 0.3.1
> Attachments: reduce_sleep.patch
>
> The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-262) the reduce tasks do not report
progress if they the map output locations is empty.
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-262?page=all ]
Mahadev konar updated HADOOP-262:
---------------------------------
Attachment: reduce_sleep.patch
here is a patch that reports progress while its sleeping and waiting for more map outputs.
> the reduce tasks do not report progress if they the map output locations is empty.
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-262
> URL: http://issues.apache.org/jira/browse/HADOOP-262
> Project: Hadoop
> Type: Bug
> Components: mapred
> Reporter: Mahadev konar
> Assignee: Mahadev konar
> Attachments: reduce_sleep.patch
>
> The ReduceTaskRunner should report progress even if the number of ouput locations to copy is empty. In case, the last few maps are running on a tasktracker that goes down, all the reduce tasks waiting for these mapoutputs would fail.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira