You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/12/01 00:30:00 UTC
[jira] [Commented] (MAPREDUCE-7339) Default Speculator returns speculationValue as TOO_LATE_TO_SPECULATE or PROGRESS_IS_GOOD even if the task is ALREADY_SPECULATING
[ https://issues.apache.org/jira/browse/MAPREDUCE-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18041706#comment-18041706 ]
ASF GitHub Bot commented on MAPREDUCE-7339:
-------------------------------------------
github-actions[bot] commented on PR #2951:
URL: https://github.com/apache/hadoop/pull/2951#issuecomment-3594031263
We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you feel like this was a mistake, or you would like to continue working on it, please feel free to re-open it and ask for a committer to remove the stale tag and review again.
Thanks all for your contribution.
> Default Speculator returns speculationValue as TOO_LATE_TO_SPECULATE or PROGRESS_IS_GOOD even if the task is ALREADY_SPECULATING
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-7339
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7339
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Mudit Sharma
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> DefaultSpeculator implementation in Mapreduce returns some MAGIC numbers in speculationValue if the task is not a good candidate for speculation. It returns these values:
>
> {noformat}
> returns ALREADY_SPECULATING if that is true. This has priority.
> returns TOO_NEW if our companion task hasn't gotten any information
> returns PROGRESS_IS_GOOD if the task is sailing through
> returns NOT_RUNNING if the task is not running{noformat}
>
>
> {color:#172b4d}But there is one bug, due to which even if task is speculating, but if its progress is good or its too late to speculate, code returns TOO_LATE_TO_SPECULATE or PROGRESS_IS_GOOD and not ALREADY_SPECULATING{color}
>
> {color:#172b4d}Raised PR for the fix: [https://github.com/apache/hadoop/pull/2951]{color}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org