You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ahmed Hussein (Jira)" <ji...@apache.org> on 2020/01/02 16:05:00 UTC

[jira] [Commented] (MAPREDUCE-7252) Handling 0 progress in SimpleExponential task runtime estimator

    [ https://issues.apache.org/jira/browse/MAPREDUCE-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006893#comment-17006893 ] 

Ahmed Hussein commented on MAPREDUCE-7252:
------------------------------------------

[~jeagles] the error is not related to the current patch. It is an old bug that causes the tests to be flaky.

See the pending Jira MAPREDUCE-7099. I am still investigating when did that bug starts to break the tests.
{code:bash}
[WARNING] Tests run: 568, Failures: 0, Errors: 0, Skipped: 10
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  02:00 h
[INFO] Finished at: 2020-01-01T00:06:16Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M1:test (default-test) on project hadoop-mapreduce-client-jobclient: There was a timeout or other error in the fork -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
{code}

> Handling 0 progress in SimpleExponential task runtime estimator
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-7252
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7252
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Ahmed Hussein
>            Assignee: Ahmed Hussein
>            Priority: Minor
>         Attachments: MAPREDUCE-7252.001.patch, MAPREDUCE-7252.002.patch, MAPREDUCE-7252.003.patch
>
>
> The simple exponential runtime estimator (added in MAPREDUCE-7208) seems not to handle the corner cases where the delta progress is 0. As a result, the forecast will be NaN or Inf which messes up the subsequent forecast values.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org