You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jonathan Turner Eagles (Jira)" <ji...@apache.org> on 2020/02/03 22:17:00 UTC
[jira] [Commented] (TEZ-4106) Add Exponential Smooth
RuntimeEstimator to the speculator
[ https://issues.apache.org/jira/browse/TEZ-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17029333#comment-17029333 ]
Jonathan Turner Eagles commented on TEZ-4106:
---------------------------------------------
[~ahussein], Couple of minor comments I should have caught before.
The javadoc for TEZ_AM_SPECULATOR_CLASS and TEZ_AM_SPECULATOR_ESTIMATOR_CLASS should be change to differentiate them.
scanForSpeculationsForTesting uses both LOG.info and System.out.println as well as a comment saying // debug. Makes me think they were intended to be removed.
> Add Exponential Smooth RuntimeEstimator to the speculator
> ---------------------------------------------------------
>
> Key: TEZ-4106
> URL: https://issues.apache.org/jira/browse/TEZ-4106
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ahmed Hussein
> Assignee: Ahmed Hussein
> Priority: Major
> Attachments: TEZ-4106.001.patch, TEZ-4106.002.patch, TEZ-4106.003.patch, TEZ-4106.004.patch, TEZ-4106.005.patch
>
>
> Tez speculator implements start-end runtime estimator. Similar to [MAPREDUCE-7208|https://issues.apache.org/jira/browse/MAPREDUCE-7208], we need to implement an adaptive estimator based on smooth Exponential
--
This message was sent by Atlassian Jira
(v8.3.4#803005)