You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Andrew Chung (JIRA)" <ji...@apache.org> on 2015/10/28 19:50:27 UTC
[jira] [Comment Edited] (REEF-877) Consider rounding issues in
ProcessNewEvaluator() in AllocatedEvaluator.cs
[ https://issues.apache.org/jira/browse/REEF-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14978913#comment-14978913 ]
Andrew Chung edited comment on REEF-877 at 10/28/15 6:50 PM:
-------------------------------------------------------------
It might be good to deprecate the feature for now, but I also think it's valuable to have something similar around that implements the {{Comparable}} interface and supports the "rounding" of values as in the description of the JIRA item.
was (Author: afchung90):
It might be good to deprecate the feature for now, but I also think it's valuable to have something similar around that implements the ``Comparable`` interface and supports the "rounding" of values as in the description of the JIRA item.
> Consider rounding issues in ProcessNewEvaluator() in AllocatedEvaluator.cs
> --------------------------------------------------------------------------
>
> Key: REEF-877
> URL: https://issues.apache.org/jira/browse/REEF-877
> Project: REEF
> Issue Type: Bug
> Components: REEF.NET Driver
> Reporter: Andrew Chung
>
> In the method, we specifically check that the memory of the request matches the allocated evaluator before removing it from EvaluatorRequestor.Evaluators. That means that if it never matches, the Evaluator stays there forever and an the AllocatedEvaluatorHandler is never called with an AllocatedEvaluator that matches the EvaluatorBatchID. This is dangerous because resource managers such as YARN, for example, can round the memory up for the AllocatedEvaluator. It is thus likely that if the user doesn't know what memory multiple to round it to, the user will never get an AllocatedEvaluator matching the EvaluatorBatchID, and EvaluatorRequestor. Evaluators can fill up with pending requests.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)