You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@reef.apache.org by "John Yang (JIRA)" <ji...@apache.org> on 2015/01/23 08:16:34 UTC

[jira] [Created] (REEF-107) Reserve unused offers instead of declining them

John Yang created REEF-107:
------------------------------

             Summary: Reserve unused offers instead of declining them
                 Key: REEF-107
                 URL: https://issues.apache.org/jira/browse/REEF-107
             Project: REEF
          Issue Type: Improvement
          Components: REEF-Runtime-Mesos
            Reporter: John Yang
            Priority: Minor


Currently we either accept or decline every offer of each bath of resourceOffers() to acquire a fresh set of offers ASAP.

This may be a good practice in the perspective that Mesos Master can quickly acknowledge that the job does not need the resources and make better cluster-wide decisions based on that.

But on the other hand this may put too much pressure on Mesos Master. I noticed a frequent exchange of new offers & offer declination in the job duration.

It would be good to study the approaches other frameworks(especially those for long running jobs such as Aurora, Marathon, and Spark) take.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)