You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2015/02/16 06:07:25 UTC
[jira] [Commented] (REEF-30) Run REEF on Mesos
[ https://issues.apache.org/jira/browse/REEF-30?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322370#comment-14322370 ]
Hudson commented on REEF-30:
----------------------------
FAILURE: Integrated in Reef-pull-request-windows #100 (See [https://builds.apache.org/job/Reef-pull-request-windows/100/])
[REEF-30] Adding reef-runtime-mesos (weimer: rev c908a526d8ad14ab9a35be351a89160fe6576992)
* reef-runtime-mesos/pom.xml
* reef-tests/src/test/java/org/apache/reef/tests/TestEnvironmentFactory.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/REEFExecutors.java
* reef-runtime-mesos/src/main/avro/EvaluatorControl.avsc
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/client/parameters/RootFolder.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/REEFScheduler.java
* reef-examples/src/main/java/org/apache/reef/examples/hello/HelloREEFMesos.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/evaluator/parameters/MesosExecutorId.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosSchedulerDriverExecutor.java
* pom.xml
* reef-examples/pom.xml
* .gitignore
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/MesosClasspathProvider.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosResourceRequestHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosRuntimeStartHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/evaluator/REEFExecutor.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/client/MesosJobSubmissionHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosRuntimeStopHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/REEFEventHandlers.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosResourceLaunchHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/REEFExecutor.java
* reef-tests/src/test/java/org/apache/reef/tests/MesosTestEnvironment.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/client/MesosClientConfiguration.java
* reef-tests/src/test/java/org/apache/reef/tests/YarnTestEnvironment.java
* bin/runmesostests.sh
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/parameters/MesosMasterIp.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosDriverConfiguration.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/util/MesosErrorHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/client/parameters/MasterIp.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/util/HDFSConfigurationConstructor.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/util/MesosRemoteManagerCodec.java
* reef-tests/pom.xml
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/driver/MesosResourceReleaseHandler.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/util/MesosRemoteManager.java
* reef-runtime-mesos/src/main/java/org/apache/reef/runtime/mesos/evaluator/EvaluatorControlHandler.java
> Run REEF on Mesos
> -----------------
>
> Key: REEF-30
> URL: https://issues.apache.org/jira/browse/REEF-30
> Project: REEF
> Issue Type: New Feature
> Components: REEF
> Reporter: Byung-Gon Chun
> Assignee: Markus Weimer
> Fix For: 0.11
>
>
> Add reef-runtime-mesos to support running REEF on Mesos.
> The main work's done for translating Mesos resource offers to REEF resource requests and running evaluators on Mesos executors.
> On resource requests from REEF Driver, launches Mesos executors which register Evaluator Launch/Release handlers
> On evaluator launch/release requests from REEF Driver, uses the registered handlers to start/stop evaluator processes on the Mesos executors.
> One thing to note is that Mesos runs a framework scheduler as a client (i.e., it does not run on a slave mode). This means that with Mesos the REEF driver runs at the machine you launch the job.
> There're meta-frameworks like Marathon and Aurora that allows to run the framework scheduler on a slave node. We will use Mesos natively. Integrating with Marathon or Aurora can be future work.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)