[jira] [Comment Edited] (HAMA-726) Hama on Mesos

["Jeff Fenchel (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015168#comment-14015168 ] 

Jeff Fenchel edited comment on HAMA-726 at 6/2/14 3:48 AM:
-----------------------------------------------------------

Here is a patch to add in grooms managed by mesos. It has been tested on a small cluster. It still needs updates for fault tolerance and unit tests but I will do that in another JIRA ticket. Any feedback would be greatly appreciated! Thanks.

Also, here is the configuration to enable it if anyone wants to try it out:
        <property>
                <name>bsp.master.TaskWorkerManager.class</name>
                <value>org.apache.hama.bsp.MesosScheduler</value>
                <description> </description>
        </property>
<property>
    <name>hama.mesos.executor.uri</name>
    <value>hdfs://hdfs.name.node:port/hama.tar.gz</value>
    <description>
      Ignore this if you are not using the Mesos TaskWorkerManger. 
      This is the URI of the Hama distribution. Upload this yourself. 
    </description>
  </property>
  <property>
    <name>bsp.tasks.maximum.total</name>
    <value>10</value>
    <description>
      This is an override for the total maximum tasks that may be run.
      The default behavior is to determine a value based on the available groom
      servers. However, if using mesos, the groom servers are not yet allocated.  
      So, a value indicating the number of slots available in the cluster is needed. 
    </description>
  </property>
 <property>
    <name>hama.mesos.master</name>
    <value>local</value>
    <description>
      Ignore this if you are not using the Mesos TaskWorkerManger.
      This is the address of the Mesos master instance. If you're using
      Zookeeper for master election, use the Zookeeper address here (i.e.,
      zk://zk.apache.org:2181/hadoop/mesos).
    </description>
  </property>





was (Author: jfenc91):
Here is a patch to add in grooms managed by mesos. It has been tested on a small cluster. It still needs updates for fault tolerance and unit tests but I will do that in another JIRA ticket. Any feedback would be greatly appreciated! Thanks.

> Hama on Mesos
> -------------
>
>                 Key: HAMA-726
>                 URL: https://issues.apache.org/jira/browse/HAMA-726
>             Project: Hama
>          Issue Type: New Feature
>          Components: bsp core
>            Reporter: Suraj Menon
>            Assignee: Jeff Fenchel
>         Attachments: HAMA-726.patch
>
>
> Since we are going to refactor our code to work on YARN, it would be nice to keep our abstraction levels to make it feasible to work on Mesos. 
> Documentation: http://incubator.apache.org/mesos/documentation.html
> Framework development guide:
> https://github.com/mesos/mesos/wiki/App-Framework-development-guide



--
This message was sent by Atlassian JIRA
(v6.2#6252)