You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2010/10/30 19:14:20 UTC

[jira] Created: (WHIRR-121) Create a service for Mesos

Create a service for Mesos
--------------------------

                 Key: WHIRR-121
                 URL: https://issues.apache.org/jira/browse/WHIRR-121
             Project: Whirr
          Issue Type: New Feature
            Reporter: Tom White


>From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (WHIRR-121) Create a service for Mesos

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated WHIRR-121:
----------------------------

    Status: Patch Available  (was: Open)

> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch, WHIRR-121.patch, WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (WHIRR-121) Create a service for Mesos

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated WHIRR-121:
----------------------------

    Attachment: WHIRR-121.patch

Updated patch now that WHIRR-87 is in.

> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch, WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (WHIRR-121) Create a service for Mesos

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated WHIRR-121:
----------------------------

    Attachment: WHIRR-121.patch

Work-in-progress patch. Includes WHIRR-87.

> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (WHIRR-121) Create a service for Mesos

Posted by "Tom White (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated WHIRR-121:
----------------------------

    Attachment: WHIRR-121.patch

Here's a new version which I tried out. To build:

{noformat}
mvn clean install
cp cli/target/whirr-cli-*-SNAPSHOT.jar .
{noformat}

I used the following configuration:

{noformat}
whirr.service-name=mesos
whirr.cluster-name=mymesoscluster
whirr.instance-templates=1 mesos-master,1 mesos-slave
whirr.provider=ec2
whirr.identity=...
whirr.credential=...
whirr.client-cidrs=0.0.0.0/0
whirr.run-url-base=http://whirr.s3.amazonaws.com/WHIRR-mesos/
{noformat}

Run with

{noformat}
bin/whirr launch-cluster --config=mesos.properties
{noformat}

It takes a while (20 mins or more) to start since the install script has to build Mesos from source. This could be improved if Mesos built RPMs, or if we had WHIRR-88. Using larger instances would help a lot too.

Multiple services are being tracked in WHIRR-117 - Mesos + HDFS is a great example of where we want to get to.



> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch, WHIRR-121.patch, WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (WHIRR-121) Create a service for Mesos

Posted by "Matei Zaharia (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965122#action_12965122 ] 

Matei Zaharia commented on WHIRR-121:
-------------------------------------

Pretty cool to see this posted. How should I test it out? Also, is it possible to launch multiple services on the same cluster yet (e.g. Mesos + HDFS)?

> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch, WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] [Updated] (WHIRR-121) Create a service for Mesos

Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrei Savu updated WHIRR-121:
------------------------------

    Status: Open  (was: Patch Available)

> Create a service for Mesos
> --------------------------
>
>                 Key: WHIRR-121
>                 URL: https://issues.apache.org/jira/browse/WHIRR-121
>             Project: Whirr
>          Issue Type: New Feature
>          Components: new service
>            Reporter: Tom White
>         Attachments: WHIRR-121.patch, WHIRR-121.patch, WHIRR-121.patch
>
>
> From the website: "Mesos is a platform for running multiple diverse cluster computing frameworks, such as Hadoop, MPI, and web services, on commodity clusters." See http://mesos.berkeley.edu/

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira