You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2009/10/15 14:14:31 UTC

[jira] Updated: (HADOOP-6108) Add support for EBS storage on EC2

     [ https://issues.apache.org/jira/browse/HADOOP-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HADOOP-6108:
------------------------------

    Attachment: HADOOP-6108.patch

Here is a new patch which provides EBS support, amongst other things.

The scripts have been refactored to make it easy to support other providers. The current patch does not include anything other than EC2, but the plan is to add other providers, perhaps by using libcloud (http://libcloud.org/). Since the scripts are no longer EC2 specific they are under src/contrib/cloud.

These new scripts are a superset of the the bash scripts (in src/contrib/ec2) and are intended to replace them. They are also more amenable to testing (there are some unit tests included).

There are also integration (functional) tests for testing running a MapReduce job on a transient and a persistent (EBS) cluster.

> Add support for EBS storage on EC2
> ----------------------------------
>
>                 Key: HADOOP-6108
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6108
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: contrib/ec2
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: HADOOP-6108.patch
>
>
> By using EBS for namenode and datanode storage we can have persistent, restartable Hadoop clusters running on EC2.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.