You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Tom White (Created) (JIRA)" <ji...@apache.org> on 2011/12/14 23:51:31 UTC

[jira] [Created] (WHIRR-450) Add a hadoop-client role

Add a hadoop-client role
------------------------

                 Key: WHIRR-450
                 URL: https://issues.apache.org/jira/browse/WHIRR-450
             Project: Whirr
          Issue Type: New Feature
            Reporter: Tom White
             Fix For: 0.8.0


The hadoop-client role would install the client libraries on a cloud instance so that users can launch Hadoop commands from there.

In the case of EC2 it would also propagate the fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey Hadoop settings so that using S3 filesystems from Hadoop works without further configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (WHIRR-450) Add a hadoop-client role

Posted by "Tom White (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/WHIRR-450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411794#comment-13411794 ] 

Tom White commented on WHIRR-450:
---------------------------------

That's right. You would also need to set up the configuration to point to the Hadoop cluster. Have a look at MahoutClientClusterActionHandler - I think it does something similar.
                
> Add a hadoop-client role
> ------------------------
>
>                 Key: WHIRR-450
>                 URL: https://issues.apache.org/jira/browse/WHIRR-450
>             Project: Whirr
>          Issue Type: New Feature
>          Components: service/hadoop
>            Reporter: Tom White
>             Fix For: 0.9.0
>
>
> The hadoop-client role would install the client libraries on a cloud instance so that users can launch Hadoop commands from there.
> In the case of EC2 it would also propagate the fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey Hadoop settings so that using S3 filesystems from Hadoop works without further configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (WHIRR-450) Add a hadoop-client role

Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/WHIRR-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated WHIRR-450:
----------------------------

    Component/s: service/hadoop
    
> Add a hadoop-client role
> ------------------------
>
>                 Key: WHIRR-450
>                 URL: https://issues.apache.org/jira/browse/WHIRR-450
>             Project: Whirr
>          Issue Type: New Feature
>          Components: service/hadoop
>            Reporter: Tom White
>             Fix For: 0.8.0
>
>
> The hadoop-client role would install the client libraries on a cloud instance so that users can launch Hadoop commands from there.
> In the case of EC2 it would also propagate the fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey Hadoop settings so that using S3 filesystems from Hadoop works without further configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (WHIRR-450) Add a hadoop-client role

Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/WHIRR-450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409950#comment-13409950 ] 

Andrew Bayer commented on WHIRR-450:
------------------------------------

Would this mean just installing the tarball and the s3 keys if needed?
                
> Add a hadoop-client role
> ------------------------
>
>                 Key: WHIRR-450
>                 URL: https://issues.apache.org/jira/browse/WHIRR-450
>             Project: Whirr
>          Issue Type: New Feature
>          Components: service/hadoop
>            Reporter: Tom White
>             Fix For: 0.9.0
>
>
> The hadoop-client role would install the client libraries on a cloud instance so that users can launch Hadoop commands from there.
> In the case of EC2 it would also propagate the fs.s3n.awsAccessKeyId and fs.s3n.awsSecretAccessKey Hadoop settings so that using S3 filesystems from Hadoop works without further configuration.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira