You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "zhaoqi (JIRA)" <ji...@apache.org> on 2013/11/19 00:59:23 UTC
[jira] [Commented] (OOZIE-426) OOZIE-9: Support (Amazon) s3/s3n
schemes
[ https://issues.apache.org/jira/browse/OOZIE-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13825969#comment-13825969 ]
zhaoqi commented on OOZIE-426:
------------------------------
It's very usefull if you can give an link to download the patch
> OOZIE-9: Support (Amazon) s3/s3n schemes
> ----------------------------------------
>
> Key: OOZIE-426
> URL: https://issues.apache.org/jira/browse/OOZIE-426
> Project: Oozie
> Issue Type: New Feature
> Reporter: Hadoop QA
> Assignee: Roman Shaposhnik
>
> Currently Oozie supports only the 'hdfs' scheme. For people having their hadoop cluster in Amazon EC2 and using S3 for storage, it would be very useful if oozie supports the 's3n/s3' scheme(s). The use case I am talking about is as follows
> Hadoop cluster in Amazon EC2
> Uses hdfs for intermediate storage
> Uses s3 for getting input for, storing output of map-reduce jobs.
> More details on the above use-case and the exceptions/failures I have seen is documented here (http://tech.groups.yahoo.com/group/Oozie-users/message/1138).
> There can be other use cases as well - say use s3 as the DFS instead of HDFS.
--
This message was sent by Atlassian JIRA
(v6.1#6144)