You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2019/03/01 14:19:00 UTC

[jira] [Commented] (HADOOP-14710) Uber-JIRA: Support AWS Snowball

    [ https://issues.apache.org/jira/browse/HADOOP-14710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781709#comment-16781709 ] 

Steve Loughran commented on HADOOP-14710:
-----------------------------------------

[~kdzhao]:
1: distcp now has a -direct option which avoids the copy
2. you need to enable path-style access and switch back to the v1 list API (there are options for those)

bq. .if I use "s3a://xyz" instead (no back slash at the end), then the error is like: ls: 's3a://xyz': No such file or directory.

that's an irritating feature of the FS shell. If you don't have any path in the URL, it says "your home directory", and so unless there's a /user/$myname path, 404. Create the path or use trailing / entries. Nothing we can do to fix. I've thought about making the home dir of a bucket "/", but that might break existing things. Sorry. it annoys us all. repeatedly


> Uber-JIRA: Support AWS Snowball
> -------------------------------
>
>                 Key: HADOOP-14710
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14710
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Major
>
> Support data transfer between Hadoop and [AWS Snowball|http://docs.aws.amazon.com/snowball/latest/ug/whatissnowball.html].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org