You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@oozie.apache.org by Andy Srine <an...@gmail.com> on 2014/04/08 06:52:36 UTC

Distcp action (from S3)

Hello,


I am trying to do a distcp from a S3 bucket to hdfs using oozie's distcp
action and am not having any luck. Ditcp itself works from the commandline,
but fails with credentials error via oozie as shown below. Any ideas?


2014-04-08 04:34:04,609 ERROR [main] org.apache.hadoop.tools.DistCp:
Exception encountered

java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key
must be specified as the username or password (respectively) of a s3n URL,
or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey
properties (respectively).

at org.apache.hadoop.fs.s3.S3Credentials.initialize(S3Credentials.java:70)

at
org.apache.hadoop.fs.s3native.Jets3tNativeFileSystemStore.initialize(Jets3tNativeFileSystemStore.java:55)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)


Thanks,
Andy