You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by roni <ro...@gmail.com> on 2015/03/09 19:17:39 UTC

distcp problems on ec2 standalone spark cluster

I got pass the issues with the cluster not started problem by adding Yarn
to mapreduce.framework.name .
But when I try to to distcp , if I use uRI with s3://path to my bucket .. I
get invalid path even though the bucket exists.
If I use s3n:// it just hangs.
Did anyone else  face anything like that ?

I also noticed that this script puts the image of cloudera. hadoop. Does it
matter?
Thanks
-R