Problems accessing the local file system on AWS MapReduce

[Steve Lewis <lo...@gmail.com>]

I am trying to use Distributes Cache on AWS Elastic Map educe

Using S3Fox I see I have two files in my bucket lordjoe
FeeFie.txt
and
Hello


In My main I say
public static void main(String[] args) throws Exception {
Configuration conf = new Configuration();
String[] otherArgs = new GenericOptionsParser(conf,
args).getRemainingArgs();
Job job = new Job(conf, "WholeFiles");
.....
DistributedCache.addCacheFile(new
Path("s3n://lordjoe/Hello#Hello.x").toUri(), conf);
DistributedCache.addCacheFile(new
Path("s3n://lordjoe/FeeFie.txt#FeeFie.txt").toUri(), conf);
.....
boolean ans = job.waitForCompletion(true);
}


In my reducer I say
protected void reduce(final KEYIN key, final Iterable<VALUEIN> values, final
Context context) throws IOException, InterruptedException {
Configuration configuration = context.getConfiguration();
Path[] files = DistributedCache.getLocalCacheFiles(configuration);
if (files != null) {
for (int i = 0; i < files.length; i++) {
Path file = files *" *
-- 
Steven M. Lewis PhD
Institute for Systems Biology
Seattle WA