You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Sai Sai <sa...@yahoo.in> on 2013/02/21 13:38:06 UTC
Re: Newbie Debuggin Question
This may be a basic beginner debug question will appreciate if anyone can pour some light:
Here is the method i have in Eclipse:
*******************************
@Override
protected void setup(Context context) throws java.io.IOException,
InterruptedException {
Path[] cacheFiles = DistributedCache.getLocalCacheFiles(context
.getConfiguration());
lookUp = cacheFiles[0];
};
*******************************
I have put a breakpoint at the second line and inspected cacheFiles[0] and here is what i see:
[/tmp/hadoop-sai/mapred/local/archive/3401759285981873176_334405473_2022582449/fileinput/lookup.txt]
I went back to my local folders looking for these folders to see if there r in here but do not see them.
Just wondering where it is getting this file from.
Any help will be really appreciated.
Thanks
Sai
Re: Newbie Debuggin Question
Posted by be...@gmail.com.
Hi Sai
The location you are seeing should be the mapred.local.dir .
From my understanding the files in distributed cache would be available in that location while you are running the job and would be cleaned up at the end of it.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: Sai Sai <sa...@yahoo.in>
Date: Thu, 21 Feb 2013 20:38:06
To: user@hadoop.apache.org<us...@hadoop.apache.org>; cdh-user@cloudera.org<cd...@cloudera.org>
Reply-To: user@hadoop.apache.org
Subject: Re: Newbie Debuggin Question
This may be a basic beginner debug question will appreciate if anyone can pour some light:
Here is the method i have in Eclipse:
*******************************
@Override
protected void setup(Context context) throws java.io.IOException,
InterruptedException {
Path[] cacheFiles = DistributedCache.getLocalCacheFiles(context
.getConfiguration());
lookUp = cacheFiles[0];
};
*******************************
I have put a breakpoint at the second line and inspected cacheFiles[0] and here is what i see:
[/tmp/hadoop-sai/mapred/local/archive/3401759285981873176_334405473_2022582449/fileinput/lookup.txt]
I went back to my local folders looking for these folders to see if there r in here but do not see them.
Just wondering where it is getting this file from.
Any help will be really appreciated.
Thanks
Sai
Re: Newbie Debuggin Question
Posted by be...@gmail.com.
Hi Sai
The location you are seeing should be the mapred.local.dir .
From my understanding the files in distributed cache would be available in that location while you are running the job and would be cleaned up at the end of it.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: Sai Sai <sa...@yahoo.in>
Date: Thu, 21 Feb 2013 20:38:06
To: user@hadoop.apache.org<us...@hadoop.apache.org>; cdh-user@cloudera.org<cd...@cloudera.org>
Reply-To: user@hadoop.apache.org
Subject: Re: Newbie Debuggin Question
This may be a basic beginner debug question will appreciate if anyone can pour some light:
Here is the method i have in Eclipse:
*******************************
@Override
protected void setup(Context context) throws java.io.IOException,
InterruptedException {
Path[] cacheFiles = DistributedCache.getLocalCacheFiles(context
.getConfiguration());
lookUp = cacheFiles[0];
};
*******************************
I have put a breakpoint at the second line and inspected cacheFiles[0] and here is what i see:
[/tmp/hadoop-sai/mapred/local/archive/3401759285981873176_334405473_2022582449/fileinput/lookup.txt]
I went back to my local folders looking for these folders to see if there r in here but do not see them.
Just wondering where it is getting this file from.
Any help will be really appreciated.
Thanks
Sai
Re: Newbie Debuggin Question
Posted by be...@gmail.com.
Hi Sai
The location you are seeing should be the mapred.local.dir .
From my understanding the files in distributed cache would be available in that location while you are running the job and would be cleaned up at the end of it.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: Sai Sai <sa...@yahoo.in>
Date: Thu, 21 Feb 2013 20:38:06
To: user@hadoop.apache.org<us...@hadoop.apache.org>; cdh-user@cloudera.org<cd...@cloudera.org>
Reply-To: user@hadoop.apache.org
Subject: Re: Newbie Debuggin Question
This may be a basic beginner debug question will appreciate if anyone can pour some light:
Here is the method i have in Eclipse:
*******************************
@Override
protected void setup(Context context) throws java.io.IOException,
InterruptedException {
Path[] cacheFiles = DistributedCache.getLocalCacheFiles(context
.getConfiguration());
lookUp = cacheFiles[0];
};
*******************************
I have put a breakpoint at the second line and inspected cacheFiles[0] and here is what i see:
[/tmp/hadoop-sai/mapred/local/archive/3401759285981873176_334405473_2022582449/fileinput/lookup.txt]
I went back to my local folders looking for these folders to see if there r in here but do not see them.
Just wondering where it is getting this file from.
Any help will be really appreciated.
Thanks
Sai
Re: Newbie Debuggin Question
Posted by be...@gmail.com.
Hi Sai
The location you are seeing should be the mapred.local.dir .
From my understanding the files in distributed cache would be available in that location while you are running the job and would be cleaned up at the end of it.
Regards
Bejoy KS
Sent from remote device, Please excuse typos
-----Original Message-----
From: Sai Sai <sa...@yahoo.in>
Date: Thu, 21 Feb 2013 20:38:06
To: user@hadoop.apache.org<us...@hadoop.apache.org>; cdh-user@cloudera.org<cd...@cloudera.org>
Reply-To: user@hadoop.apache.org
Subject: Re: Newbie Debuggin Question
This may be a basic beginner debug question will appreciate if anyone can pour some light:
Here is the method i have in Eclipse:
*******************************
@Override
protected void setup(Context context) throws java.io.IOException,
InterruptedException {
Path[] cacheFiles = DistributedCache.getLocalCacheFiles(context
.getConfiguration());
lookUp = cacheFiles[0];
};
*******************************
I have put a breakpoint at the second line and inspected cacheFiles[0] and here is what i see:
[/tmp/hadoop-sai/mapred/local/archive/3401759285981873176_334405473_2022582449/fileinput/lookup.txt]
I went back to my local folders looking for these folders to see if there r in here but do not see them.
Just wondering where it is getting this file from.
Any help will be really appreciated.
Thanks
Sai