You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Xun TANG <ta...@gmail.com> on 2013/04/29 02:38:43 UTC
Where's downlink.data file?
According to this link
http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
I am trying to find out where the downlink.data file is actually stored.
I have set the variable keep.failed.task.files to true in mapred-site.xml,
and hadoop.pipes.command-file.keep to true in the config.xml file that I
pass to the pipes mapreduce task.
Yet, there is no downlink.data file that I can locate either locally or on
hdfs.
I assume from the instructions for debugging that I should run the entire
task in distributed mapreduce mode, collect the input in downlink.data and
then run the mapreduce task with just the downlink.data. I am assuming
'task working directory' refers to where I ran 'hadoop pipes ...'. I've
done a 'locate downlink.data' but nothing found.
Am I making some incorrect assumption here? Or anything else needs to be
set?
I am running Hadoop 1.0.4
Thanks,
Alice
Re: Where's downlink.data file?
Posted by Xun TANG <ta...@gmail.com>.
Anyone has similar experience? Any suggestion welcome. I am stuck here for
a week now...
Thanks,
Alice
On Sun, Apr 28, 2013 at 5:38 PM, Xun TANG <ta...@gmail.com> wrote:
> According to this link
> http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
>
> I am trying to find out where the downlink.data file is actually stored.
> I have set the variable keep.failed.task.files to true in mapred-site.xml,
> and hadoop.pipes.command-file.keep to true in the config.xml file that I
> pass to the pipes mapreduce task.
> Yet, there is no downlink.data file that I can locate either locally or on
> hdfs.
>
> I assume from the instructions for debugging that I should run the entire
> task in distributed mapreduce mode, collect the input in downlink.data and
> then run the mapreduce task with just the downlink.data. I am assuming
> 'task working directory' refers to where I ran 'hadoop pipes ...'. I've
> done a 'locate downlink.data' but nothing found.
>
> Am I making some incorrect assumption here? Or anything else needs to be
> set?
>
> I am running Hadoop 1.0.4
>
>
> Thanks,
> Alice
>
Re: Where's downlink.data file?
Posted by Xun TANG <ta...@gmail.com>.
Anyone has similar experience? Any suggestion welcome. I am stuck here for
a week now...
Thanks,
Alice
On Sun, Apr 28, 2013 at 5:38 PM, Xun TANG <ta...@gmail.com> wrote:
> According to this link
> http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
>
> I am trying to find out where the downlink.data file is actually stored.
> I have set the variable keep.failed.task.files to true in mapred-site.xml,
> and hadoop.pipes.command-file.keep to true in the config.xml file that I
> pass to the pipes mapreduce task.
> Yet, there is no downlink.data file that I can locate either locally or on
> hdfs.
>
> I assume from the instructions for debugging that I should run the entire
> task in distributed mapreduce mode, collect the input in downlink.data and
> then run the mapreduce task with just the downlink.data. I am assuming
> 'task working directory' refers to where I ran 'hadoop pipes ...'. I've
> done a 'locate downlink.data' but nothing found.
>
> Am I making some incorrect assumption here? Or anything else needs to be
> set?
>
> I am running Hadoop 1.0.4
>
>
> Thanks,
> Alice
>
Re: Where's downlink.data file?
Posted by Xun TANG <ta...@gmail.com>.
Anyone has similar experience? Any suggestion welcome. I am stuck here for
a week now...
Thanks,
Alice
On Sun, Apr 28, 2013 at 5:38 PM, Xun TANG <ta...@gmail.com> wrote:
> According to this link
> http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
>
> I am trying to find out where the downlink.data file is actually stored.
> I have set the variable keep.failed.task.files to true in mapred-site.xml,
> and hadoop.pipes.command-file.keep to true in the config.xml file that I
> pass to the pipes mapreduce task.
> Yet, there is no downlink.data file that I can locate either locally or on
> hdfs.
>
> I assume from the instructions for debugging that I should run the entire
> task in distributed mapreduce mode, collect the input in downlink.data and
> then run the mapreduce task with just the downlink.data. I am assuming
> 'task working directory' refers to where I ran 'hadoop pipes ...'. I've
> done a 'locate downlink.data' but nothing found.
>
> Am I making some incorrect assumption here? Or anything else needs to be
> set?
>
> I am running Hadoop 1.0.4
>
>
> Thanks,
> Alice
>
Re: Where's downlink.data file?
Posted by Xun TANG <ta...@gmail.com>.
Anyone has similar experience? Any suggestion welcome. I am stuck here for
a week now...
Thanks,
Alice
On Sun, Apr 28, 2013 at 5:38 PM, Xun TANG <ta...@gmail.com> wrote:
> According to this link
> http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
>
> I am trying to find out where the downlink.data file is actually stored.
> I have set the variable keep.failed.task.files to true in mapred-site.xml,
> and hadoop.pipes.command-file.keep to true in the config.xml file that I
> pass to the pipes mapreduce task.
> Yet, there is no downlink.data file that I can locate either locally or on
> hdfs.
>
> I assume from the instructions for debugging that I should run the entire
> task in distributed mapreduce mode, collect the input in downlink.data and
> then run the mapreduce task with just the downlink.data. I am assuming
> 'task working directory' refers to where I ran 'hadoop pipes ...'. I've
> done a 'locate downlink.data' but nothing found.
>
> Am I making some incorrect assumption here? Or anything else needs to be
> set?
>
> I am running Hadoop 1.0.4
>
>
> Thanks,
> Alice
>