You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Mapred Learn <ma...@gmail.com> on 2011/06/14 17:30:38 UTC
mapred.child.java.opts question
Hi,
I am trying to pass this option with my
Re: mapred.child.java.opts question
Posted by Mapred Learn <ma...@gmail.com>.
No it does not.
Sent from my iPhone
On Jun 14, 2011, at 11:22 AM, Jeff Bean <jw...@cloudera.com> wrote:
> Does your class use GenericOptionsParser (does it implement Tool, and does it call ToolRunner.run(), for example?
>
> Jeff
>
> On Tue, Jun 14, 2011 at 8:47 AM, Alex Kozlov <al...@cloudera.com> wrote:
> There might be different reasons why this parameter is not passed to the slave JVM: for example, it might have been declared final. Do you see the correct parameter in your job xml file (to be found in the JT UI or in the slave local FS)? You can also see the passed parameters if you do `ps aux` on the slave during the execution (but you need to catch the right time to catch the execution). -- Alex K
>
>
> On Tue, Jun 14, 2011 at 8:34 AM, Mapred Learn <ma...@gmail.com> wrote:
> Sorry about the last message. Here we go again:
>
> I am trying to pass this option with my job as:
> hadoop jar <jar file> <main class> -Dmapred.child.java.opts=-Xmx1000m -conf <conf file> <input dir> <output dir>
>
> But I still get the error: "Error: Java Heap Space" for all the task trackers.
>
>
> Could somebody advice how can I make this value propagate to all the task-trackers ?
>
> Thanks a lot in advance,
> -JJ
> On Tue, Jun 14, 2011 at 8:30 AM, Mapred Learn <ma...@gmail.com> wrote:
> Hi,
> I am trying to pass this option with my
>
>
>
Re: mapred.child.java.opts question
Posted by Jeff Bean <jw...@cloudera.com>.
Does your class use GenericOptionsParser (does it implement Tool, and does
it call ToolRunner.run(), for example?
Jeff
On Tue, Jun 14, 2011 at 8:47 AM, Alex Kozlov <al...@cloudera.com> wrote:
> There might be different reasons why this parameter is not passed to the
> slave JVM: for example, it might have been declared final. Do you see the
> correct parameter in your job xml file (to be found in the JT UI or in the
> slave local FS)? You can also see the passed parameters if you do `ps aux`
> on the slave during the execution (but you need to catch the right time to
> catch the execution). -- Alex K
>
>
> On Tue, Jun 14, 2011 at 8:34 AM, Mapred Learn <ma...@gmail.com>wrote:
>
>> Sorry about the last message. Here we go again:
>>
>> I am trying to pass this option with my job as:
>> hadoop jar <jar file> <main class> -Dmapred.child.java.opts=-Xmx1000m
>> -conf <conf file> <input dir> <output dir>
>>
>> But I still get the error: "Error: Java Heap Space" for all the task
>> trackers.
>>
>>
>> Could somebody advice how can I make this value propagate to all the
>> task-trackers ?
>>
>> Thanks a lot in advance,
>> -JJ
>> On Tue, Jun 14, 2011 at 8:30 AM, Mapred Learn <ma...@gmail.com>wrote:
>>
>>> Hi,
>>> I am trying to pass this option with my
>>>
>>
>>
>
Re: mapred.child.java.opts question
Posted by Alex Kozlov <al...@cloudera.com>.
There might be different reasons why this parameter is not passed to the
slave JVM: for example, it might have been declared final. Do you see the
correct parameter in your job xml file (to be found in the JT UI or in the
slave local FS)? You can also see the passed parameters if you do `ps aux`
on the slave during the execution (but you need to catch the right time to
catch the execution). -- Alex K
On Tue, Jun 14, 2011 at 8:34 AM, Mapred Learn <ma...@gmail.com>wrote:
> Sorry about the last message. Here we go again:
>
> I am trying to pass this option with my job as:
> hadoop jar <jar file> <main class> -Dmapred.child.java.opts=-Xmx1000m -conf
> <conf file> <input dir> <output dir>
>
> But I still get the error: "Error: Java Heap Space" for all the task
> trackers.
>
>
> Could somebody advice how can I make this value propagate to all the
> task-trackers ?
>
> Thanks a lot in advance,
> -JJ
> On Tue, Jun 14, 2011 at 8:30 AM, Mapred Learn <ma...@gmail.com>wrote:
>
>> Hi,
>> I am trying to pass this option with my
>>
>
>
Re: mapred.child.java.opts question
Posted by Mapred Learn <ma...@gmail.com>.
Sorry about the last message. Here we go again:
I am trying to pass this option with my job as:
hadoop jar <jar file> <main class> -Dmapred.child.java.opts=-Xmx1000m -conf
<conf file> <input dir> <output dir>
But I still get the error: "Error: Java Heap Space" for all the task
trackers.
Could somebody advice how can I make this value propagate to all the
task-trackers ?
Thanks a lot in advance,
-JJ
On Tue, Jun 14, 2011 at 8:30 AM, Mapred Learn <ma...@gmail.com>wrote:
> Hi,
> I am trying to pass this option with my
>