You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Henry Hung <YT...@winbond.com> on 2013/12/04 08:26:55 UTC

about hadoop-2.2.0 "mapred.child.java.opts"

Hello,

I have a question.
Is it correct to say that in hadoop-2.2.0, the mapred-site.xml node "mapred.child.java.opts" is replaced by two new node "mapreduce.map.java.opts" and "mapreduce.reduce.java.opts"?

Best regards,
Henry

________________________________
The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.

RE: about hadoop-2.2.0 "mapred.child.java.opts"

Posted by Henry Hung <YT...@winbond.com>.

@Harsh J

Thank you, I intend to upgrade from Hadoop 1.0.4 and this kind of information is very helpful.

Best regards,
Henry

-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Wednesday, December 04, 2013 4:20 PM
To: <us...@hadoop.apache.org>
Subject: Re: about hadoop-2.2.0 "mapred.child.java.opts"

Actually, its the other way around (thanks Sandy for catching this error in my post). The presence of mapreduce.map|reduce.java.opts overrides mapred.child.java.opts, not the other way round as I had stated earlier (below).

On Wed, Dec 4, 2013 at 1:28 PM, Harsh J <ha...@cloudera.com> wrote:
> Yes but the old property is yet to be entirely removed (removal of
> configs is graceful).
>
> These properties were introduced to provide more fine-tuned way to
> configure each type of task separately, but the older value continues
> to be accepted if present; the current behaviour is that if the MR
> runtime finds mapred.child.java.opts configured, it will override
> values of mapreduce.map|reduce.java.opts configs. To configure
> mapreduce.map|reduce.java.opts therefore, you should make sure you
> aren't passing mapred.child.java.opts (which is also no longer in the
> mapred-default.xml intentionally).
>
> On Wed, Dec 4, 2013 at 12:56 PM, Henry Hung <YT...@winbond.com> wrote:
>> Hello,
>>
>>
>>
>> I have a question.
>>
>> Is it correct to say that in hadoop-2.2.0, the mapred-site.xml node
>> "mapred.child.java.opts" is replaced by two new node
>> "mapreduce.map.java.opts" and "mapreduce.reduce.java.opts"?
>>
>>
>>
>> Best regards,
>>
>> Henry
>>
>>
>> ________________________________
>> The privileged confidential information contained in this email is
>> intended for use only by the addressees as indicated by the original
>> sender of this email. If you are not the addressee indicated in this
>> email or are not responsible for delivery of the email to such a
>> person, please kindly reply to the sender indicating this fact and
>> delete all copies of it from your computer and network server
>> immediately. Your cooperation is highly appreciated. It is advised
>> that any unauthorized use of confidential information of Winbond is
>> strictly prohibited; and any information in this email irrelevant to
>> the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
>
>
>
> --
> Harsh J

--
Harsh J

The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.

RE: about hadoop-2.2.0 "mapred.child.java.opts"

Posted by Henry Hung <YT...@winbond.com>.

@Harsh J

Thank you, I intend to upgrade from Hadoop 1.0.4 and this kind of information is very helpful.

Best regards,
Henry

-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Wednesday, December 04, 2013 4:20 PM
To: <us...@hadoop.apache.org>
Subject: Re: about hadoop-2.2.0 "mapred.child.java.opts"

Actually, its the other way around (thanks Sandy for catching this error in my post). The presence of mapreduce.map|reduce.java.opts overrides mapred.child.java.opts, not the other way round as I had stated earlier (below).

On Wed, Dec 4, 2013 at 1:28 PM, Harsh J <ha...@cloudera.com> wrote:
> Yes but the old property is yet to be entirely removed (removal of
> configs is graceful).
>
> These properties were introduced to provide more fine-tuned way to
> configure each type of task separately, but the older value continues
> to be accepted if present; the current behaviour is that if the MR
> runtime finds mapred.child.java.opts configured, it will override
> values of mapreduce.map|reduce.java.opts configs. To configure
> mapreduce.map|reduce.java.opts therefore, you should make sure you
> aren't passing mapred.child.java.opts (which is also no longer in the
> mapred-default.xml intentionally).
>
> On Wed, Dec 4, 2013 at 12:56 PM, Henry Hung <YT...@winbond.com> wrote:
>> Hello,
>>
>>
>>
>> I have a question.
>>
>> Is it correct to say that in hadoop-2.2.0, the mapred-site.xml node
>> "mapred.child.java.opts" is replaced by two new node
>> "mapreduce.map.java.opts" and "mapreduce.reduce.java.opts"?
>>
>>
>>
>> Best regards,
>>
>> Henry
>>
>>
>> ________________________________
>> The privileged confidential information contained in this email is
>> intended for use only by the addressees as indicated by the original
>> sender of this email. If you are not the addressee indicated in this
>> email or are not responsible for delivery of the email to such a
>> person, please kindly reply to the sender indicating this fact and
>> delete all copies of it from your computer and network server
>> immediately. Your cooperation is highly appreciated. It is advised
>> that any unauthorized use of confidential information of Winbond is
>> strictly prohibited; and any information in this email irrelevant to
>> the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
>
>
>
> --
> Harsh J

--
Harsh J

The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.

RE: about hadoop-2.2.0 "mapred.child.java.opts"

Posted by Henry Hung <YT...@winbond.com>.

@Harsh J

Thank you, I intend to upgrade from Hadoop 1.0.4 and this kind of information is very helpful.

Best regards,
Henry

-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Wednesday, December 04, 2013 4:20 PM
To: <us...@hadoop.apache.org>
Subject: Re: about hadoop-2.2.0 "mapred.child.java.opts"

Actually, its the other way around (thanks Sandy for catching this error in my post). The presence of mapreduce.map|reduce.java.opts overrides mapred.child.java.opts, not the other way round as I had stated earlier (below).

On Wed, Dec 4, 2013 at 1:28 PM, Harsh J <ha...@cloudera.com> wrote:
> Yes but the old property is yet to be entirely removed (removal of
> configs is graceful).
>
> These properties were introduced to provide more fine-tuned way to
> configure each type of task separately, but the older value continues
> to be accepted if present; the current behaviour is that if the MR
> runtime finds mapred.child.java.opts configured, it will override
> values of mapreduce.map|reduce.java.opts configs. To configure
> mapreduce.map|reduce.java.opts therefore, you should make sure you
> aren't passing mapred.child.java.opts (which is also no longer in the
> mapred-default.xml intentionally).
>
> On Wed, Dec 4, 2013 at 12:56 PM, Henry Hung <YT...@winbond.com> wrote:
>> Hello,
>>
>>
>>
>> I have a question.
>>
>> Is it correct to say that in hadoop-2.2.0, the mapred-site.xml node
>> "mapred.child.java.opts" is replaced by two new node
>> "mapreduce.map.java.opts" and "mapreduce.reduce.java.opts"?
>>
>>
>>
>> Best regards,
>>
>> Henry
>>
>>
>> ________________________________
>> The privileged confidential information contained in this email is
>> intended for use only by the addressees as indicated by the original
>> sender of this email. If you are not the addressee indicated in this
>> email or are not responsible for delivery of the email to such a
>> person, please kindly reply to the sender indicating this fact and
>> delete all copies of it from your computer and network server
>> immediately. Your cooperation is highly appreciated. It is advised
>> that any unauthorized use of confidential information of Winbond is
>> strictly prohibited; and any information in this email irrelevant to
>> the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.
>
>
>
> --
> Harsh J

--
Harsh J

The privileged confidential information contained in this email is intended for use only by the addressees as indicated by the original sender of this email. If you are not the addressee indicated in this email or are not responsible for delivery of the email to such a person, please kindly reply to the sender indicating this fact and delete all copies of it from your computer and network server immediately. Your cooperation is highly appreciated. It is advised that any unauthorized use of confidential information of Winbond is strictly prohibited; and any information in this email irrelevant to the official business of Winbond shall be deemed as neither given nor endorsed by Winbond.