You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Rajesh Jain <rj...@gmail.com> on 2013/08/29 22:59:51 UTC
Hadoop Yarn
I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
Thanks
Rajesh
Sent from my iPhone
Re: Hadoop Yarn
Posted by Hitesh Shah <hi...@apache.org>.
Hi Rajesh,
Have you looked at re-using the profiling options to inject the jvm options to a defined range of tasks? http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Profiling
-- Hitesh
On Aug 29, 2013, at 3:51 PM, Rajesh Jain wrote:
> Hi Vinod
>
> These are jvm parameters to inject agent only on some nodes for sampling.
>
> Is there a property because code change is not a option.
>
> Second is there a way to tell the jvms how much data size to process.
>
> Thanks
>
> Sent from my iPhone
>
> On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
>>
>> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>>
>> More details can help us help you.
>>
>> Thanks,
>> +Vinod Kumar Vavilapalli
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>>
>>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>>
>>> Thanks
>>> Rajesh
>>>
>>> Sent from my iPhone
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>> <signature.asc>
Re: Hadoop Yarn
Posted by Hitesh Shah <hi...@apache.org>.
Hi Rajesh,
Have you looked at re-using the profiling options to inject the jvm options to a defined range of tasks? http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Profiling
-- Hitesh
On Aug 29, 2013, at 3:51 PM, Rajesh Jain wrote:
> Hi Vinod
>
> These are jvm parameters to inject agent only on some nodes for sampling.
>
> Is there a property because code change is not a option.
>
> Second is there a way to tell the jvms how much data size to process.
>
> Thanks
>
> Sent from my iPhone
>
> On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
>>
>> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>>
>> More details can help us help you.
>>
>> Thanks,
>> +Vinod Kumar Vavilapalli
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>>
>>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>>
>>> Thanks
>>> Rajesh
>>>
>>> Sent from my iPhone
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>> <signature.asc>
Re: Hadoop Yarn
Posted by Hitesh Shah <hi...@apache.org>.
Hi Rajesh,
Have you looked at re-using the profiling options to inject the jvm options to a defined range of tasks? http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Profiling
-- Hitesh
On Aug 29, 2013, at 3:51 PM, Rajesh Jain wrote:
> Hi Vinod
>
> These are jvm parameters to inject agent only on some nodes for sampling.
>
> Is there a property because code change is not a option.
>
> Second is there a way to tell the jvms how much data size to process.
>
> Thanks
>
> Sent from my iPhone
>
> On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
>>
>> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>>
>> More details can help us help you.
>>
>> Thanks,
>> +Vinod Kumar Vavilapalli
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>>
>>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>>
>>> Thanks
>>> Rajesh
>>>
>>> Sent from my iPhone
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>> <signature.asc>
Re: Hadoop Yarn
Posted by Hitesh Shah <hi...@apache.org>.
Hi Rajesh,
Have you looked at re-using the profiling options to inject the jvm options to a defined range of tasks? http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Profiling
-- Hitesh
On Aug 29, 2013, at 3:51 PM, Rajesh Jain wrote:
> Hi Vinod
>
> These are jvm parameters to inject agent only on some nodes for sampling.
>
> Is there a property because code change is not a option.
>
> Second is there a way to tell the jvms how much data size to process.
>
> Thanks
>
> Sent from my iPhone
>
> On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
>>
>> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>>
>> More details can help us help you.
>>
>> Thanks,
>> +Vinod Kumar Vavilapalli
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>>
>>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>>
>>> Thanks
>>> Rajesh
>>>
>>> Sent from my iPhone
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
>> <signature.asc>
Re: Hadoop Yarn
Posted by Rajesh Jain <rj...@gmail.com>.
Hi Vinod
These are jvm parameters to inject agent only on some nodes for sampling.
Is there a property because code change is not a option.
Second is there a way to tell the jvms how much data size to process.
Thanks
Sent from my iPhone
On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>
>> Thanks
>> Rajesh
>>
>> Sent from my iPhone
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
> <signature.asc>
Re: Hadoop Yarn
Posted by Harsh J <ha...@cloudera.com>.
This is sorta a regression with YARN+MR2. In MR1 we've had the
administrative ability to lock down changes to mapred.child.java.opts
on a per node basis, as Tasks would load the TT config and they could
supply finalized arguments (controllable per-node when needed).
Given the app behavior of MR2, I am not sure if its still a good idea
to do, as we wouldn't expect all cluster nodes to even carry the MR
config anymore.
We could have the NM inspect+inject or override container opts though, thoughts?
On Fri, Aug 30, 2013 at 4:07 AM, Vinod Kumar Vavilapalli
<vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly
> looking for and why should they be only applied on some nodes? Some kind of
> sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
> I have some jvm options which i want to configure only for a few nodes in
> the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml
> it gets applied to all the task jvms. I just want handful of map jvms to
> have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader of
> this message is not the intended recipient, you are hereby notified that any
> printing, copying, dissemination, distribution, disclosure or forwarding of
> this communication is strictly prohibited. If you have received this
> communication in error, please contact the sender immediately and delete it
> from your system. Thank You.
--
Harsh J
Re: Hadoop Yarn
Posted by Harsh J <ha...@cloudera.com>.
This is sorta a regression with YARN+MR2. In MR1 we've had the
administrative ability to lock down changes to mapred.child.java.opts
on a per node basis, as Tasks would load the TT config and they could
supply finalized arguments (controllable per-node when needed).
Given the app behavior of MR2, I am not sure if its still a good idea
to do, as we wouldn't expect all cluster nodes to even carry the MR
config anymore.
We could have the NM inspect+inject or override container opts though, thoughts?
On Fri, Aug 30, 2013 at 4:07 AM, Vinod Kumar Vavilapalli
<vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly
> looking for and why should they be only applied on some nodes? Some kind of
> sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
> I have some jvm options which i want to configure only for a few nodes in
> the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml
> it gets applied to all the task jvms. I just want handful of map jvms to
> have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader of
> this message is not the intended recipient, you are hereby notified that any
> printing, copying, dissemination, distribution, disclosure or forwarding of
> this communication is strictly prohibited. If you have received this
> communication in error, please contact the sender immediately and delete it
> from your system. Thank You.
--
Harsh J
Re: Hadoop Yarn
Posted by Harsh J <ha...@cloudera.com>.
This is sorta a regression with YARN+MR2. In MR1 we've had the
administrative ability to lock down changes to mapred.child.java.opts
on a per node basis, as Tasks would load the TT config and they could
supply finalized arguments (controllable per-node when needed).
Given the app behavior of MR2, I am not sure if its still a good idea
to do, as we wouldn't expect all cluster nodes to even carry the MR
config anymore.
We could have the NM inspect+inject or override container opts though, thoughts?
On Fri, Aug 30, 2013 at 4:07 AM, Vinod Kumar Vavilapalli
<vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly
> looking for and why should they be only applied on some nodes? Some kind of
> sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
> I have some jvm options which i want to configure only for a few nodes in
> the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml
> it gets applied to all the task jvms. I just want handful of map jvms to
> have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader of
> this message is not the intended recipient, you are hereby notified that any
> printing, copying, dissemination, distribution, disclosure or forwarding of
> this communication is strictly prohibited. If you have received this
> communication in error, please contact the sender immediately and delete it
> from your system. Thank You.
--
Harsh J
Re: Hadoop Yarn
Posted by Harsh J <ha...@cloudera.com>.
This is sorta a regression with YARN+MR2. In MR1 we've had the
administrative ability to lock down changes to mapred.child.java.opts
on a per node basis, as Tasks would load the TT config and they could
supply finalized arguments (controllable per-node when needed).
Given the app behavior of MR2, I am not sure if its still a good idea
to do, as we wouldn't expect all cluster nodes to even carry the MR
config anymore.
We could have the NM inspect+inject or override container opts though, thoughts?
On Fri, Aug 30, 2013 at 4:07 AM, Vinod Kumar Vavilapalli
<vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly
> looking for and why should they be only applied on some nodes? Some kind of
> sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
> I have some jvm options which i want to configure only for a few nodes in
> the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml
> it gets applied to all the task jvms. I just want handful of map jvms to
> have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader of
> this message is not the intended recipient, you are hereby notified that any
> printing, copying, dissemination, distribution, disclosure or forwarding of
> this communication is strictly prohibited. If you have received this
> communication in error, please contact the sender immediately and delete it
> from your system. Thank You.
--
Harsh J
Re: Hadoop Yarn
Posted by Rajesh Jain <rj...@gmail.com>.
Hi Vinod
These are jvm parameters to inject agent only on some nodes for sampling.
Is there a property because code change is not a option.
Second is there a way to tell the jvms how much data size to process.
Thanks
Sent from my iPhone
On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>
>> Thanks
>> Rajesh
>>
>> Sent from my iPhone
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
> <signature.asc>
Re: Hadoop Yarn
Posted by Rajesh Jain <rj...@gmail.com>.
Hi Vinod
These are jvm parameters to inject agent only on some nodes for sampling.
Is there a property because code change is not a option.
Second is there a way to tell the jvms how much data size to process.
Thanks
Sent from my iPhone
On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>
>> Thanks
>> Rajesh
>>
>> Sent from my iPhone
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
> <signature.asc>
Re: Hadoop Yarn
Posted by Rajesh Jain <rj...@gmail.com>.
Hi Vinod
These are jvm parameters to inject agent only on some nodes for sampling.
Is there a property because code change is not a option.
Second is there a way to tell the jvms how much data size to process.
Thanks
Sent from my iPhone
On Aug 29, 2013, at 6:37 PM, Vinod Kumar Vavilapalli <vi...@apache.org> wrote:
>
> You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
>
> More details can help us help you.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
>
>> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>>
>> Thanks
>> Rajesh
>>
>> Sent from my iPhone
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
> <signature.asc>
Re: Hadoop Yarn
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
More details can help us help you.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Yarn
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
More details can help us help you.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Yarn
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
More details can help us help you.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Yarn
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
You'll have to change the MapReduce code. What options are you exactly looking for and why should they be only applied on some nodes? Some kind of sampling?
More details can help us help you.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Aug 29, 2013, at 1:59 PM, Rajesh Jain wrote:
> I have some jvm options which i want to configure only for a few nodes in the cluster using Hadoop yarn. How do i di it. If i edit the mapred-site.xml it gets applied to all the task jvms. I just want handful of map jvms to have that option and other map jvm not have that options.
>
> Thanks
> Rajesh
>
> Sent from my iPhone
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.