You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Matt Pouttu-Clarke <Ma...@icrossing.com> on 2010/07/13 16:46:44 UTC

Setting different hadoop-env.sh for DataNode, TaskTracker

Can anyone suggest a way to set different hadoop-env.sh values for DataNode
and TaskTracker without having to duplicate the whole Hadoop conf directory?
For example, to set a different HADOOP_NICENESS for DataNode and
TaskTracker.

TIA
Matt Pouttu-Clarke

iCrossing Privileged and Confidential Information
This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information of iCrossing. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.



Re: Setting different hadoop-env.sh for DataNode, TaskTracker

Posted by Edward Capriolo <ed...@gmail.com>.
On Tue, Jul 13, 2010 at 10:46 AM, Matt Pouttu-Clarke
<Ma...@icrossing.com> wrote:
> Can anyone suggest a way to set different hadoop-env.sh values for DataNode
> and TaskTracker without having to duplicate the whole Hadoop conf directory?
> For example, to set a different HADOOP_NICENESS for DataNode and
> TaskTracker.
>
> TIA
> Matt Pouttu-Clarke
>
> iCrossing Privileged and Confidential Information
> This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information of iCrossing. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
>
>
>

hadoop-env.sh is a script file you are free to write arbitrary shell code.

if [ "$HOSTNAME" = "server1" ] ; then
  dothis
else
  dothat
fi

This allows you to push one file to all systems but now you manage
scripts not files.