You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Guillaume Polaert <gp...@cyres.fr> on 2012/10/12 13:43:27 UTC
Start NN with dynamic property (option -D)
Hello,
I'm trying to start a NN using the -Dproperty=value functionality.
I've modified hadoop-env.sh like this :
export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
and I've launched the daemon with hadoop-hdfs-namenode script.
ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
But the property has always the same value : 50070 (default port).
Is "-D-substitution" working for this use case ?
Thanks, Guillaume
RE: Start NN with dynamic property (option -D)
Posted by Guillaume Polaert <gp...@cyres.fr>.
It's a good news, I'll try it soon.
Thanks you :)
Guillaume Polaert
-----Message d'origine-----
De : Harsh J [mailto:harsh@cloudera.com]
Envoyé : vendredi 12 octobre 2012 17:21
À : user@hadoop.apache.org
Objet : Re: Start NN with dynamic property (option -D)
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement was recently added to trunk but is not in any Apache release I know of yet.
I instead make things like this work via the Configuration's ability to use System Properties (from the JVM) when substituting. So if your config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has -Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
RE: Start NN with dynamic property (option -D)
Posted by Guillaume Polaert <gp...@cyres.fr>.
It's a good news, I'll try it soon.
Thanks you :)
Guillaume Polaert
-----Message d'origine-----
De : Harsh J [mailto:harsh@cloudera.com]
Envoyé : vendredi 12 octobre 2012 17:21
À : user@hadoop.apache.org
Objet : Re: Start NN with dynamic property (option -D)
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement was recently added to trunk but is not in any Apache release I know of yet.
I instead make things like this work via the Configuration's ability to use System Properties (from the JVM) when substituting. So if your config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has -Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
RE: Start NN with dynamic property (option -D)
Posted by Guillaume Polaert <gp...@cyres.fr>.
It's a good news, I'll try it soon.
Thanks you :)
Guillaume Polaert
-----Message d'origine-----
De : Harsh J [mailto:harsh@cloudera.com]
Envoyé : vendredi 12 octobre 2012 17:21
À : user@hadoop.apache.org
Objet : Re: Start NN with dynamic property (option -D)
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement was recently added to trunk but is not in any Apache release I know of yet.
I instead make things like this work via the Configuration's ability to use System Properties (from the JVM) when substituting. So if your config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has -Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
RE: Start NN with dynamic property (option -D)
Posted by Guillaume Polaert <gp...@cyres.fr>.
It's a good news, I'll try it soon.
Thanks you :)
Guillaume Polaert
-----Message d'origine-----
De : Harsh J [mailto:harsh@cloudera.com]
Envoyé : vendredi 12 octobre 2012 17:21
À : user@hadoop.apache.org
Objet : Re: Start NN with dynamic property (option -D)
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement was recently added to trunk but is not in any Apache release I know of yet.
I instead make things like this work via the Configuration's ability to use System Properties (from the JVM) when substituting. So if your config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has -Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
Re: Start NN with dynamic property (option -D)
Posted by Harsh J <ha...@cloudera.com>.
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement
was recently added to trunk but is not in any Apache release I know of
yet.
I instead make things like this work via the Configuration's ability
to use System Properties (from the JVM) when substituting. So if your
config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has
-Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
Re: Start NN with dynamic property (option -D)
Posted by Harsh J <ha...@cloudera.com>.
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement
was recently added to trunk but is not in any Apache release I know of
yet.
I instead make things like this work via the Configuration's ability
to use System Properties (from the JVM) when substituting. So if your
config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has
-Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
Re: Start NN with dynamic property (option -D)
Posted by Harsh J <ha...@cloudera.com>.
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement
was recently added to trunk but is not in any Apache release I know of
yet.
I instead make things like this work via the Configuration's ability
to use System Properties (from the JVM) when substituting. So if your
config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has
-Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J
Re: Start NN with dynamic property (option -D)
Posted by Harsh J <ha...@cloudera.com>.
Hi Guillaume,
See https://issues.apache.org/jira/browse/HDFS-2580 - This improvement
was recently added to trunk but is not in any Apache release I know of
yet.
I instead make things like this work via the Configuration's ability
to use System Properties (from the JVM) when substituting. So if your
config files have <value>${foo}</value> and HADOOP_NAMENODE_OPTS has
-Dfoo=bar, then the <value> passed in is bar.
Hope this helps!
On Fri, Oct 12, 2012 at 5:13 PM, Guillaume Polaert <gp...@cyres.fr> wrote:
> Hello,
>
> I'm trying to start a NN using the -Dproperty=value functionality.
> I've modified hadoop-env.sh like this :
> export HADOOP_NAMENODE_OPTS= ... -Ddfs.namenode.http-address=0.0.0.0:50071 ...
>
> and I've launched the daemon with hadoop-hdfs-namenode script.
>
> ps -efHww returns ".../java -Dproc_namenode ... -Dhadoop.security.logger=INFO,RFAS -Ddfs.namenode.http-address=0.0.0.0:50071 -Dhdfs.audit.logger=INFO,NullAppender ..."
>
> But the property has always the same value : 50070 (default port).
>
> Is "-D-substitution" working for this use case ?
>
> Thanks, Guillaume
>
--
Harsh J