[jira] [Commented] (SLIDER-90) Slider to work on HA NNs

["Steve Loughran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SLIDER-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14003132#comment-14003132 ] 

Steve Loughran commented on SLIDER-90:
--------------------------------------

from josh, feb 2014

I tried to test Slider on an Ambari-installed hadoop instance and kept getting an UnknownHostException when using the nameservice as the host in the HDFS URI.

For my installation, I have a nameservice of "isty" and two namenodes (istymst and istydn1).

It appears if I include hdfs-site.xml on Hoya's classpath (really just $HADOOP_CONF_DIR), appears to clean things up as it gets added to the Configuration and then NameNodeProxies correctly creates the correct class. Alternatively, I could also make things work by including all of the HA configuration params into {[slider-client.xml}}

{code}
  <property>
    <name>dfs.client.failover.proxy.provider.isty</name>
    <value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
  </property>

  <property>
    <name>dfs.namenode.rpc-address.isty.nn2</name>
    <value>istydn1.ctolab.hortonworks.com:8020</value>
  </property>

  <property>
    <name>dfs.namenode.rpc-address.isty.nn1</name>
    <value>istymst.ctolab.hortonworks.com:8020</value>
  </property>

  <property>
    <name>dfs.nameservices</name>
    <value>isty</value>
  </property>

  <property>
    <name>dfs.ha.namenodes.isty</name>
    <value>nn1,nn2</value>
  </property>
{code}

I'm presently leaning towards including HADOOP_CONF_DIR (and checking expected dirs based on HADOOP_HOME/HADOOP_PREFIX) is the cleanest. If we can't ascertain it on our own, we can at least print a warning and let things progress as normal (as it won't affect the non-HA NN users).

> Slider to work on HA NNs
> ------------------------
>
>                 Key: SLIDER-90
>                 URL: https://issues.apache.org/jira/browse/SLIDER-90
>             Project: Slider
>          Issue Type: Sub-task
>          Components: appmaster
>            Reporter: Josh Elser
>
> Reported {{UnknownHostException}} when using the nameservice as the host in the HDFS URI.
> -likely cause failure to pass down all DFS info and/or failure to pick up config from local installation



--
This message was sent by Atlassian JIRA
(v6.2#6252)