[jira] [Created] (AMBARI-22628) Downloaded client configs have invalid values for spark properties in yarn-site.xml

["Jonathan Hurley (JIRA)" <ji...@apache.org>]

Jonathan Hurley created AMBARI-22628:
----------------------------------------

             Summary: Downloaded client configs have invalid values for spark properties in yarn-site.xml
                 Key: AMBARI-22628
                 URL: https://issues.apache.org/jira/browse/AMBARI-22628
             Project: Ambari
          Issue Type: Bug
    Affects Versions: 2.6.1
            Reporter: Jonathan Hurley
            Assignee: Jonathan Hurley
            Priority: Blocker
             Fix For: 2.6.1


Downloaded client configs have invalid values for spark properties in yarn-site.xml.

Issue: spark_version variable is replaced by 'None' in the spark related config properties in yarn-site in the client configs downloaded.

Attaching downloaded yarn-site.xml
 [^yarn-site.xml] 

Properties with issue:

{code:java}
<property>
      <name>yarn.nodemanager.aux-services.spark2_shuffle.classpath</name>
      <value>/usr/hdp/None/spark2/aux/*</value>
    </property>

 <property>
      <name>yarn.nodemanager.aux-services.spark_shuffle.classpath</name>
      <value>/usr/hdp/None/spark/aux/*</value>
    </property>

<property>
      <name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classpath</name>
      <value>/usr/hdp/None/spark/hdpLib/*</value>
    </property>
{code}

The cause for this is that YARN Clients on hosts without daemons never get a restart command after the initial {{yarn-site.xml}}, and can never fill in the correct values.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)