[jira] [Created] (AMBARI-14751) Ambari not setting hdp.version in config files

["Nick Dimiduk (JIRA)" <ji...@apache.org>]

Nick Dimiduk created AMBARI-14751:
-------------------------------------

             Summary: Ambari not setting hdp.version in config files
                 Key: AMBARI-14751
                 URL: https://issues.apache.org/jira/browse/AMBARI-14751
             Project: Ambari
          Issue Type: Bug
    Affects Versions: 2.2.0
            Reporter: Nick Dimiduk
            Priority: Critical


After dealing with a number of arcane failures, I've tracked down the issue to ambari not rendering config files correctly. This manifests mostly MR and Spark job submission failures. For example,

{noformat}
$ hbase org.apache.hadoop.hbase.mapreduce.RowCounter -libjars /usr/hdp/current/phoenix-client/phoenix-server.jar -Dhbase.client.scanner.caching=1000 -Dmapreduce.map.speculative=false TEST
...
Exception in thread "main" java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path
        at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:443)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
        at org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:210)
Caused by: java.net.URISyntaxException: Illegal character in path at index 11: /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework
        at java.net.URI$Parser.fail(URI.java:2848)
        at java.net.URI$Parser.checkChars(URI.java:3021)
        at java.net.URI$Parser.parseHierarchical(URI.java:3105)
        at java.net.URI$Parser.parse(URI.java:3063)
        at java.net.URI.<init>(URI.java:588)
        at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:441)
        ... 9 more
{noformat}

Restarting ambari-server + redeploying configs does not help.

{noformat}
$ dpkg -s ambari-server
Package: ambari-server
Status: install ok installed
Priority: extra
Section: universe/admin
Installed-Size: 457149
Maintainer: Hortonworks
Architecture: amd64
Version: 2.2.0.0-1310
Depends: openssl, postgresql (>= 8.1), python (>= 2.6), curl
Description: Ambari Server
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)