[jira] [Created] (AMBARI-7844) Ambari needs to fix client configuration files to point to versioned tarballs

["Alejandro Fernandez (JIRA)" <ji...@apache.org>]

Alejandro Fernandez created AMBARI-7844:
-------------------------------------------

             Summary: Ambari needs to fix client configuration files to point to versioned tarballs
                 Key: AMBARI-7844
                 URL: https://issues.apache.org/jira/browse/AMBARI-7844
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
    Affects Versions: 1.7.0
            Reporter: Alejandro Fernandez
            Assignee: Alejandro Fernandez
            Priority: Blocker
             Fix For: 1.7.0
         Attachments: ambari_170_versioned_rpms.pptx

Once AMBARI-7842 is committed, many clients in the stack need to point to the versioned tar-balls on HDFS. Ambari needs to propagate these changes to the clients by modifying the client configs to point to the right tar-ball version.

This will require dynamic variable interpretation in the *-site.xml files

||Client where the config should be changed||Configuration file||Configuration property||Example value||
|MR clients |mapred-site.xml|mapreduce.application.framework.path|hdfs:/mapred/framework/hadoop-2.3.0.tar.gz#mr-framework|
|MR clients|mapred-site.xml|mapreduce.application.classpath|$PWD/mr-framework/hadoop-2.3.0/share/hadoop/mapreduce/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/mapreduce/lib/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/common/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/common/lib/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/yarn/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/yarn/lib/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/hdfs/:$PWD/mr-framework/hadoop-2.3.0/share/hadoop/hdfs/lib/|
|Tez client|tez-site.xml|tez.lib.uris|(fs.defaultFS)/hdp/hdp_version/apps/tez/tez.tar.gz |
|Tez client|tez-site.xml|tez.aux.uris|(fs.defaultFS)/hdp/hdp_version/apps/tez/aux/hadoop-lzo.jar|
|WebHCat server|webhcat-site.xml|templeton.pig.archive|hdfs:///apps/templeton/pig-$(env.PIG_VERSION).tar.gz|
|WebHCat server|webhcat-site.xml|templeton.pig.path|pig-$(env.PIG_VERSION).tar.gz/pig-$(env.PIG_VERSION)/bin/pig|
|WebHCat server|webhcat-site.xml|templeton.hive.archive|hdfs:///apps/templeton/apache-hive-$(env.HIVE_VERSION)-bin.tar.gz|
|WebHCat server|webhcat-site.xml|templeton.hive.path|apache-hive-$(env.HIVE_VERSION)-bin.tar.gz/apache-hive-$(env.HIVE_VERSION)-bin/bin/hive|
|WebHCat server|webhcat-site.xml|templeton.hive.home|apache-hive-$(env.HIVE_VERSION)-bin.tar.gz/apache-hive-$(env.HIVE_VERSION)-bin|
|WebHCat server|webhcat-site.xml|templeton.hcat.home|apache-hive-$(env.HIVE_VERSION)-bin.tar.gz/apache-hive-$(env.HIVE_VERSION)-bin/hcatalog|
|WebHCat server|webhcat-site.xml|templeton.sqoop.home|-|
|WebHCat server|webhcat-site.xml|templeton.sqoop.path|-|
|WebHCat server|webhcat-site.xml|templeton.sqoop.archive|-|
|Slider| N/A | N/A | Slider client uploads all the dependencies for each application instance  |

Oozie server has its own shared lib mechanism that is already integrated into Ambari, is versioned and is not easy to integrate into a unified layout.

WebHCat related tarballs are already uploaded to HDFS by the installer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)