You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2016/02/17 21:48:08 UTC
Review Request 43675: Preupload.py should pre-create hdfs directories

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43675/
-----------------------------------------------------------

Review request for Ambari and Sumit Gupta.


Bugs: AMBARI-15079
    https://issues.apache.org/jira/browse/AMBARI-15079


Repository: ambari


Description
-------

This should eliminate any 'hadoop --config ... jar' fast-hdfs-resource.jar calls during deploy.
By executing them pre-deploy in preupload.py, and adding to ignore file.
This should benefit ~6 minutes of time deploy, taking the data from 24min cluster. And probably less for faster deployments.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/providers/hdfs_resource.py ebcf1a4 
  ambari-common/src/main/python/resource_management/libraries/resources/hdfs_resource.py 7c12409 
  ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py 2bd2626 
  ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f3a97fc 
  ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py b150464 
  ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 6837bf1 
  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 29c4784 
  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py dc17dba 
  ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/params.py 47af240 
  ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py 7ec85b5 
  ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 69c03ea 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py 7a2f6f6 
  ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py f923723 
  ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params_linux.py 09b7876 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 68c4f37 
  ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py 25da2a1 
  ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 25f867e 
  ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py f0b6927 
  ambari-server/src/main/resources/scripts/Ambaripreupload.py 61db286 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 2a9d7c5 

Diff: https://reviews.apache.org/r/43675/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk