[incubator-dlab] branch DLAB-483 updated: fixed issue with spark reconfiguration after stop

[om...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

omartushevskyi pushed a commit to branch DLAB-483
in repository https://gitbox.apache.org/repos/asf/incubator-dlab.git


The following commit(s) were added to refs/heads/DLAB-483 by this push:
     new efa4f09  fixed issue with spark reconfiguration after stop
efa4f09 is described below

commit efa4f096c025b83b392a3f0898df72979e9bba77
Author: Oleh Martushevskyi <Ol...@epam.com>
AuthorDate: Tue Mar 19 17:09:04 2019 +0200

    fixed issue with spark reconfiguration after stop
---
 .../src/general/scripts/os/reconfigure_spark.py                        | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/infrastructure-provisioning/src/general/scripts/os/reconfigure_spark.py b/infrastructure-provisioning/src/general/scripts/os/reconfigure_spark.py
index 0d645ff..246f103 100644
--- a/infrastructure-provisioning/src/general/scripts/os/reconfigure_spark.py
+++ b/infrastructure-provisioning/src/general/scripts/os/reconfigure_spark.py
@@ -60,6 +60,9 @@ if __name__ == "__main__":
                 '/tmp/notebook_reconfigure_dataengine_spark.py')
             sudo('mv /tmp/notebook_reconfigure_dataengine_spark.py '
                  '/usr/local/bin/notebook_reconfigure_dataengine_spark.py')
+        sudo('mkdir -p /tmp/{}'.format(args.cluster_name))
+        put(templates_dir + 'notebook_spark-defaults_local.conf',
+            '/tmp/{}/notebook_spark-defaults_local.conf'.format(args.cluster_name), use_sudo=True)
         cluster_dir = '/opt/' + args.cluster_name + '/'
         if 'azure_datalake_enable' in os.environ:
             datalake_enabled = os.environ['azure_datalake_enable']


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@dlab.apache.org
For additional commands, e-mail: commits-help@dlab.apache.org