You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datalab.apache.org by lf...@apache.org on 2022/09/08 11:14:25 UTC
[incubator-datalab] branch develop updated (d74050055 -> 58963ccae)
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a change to branch develop
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
from d74050055 Merge pull request #1715 from apache/DATALAB-2995
add 2a4766739 added files and func to actions lib
add 727439e1d params and creds
add 488e44555 added hdinsight lib to reqs
add 9c613a6d7 add libs in base_Dockerfile
add 2bf412f82 add imports
add 008febb35 add class AzureActions
add dcac403ad delete hdinsight_client
add 8dffa5e89 modify hdinsight func
add a62b36011 modify func
add 189d2c0c4 modify func add self=
add 5379753b1 remove self
add dddfd288d add import self and add self to func
add d18321b36 remove self from func and from import
add c3be8d16b add self before client creation
add c91deaf60 changes in def hdinsight
add 17fd0c1fa some changes
add b1cf6e39a revert changes
add 3dc6e239c edit actions_lib
add bd88e30d7 changes
add fde2b5d73 revert changes
add 6fa45158d changes
add b56086d20 revert changes
add d0543dfb3 changes
add b2df54a2d some changes
add 9e4e3ca79 changes
add 5cb6feb91 change func hdinsight
add 2fc07eccc change cluster name
add 05b2d825b delete unused statement
add 42ed96c99 changes
add c6b536591 refactor dataengine-service_prepare
add fa7e32fc6 fix errors
add 23223bd7e add print to def_terminate
add c8092d2e2 [DATALAB-2982]: added new files for hdinsight
add 5794a7399 [DATALAB-2982]: changed cluster name variable
add 14f36c05f [DATALAB-1408]: added some creation changes
add 8b6adca64 added files and func to actions lib
add 9cd124d1b params and creds
add 7e4a1fef4 added hdinsight lib to reqs
add 4c49e050e add libs in base_Dockerfile
add 45ac1af5e add imports
add b823d5c2f add class AzureActions
add 17804f4d4 delete hdinsight_client
add 6d6516f32 modify hdinsight func
add 364923eb8 modify func
add 43838a0d2 modify func add self=
add e96b775fd remove self
add 6e48bf42b add import self and add self to func
add 1515f9489 remove self from func and from import
add 8999bf12f add self before client creation
add 35711de16 changes in def hdinsight
add 77996f493 some changes
add 6ad055fb1 revert changes
add 102998463 edit actions_lib
add adeffa289 changes
add a0119deed revert changes
add 631cdcdd1 changes
add 8427f295e revert changes
add fe2e037d5 changes
add fb1887382 some changes
add ddc4ad185 changes
add 832520a43 change func hdinsight
add c6fcee81f change cluster name
add d11745cb2 delete unused statement
add b8c35d006 changes
add 602f6ba1c refactor dataengine-service_prepare
add 12cfe74da fix errors
add 46a0b45a6 add print to def_terminate
add 82a329a2f Merge pull request #1557 from korsicanec/DATALAB-1408
add 165a812d7 Merge pull request #1667 from apache/DATALAB-1408
add 8f50e2a74 [DATALAB-2982]: added new files for hdinsight
add d5e5d035c [DATALAB-2982]: changed cluster name variable
add 673d9a876 Merge pull request #1676 from apache/DATALAB-2982
add 44d963997 fixed conflict
add dbec8bea7 [DATALAB-1408]: hdinsight creation code update
add d1f90ba76 [DATALAB-1408]: added hdinsight storage creation
add 3d281844f [DATALAB-1408]: fixed password agrument
add 778bc2eff [DATALAB-1408]: added version to hdinsight description json
add 0b7b14aae [DATALAB-1408]: changed description json
add 458329d63 Merge branch 'develop' into DATALAB-1408
add e90c725fb [DATALAB-1408]: fixed some variables
add 2035ec488 [DATALAB-1408]: added custom tag to hdinsight
add 3f7bd197d Merge branch 'develop' into DATALAB-1408
add 87baa00cc Merge branch 'develop' into DATALAB-1408
add b1cbe3004 [DATALAB-1408]: fixed some variables and imports
add 9f9d1045d [DATALAB-1408]: fixed container name
add 49f5dbbc1 [DATALAB-1408]: added vpc and edge subnet usage
add f153bbeb3 [DATALAB-1408]: changed container type
add 3a1f63280 [DATALAB-1408]: added zookeeper nodes
add a3b6d915e [DATALAB-1408]: fixed shapes
add 76ca78cf4 [DATALAB-1408]: removed cluster parameters from hdinsight terminate
add 345e3399f [DATALAB-1408]: added cluster termination
add b72051fd2 [DATALAB-1408]: added password generation
add 0f583e86b [DATALAB-1408]: added cluster status checks
add 55e7f85c3 [DATALAB-1408]: added cluster status check before termination
add 3fd3fe906 Merge branch 'develop' into DATALAB-1408
add 413ef0843 [DATALAB-1408]: added cluster termination during project and ssn node termination
add 3f54a31f2 Merge branch 'develop' into DATALAB-1408
add 1e9664da1 [DATALAB-1408]: changed print to logging
add bd5f36720 [DATALAB-1408]: fixed minor bugs, changed zookeeper shape to A2
add 92f98b56f [DATALAB-1408]: cluster storage account is now deleted if cluster is not found
add d3ba2596b [DATALAB-1408]: changed where cluster password is generated
add 2bddbd170 [DATALAB-1408]: increased check interval during cluster creation and termination
add d9205c9fe [DATALAB-1408]: fixed cluster tags
add d3fa76e4e [DATALAB-3020]: added sbn tag checks during azure project termination
add a9d0782d4 [DATALAB-1408]: fixed azure image list
add ca24a5ed9 [DATALAB-1408]: fixed cluster SBN tag
add 3767646bd [DATALAB-1408]: fixed typo
new 58963ccae Merge pull request #1716 from apache/DATALAB-1408
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../src/base/scripts/install_prerequisites.py | 2 +-
.../src/dataengine-service/fabfile.py | 10 +-
.../src/general/files/azure/base_Dockerfile | 2 +-
.../{aws => azure}/dataengine-service_Dockerfile | 8 +-
.../azure/dataengine-service_description.json | 20 +++
.../src/general/lib/azure/actions_lib.py | 69 ++++++--
.../src/general/lib/azure/meta_lib.py | 36 +++++
.../src/general/lib/gcp/meta_lib.py | 2 +-
.../scripts/aws/dataengine-service_configure.py | 1 +
.../scripts/aws/dataengine-service_prepare.py | 1 +
.../scripts/azure/common_create_storage_account.py | 7 +-
.../scripts/azure/dataengine-service_configure.py | 108 +++++++++++++
.../scripts/azure/dataengine-service_create.py | 176 +++++++++++++++++++++
.../scripts/azure/dataengine-service_prepare.py | 169 ++++++++++++++++++++
.../scripts/azure/dataengine-service_terminate.py | 93 +++++++++++
.../src/general/scripts/azure/project_terminate.py | 38 ++++-
.../src/general/scripts/azure/ssn_configure.py | 3 +-
.../src/general/scripts/azure/ssn_terminate.py | 10 ++
.../scripts/gcp/dataengine-service_create.py | 2 +-
.../scripts/gcp/dataengine-service_prepare.py | 6 +
.../src/ssn/scripts/docker_build.py | 5 +-
.../src/ssn/scripts/gitlab_deploy.py | 2 +-
22 files changed, 730 insertions(+), 40 deletions(-)
copy infrastructure-provisioning/src/general/files/{aws => azure}/dataengine-service_Dockerfile (84%)
create mode 100644 infrastructure-provisioning/src/general/files/azure/dataengine-service_description.json
create mode 100644 infrastructure-provisioning/src/general/scripts/azure/dataengine-service_configure.py
create mode 100644 infrastructure-provisioning/src/general/scripts/azure/dataengine-service_create.py
create mode 100644 infrastructure-provisioning/src/general/scripts/azure/dataengine-service_prepare.py
create mode 100644 infrastructure-provisioning/src/general/scripts/azure/dataengine-service_terminate.py
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 01/01: Merge pull request #1716 from apache/DATALAB-1408
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch develop
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit 58963ccaece59ccfbe14afab564696c3caabc90f
Merge: d74050055 3767646bd
Author: Leonid Frolov <51...@users.noreply.github.com>
AuthorDate: Thu Sep 8 14:14:18 2022 +0300
Merge pull request #1716 from apache/DATALAB-1408
[DATALAB-1408]: added HDinsight creation/termination
.../src/base/scripts/install_prerequisites.py | 2 +-
.../src/dataengine-service/fabfile.py | 10 +-
.../src/general/files/azure/base_Dockerfile | 2 +-
.../files/azure/dataengine-service_Dockerfile | 39 +++++
.../azure/dataengine-service_description.json | 20 +++
.../src/general/lib/azure/actions_lib.py | 69 ++++++--
.../src/general/lib/azure/meta_lib.py | 36 +++++
.../src/general/lib/gcp/meta_lib.py | 2 +-
.../scripts/aws/dataengine-service_configure.py | 1 +
.../scripts/aws/dataengine-service_prepare.py | 1 +
.../scripts/azure/common_create_storage_account.py | 7 +-
.../scripts/azure/dataengine-service_configure.py | 108 +++++++++++++
.../scripts/azure/dataengine-service_create.py | 176 +++++++++++++++++++++
.../scripts/azure/dataengine-service_prepare.py | 169 ++++++++++++++++++++
.../scripts/azure/dataengine-service_terminate.py | 93 +++++++++++
.../src/general/scripts/azure/project_terminate.py | 38 ++++-
.../src/general/scripts/azure/ssn_configure.py | 3 +-
.../src/general/scripts/azure/ssn_terminate.py | 10 ++
.../scripts/gcp/dataengine-service_create.py | 2 +-
.../scripts/gcp/dataengine-service_prepare.py | 6 +
.../src/ssn/scripts/docker_build.py | 5 +-
.../src/ssn/scripts/gitlab_deploy.py | 2 +-
22 files changed, 766 insertions(+), 35 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org