You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dlab.apache.org by om...@apache.org on 2019/04/15 09:10:27 UTC
[incubator-dlab] branch EPMCDLAB-1186 updated (e274740 -> a1c4dc9)
This is an automated email from the ASF dual-hosted git repository.
omartushevskyi pushed a change to branch EPMCDLAB-1186
in repository https://gitbox.apache.org/repos/asf/incubator-dlab.git.
from e274740 [DLAB-435]: Fixed issue with EMR libraries installation
new 70a9151 [DLAB-573]:fixed issue with azure_client_id
new afa9711 [DLAB-573]: added needed parameters
new 044a120 DLAB-573 added refresh token param for spark reconfiguration
new 34ef8f4 Merge pull request #65 from apache/DLAB-573-dev
new aff4ce5 DLAB-000 fixed bug connected with cluster configuration dto
new 24d92a7 DLAB-000 2.1 Release notes updated
new 78acb1d [DLAB-372]: added fixes on Manage Git Credentials page
new 8ee12bb [DLAB-573]: fixed preemptible node validation
new b7d3df5 [DLAB-573]: fixed preemptible node validation
new dd801d2 Merge pull request #63 from apache/DLAB-537
new 49bd075 [DLAB-378]: fixed issue with edge node action selectors
new 4b2d6e3 Merge pull request #50 from apache/DLAB-378_2
new 59058fc Merge branch 'develop' of github.com:apache/incubator-dlab into DLAB-372
new 0600f33 Merge pull request #66 from apache/DLAB-372
new fb8d1c9 [DLAB-449]: fixed issue with error handling on login
new a722270 [DLAB-449]: fixed issue with in grid multiselect filters
new 5dda84c [DLAB-449]: libraries version fixes
new 2b002e0 [DLAB-449]: fixed issue with extra scrollbar for users column
new f68e584 [DLAB-449]: reset classes on resource creation without permission
new 5c2e232 [DLAB-449]: added headers to alert dialogs
new a8c1b59 Merge branch 'develop' of github.com:apache/incubator-dlab into DLAB-449
new c6f2b5d merge develop into DLAB-449
new b54b336 Merge pull request #62 from apache/DLAB-449
new 623fd3c [DLAB-531]: Fix broken python on jupyter/zeppelin after DataProc install
new 759651d Merge pull request #67 from ioleksandr/DLAB-531
new 4a9afaf [DLAB-578]: merge preemptible node labels
new e0ff817 [DLAB-576]: Added succeess notification after creating/removing account
new dbc9c05 [DLAB-577][Manage roles]: removed extra scrollbar from users column
new 790f827 Merge pull request #69 from apache/DLAB-576
new f804563 [DLAB-550]: fixed Issues with merging of Health status and Environment Management pages
new 70605a8 Merge pull request #68 from apache/DLAB-550
new 1ac5a1a Merge branch 'develop' of github.com:apache/incubator-dlab into DLAB-578
new cc643a1 Merge pull request #70 from apache/DLAB-578
new 41ee4c7 DLAB-518 fixed bug with wrong billing information for personal bucket
new c0f3d8b Merge pull request #71 from apache/bugfix-DLAB-518
new 69f9d28 [DLAB-77] Created Rstudio with Tensorflow image
new 3d9a205 [DLAB-77] Corrected Tensorflow version
new 6677420 Merge pull request #72 from Dyoma33/DLAB-77-dev
new 005f11e DLAB-527 fixed bug connected with billing on azure
new 086fc51 Merge pull request #73 from apache/bugfix-DLAB-527
new ddc2044 [DLAB-77] Fixed result.write operation
new ceb071c Merge pull request #74 from Dyoma33/DLAB-77-dev
new 2f79cd9 DLAB-574 removed azure_client_id param from docker requests
new c042f0d Merge pull request #75 from apache/bugfix-DLAB-574
new 7bea848 [DLAB-77] Added username and pass to json
new be9cc6a Merge pull request #76 from Dyoma33/DLAB-77-dev
new ce25664 DLAB-000 unit test fixed
new 0b74de8 [DLAB-551]: Fix problem with create notebooks of the same template simultaneously
new cd23b5d [DLAB-551]: Fix problem with create notebooks of the same template simultaneously add all templates
new effe960 Merge pull request #77 from ioleksandr/DLAB-551
new 0410ffc [DLAB-589] Remove n1-standard-1 shape
new 7932305 Merge pull request #78 from Dyoma33/DLAB-580
new c1c4451 [DLAB-77-551] Fixed image creation issue for Tensor-Rstudio
new 04ccc64 Merge pull request #79 from Dyoma33/DLAB-77-dev
new b898523 [DLAB-77] Added missing coma
new e3bc758 Merge pull request #80 from Dyoma33/DLAB-77-dev
new 12771be [DLAB-551]: add forgotten lib
new 31518ab Merge pull request #81 from ioleksandr/DLAB-551
new 06f1da6 DLAB-582 added API for getting DLab version
new d2deca8 Merge pull request #82 from apache/feature-DLAB-582
new 2ee1914 [DLAB-77] Fixed dataengine creation issue due to missing GPU in spark cluster nodes
new 2d42d33 Merge pull request #83 from Dyoma33/DLAB-77-dev
new d27782d [GCP]: Fix Data Engine creation fails on DeepLearning -remove old and unsupported library Caffe -change versionc of cuda for Data Engine on deeplearning
new 7c6f1c9 Merge pull request #84 from apache/DLAB-523
new d58afd8 [DLAB-580] Changed shape in integration tests
new 6cfbeb5 Merge pull request #85 from Dyoma33/DLAB-580
new 0858bba [DLAB-456]: fixed issue with header structure
new 3e3c33a Merge pull request #86 from apache/DLAB-456
new 583cf02 [DLAB-593]: Fixed issue with removing IAM resources
new e66a70a Merge pull request #87 from apache/DLAB-593
new 4c04431 [DLAB-594]: added tags for Elastic IPs
new 2cad14f [DLAB-594]: added tags for VPCs,subnets, Route tables, SGs and IAM roles
new e506e4b [DLAB-594]: fixed issue with creating IAM role and added tag for peering connection
new 4348401 [DLAB-594]: fixed issue with creating IAM role
new 6c7a30a [DLAB-594]: fixed issue with removing peering connection during rolling back
new e2b5f80 debugging
new 74788b1 [DLAB-594]: Fixed issue second VPC
new b8bec80 [DLAB-594]: Fixed typo
new 4900f52 [DLAB-594]: Fixed typo
new f74984a Merge pull request #88 from apache/DLAB-594
new ae2926a [DLAB-596]: Fixed issue with header structure after Dataengine creation with custom Spark configuration
new aff5303 Merge pull request #89 from apache/DLAB-596
new 404eb3c [DLAB-597]: Fixed issue with getting list of Service Accounts
new 8dae908 Merge pull request #90 from apache/DLAB-597-fix
new bdc7fea DLAB-453 added possibility to terminate computational by scheduler
new d1842f7 Merge pull request #91 from apache/feature-DLAB-453-1
new 9260408 EPMCDLAB-000 refactored ldap authentication
new d2a1a40 DLAB-000 fixed merge conflicts
new 875566d DLAB-000 copyright updated
new 85f0db8 Merge pull request #92 from apache/ldab_refactored
new 22aba18 [DLAB-600]: Fixed issue with missed tags
new bbf8b59 Merge pull request #93 from apache/DLAB-600
new 8d86774 [DLAB-592]: use DataProc v1.4 instead of v1.1
new 4bfaf01 Merge pull request #94 from apache/DLAB-592
new bbf373e DLAB-602 fixed bug connected with wrong error message in case of wrong user login entered
new b6e7f8a Merge pull request #95 from apache/bugfix-DLAB-602-1
new 4c04126 [DLAB-580] Removed n1-standard-1 shape from Dataproc jenkins job
new 55cd899 Merge pull request #96 from Dyoma33/DLAB-580
new e4d5dd4 DLAB-570 fixed bug connected with wrong key status in case of fail
new 7d37d3c Merge branch 'bugfix-DLAB-570' of github.com:apache/incubator-dlab into DLAB-572
new 4e21daa [DLAB-572]: added handler on edge creation failing; app version added
new 76c8a67 [DLAB-572]: linter configuration updates
new 87e5ba8 DLAB-572 added status to health status page in case of edge is not exist
new 652e3eb [DLAB-583]: added meta data service
new b990cac Merge pull request #97 from apache/DLAB-572
new 25f93b5 DLAB-000 changed error message in case of wrong credentials
new a1c4dc9 Merge branch 'develop' of github.com:apache/incubator-dlab into EPMCDLAB-1186
The 5962 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
README.md | 3 +-
RELEASE_NOTES.md | 10 +-
USER_GUIDE.md | 2 +-
.../src/dataengine/scripts/configure_dataengine.py | 8 +-
.../scripts/configure_deep_learning_node.py | 2 -
.../src/general/files/aws/ssn_policy.json | 3 +-
.../src/general/files/aws/tensor_description.json | 2 +-
.../files/gcp/dataengine-service_description.json | 5 +-
.../general/files/gcp/dataengine_description.json | 1 -
.../src/general/files/gcp/jupyter_description.json | 1 -
.../src/general/files/gcp/rstudio_description.json | 1 -
.../files/{aws => gcp}/tensor-rstudio_Dockerfile | 6 +-
...iption.json => tensor-rstudio_description.json} | 6 +-
.../src/general/files/gcp/tensor_description.json | 6 +-
.../general/files/gcp/zeppelin_description.json | 1 -
.../src/general/lib/aws/actions_lib.py | 95 ++--
.../src/general/lib/azure/actions_lib.py | 43 +-
.../src/general/lib/gcp/actions_lib.py | 85 ++--
.../src/general/lib/gcp/meta_lib.py | 11 +-
.../src/general/lib/os/debian/notebook_lib.py | 49 --
.../src/general/lib/os/redhat/notebook_lib.py | 46 --
.../scripts/aws/common_create_role_policy.py | 5 +-
.../general/scripts/aws/common_create_subnet.py | 8 +-
.../scripts/aws/edge_associate_elastic_ip.py | 7 +-
.../src/general/scripts/aws/edge_prepare.py | 26 +-
.../scripts/aws/ssn_associate_elastic_ip.py | 7 +-
.../src/general/scripts/aws/ssn_configure.py | 48 ++
.../src/general/scripts/aws/ssn_create_vpc.py | 5 +
.../src/general/scripts/aws/ssn_prepare.py | 79 ++-
.../general/scripts/gcp/common_prepare_notebook.py | 2 +-
.../scripts/gcp/dataengine-service_jars_parser.py | 14 +-
.../src/general/scripts/gcp/dataengine_prepare.py | 2 +-
.../general/scripts/gcp/deeplearning_configure.py | 20 +-
.../src/general/scripts/gcp/jupyter_configure.py | 19 +-
.../src/general/scripts/gcp/rstudio_configure.py | 19 +-
.../src/general/scripts/gcp/ssn_configure.py | 1 +
...io_configure.py => tensor-rstudio_configure.py} | 69 +--
.../src/general/scripts/gcp/tensor_configure.py | 19 +-
.../src/general/scripts/gcp/zeppelin_configure.py | 19 +-
.../general/scripts/os/common_configure_spark.py | 20 +-
.../dataengine_reconfigure_spark/template.json | 1 +
.../notebook_reconfigure_spark/template.json | 1 +
.../gcp/jenkins_jobs/create_data_engine/config.xml | 4 +-
.../create_dataengine-service/config.xml | 5 +-
.../jenkins_jobs/create_notebook_server/config.xml | 2 +-
.../jenkins_jobs/start_notebook_server/config.xml | 1 +
.../jenkins_jobs/stop_notebook_server/config.xml | 1 +
.../terminate_notebook_server/config.xml | 1 +
.../src/ssn/files/gcp/mongo_roles.json | 32 +-
.../gcp_templates/deeplearning/dataproc.json | 4 +-
.../examples/gcp_templates/jupyter/dataproc.json | 4 +-
.../examples/gcp_templates/rstudio/dataproc.json | 4 +-
.../examples/gcp_templates/tensor/dataproc.json | 4 +-
.../examples/gcp_templates/zeppelin/dataproc.json | 4 +-
.../epam/dlab/automation/test/TestServices.java | 4 +-
.../com/epam/dlab/mongo/DlabResourceTypeDAO.java | 7 +-
.../azure/AzureBillableResourcesService.java | 4 +-
.../main/java/com/epam/dlab/auth/UserInfoDAO.java | 10 +-
.../epam/dlab/auth/UserVerificationService.java | 2 +-
...esponse.java => InfrastructureMetaInfoDTO.java} | 12 +-
.../SparkComputationalCreateAzure.java | 8 -
.../exploratory/ExploratoryActionStartAzure.java | 76 ++-
.../azure/exploratory/ExploratoryCreateAzure.java | 16 -
.../ComputationalClusterConfigDTO.java | 12 +-
...xploratoryReconfigureSparkClusterActionDTO.java | 19 +-
.../backendapi/modules/ProvisioningDevModule.java | 2 +-
.../aws/service/AwsUserVerificationService.java | 16 +-
.../auth/azure/AzureAuthenticationResource.java | 14 +-
services/security-service/pom.xml | 6 +
services/security-service/security.yml | 112 +----
.../dlab/auth/SecurityServiceConfiguration.java | 37 +-
.../epam/dlab/auth/core/CacheableReference.java | 56 ---
.../epam/dlab/auth/core/DlabLdapConnection.java | 2 +-
.../dlab/auth/core/DlabLdapConnectionFactory.java | 49 ++
.../com/epam/dlab/auth/core/LdapFilterCache.java | 79 ---
.../java/com/epam/dlab/auth/core/LoginCache.java | 83 ----
.../com/epam/dlab/auth/core/LoginConveyor.java | 67 ---
.../java/com/epam/dlab/auth/core/LoginStep.java | 47 --
.../com/epam/dlab/auth/core/UserInfoBuilder.java | 197 --------
.../java/com/epam/dlab/auth/dao/LdapUserDAO.java | 189 +-------
.../com/epam/dlab/auth/dao/LdapUserDAOImpl.java | 165 +++++++
.../main/java/com/epam/dlab/auth/dao/Request.java | 92 +---
.../epam/dlab/auth/dao/SearchRequestBuilder.java | 26 -
.../epam/dlab/auth/dao/UserInfoDAODumbImpl.java | 6 +-
.../epam/dlab/auth/dao/UserInfoDAOMongoImpl.java | 85 ++--
.../dlab/auth/dao/filter/SearchResultMapper.java | 31 --
.../auth/dao/filter/SearchResultProcessor.java | 68 ---
.../com/epam/dlab/auth/dao/script/DeepMap.java | 57 ---
.../epam/dlab/auth/dao/script/ScriptHolder.java | 59 ---
.../dao/script/SearchResultToDictionaryMapper.java | 98 ----
.../auth/modules/AwsSecurityServiceModule.java | 4 +-
.../auth/modules/AzureSecurityServiceModule.java | 4 +-
.../auth/modules/GcpSecurityServiceModule.java | 4 +-
.../dlab/auth/modules/SecurityServiceModule.java | 13 +-
.../SynchronousLdapAuthenticationResource.java | 80 ++++
.../SynchronousLdapAuthenticationService.java | 186 --------
.../dlab/auth/service/AuthenticationService.java} | 15 +-
.../service/impl/LdapAuthenticationService.java | 89 ++++
.../test/java/com/epam/dlab/auth/aws/AwsTest.java | 78 ---
.../com/epam/dlab/auth/core/LoginConveyorTest.java | 131 -----
.../dlab/auth/dao/script/ScriptHolderTest.java | 65 ---
.../java/com/epam/dlab/auth/ldap/AuthTest.java | 29 --
.../java/com/epam/dlab/auth/ldap/BasicTest.java | 116 -----
.../java/com/epam/dlab/auth/ldap/JsonTest.java | 84 ----
.../java/com/epam/dlab/auth/ldap/ScriptList.java | 76 ---
.../impl/LdapAuthenticationServiceTest.java | 139 ++++++
services/self-service/pom.xml | 6 +
services/self-service/self-service.yml | 3 +
.../java/com/epam/dlab/backendapi/dao/EnvDAO.java | 16 +-
.../epam/dlab/backendapi/dao/SchedulerJobDAO.java | 43 +-
.../resources/InfrastructureInfoResource.java | 9 +
.../callback/base/KeyUploaderCallback.java | 5 +-
.../backendapi/resources/dto/BillingFilter.java | 19 +
.../computational/StopComputationalJob.java | 2 -
...onalJob.java => TerminateComputationalJob.java} | 19 +-
.../service/InfrastructureInfoService.java | 3 +
.../impl/InfrastructureInfoServiceBase.java | 11 +
.../service/impl/SchedulerJobServiceImpl.java | 29 +-
.../epam/dlab/backendapi/util/RequestBuilder.java | 27 +-
.../validation/SchedulerJobDTOValidator.java | 2 +-
.../src/main/resources/webapp/angular.json | 23 -
.../src/main/resources/webapp/package-lock.json | 527 ++++-----------------
.../src/main/resources/webapp/package.json | 4 +-
.../core/services/applicationSecurity.service.ts | 5 +-
.../services/applicationServiceFacade.service.ts | 9 +
.../src/app/core/services/healthStatus.service.ts | 8 +
.../webapp/src/app/login/login.component.css | 1 +
.../resources/webapp/src/app/management/index.ts | 6 +-
.../manage-environment-dilog.component.ts | 14 +-
.../manage-roles-groups.component.scss | 2 +
.../manage-roles-groups.component.ts | 10 +-
.../management-grid/management-grid.component.html | 38 +-
.../management-grid/management-grid.component.scss | 3 +
.../management-grid/management-grid.component.ts | 31 +-
.../src/app/management/management.component.ts | 4 +-
.../webapp/src/app/management/management.model.ts | 3 +-
.../cluster-details/cluster-details.component.html | 2 +-
...utational-resource-create-dialog.component.html | 35 +-
...utational-resource-create-dialog.component.scss | 15 +-
...mputational-resource-create-dialog.component.ts | 15 +-
.../computational-resources-list.component.ts | 12 +-
.../install-libraries.component.html | 2 +-
.../install-libraries.component.scss | 6 +-
.../install-libraries.component.ts | 36 +-
.../manage-ungit/manage-ungit.component.html | 9 +-
.../manage-ungit/manage-ungit.component.scss | 9 +-
.../manage-ungit/manage-ungit.component.ts | 8 +-
.../shared/form-controls/dropdowns.component.scss | 7 +
.../confirmation-dialog.component.ts | 7 +-
.../confirmation-dialog.model.ts | 6 +-
.../webapp/src/app/shared/navbar/index.ts | 5 +-
.../src/app/shared/navbar/navbar.component.html | 9 +
.../src/app/shared/navbar/navbar.component.scss | 20 +-
.../src/app/shared/navbar/navbar.component.ts | 19 +-
.../resources/webapp/src/assets/styles/_theme.scss | 101 +++-
.../main/resources/webapp/src/tsconfig.spec.json | 20 +
.../src/main/resources/webapp/tslint.json | 1 -
.../resources/InfrastructureInfoResourceTest.java | 17 +
.../service/impl/SchedulerJobServiceImplTest.java | 17 +-
.../dlab/backendapi/util/RequestBuilderTest.java | 4 -
160 files changed, 1759 insertions(+), 3274 deletions(-)
copy infrastructure-provisioning/src/general/files/{aws => gcp}/tensor-rstudio_Dockerfile (90%)
copy infrastructure-provisioning/src/general/files/gcp/{tensor_description.json => tensor-rstudio_description.json} (73%)
copy infrastructure-provisioning/src/general/scripts/gcp/{rstudio_configure.py => tensor-rstudio_configure.py} (85%)
copy services/dlab-model/src/main/java/com/epam/dlab/dto/{gcp/auth/GcpOauth2AuthorizationCodeResponse.java => InfrastructureMetaInfoDTO.java} (81%)
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/CacheableReference.java
create mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/DlabLdapConnectionFactory.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/LdapFilterCache.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/LoginCache.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/LoginConveyor.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/LoginStep.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/core/UserInfoBuilder.java
create mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/LdapUserDAOImpl.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/SearchRequestBuilder.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/filter/SearchResultMapper.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/filter/SearchResultProcessor.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/script/DeepMap.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/script/ScriptHolder.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/dao/script/SearchResultToDictionaryMapper.java
create mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/resources/SynchronousLdapAuthenticationResource.java
delete mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/resources/SynchronousLdapAuthenticationService.java
copy services/{self-service/src/main/java/com/epam/dlab/backendapi/service/GitCredentialService.java => security-service/src/main/java/com/epam/dlab/auth/service/AuthenticationService.java} (74%)
create mode 100644 services/security-service/src/main/java/com/epam/dlab/auth/service/impl/LdapAuthenticationService.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/aws/AwsTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/core/LoginConveyorTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/dao/script/ScriptHolderTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/ldap/AuthTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/ldap/BasicTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/ldap/JsonTest.java
delete mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/ldap/ScriptList.java
create mode 100644 services/security-service/src/test/java/com/epam/dlab/auth/service/impl/LdapAuthenticationServiceTest.java
copy services/self-service/src/main/java/com/epam/dlab/backendapi/schedulers/computational/{StopComputationalJob.java => TerminateComputationalJob.java} (70%)
create mode 100644 services/self-service/src/main/resources/webapp/src/tsconfig.spec.json
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@dlab.apache.org
For additional commands, e-mail: commits-help@dlab.apache.org