You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dlab.apache.org by lf...@apache.org on 2020/08/06 13:26:08 UTC

[incubator-dlab] branch DLAB-1594-2 updated (d3c1723 -> 219e9fb)

This is an automated email from the ASF dual-hosted git repository.

lfrolov pushed a change to branch DLAB-1594-2
in repository https://gitbox.apache.org/repos/asf/incubator-dlab.git.


    from d3c1723  [DLAB-1594]: enabled resource termination on failure
     add 282641f  [DLAB-1959] Fixed issue with pagination on Audit page
     add 88a8d47  [DLAB-1926] Billing report sorting (#823)
     add 40f90e4  [DLAB-1963] Fixed issue with creating notebook from image
     add 8ac13fd  [DLAB-1750]: Changed library search, fixed issues for library page (#827)
     add e5fd885  [DLAB-1943]: Small library fix
     add e4ab8f7  [DLAB-1965]: Fixed bucket browser issue (#828)
     add ef0a28a  [DLAB-1594]: fixed for apt packages
     add 20a154e  [DLAB-1594]: fixed for pip libs
     add bb8214d  [DLAB-1594]: fixed for pip libs
     add 81daea6  [DLAB-1594]: if failed to install, returns version N/A for apt and pip
     add 46445d9  [DLAB-1961]: made changes for R package installation
     add bef18ec  [DLAB-1961]: pip now upgrades lib if version is not specified and new version is available
     add bf9cce3  [DLAB-1961]: changed status 'invalid version' to 'invalid_version'
     add 126bbdd  [DLAB-1961]: made dataengine-service to only run pip3 during 'others' packages installation
     add a866f0a  [DLAB-1961]: some changes to additional apt package installation
     add 440c433  [DLAB-1961]: changed 'failed' status to 'installation_error'
     add 237e738  Merge pull request #826 from apache/DLAB-1961
     add 8eb2e1f  Changed library status
     add ef44530  [DLAB-1961]: changed error message for java
     add c27dd4e  [DLAB-1962]: made new response in case of exception for apt yum pip R and java
     add 12c9a5c  [DLAB-1962]: changed status in response
     add faea35e  Merge pull request #829 from apache/DLAB-1961
     add 0f31d59  [DLAB-1960]: Fixed library issues (#830)
     add c4f72c4  [DLAB-1967]: Fixed additional packages are not shown (#832)
     add 765eddb  [DLAB-1968] - Jenkins installing suspended
     add 4d58043  Merge pull request #833 from apache/DLAB-1968
     add 159eb9d  [DLAB-1870] Intigration with sonar
     add 76a8249  Updated copyright
     add f529b0f  [DLAB-1870] Intigration with sonar
     add dce5820  [DLAB-1870] Intigration with sonar
     add 0309886  [DLAB-1870] Intigration with sonar
     add 1b46e4c  [DLAB-1870] Intigration with sonar
     add fab7998  [DLAB-1870] Intigration with sonar
     add 07b88e0  [DLAB-1870] Intigration with sonar
     add 4e6dc6e  [DLAB-1870] Intigration with sonar
     add e9ea179  [DLAB-1870] Intigration with sonar
     add c820746  Updated copyright
     add cc4be26  Updated copyright
     add 580a5e8  Updated copyright
     add ca8d090  Updated pom
     add 223f348  Merge remote-tracking branch 'origin/sonar' into sonar
     add 3c743a7  Added sonar.py
     add 727deb6  Added sonar.py
     add 5335dc7  Updated sonar.py
     add 82c35ed  Updated sonar.py
     add 6e404ae  Updated sonar.py
     add 4f8b5dd  Updated sonar.py
     add 95a6626  aaa
     add 55931ff  Updated sonar.py
     add b62dd80  Updated sonar.py
     add 78025b3  Updated sonar.py
     add 5d8b9a5  Updated sonar.py
     add db12a91  Updated sonar.py
     add 840a045  Updated sonar.py
     add 572981c  Merge branch 'sonar' into develop
     add 24f7781  [DLAB-1943]: Change style on grids (#834)
     add c586248  Created test for AccessKeyServiceImpl
     add dc2d3b9  Updated test for AccessKeyService, created test for AccessKeyService
     add c1d23dc  [DLAB-1966]: fixed R package installation for dataengine-service, yum installation, some other pip, R and apt improvements
     add b1e2372  [DLAB-1966]: fixed R package installation for dataengine-service, yum installation, some other pip, R and apt improvements
     add 6e72bbf  Merge branch 'DLAB-1966' of https://github.com/apache/incubator-dlab into DLAB-1966
     add 554c79a  [DLAB-1966]: added removal of apt package from it`s dependencies list
     add 587a644  [DLAB-1966]: removed '***' from available versions list
     add 9958adc  [DLAB-1966]: added additional package installation for gcp
     add 37b4315  [DLAB-1966]: added additional package installation for gcp
     add b827eca  [DLAB-1966]: for R status invalid_version is returned only if list of available versions has been obtained
     add e2181c1  Merge pull request #837 from apache/DLAB-1966
     add 18088c6  [DLAB-298] Updated error message
     add 11f4441  Updated coverage exclusion for sonar
     add 5b5cd54  Updated coverage exclusion for sonar
     add 4d9475b  [DLAB-1964]: Limited project quota (#838)
     add f6593b2  Merge remote-tracking branch 'origin/develop' into develop
     add 3dec71f  Updated name of classes/interfaces
     add 038682b  [DLAB-1973] Conveyed dependency for custom image
     add 9967ea3  Updated coverage exclusion for sonar
     add e76e167  [DLAB-1916] Cluster version (#831)
     add d288aa5  Annotated the "MetadataHolder" interface with the @FunctionalInterface annotation
     add fd4ed06  Annotated the "CmdCommand" interface with the FunctionalInterface annotation
     add 0877072  Removed unnecessary field
     add c370d06  Annotated the "AccessKeyService" interface with the FunctionalInterface annotation
     add 21c4933  Created test for BucketServiceImpl
     add d330f61  Removed method to simply inherit it.
     add 203c99a  Sonar code smell changes
     add 074f5bf  Sonar code smell changes
     add d8a3478  [DLAB-1715]: Notification if project quota is exceeded (#836)
     add a493c9c  Merge remote-tracking branch 'origin/develop' into develop
     add 6a76d22  [DLAB-1971]: UI changes for all pages (part2) (#839)
     add d01594a  [DLAB-1969]: Added possibility to switch between project on list of resources (#840)
     add ab8eb5e  Created test for ProjectServiceImpl
     add 223653d  Updated test for ProjectServiceImpl
     add 0c997c2  [DLAB-515]: Changed Ubuntu AMI to 18.04
     add d3db17b  [DLAB-515]: fixed issue with Ubuntu version change
     add 7f777c6  [DLAB-515]: fixed issue with Ubuntu version change
     add 909b117  [DLAB-515]: fixed issue with Ubuntu version change
     add b6ea36f  [DLAB-515]: fixed issue with Ubuntu version change
     add 0738b69  [DLAB-515]: fixed issue with Ubuntu version change
     add eefcfeb  [DLAB-515]: fixed issue with Ubuntu version change
     add 9395093  [DLAB-515]: [AWS] OpenResty implemented
     add 8ad1aa2  [DLAB-515]: [AWS] Notebook creation fixed
     add 197d78e  [DLAB-515]: [AWS] Notebook creation fixed
     add 46bd2f8  [DLAB-515]: [GCP] Ubuntuversion changed to 18.04
     add 22f21bb  [DLAB-515]: [GCP] Ubuntu version changed
     add 015903d  [DLAB-515]: [Azure] Ubuntu version updated
     add 6c9a325  [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
     add b74c4a8  [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
     add 6e1b85b  [DLAB-515]: EDGE as NAT configuration implemented
     add 01002f2  [DLAB-515]: EDGE as NAT configuration fixed / EMR version updated
     add 746afef  [DLAB-515]: EDGE as NAT configuration fixed
     add 098c95e  [DLAB-515] - nftables.conf fixed
     add 13ec57c  DLAB-1799 added parameter in tensorboard.service, changed numpy version for python 2.7, added setuptools version to dlab.ini that is necessary for tensorboard
     add 360838b  [DLAB-515]: Dataengine creation fixed
     add 85d6533  [DLAB-1799]: fixed typo
     add 94dad59  [DLAB-1799]: fixed error
     add 9c27826  [DLAB-515]: Toree version updated
     add 01594c1  [DLAB-515]: Toree version fixed/ Docker ubuntu version updated/ Docker pip version updated
     add b9cb267  [DLAB-515]- Jupyter kernels connection fixed
     add f9424d8  [DLAB-515]- Jupyter remote kernels fixed
     add a6bb453  [DLAB-515]- Rstudio fixed
     add e55e6bc  [DLAB-515]- Rstudio fixed
     add 0892292  [DLAB-515]- Rstudio fixed
     add 219564b  [DLAB-515]- Rstudio fixed
     add bbd95aa  [DLAB-515]- Ubuntu 18.04 for container updated/ pip v20.1 for containers updated/ toree v0.3.0 for all clouds updated
     add 881b2dc  [DLAB-1850]: added arg to jupyterlab docker build command
     add 2e177e6  [DLAB-1827]: increased primary disk size to 14G as with 12 tensorflow with jupyter creation failed
     add 20f5e9b  [DLAB-1827]: increased primary disk size to 16G
     add 2377860  [DLAB-515] - [GCP] Dataproc version updated
     add 7b972e3  [DLAB-1825]: added possibility to enable warn_only for manage_pkg
     add d8561cb  [DLAB-515] - [GCP] Dataproc on Jupyter and Zeppelin creation fixed
     add 012ff0f  [DLAB-515] - Python version 3.5 changed for 3.6 for library packages
     add 7c1730a  [DLAB-515] - Dataproc version fixed
     add b3a9f2c  [DLAB-515] - GPG update disabled/HTTPS proxy for apt added
     add 717c402  [DLAB-515] - dataproc fixed
     add 17101bb  [DLAB-515] - GPG key renewal changed
     add 5d9b574  [DLAB-1855]: changed pip install
     add 07de2c9  [DLAB-1855]: changed pip2 installation
     add fd31c7c  [DLAB-1855]: added pip3 pip2 upgrade
     add cae7158  [DLAB-515] - dataengine-service libs installing fixed
     add 0339fb3  [DLAB-1856]: added R-devel package installation during cluster creation
     add 995b1de  [DLAB-1855]: changed pip update during dataengine service creation
     add 163c8b7  [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy implemented
     add 8bed136  Update fab.py
     add 4dcf89c  [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy fixed
     add 02aa350  [DLAB-515] - [GCP] EDGE node as NAT implemented, [GCP] Dataproc kernels connection via sparkmagic/livy implemented, [AWS] [GCP] [Azure] Sprk Cluster connection via sparkmagic/livy implemented
     add ef0d07a  [DLAB-515] [AWS] [GCP] Dataengine/Dataengine-service kernel removing fixed
     add d5307d2  [DLAB-515]: Changed Ubuntu AMI to 18.04
     add 3df3619  [DLAB-515]: fixed issue with Ubuntu version change
     add 97e2b7f  [DLAB-515]: fixed issue with Ubuntu version change
     add c859336  [DLAB-515]: fixed issue with Ubuntu version change
     add 59800e4  [DLAB-515]: fixed issue with Ubuntu version change
     add b7a4e4f  [DLAB-515]: fixed issue with Ubuntu version change
     add 560c223  [DLAB-515]: fixed issue with Ubuntu version change
     add 1c43eb9  [DLAB-515]: fixed issue with Ubuntu version change
     add 01c8213  [DLAB-515]: fixed issue with Ubuntu version change
     add 7415f61  [DLAB-515]: fixed issue with Ubuntu version change
     add 0a267fb  [DLAB-515]: [AWS] OpenResty implemented
     add c722d73  [DLAB-515]: [AWS] Notebook creation fixed
     add 6e6e0ad  [DLAB-515]: [AWS] Notebook creation fixed
     add ae07eb2e [DLAB-515]: [GCP] Ubuntuversion changed to 18.04
     add 9642ba4  [DLAB-515]: [GCP] Ubuntu version changed
     add 7a35c31  [DLAB-515]: [Azure] Ubuntu version updated
     add b5ee9e8  [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
     add da70c67  [DLAB-515]: Notebooks deploing fixed/Hrrps_proxy added
     add 1428f9a  [DLAB-515]: EDGE as NAT configuration implemented
     add ec13ff1  [DLAB-515]: EDGE as NAT configuration fixed / EMR version updated
     add 03e7935  [DLAB-515] Fixed jupyterlab image
     add b2e61b8  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add d53b2a9  [DLAB-515]: EDGE as NAT configuration fixed
     add 8163a43  [DLAB-515] - nftables.conf fixed
     add 9a884b5  DLAB-1799 added parameter in tensorboard.service, changed numpy version for python 2.7, added setuptools version to dlab.ini that is necessary for tensorboard
     add 5849b09  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add 3ede45c  [DLAB-515]: Dataengine creation fixed
     add 5a2b871  [DLAB-1799]: fixed typo
     add 849afef  Merge branch 'DLAB-515' of https://github.com/apache/incubator-dlab into DLAB-515
     add 178b0c4  [DLAB-1799]: fixed error
     add d51d314  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add 35eb846  [DLAB-515]: Toree version updated
     add 50de7a6  [DLAB-515]: Toree version fixed/ Docker ubuntu version updated/ Docker pip version updated
     add e0bba64  Merge branch 'develop' into DLAB-515
     add 694edd7  [DLAB-515]- Jupyter kernels connection fixed
     add 2113a07  [DLAB-515]- Jupyter remote kernels fixed
     add 6c0f1c7  [DLAB-515]- Rstudio fixed
     add c837db6  [DLAB-515]- Rstudio fixed
     add 8360a15  [DLAB-515]- Rstudio fixed
     add 010f6f8  [DLAB-515]- Rstudio fixed
     add 3178abb  [DLAB-515]- Ubuntu 18.04 for container updated/ pip v20.1 for containers updated/ toree v0.3.0 for all clouds updated
     add 93a219f  [DLAB-1850]: added arg to jupyterlab docker build command
     add b86160e  Merge pull request #777 from apache/DLAB-1850
     add 21d56f8  [DLAB-1827]: increased primary disk size to 14G as with 12 tensorflow with jupyter creation failed
     add ddf336f  Merge pull request #778 from apache/DLAB-1827
     add 91a492a  [DLAB-1827]: increased primary disk size to 16G
     add ab58e4b  [DLAB-515] - [GCP] Dataproc version updated
     add 5d80f34  [DLAB-1825]: added possibility to enable warn_only for manage_pkg
     add dd3cbd9  Merge pull request #783 from apache/DLAB-1825
     add 560e9d2  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add a28ff32  [DLAB-515] - [GCP] Dataproc on Jupyter and Zeppelin creation fixed
     add 3600b1a  [DLAB-515] - Python version 3.5 changed for 3.6 for library packages
     add 91c734f  [DLAB-515] - Dataproc version fixed
     add a6ebe55  [DLAB-515] - GPG update disabled/HTTPS proxy for apt added
     add 873bab8  [DLAB-515] - dataproc fixed
     add a45445c  [DLAB-515] - GPG key renewal changed
     add 6662b81  [DLAB-1855]: changed pip install
     add c881a67  [DLAB-1855]: changed pip2 installation
     add 5eaa170  [DLAB-1855]: added pip3 pip2 upgrade
     add 1bcf291  [DLAB-1855]: changed return in case of error during pip pkg installation
     add 7998afa  Merge pull request #795 from apache/DLAB-1855
     add 2f3ec2e  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add c0aae69  [DLAB-515] - dataengine-service libs installing fixed
     add 7b4e6d9  [DLAB-1856]: added R-devel package installation during cluster creation
     add cf0cf20  Merge pull request #797 from apache/DLAB-1856
     add a33f75d  [DLAB-1855]: changed pip update during dataengine service creation
     add be4a83a  [DLAB-1855]: changed pip update during dataengine service creation
     add bdd1176  Merge branch 'DLAB-1855' of https://github.com/apache/incubator-dlab into DLAB-1855
     add d487864  Merge pull request #798 from apache/DLAB-1855
     add 3521c5f  [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy implemented
     add 9b5f77a  Update fab.py
     add 8b86370  [DLAB-515] - [AWS] EMR kernels connection via sparkmagic/livy fixed
     add dc8e24c  [DLAB-515] - [GCP] EDGE node as NAT implemented, [GCP] Dataproc kernels connection via sparkmagic/livy implemented, [AWS] [GCP] [Azure] Sprk Cluster connection via sparkmagic/livy implemented
     add e7eeec5  Merge remote-tracking branch 'origin/DLAB-515' into DLAB-515
     add 4b85cc7  [DLAB-515] Deployment fixed
     add fb6c895  [DLAB-515] [GCP] Datapoc v. 1.4 changed
     add e5540a2  [DLAB-515] Dataengine kernels removing fixed
     add 834cf62  [DLAB-1810]: fixed some versions
     add 0f92ecb  [DLAB-1810]: fixed some versions
     add 638350c  [DLAB-1810]: changed cmake version
     add 8bb04b9  [DLAB-1810]: changed caffe2 version
     add d9c40f5  [DLAB-1810]: temporarily turned of instance deletion on failure
     add 6205a03  [DLAB-1810]: changed caffe2 version and how it is installed
     add 22c905d  [DLAB-1810]: added fix for torch
     add 825ffbf  [DLAB-1810]: moved pytorch_branch as variable to dlab.ini
     add 40f1909  [DLAB-1810]: uncommented superset instance removal on failure
     add eb536dd  [DLAB-1810]: changed torch git repository link
     add a355d9c  [DLAB-1810]: changed cntk version
     add 9f21179  [DLAB-1810]: changed cntk version and link
     add 3437ed2  [DLAB-1810]: changed mxnet version
     add 7dc705a  [DLAB-1810]: added cntk version for py2
     add 802675a  [DLAB-1810]: changed cntk-gpu link
     add 4c1ee4f  [DLAB-1810]: added some luarocks dependencies
     add 0082910  [DLAB-1810]: increased wait time during reboot to 180, with wait=150 script exited on gcp
     add 9f56486  [DLAB-1810]: commented torch related code
     add f3a405a  [DLAB-1810]: disabled iTorch installation
     add 8dbacee  Merge pull request #835 from apache/DLAB-1810
     add b45fecb  [DLAB-515] JAVA_HOME for Zeppelin/Spark added
     add 44f4fbf  Merge branch 'develop' into DLAB-515
     add c79b3a6  [DLAB-515] dataengine cluster json fixed
     add d8d24bd  [DLAB-515] [GCP] Dadaproc deployment fixed
     add e32996b  Merge pull request #841 from apache/DLAB-515
     add 401da28  [DLAB-1970]: Changed validation for folder creation an other small changes (#843)
     add e709696  [DLAB-1662]: Fixed notebook position if user applies any action for it (#844)
     add 219e9fb  Merge branch 'develop' into DLAB-1594-2

No new revisions were added by this update.

Summary of changes:
 .../scripts/deploy_repository/deploy_repository.py |  10 +-
 .../scripts/jenkins/sonar.py                       |  33 +-
 .../src/dataengine/scripts/configure_dataengine.py |  29 +-
 .../scripts/configure_deep_learning_node.py        |  28 +-
 .../src/general/conf/dlab.ini                      |  46 ++-
 .../src/general/files/aws/base_Dockerfile          |   4 +-
 .../files/aws/dataengine-service_description.json  |   4 +-
 .../src/general/files/aws/dataengine_Dockerfile    |   2 +
 .../src/general/files/aws/deeplearning_Dockerfile  |   3 +-
 .../src/general/files/aws/jupyter_Dockerfile       |   3 +-
 .../src/general/files/aws/jupyterlab_Dockerfile    |   2 +-
 .../src/general/files/azure/base_Dockerfile        |   4 +-
 .../src/general/files/azure/dataengine_Dockerfile  |   2 +
 .../general/files/azure/deeplearning_Dockerfile    |   2 +-
 .../src/general/files/azure/jupyter_Dockerfile     |   2 +-
 .../src/general/files/azure/jupyterlab_Dockerfile  |   2 +-
 .../src/general/files/gcp/base_Dockerfile          |   4 +-
 .../files/gcp/dataengine-service_description.json  |   3 +-
 .../src/general/files/gcp/dataengine_Dockerfile    |   2 +
 .../src/general/files/gcp/deeplearning_Dockerfile  |   2 +-
 .../src/general/files/gcp/jupyter_Dockerfile       |   3 +-
 .../src/general/files/gcp/jupyterlab_Dockerfile    |   2 +-
 .../src/general/files/gcp/ssn_policy.json          |   4 +-
 .../src/general/lib/aws/actions_lib.py             |  31 ++
 .../src/general/lib/azure/actions_lib.py           |   4 +
 .../src/general/lib/gcp/actions_lib.py             |  35 ++
 .../src/general/lib/gcp/meta_lib.py                |  19 +
 .../src/general/lib/os/debian/common_lib.py        |  73 ++--
 .../src/general/lib/os/debian/edge_lib.py          | 111 +++---
 .../src/general/lib/os/debian/notebook_lib.py      | 189 +++++----
 .../src/general/lib/os/debian/ssn_lib.py           |   4 +-
 .../src/general/lib/os/fab.py                      | 153 +++++---
 .../src/general/lib/os/redhat/notebook_lib.py      |  73 +++-
 .../general/scripts/aws/common_create_subnet.py    |  27 +-
 .../general/scripts/aws/common_prepare_notebook.py |   2 +-
 .../scripts/aws/dataengine-service_configure.py    |   6 +-
 .../scripts/aws/dataengine-service_jars_parser.py  |   2 +-
 .../src/general/scripts/aws/edge_configure.py      |  34 ++
 .../edge_configure_route_table.py}                 |  18 +-
 .../jupyter_dataengine-service_create_configs.py   |  69 +++-
 .../jupyter_install_dataengine-service_kernels.py  |  24 +-
 .../src/general/scripts/aws/project_prepare.py     |  44 +++
 ...create_bucket.py => common_create_nat_route.py} |  39 +-
 .../general/scripts/gcp/common_prepare_notebook.py |   2 +-
 .../scripts/gcp/dataengine-service_jars_parser.py  |   2 +-
 .../scripts/gcp/dataengine-service_prepare.py      |   2 +
 .../src/general/scripts/gcp/edge_configure.py      |  19 +
 .../jupyter_dataengine-service_create_configs.py   |  57 ++-
 .../jupyter_install_dataengine-service_kernels.py  |  24 +-
 .../src/general/scripts/gcp/project_prepare.py     |  38 ++
 .../general/scripts/os/common_clean_instance.py    |   2 +-
 .../scripts/os/common_configure_reverse_proxy.py   |   4 +-
 .../os/deeplearning_dataengine_create_configs.py   |   6 +-
 .../general/scripts/os/get_list_available_pkgs.py  |   2 +-
 .../general/scripts/os/install_additional_libs.py  |  21 +-
 .../os/jupyter_dataengine_create_configs.py        |  65 +++-
 .../os/jupyter_install_dataengine_kernels.py       |  17 +-
 .../scripts/os/jupyterlab_container_start.py       |   2 +-
 .../scripts/os/tensor_dataengine_create_configs.py |   6 +-
 .../os/zeppelin_dataengine_create_configs.py       |   4 +-
 .../templates/gcp/dataengine-service_cluster.json  |  12 +-
 .../templates/os/debian/livy.service}              |  14 +-
 .../.env => general/templates/os/livy-env.sh}      |   8 +-
 .../templates/os/py3spark_local_template.json      |   6 +-
 .../templates/os/sparkmagic_config_template.json   |  20 +
 .../src/general/templates/os/tensorboard.service   |   2 +-
 .../src/jupyter/scripts/configure_jupyter_node.py  |   2 +-
 .../scripts/configure_jupyterlab_node.py           |   2 +-
 ...nfigure_http_proxy.py => configure_nftables.py} |  10 +-
 .../src/project/templates/nftables.conf            |  22 ++
 .../src/project/templates/nginx.conf               |  29 +-
 .../src/ssn/scripts/configure_docker.py            |   8 +-
 .../src/ssn/scripts/configure_ssn_node.py          |  10 +
 .../zeppelin/scripts/configure_zeppelin_node.py    |   8 +
 .../aws/computational_resources/main/main.tf       |  27 +-
 .../aws/computational_resources/main/variables.tf  |  21 +
 .../terraform/aws/endpoint/main/bucket.tf          |  54 +--
 .../ssn-helm-charts/main/step-ca-chart/.helmignore |  21 +
 .../ssn-helm-charts/main/step-ca-chart/Chart.yaml  |  23 +-
 .../main/step-ca-chart/templates/_helpers.tpl      |  21 +
 .../main/step-ca-chart/templates/bootstrap.yaml    |  47 ++-
 .../main/step-ca-chart/templates/ca.yaml           | 203 +++++-----
 .../main/step-ca-chart/templates/configmaps.yaml   | 117 +++---
 .../main/step-ca-chart/templates/ingress.yaml      |  63 ++-
 .../main/step-ca-chart/templates/rbac.yaml         |  23 +-
 .../main/step-ca-chart/templates/secrets.yaml      |  21 +
 .../main/step-ca-chart/templates/service.yaml      |  35 +-
 .../templates/tests/test-connection.yaml           |  27 +-
 .../ssn-helm-charts/main/step-ca-chart/values.yaml |  25 +-
 .../terraform/bin/deploy/billing_app_aws.yml       |  21 +
 .../terraform/bin/deploy/billing_azure.yml         |  21 +
 .../terraform/bin/deploy/billing_gcp.yml           |  21 +
 .../terraform/bin/deploy/endpoint_fab.py           |  29 +-
 infrastructure-provisioning/terraform/bin/dlab.py  |  20 +-
 .../terraform/bin/terraform-cli.py                 |  31 +-
 .../terraform/gcp/endpoint/provisioning.py         |  25 +-
 .../terraform/gcp/main/main.tf                     |  29 +-
 .../terraform/gcp/main/variables.tf                |  21 +
 .../terraform/gcp/modules/common/iam.tf            |  25 +-
 .../terraform/gcp/modules/common/network.tf        |  29 +-
 .../terraform/gcp/modules/common/variables.tf      |  21 +
 .../terraform/gcp/modules/data_engine/instance.tf  |  28 +-
 .../terraform/gcp/modules/data_engine/variables.tf |  21 +
 .../terraform/gcp/modules/dataproc/instance.tf     |  83 ++--
 .../terraform/gcp/modules/dataproc/variables.tf    |  21 +
 .../terraform/gcp/modules/notebook/instance.tf     |  23 +-
 .../terraform/gcp/modules/notebook/variables.tf    |  21 +
 .../helm_charts/files/get_configmap_values.sh      |  21 +
 .../modules/helm_charts/step-ca-chart/.helmignore  |  21 +
 .../modules/helm_charts/step-ca-chart/Chart.yaml   |  23 +-
 .../step-ca-chart/templates/_helpers.tpl           |  21 +
 .../step-ca-chart/templates/bootstrap.yaml         |  47 ++-
 .../helm_charts/step-ca-chart/templates/ca.yaml    | 203 +++++-----
 .../step-ca-chart/templates/configmaps.yaml        | 117 +++---
 .../step-ca-chart/templates/ingress.yaml           |  62 ++-
 .../helm_charts/step-ca-chart/templates/rbac.yaml  |  23 +-
 .../step-ca-chart/templates/secrets.yaml           |  21 +
 .../step-ca-chart/templates/service.yaml           |  35 +-
 .../templates/tests/test-connection.yaml           |  27 +-
 .../modules/helm_charts/step-ca-chart/values.yaml  |  25 +-
 .../dlab/login/resources/css/login.css             |  19 +
 .../keycloak-theme/dlab/login/theme.properties     |  33 +-
 integration-tests-cucumber/pom.xml                 |  19 +
 .../main/java/org/apache/dlab/dto/EndpointDTO.java |  19 +
 .../java/org/apache/dlab/mongo/MongoDBHelper.java  |  19 +
 .../java/org/apache/dlab/util/JacksonMapper.java   |  19 +
 .../java/org/apache/dlab/util/PropertyHelper.java  |  19 +
 .../src/test/java/dlab/Constants.java              |  19 +
 .../src/test/java/dlab/RunCucumberTest.java        |  19 +
 .../src/test/java/dlab/endpoint/EndpointSteps.java |  19 +
 .../src/test/java/dlab/login/LoginSteps.java       |  19 +
 .../src/test/resources/config.properties           |  18 +
 .../src/test/resources/dlab/endpoint.feature       |  18 +
 .../src/test/resources/dlab/login.feature          |  18 +
 .../scenario_deeplearning/deeplearning_tests.py    |  12 +-
 .../test_templates/rstudio/template_preparation.r  |  17 +
 .../rstudio/template_visualization.r               |  17 +
 pom.xml                                            |  46 ++-
 .../main/java/com/epam/dlab/BillingService.java    |   1 +
 .../billing-aws/src/main/resources/application.yml |  21 +
 .../azure/AzureInvoiceCalculationService.java      |   2 -
 .../billing/azure/CalculateBillingService.java     |   1 +
 .../dlab/billing/azure/config/SecurityConfig.java  |   2 +-
 .../src/main/resources/application.yml             |  21 +
 services/billing-gcp/billing.yml                   |  21 +
 .../epam/dlab/billing/gcp/conf/SecurityConfig.java |   4 +-
 .../com/epam/dlab/billing/gcp/dao/BillingDAO.java  |   3 +-
 .../billing/gcp/dao/impl/BigQueryBillingDAO.java   |  11 +-
 .../dlab/billing/gcp/model/BillingHistory.java     |  19 +
 .../gcp/repository/BillingHistoryRepository.java   |  19 +
 .../dlab/billing/gcp/service/BillingService.java   |   3 +-
 .../billing-gcp/src/main/resources/application.yml |  21 +
 .../dlab/auth/conf/AzureLoginConfiguration.java    |  39 --
 .../epam/dlab/auth/conf/GcpLoginConfiguration.java |  33 --
 .../src/main/java/com/epam/dlab/MongoKeyWords.java |  30 --
 .../epam/dlab/dto/base/project/ProjectResult.java  |  19 +
 .../computational/UserComputationalResource.java   |   4 +
 .../dlab/dto/exploratory/ExploratoryCreateDTO.java |   3 +
 .../dlab/dto/exploratory/ExploratoryGitCreds.java  |   4 +-
 .../dlab/dto/exploratory/ExploratoryImageDTO.java  |   1 +
 .../epam/dlab/dto/exploratory/LibInstallDTO.java   |   5 +
 .../com/epam/dlab/dto/exploratory/LibStatus.java   |   3 +-
 .../epam/dlab/dto/project/ProjectActionDTO.java    |  19 +
 .../epam/dlab/dto/project/ProjectCreateDTO.java    |  19 +
 .../main/java/com/epam/dlab/model/StringList.java  |  35 +-
 .../java/com/epam/dlab/model/aws/ReportLine.java   |  17 +-
 .../java/com/epam/dlab/model/library/Library.java  |   6 +
 .../main/java/com/epam/dlab/util/FileUtils.java    |   2 +-
 .../main/java/com/epam/dlab/util/ServiceUtils.java |  66 ++--
 .../java/com/epam/dlab/util/UsernameUtils.java     |   6 +-
 .../src/main/java/com/epam/dlab/ModuleBase.java    |  22 +-
 .../src/main/java/com/epam/dlab/auth/UserInfo.java |  53 ++-
 .../java/com/epam/dlab/rest/contracts/EdgeAPI.java |  28 --
 services/provisioning-service/pom.xml              |  14 +
 .../DropwizardBearerTokenFilterImpl.java           |  19 +
 ...rovisioningServiceApplicationConfiguration.java |   1 +
 .../backendapi/{ => conf}/CloudConfiguration.java  |   2 +-
 .../epam/dlab/backendapi/core/MetadataHolder.java  |   1 +
 .../dlab/backendapi/core/commands/CmdCommand.java  |   1 +
 .../backendapi/core/commands/CommandBuilder.java   |   2 +-
 .../core/commands/CommandExecutorMockAsync.java    |  11 +-
 .../core/response/folderlistener/WatchItem.java    |  20 +-
 .../response/handlers/ProjectCallbackHandler.java  |  23 +-
 .../handlers/dao/FileSystemCallbackHandlerDao.java |   6 +-
 .../dlab/backendapi/resources/ProjectResource.java |  19 +
 .../resources/ProvisioningHealthCheckResource.java |   2 -
 .../backendapi/resources/aws/EdgeResourceAws.java  |   7 +-
 .../resources/azure/EdgeResourceAzure.java         |   7 +-
 .../backendapi/resources/gcp/EdgeResourceGcp.java  |   7 +-
 .../dlab/backendapi/service/ProjectService.java    |  19 +
 .../service/impl/CheckInactivityServiceImpl.java   |   2 +-
 .../dlab/backendapi/service/impl/KeyService.java   |   2 +-
 .../service/impl/ProjectServiceImpl.java           |  47 ++-
 .../service/impl/aws/BucketServiceAwsImpl.java     | 113 +++---
 .../service/impl/azure/BucketServiceAzureImpl.java |   8 +-
 .../service/impl/gcp/BucketServiceGcpImpl.java     |  10 +-
 .../dlab/process/builder/ProcessInfoBuilder.java   |  17 +-
 services/self-service/entrypoint.sh                |  21 +
 services/self-service/pom.xml                      |  11 +
 .../epam/dlab/backendapi/annotation/Project.java   |  19 +
 .../backendapi/auth/KeycloakAuthenticator.java     |  31 +-
 .../filters/DropwizardBearerTokenFilterImpl.java   |  19 +
 .../dlab/backendapi/conf/CloudConfiguration.java   |  21 +-
 .../backendapi/conf/KeycloakConfiguration.java     |  19 +
 .../com/epam/dlab/backendapi/dao/AuditDAOImpl.java |   4 +-
 .../dao/{BackupDao.java => BackupDAO.java}         |   2 +-
 .../dao/{BackupDaoImpl.java => BackupDAOImpl.java} |   2 +-
 .../epam/dlab/backendapi/dao/BaseBillingDAO.java   |   7 +
 .../dlab/backendapi/dao/ExploratoryLibDAO.java     |   2 +
 ...xploratoryDao.java => ImageExploratoryDAO.java} |   2 +-
 ...ryDaoImpl.java => ImageExploratoryDAOImpl.java} |  16 +-
 .../com/epam/dlab/backendapi/dao/ProjectDAO.java   |  19 +
 .../epam/dlab/backendapi/dao/ProjectDAOImpl.java   |  32 +-
 .../com/epam/dlab/backendapi/dao/SecurityDAO.java  |  44 +--
 .../dao/{UserGroupDao.java => UserGroupDAO.java}   |   4 +-
 ...UserGroupDaoImpl.java => UserGroupDAOImpl.java} |   2 +-
 .../dao/{UserRoleDao.java => UserRoleDAO.java}     |   2 +-
 .../{UserRoleDaoImpl.java => UserRoleDAOImpl.java} |   5 +-
 .../dlab/backendapi/domain/CreateProjectDTO.java   |  19 +
 .../epam/dlab/backendapi/domain/EndpointDTO.java   |   1 -
 .../epam/dlab/backendapi/domain/ProjectDTO.java    |  19 +
 .../dlab/backendapi/domain/ProjectEndpointDTO.java |  19 +
 .../backendapi/domain/UpdateProjectBudgetDTO.java  |  19 +
 .../dlab/backendapi/domain/UpdateProjectDTO.java   |  19 +
 .../dropwizard/bundles/DlabKeycloakBundle.java     |  20 +-
 .../dropwizard/listeners/MongoStartupListener.java |  29 +-
 .../listeners/RestoreHandlerStartupListener.java   |   2 +-
 .../backendapi/healthcheck/MongoHealthCheck.java   |   2 +-
 .../interceptor/BudgetLimitInterceptor.java        |  11 -
 .../epam/dlab/backendapi/modules/DevModule.java    |  24 +-
 .../dlab/backendapi/modules/ProductionModule.java  |  24 +-
 .../resources/ImageExploratoryResource.java        |   2 +-
 .../backendapi/resources/KeycloakResource.java     |  24 +-
 .../resources/LibExploratoryResource.java          |   1 -
 .../dlab/backendapi/resources/ProjectResource.java |  33 +-
 .../resources/callback/GitCredsCallback.java       |   3 -
 .../resources/callback/LibraryCallback.java        |   2 -
 .../resources/callback/ProjectCallback.java        |  19 +
 .../resources/callback/ReuploadKeyCallback.java    |   2 -
 .../dlab/backendapi/resources/dto/KeysDTO.java     |  25 +-
 .../resources/dto/ProjectActionFormDTO.java        |  19 +
 .../com/epam/dlab/backendapi/roles/UserRole.java   |   8 +-
 .../schedulers/billing/BillingScheduler.java       |   2 +-
 .../endpoint/CheckEndpointStatusScheduler.java     |   2 +-
 .../dlab/backendapi/service/AccessKeyService.java  |   2 +-
 .../dlab/backendapi/service/EndpointService.java   |  19 +
 .../backendapi/service/ExternalLibraryService.java |   1 +
 .../dlab/backendapi/service/GuacamoleService.java  |  20 +
 .../dlab/backendapi/service/KeycloakService.java   |  22 ++
 .../backendapi/service/KeycloakServiceImpl.java    |  30 +-
 .../dlab/backendapi/service/ProjectService.java    |  41 +-
 .../backendapi/service/ReuploadKeyService.java     |   3 +-
 .../dlab/backendapi/service/SecurityService.java   |  19 +
 .../backendapi/service/SecurityServiceImpl.java    |  19 +
 .../dlab/backendapi/service/SystemInfoService.java |   1 +
 .../epam/dlab/backendapi/service/TagService.java   |  20 +
 .../dlab/backendapi/service/TagServiceImpl.java    |  21 +-
 .../backendapi/service/UserRoleServiceImpl.java    |   4 +-
 .../backendapi/service/impl/BackupServiceImpl.java |   4 +-
 .../service/impl/BillingServiceImpl.java           |  44 +--
 .../backendapi/service/impl/BucketServiceImpl.java |  17 +-
 .../service/impl/ComputationalServiceImpl.java     |   3 +-
 .../service/impl/EndpointServiceImpl.java          | 107 +++---
 .../service/impl/ExploratoryServiceImpl.java       |  17 +-
 .../service/impl/GuacamoleServiceImpl.java         |  25 +-
 .../service/impl/ImageExploratoryServiceImpl.java  |  38 +-
 .../impl/InfrastructureTemplateServiceImpl.java    |  10 +-
 .../service/impl/MavenCentralLibraryService.java   |   6 +-
 .../service/impl/ProjectServiceImpl.java           | 141 ++++---
 .../service/impl/UserGroupServiceImpl.java         |  19 +-
 .../servlet/guacamole/GuacamoleServlet.java        |  37 +-
 .../epam/dlab/backendapi/util/CSVFormatter.java    |  24 +-
 .../epam/dlab/backendapi/util/KeycloakUtil.java    |  43 ++-
 .../validation/annotation/LibNameValid.java        |   3 +-
 .../src/main/resources/webapp/browserslist         |  23 +-
 .../manage-environment-dilog.component.html        |  16 +-
 .../manage-environment-dilog.component.scss        |   3 +-
 .../manage-environment-dilog.component.ts          |  10 +-
 .../management-grid/management-grid.component.html |   4 +-
 .../management-grid/management-grid.component.scss |  62 ++-
 .../management/management.component.html           |   2 +-
 .../project-list/project-list.component.scss       |  11 +-
 .../administration/project/project.component.html  |   2 +-
 .../src/app/core/interceptors/error.interceptor.ts |   3 +-
 .../src/app/core/pipes/keys-pipe/keys.pipe.ts      |   2 +-
 .../underscoreless-pipe/underscoreless.pipe.ts     |   2 +-
 .../services/applicationServiceFacade.service.ts   |   9 +
 .../webapp/src/app/core/services/audit.service.ts  |  19 +
 .../app/core/services/bucket-browser.service.ts    |  19 +
 .../src/app/core/services/healthStatus.service.ts  |   8 +
 .../core/services/librariesInstallation.service.ts |   1 -
 .../resources/webapp/src/app/core/util/patterns.ts |   2 +-
 .../audit/audit-grid/audit-grid.component.html     |  73 ++--
 .../audit/audit-grid/audit-grid.component.scss     |  79 ++--
 .../audit/audit-grid/audit-grid.component.ts       |   7 +-
 .../audit-toolbar/audit-toolbar.component.html     |   4 +-
 .../audit-toolbar/audit-toolbar.component.scss     |  76 +---
 .../audit/audit-toolbar/audit-toolbar.component.ts |  34 +-
 .../src/app/reports/audit/audit.component.ts       |   8 +-
 .../src/app/reports/audit/filter-audit.model.ts    |  19 +
 .../reporting-grid/reporting-grid.component.html   |  93 ++++-
 .../reporting-grid/reporting-grid.component.scss   | 121 ++++--
 .../reporting-grid/reporting-grid.component.ts     |  49 ++-
 .../reporting/toolbar/toolbar.component.html       |   2 +-
 .../reporting/toolbar/toolbar.component.scss       |  76 ----
 .../reports/reporting/toolbar/toolbar.component.ts |  33 +-
 .../bucket-browser/bucket-browser.component.html   |   5 +-
 .../bucket-browser/bucket-browser.component.scss   |   9 +-
 .../bucket-browser/bucket-browser.component.ts     |  39 +-
 .../bucket-browser/bucket-data.service.ts          |  37 +-
 .../buckets-tree/bucket-tree.component.html        |  21 +-
 .../buckets-tree/bucket-tree.component.scss        |  19 +-
 .../buckets-tree/bucket-tree.component.ts          |  19 +
 .../folder-tree/folder-tree.component.html         |  23 +-
 .../folder-tree/folder-tree.component.scss         |  18 +
 .../folder-tree/folder-tree.component.ts           |  21 +-
 ...utational-resource-create-dialog.component.html |   2 +-
 ...mputational-resource-create-dialog.component.ts |   2 +-
 .../computational-resources-list.component.scss    |  46 +--
 .../ami-create-dialog.component.ts                 |   2 +-
 .../cost-details-dialog.component.html             |   3 +-
 .../cost-details-dialog.component.scss             |   3 +-
 .../install-libraries.component.html               | 244 +++++++-----
 .../install-libraries.component.scss               | 198 +++++++---
 .../install-libraries.component.ts                 | 231 ++++++-----
 .../install-libraries/install-libraries.model.ts   |   2 +-
 .../resources-grid/resources-grid.component.html   |  32 +-
 .../resources-grid/resources-grid.component.scss   | 362 +++++++++--------
 .../resources-grid/resources-grid.component.ts     |  43 ++-
 .../src/app/resources/resources.component.html     |  57 +--
 .../src/app/resources/resources.component.ts       |  19 +-
 .../shared/form-controls/dropdowns.component.scss  |   7 +-
 .../multi-level-select-dropdown.component.scss     |   5 +-
 .../confirmation-dialog.component.ts               |   8 +-
 .../notification-dialog.component.ts               |   5 +-
 .../src/app/shared/navbar/navbar.component.ts      | 105 +++--
 .../src/app/webterminal/webterminal.component.html |   2 +-
 .../webapp/src/assets/styles/_dialogs.scss         |   8 +-
 .../webapp/src/assets/styles/_general.scss         |   9 +-
 .../resources/webapp/src/assets/styles/_theme.scss | 204 +++++++++-
 .../webapp/src/assets/styles/_variables.scss       |   2 +
 .../src/main/resources/webapp/src/styles.scss      |  11 +-
 .../backendapi/resources/KeycloakResourceTest.java |  25 +-
 .../resources/LibExploratoryResourceTest.java      |   3 +-
 .../backendapi/resources/ProjectResourceTest.java  | 173 +++++----
 .../epam/dlab/backendapi/resources/TestBase.java   |  17 +-
 .../service/KeycloakServiceImplTest.java           | 135 ++++---
 .../backendapi/service/ProjectServiceImplTest.java | 426 +++++++++++++++++++++
 .../service/UserRoleServiceImplTest.java           |  18 +-
 .../service/impl/AccessKeyServiceImplTest.java     |  66 ++++
 .../service/impl/AuditServiceImplTest.java         | 106 +++++
 .../service/impl/BackupServiceImplTest.java        |  15 +-
 .../service/impl/BucketServiceImplTest.java        | 262 +++++++++++++
 .../impl/ImageExploratoryServiceImplTest.java      |   4 +-
 .../InfrastructureTemplateServiceBaseTest.java     |   4 +-
 .../service/impl/UserGroupServiceImplTest.java     |  42 +-
 356 files changed, 7361 insertions(+), 2759 deletions(-)
 copy services/self-service/src/main/resources/webapp/.editorconfig => infrastructure-provisioning/scripts/jenkins/sonar.py (59%)
 copy infrastructure-provisioning/src/general/scripts/{gcp/common_put_to_bucket.py => aws/edge_configure_route_table.py} (74%)
 copy infrastructure-provisioning/src/general/scripts/gcp/{common_create_bucket.py => common_create_nat_route.py} (59%)
 copy infrastructure-provisioning/src/{zeppelin/templates/livy-server.service => general/templates/os/debian/livy.service} (86%)
 copy infrastructure-provisioning/src/{superset/templates/.env => general/templates/os/livy-env.sh} (83%)
 create mode 100644 infrastructure-provisioning/src/general/templates/os/sparkmagic_config_template.json
 copy infrastructure-provisioning/src/project/scripts/{configure_http_proxy.py => configure_nftables.py} (91%)
 create mode 100644 infrastructure-provisioning/src/project/templates/nftables.conf
 delete mode 100644 services/common/src/main/java/com/epam/dlab/auth/conf/AzureLoginConfiguration.java
 delete mode 100644 services/common/src/main/java/com/epam/dlab/auth/conf/GcpLoginConfiguration.java
 delete mode 100644 services/dlab-webapp-common/src/main/java/com/epam/dlab/rest/contracts/EdgeAPI.java
 rename services/provisioning-service/src/main/java/com/epam/dlab/backendapi/{ => conf}/CloudConfiguration.java (98%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{BackupDao.java => BackupDAO.java} (97%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{BackupDaoImpl.java => BackupDAOImpl.java} (97%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{ImageExploratoryDao.java => ImageExploratoryDAO.java} (97%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{ImageExploratoryDaoImpl.java => ImageExploratoryDAOImpl.java} (90%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{UserGroupDao.java => UserGroupDAO.java} (93%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{UserGroupDaoImpl.java => UserGroupDAOImpl.java} (97%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{UserRoleDao.java => UserRoleDAO.java} (98%)
 rename services/self-service/src/main/java/com/epam/dlab/backendapi/dao/{UserRoleDaoImpl.java => UserRoleDAOImpl.java} (97%)
 create mode 100644 services/self-service/src/test/java/com/epam/dlab/backendapi/service/ProjectServiceImplTest.java
 create mode 100644 services/self-service/src/test/java/com/epam/dlab/backendapi/service/impl/AccessKeyServiceImplTest.java
 create mode 100644 services/self-service/src/test/java/com/epam/dlab/backendapi/service/impl/AuditServiceImplTest.java
 create mode 100644 services/self-service/src/test/java/com/epam/dlab/backendapi/service/impl/BucketServiceImplTest.java


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@dlab.apache.org
For additional commands, e-mail: commits-help@dlab.apache.org