You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datalab.apache.org by lf...@apache.org on 2021/12/02 14:31:24 UTC
[incubator-datalab] branch DATALAB-2629 created (now 65f3408)
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a change to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git.
at 65f3408 Updated RNs
This branch includes the following new commits:
new f802d16 [DATALAB-2629]: removed unnecessary commands
new c517302 [DATALAB-2629]: fixed mongo commands for new pymongo version
new da11b6c updated datalab version in python scripts
new 8d48721 Updated Release notes
new 65f3408 Updated RNs
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 04/05: Updated Release notes
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit 8d487211ae590534c0a2f42a9dd1b2c8245572db
Author: viravit <vi...@epam.com>
AuthorDate: Tue Nov 23 23:11:16 2021 +0200
Updated Release notes
---
RELEASE_NOTES.md | 82 +++++++++++++++++++++++---------------------------------
1 file changed, 33 insertions(+), 49 deletions(-)
diff --git a/RELEASE_NOTES.md b/RELEASE_NOTES.md
index ebda811..733d053 100644
--- a/RELEASE_NOTES.md
+++ b/RELEASE_NOTES.md
@@ -1,62 +1,46 @@
-# DLab is Self-service, Fail-safe Exploratory Environment for Collaborative Data Science Workflow
-
-## New features in v2.4.0
-**All Cloud platforms:**
-- Implemented bucket browser. Now user is able to manage Cloud data source by means of accessing Cloud Blob Storage from DLab Web UI;
-- Added support of audit. Now DLab administrators can view history of all actions;
-- Updated versions of installed software:
- * Ubuntu v.18.04;
- * TensorFlow notebook v.2.1.0;
- * MongoDB v.4.2.
-
-**AWS:**
-- Added support of new version of Data Engine Service (EMR) v.5.30.0 and v.6.0.0.
-
-## Improvements in v2.4.0
-**All Cloud platforms:**
-- Added support of connection via Livy and SparkMagic for Jupyter and RStudio notebooks;
-- Added ability to select multiple resources on 'Environment management' to make user experience easier and more intuitive;
-- Added support to install libraries of particular version from DLab Web UI. Also, now user is able to update/downgrade library via Web UI;
-- Extended billing functionality introducing new entity - monthly project quota(s);
-- Added notifications for cases when project quota is exceeded;
-- Conveyed analytical environment URL's to DLab administration page.
-
-**GCP:**
-- Added possibility to create custom image for notebook.
-
-## Bug fixes in v2.4.0
-**All Cloud platforms:**
-- Fixed a bug when administrative permissions disappeared after endpoint connectivity issues;
-- Fixed a bug when all resources disappeared in 'List of resources' page after endpoint connectivity issues;
-- Fixed a bug when administrative role could not be edited for already existing group;
-- Fixed a bug when billing report was not populated in Safari;
-- Fixed a bug with discrepancies in detailed billing and in-grid billing report.
-
-**GCP:**
-- Fixed a bug when billing was not correctly updated for period overlapping two calendar years;
-
-**Microsoft Azure:**
-- Fixed a rare bug when notebooks or SSN were not always created successfully from the first attempt.
-
-## Known issues in v2.4.0
+# DataLab is Self-service, Fail-safe Exploratory Environment for Collaborative Data Science Workflow
+
+## Improvements in v2.5.1
+**All cloud platforms:**
+- Added GPU filter type and count for easier environment management by administrator;
+- Added explanation for open terminal action on Audit page.
+
+## Bug fixes in v2.5.1
+**Azure:**
+- Fixed a bug when instance creation failed on stage of devtools installation;
+- Fixed a bug when Apache Zeppelin notebook creation failed during shell interpreter configuration;
+- Fixed a bug when edge node status on WEB DataLab UI was not synced up with Cloud instance status;
+- Fixed a bug when DeepLearning creation failed due to wrong path to connector;
+- Fixed a bug when not all billing drop down values were visible;
+- Fixed minor UI issues which were reproduced only for smaller desktop size;
+- Fixed a bug when connection for Jupyter R/Scala kernels were unsuccessful;
+- Fixed a bug when Data Engine creation failed on Jupyter/RStudio/Apache Zeppelin notebooks;
+- Fixed a bug when very often notebook/Data Engine creation and stopping failed due to low level socket;
+- Fixed a bug when Jupyter/RStudio/DeepLearning notebooks creation failed from image;
+- Fixed a bug when SSN/any type of notebook creation was not always successful from the first attempt.
+
+**Azure and GCP:**
+- Fixed a bug when time to time DeepLearning notebook creation failed on stage of nvidia installation;
+- Fixed a bug when sometimes any type of notebook creation failed during disk mount.
+
+## Known issues in v2.5.1
**GCP:**
+- Superset creation fails during configuration???;
- SSO is not available for Superset.
**Microsoft Azure:**
-- Notebook creation fails on RedHat;
-- Web terminal is not working for Notebooks only for remote endpoint.
+- Notebook WEB terminal does not work for remote endpoint.
-*Refer to the following link in order to view the other major/minor issues in v2.4.0:*
+*Refer to the following link in order to view other major/minor issues in v2.5.1*
-[Apache DLab: Known issues](https://issues.apache.org/jira/issues/?filter=12349399 "Apache DLab: Known issues")
+[Apache DataLab: Known issues](https://issues.apache.org/jira/issues/?filter=12351099 "Apache DataLab: Known issues")
-## Known issues caused by cloud provider limitations in v2.4.0
+## Known issues caused by cloud provider limitations in v2.5.1
**Microsoft Azure:**
- Resource name length should not exceed 80 chars;
-- TensorFlow templates are not supported for RedHat Enterprise Linux;
-- Low priority Virtual Machines are not supported yet.
**GCP:**
- Resource name length should not exceed 64 chars;
-- NOTE: DLab has not been tested on GCP for RedHat Enterprise Linux.
+
+**NOTE:** the DataLab has not been tested for RedHat Enterprise Linux.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 02/05: [DATALAB-2629]: fixed mongo commands for new pymongo version
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit c51730241a490042cae59426b678b3343f8f39eb
Author: leonidfrolov <fr...@gmail.com>
AuthorDate: Thu Dec 2 16:22:58 2021 +0200
[DATALAB-2629]: fixed mongo commands for new pymongo version
---
infrastructure-provisioning/src/ssn/scripts/configure_mongo.py | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/infrastructure-provisioning/src/ssn/scripts/configure_mongo.py b/infrastructure-provisioning/src/ssn/scripts/configure_mongo.py
index 9b02cb0..d38acc4 100644
--- a/infrastructure-provisioning/src/ssn/scripts/configure_mongo.py
+++ b/infrastructure-provisioning/src/ssn/scripts/configure_mongo.py
@@ -72,8 +72,8 @@ def read_yml_conf(path, section, param):
if __name__ == "__main__":
mongo_passwd = "PASSWORD"
- mongo_ip = read_yml_conf(path,'net','bindIp')
- mongo_port = read_yml_conf(path,'net','port')
+ mongo_ip = read_yml_conf(path, 'net', 'bindIp')
+ mongo_port = read_yml_conf(path, 'net', 'port')
#mongo_parameters = json.loads(args.mongo_parameters)
# Setting up admin's password and enabling security
client = MongoClient(mongo_ip + ':' + str(mongo_port))
@@ -82,7 +82,7 @@ if __name__ == "__main__":
command = ['service', 'mongod', 'start']
subprocess.call(command, shell=False)
time.sleep(5)
- client.datalabdb.add_user('admin', mongo_passwd, roles=[{'role': 'userAdminAnyDatabase', 'db': 'admin'}])
+ client.datalabdb.command('createUser', 'admin', pwd=mongo_passwd, roles=[{'role': 'userAdminAnyDatabase', 'db': 'admin'}])
client.datalabdb.command('grantRolesToUser', "admin", roles=["readWrite"])
# set_mongo_parameters(client, mongo_parameters)
with open(args.datalab_path + 'tmp/local_endpoint.json', 'r') as data:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 03/05: updated datalab version in python scripts
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit da11b6c10c211bc9cdfe96796727de6b9fd51b9c
Author: leonidfrolov <fr...@gmail.com>
AuthorDate: Wed Nov 24 12:17:34 2021 +0200
updated datalab version in python scripts
---
infrastructure-provisioning/scripts/deploy_datalab.py | 2 +-
infrastructure-provisioning/terraform/bin/deploy/endpoint_fab.py | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/infrastructure-provisioning/scripts/deploy_datalab.py b/infrastructure-provisioning/scripts/deploy_datalab.py
index b6309d3..34be5ec 100644
--- a/infrastructure-provisioning/scripts/deploy_datalab.py
+++ b/infrastructure-provisioning/scripts/deploy_datalab.py
@@ -135,7 +135,7 @@ def build_parser():
multiple emails, e.g. u1@example.com,u2@example.com.''')
parser.add_argument('--conf_repository_user', type=str, default='',
help='user to access repository (used for jars download)')
- parser.add_argument('--conf_release_tag', type=str, default='2.5',
+ parser.add_argument('--conf_release_tag', type=str, default='2.5.1',
help='tag used for jars download')
parser.add_argument('--conf_repository_pass', type=str, default='',
help='password to access repository (used for jars download)')
diff --git a/infrastructure-provisioning/terraform/bin/deploy/endpoint_fab.py b/infrastructure-provisioning/terraform/bin/deploy/endpoint_fab.py
index 94ae1f9..e5bd059 100644
--- a/infrastructure-provisioning/terraform/bin/deploy/endpoint_fab.py
+++ b/infrastructure-provisioning/terraform/bin/deploy/endpoint_fab.py
@@ -989,7 +989,7 @@ def init_args():
parser.add_argument('--repository_user', type=str, default='')
parser.add_argument('--repository_pass', type=str, default='')
parser.add_argument('--release_tag', type=str,
- default='2.5')
+ default='2.5.1')
parser.add_argument('--docker_version', type=str,
default='5:20.10.6~3-0~ubuntu-bionic')
parser.add_argument('--ssn_bucket_name', type=str, default='')
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 01/05: [DATALAB-2629]: removed unnecessary commands
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit f802d168caf8b122dfe9f4f49d766c6566c4ccc4
Author: leonidfrolov <fr...@gmail.com>
AuthorDate: Thu Dec 2 16:22:35 2021 +0200
[DATALAB-2629]: removed unnecessary commands
---
infrastructure-provisioning/src/ssn/scripts/configure_ui.py | 3 ---
1 file changed, 3 deletions(-)
diff --git a/infrastructure-provisioning/src/ssn/scripts/configure_ui.py b/infrastructure-provisioning/src/ssn/scripts/configure_ui.py
index 556a575..4a4476e 100644
--- a/infrastructure-provisioning/src/ssn/scripts/configure_ui.py
+++ b/infrastructure-provisioning/src/ssn/scripts/configure_ui.py
@@ -137,9 +137,6 @@ def configure_mongo(mongo_passwd, default_endpoint_name):
os.environ['conf_cloud_provider'].upper()))
conn.sudo('mv /tmp/local_endpoint.json ' + args.datalab_path + 'tmp/')
conn.sudo('pip3 install -U six==1.15.0 patchwork')
- conn.sudo("ls -la " + args.datalab_path + "tmp/")
- conn.sudo("ls -la /etc/")
- conn.sudo("lsblk")
conn.sudo("python3 " + args.datalab_path + "tmp/configure_mongo.py --datalab_path {} ".format(
args.datalab_path))
except Exception as err:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org
[incubator-datalab] 05/05: Updated RNs
Posted by lf...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lfrolov pushed a commit to branch DATALAB-2629
in repository https://gitbox.apache.org/repos/asf/incubator-datalab.git
commit 65f3408ceb40aa7c1710fd99aa09b8e72615a3d4
Author: viravit <vi...@epam.com>
AuthorDate: Wed Nov 24 12:02:25 2021 +0200
Updated RNs
---
RELEASE_NOTES.md | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/RELEASE_NOTES.md b/RELEASE_NOTES.md
index 733d053..8ec41ab 100644
--- a/RELEASE_NOTES.md
+++ b/RELEASE_NOTES.md
@@ -25,7 +25,7 @@
## Known issues in v2.5.1
**GCP:**
-- Superset creation fails during configuration???;
+- Superset creation fails during configuration;
- SSO is not available for Superset.
**Microsoft Azure:**
@@ -38,9 +38,9 @@
## Known issues caused by cloud provider limitations in v2.5.1
**Microsoft Azure:**
-- Resource name length should not exceed 80 chars;
+- Resource name length should not exceed 80 chars.
**GCP:**
-- Resource name length should not exceed 64 chars;
+- Resource name length should not exceed 64 chars.
**NOTE:** the DataLab has not been tested for RedHat Enterprise Linux.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datalab.apache.org
For additional commands, e-mail: commits-help@datalab.apache.org