You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dlab.apache.org by vv...@apache.org on 2019/04/02 20:13:29 UTC

[incubator-dlab.wiki] branch master updated: Added table 'DLab Feature Mapping'

This is an automated email from the ASF dual-hosted git repository.

vvitanska pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-dlab.wiki.git


The following commit(s) were added to refs/heads/master by this push:
     new a6d7cac  Added table 'DLab Feature Mapping'
a6d7cac is described below

commit a6d7cac3f5746cb0eb0496b62d4e4465ac3e4140
Author: viravit <vi...@epam.com>
AuthorDate: Tue Apr 2 23:13:28 2019 +0300

    Added table 'DLab Feature Mapping'
---
 DLab-Features.md | 105 ++++++++++++++++++++++++++++++++++++++++++++++++++++++-
 1 file changed, 104 insertions(+), 1 deletion(-)

diff --git a/DLab-Features.md b/DLab-Features.md
index 520bbd5..69f9e3e 100644
--- a/DLab-Features.md
+++ b/DLab-Features.md
@@ -1 +1,104 @@
-Welcome to the incubator-dlab wiki!
+### DLab Feature Mapping
+
+| #   |  Features  | AWS [Debian] |AWS [RedHat]  | Azure [Debian] | Azure [RedHat]  | GCP [Debian]|
+|-----:|----------------------------------------------------------------------------------------------|:----------:|:----------:|:--------:|:--------:|:---------------:|
+| **1** | **DLab installation**                                                                           |          |          |        |        |               |
+|  1.1  | - Support of installing DLab into one VPC                                                    | yes      | yes      | yes    | yes    | yes           |
+| 1.2    | - Support of installing DLab into two VPCs                                                   | yes      | yes      | n/a    | n/a    | n/a           |
+| 1.3    | - DLab installation via public IP                                                            | yes      | yes      | yes    | yes    | yes           |
+| 1.4    | - DLab installation via private IP                                                           | yes      | yes      | yes    | yes    | n/a           |
+| **2**   | **Login/Logout**                                                                               |          |          |        |        |               |
+|  2.1   | - Login with LDAP                                                                            | yes      | yes      | yes    | yes    | yes           |
+| 2.2    | - Login with OAuth2 authentication and authorization                                         | n/a      | n/a      | yes    | yes    | n/a           |
+|  2.3   | - Logout                                                                                     | yes      | yes      | yes    | yes    | yes           |
+| **3**   | **Edge node management**                                                                        |          |          |        |        |               |
+| 3.1    | - Create Edge node                                                                           | yes      | yes      | yes    | yes    | yes           |
+|   3.2  | - Stop Edge node                                                                             | yes      | yes      | yes    | yes    | yes           |
+|   3.3  | - Start Edge node                                                                            | yes      | yes      | yes    | yes    | yes           |
+|   3.4  | - Reuploading a key                                                                          | yes      | yes      | yes    | yes    | yes           |
+|   3.5  | - Recreate Edge node (previously it was terminated from cloud console)                       | yes      | yes      | yes    | yes    | yes           |
+| **4**  | **Supported notebook templates**                                                                |          |          |        |        |               |
+|  4.1   | - Jupyter notebook template                                                                  | yes      | yes      | yes    | yes    | yes           |
+|   4.2  | - RStudio notebook template                                                                  | yes      | yes      | yes    | yes    | yes           |
+|  4.3   | - Apache Zeppelin notebook template                                                          | yes      | yes      | yes    | yes    | yes           |
+|   4.4  | - DeepLearning notebook template                                                             | yes      | yes      | yes    | no     | yes           |
+|   4.5  | - Rstudio with TensorFlow notebook temlate                                                   | yes      | yes      | n/a    | no     | n/a           |
+|    4.6 | - Jupyter with TensorFlow notebook template                                                  | yes      | yes      | yes    | no     | yes           |
+| **5**   | **Notebook instance management**                                                               |          |          |        |        |               |
+|   5.1  | - Stop notebook server instance                                                              | yes      | yes      | yes    | yes    | yes           |
+| 5.2    | - Start notebook server instance                                                             | yes      | yes      | yes    | yes    | yes           |
+|  5.3   | - Terminate notebook server instance                                                         | yes      | yes      | yes    | yes    | yes           |
+|   5.4  | - Go to notebook UI (via tunnel)                                                             | yes      | yes      | yes    | yes    | yes           |
+|   5.5  | - Go to notebook UI (reverse proxy)                                                          | yes      | yes      | n/a    | n/a    | n/a           |
+|   5.6  | - Creating custom AMI from running notebook instance                                         | yes      | yes      | yes    | yes    | n/a           |
+|  5.7   | - Creating notebook instance from custom image                                               | yes      | yes      | yes    | yes    | n/a           |
+|   5.8  | - Creating notebook instance from shared image                                               | yes      | yes      | yes    | yes    | n/a           |
+|   5.9  | - Tune local spark parameters from web UI on instance creation step:                         | yes      | yes      | yes    | yes    | yes           |
+|   5.10  | - Reconfiguration local spark on already existed notebook server instance                    | yes      | yes      | yes    | yes    | yes           |
+| **6**   | **Notebook templates that support Spark Standalone as computational resource**                   |          |          |        |        |               |
+|  6.1   | - Jupyter notebook template                                                                  | yes      | yes      | yes    | yes    | yes           |
+|   6.2  | - RStudio notebook template                                                                  | yes      | yes      | yes    | yes    | yes           |
+| 6.2    | - Apache Zeppelin notebook template                                                          | yes      | yes      | yes    | yes    | yes           |
+|  6.3   | - DeepLearning notebook template                                                             | yes      | yes      | yes    | no     | yes           |
+|  6.4   | - RStudio with TensorFlow notebook temlate                                                   | yes      | yes      | n/a    | no     | n/a           |
+|   6.5  | - Jupyter with TensorFlow notebook template                                                  | yes      | yes      | yes    | no     | yes           |
+| **7** | **Data Engine (Spark Standalone) management**                                                   |          |          |        |        |               |
+|   7.1  | - Stop                                                                                       | yes      | yes      | yes    | yes    | yes           |
+|   7.2  | - Start                                                                                      | yes      | yes      | yes    | yes    | yes           |
+|   7.3  | - Terminate                                                                                  | yes      | yes      | yes    | yes    | yes           |
+|  7.4   | - Ability to deploy Spark Standalone using Notebook's images                                 | yes      | yes      | yes    | yes    | n/a           |
+|   7.5  | - Ability to tune Spark Standalone parameters from web UI on instance creation step          | yes      | yes      | yes    | yes    | yes           |
+|  7.6   | - Ability to reconfiguration already existing Spark Standalone from DLab Web UI              | yes      | yes      | yes    | yes    | yes           |
+|   7.7  | - Abilit to access Spark Standalone job tracker URL from Web UI (via reverse proxy)          | yes      | yes      | n/a    | n/a    | n/a           |
+| **8** | **Notebook templates that support Cloud provider Data Engines as computational resource**        |          |          |        |        |               |
+| 8.1    | - Jupyter notebook template                                                                  | yes, EMR | yes, EMR | no     | no     | yes, Dataproc |
+|   8.2  | - RStudio notebook template                                                                  | yes, EMR | yes, EMR | no     | no     | yes, Dataproc |
+|   8.3  | - Zeppelin notebook template                                                                 | yes, EMR | yes, EMR | no     | no     | yes, Dataproc |
+|   8.4  | - TensorFlow notebook template                                                               | n/a      | n/a      | no     | no     | n/a           |
+|   8.5  | - DeepLearning notebook template                                                             | n/a      | n/a      | no     | no     | n/a           |
+|  8.6   | - RStudio with TensorFlow notebook temlate                                                   | n/a      | n/a      | no     | no     | n/a           |
+|   8.7  | - Jupyter with TensorFlow notebook template                                                  | n/a      | n/a      | no     | no     | n/a           |
+| **9** | **Data Engine Service management**                                                               |          |          |        |        |               |
+|   9.1  | - Stop                                                                                       | no       | no       | no     | no     | no            |
+|  9.2   | - Start                                                                                      | no       | no       | no     | no     | no            |
+|   9.3  | - Terminate                                                                                  | yes      | yes      | yes    | yes    | yes           |
+|   9.4  | - Ability to tune Engine Service parameters from WEB UI on instance creation step            | yes      | yes      | n/a    | n/a    | n/a           |
+|  9.5   | - Ability to navigate to Data Engine Service job tracker URL from Web UI (via reverse proxy) | yes      | yes      | n/a    | n/a    | n/a           |
+| **10**  | **Libraries management**                                                                                         |     |     |     |     |     |
+| 10.1   | - Ability to deploy libraries on notebook instance                                                            | yes | yes | yes | yes | yes |
+| 10.2 | - Ability to deploy libraries on Data Engine (Spark Standalone)                                               | yes | yes | yes | yes | yes |
+|  10.3  | - Ability to deploy libraries on Data Engine Service                                                          | yes | yes | no  | no  | yes |
+|  **11**  | **Available library groups for installation from WEB UI:**                                                      |     |     |     |     |     |
+|  11.1  | - Apt/Yum                                                                                                     | yes | yes | yes | yes | yes |
+|  11.2  | - Pip2                                                                                                        | yes | yes | yes | yes | yes |
+|  11.3  | - Pip3                                                                                                        | yes | yes | yes | yes | yes |
+|  11.4  | - R packages                                                                                                  | yes | yes | yes | yes | yes |
+|   11.5 | - Java                                                                                                        | yes | yes | yes | yes | yes |
+| **12**  | **Instance management via scheduler**                                                                            |     |     |     |     |     |
+| 12.1   | - Ability to stop/start notebook instance on scheduled basis                                                  | yes | yes | yes | yes | yes |
+| 12.2   | - Ability to stop/start Data Engine (Spark Standalone) on scheduled basis                                     | yes | yes | yes | yes | yes |
+| 12.3 | - Ability to  stop/start Data Engine Service on scheduled basis                                               | no  | no  | no  | no  | no  |
+|  12.4  | - Support of resources stopping on exceeding idle time via scheduler                                          | n/a | n/a | n/a | n/a | n/a |
+|  12.5  | - Reminder after login, notifying that corresponding resources are about to be stopped/terminated             | yes | yes | yes | yes | yes |
+| **13** | **Admin user only functionality**                                                                                |     |     |     |     |     |
+|  13.1  | - Ability to stop user's Edge node/Data Engine (Spark Standalone)/ notebook instance separately               | yes | yes | yes | yes | yes |
+| 13.2   | - Ability to terminate user's Data Engine (Spark Standalone)/Data Engine Service/notebook instance separately | yes | yes | yes | yes | yes |
+| 13.3   | - Ability  to stop user's Edge node with related instances simultaneously                                     | yes | yes | yes | yes | yes |
+| 13.4   | - Ability  to terminate user's Edge node with related instances simultaneously                                | yes | yes | yes | yes | yes |
+|  13.5  | - Ability  to execute backup                                                                                  | yes | yes | yes | yes | yes |
+| 13.6   | - Ability  to restrict available instance shapes based on user login (per user/group)                         | yes | yes | yes | yes | yes |
+|13.7    | - Ability  to adjust total cost limitation (for all users) and per  particular user                           | yes | yes | yes | yes | n/a |
+|  13.8  | - ABility to see and export billing data for all users                                                        | yes | yes | yes | yes | n/a |
+|  13.9  | - Ability  to monitor ssn load                                                                                | yes | yes | yes | yes | yes |
+| 14 | **Notebook templates that support cloning repository/merging/pulling/pushing), ungit**                            |     |     |     |     |     |
+| 14.1   | - Jupyter notebook template                                                                                   | yes | yes | yes | yes | yes |
+|  14.2  | - RStudio notebook template                                                                                   | yes | yes | yes | yes | yes |
+|  14.3  | - Apache Zeppelin notebook template                                                                           | no  | no  | no  | no  | no  |
+|  14.4  | - DeepLearning notebook template                                                                              | yes | yes | yes | no  | yes |
+|  14.5  | - Rstudio with TensorFlow notebook temlate                                                                    | yes | yes | no  | no  | no  |
+| 14.6 | - Jupyter with TensorFlow notebook template                                                                   | yes | yes | yes | no  | yes |
+| **15** | **Data Storage**                                             |         |         |         |         |         |
+| 15.1 | - Ability to read/write from/to shared or personal bucket | yes, S3 | yes, S3 | yes, blob storage, data lake | yes, blob storage, data lake | yes, blob storage, data lake |
+| 16 | **Billing Report**                                           |         |         |         |         |         |
+|  16.1 | - Ability to see and export billing Data                  | yes     | yes     | yes     | yes     | n/a  |
+


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@dlab.apache.org
For additional commands, e-mail: commits-help@dlab.apache.org