You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@dlab.apache.org by "Vira Vitanska (Jira)" <ji...@apache.org> on 2020/08/11 12:08:00 UTC
[jira] [Commented] (DLAB-1823) [Branch-515][AWS][GCP][Zeppelin]:
Playbooks flight/airbnb preparation Py2/Py3/R/Scala run with error for
local/remote kernels
[ https://issues.apache.org/jira/browse/DLAB-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175506#comment-17175506 ]
Vira Vitanska commented on DLAB-1823:
-------------------------------------
*Closed:*
Commit ID 4ca2620fe577f78690f1cd76bb011c5b401f99f9.
> [Branch-515][AWS][GCP][Zeppelin]: Playbooks flight/airbnb preparation Py2/Py3/R/Scala run with error for local/remote kernels
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: DLAB-1823
> URL: https://issues.apache.org/jira/browse/DLAB-1823
> Project: Apache DLab
> Issue Type: Bug
> Components: DLab Main
> Reporter: Vira Vitanska
> Assignee: Mykola Bodnar
> Priority: Major
> Labels: AWS, Debian, DevOps
> Attachments: AIRBNB local-remote.png, GCP Preparation airbnb py2.png, GCP preparation airbnb py3.png, Python 2 data preparation -local logs.txt, Python 2 data preparation-Spark-logs.txt, Python 2 data preparation-local.png, Python 2 data preparation-spark.png, R data preparation local remote logs.txt, Scala -py2-py3- local-remote.png, Scala py2-py3 remote-local logs.txt, Verified-AWS-Local-Fight-R-Py3.png, Verified-GCP-DP15-Flight-Prepare-Py2.png, Verified1-AWS-EMR530-AIRBNB-Prapare-Py2.png, Verified1-AWS-EMR530-AIRBNB-Prapare-Py3.png, Verified1-AWS-EMR530-Flight-preparetion-PY2.png, Verified1-AWS-EMR6-AIRBNB-Prapare-Py2-py3.png, Verified1-AWS-EMR6-Flight-Prepare-py2.png, Verified1-AWS-EMR6-Flight-R-Py2.png, Verified1-AWS-EMR6-Flight-R-Py3.png, Verified1-AWS-EMR6-Flight-Scala-Py2.png, Verified1-AWS-EMR6-Flight-Scala-Py3.png, Verified1-AWS-Scala-Flight-Prepare-Py2.png, Verified1-AWS-Scala-Flight-Prepare-Py3.png, Verified1-AWS-Spark-AIRBNB-Prepare-Py3.png, Verified1-AWS-Spark-Flight-Prapare-Py2.png, Verified1-AWS-Spark-Flight-Prepare-Py2.png, Verified1-AWS-Spark-Flight-Prepare-Py3.png, Verified1-AWS-Spark-Flight-Prepare-R-py3.png, Verified1-AWS-local-flight-prapare-Py2.png, Verified1-AWS-spark-flight-prepare-Scala-Py2.png, Verified1-GCP-DP13-Flight-prepare-Py2.jpg, Verified1-GCP-DP13-Flight-visualize-Py2.jpg, Verified1-GCP-DP15-AIRBNB-Prepare-py2.png, Verified1-GCP-DP15-Flight-prepare-py2-R.png, Verified1-GCP-DP15-Flight0Prepare-Scala.png, Verified1-GCP-local-AIRBNB-py2.jpg, Verified1-GCP-local-AirbNB-prepare-py3.jpg, Verifight-AWS-Spark-AIRBNB-Prepare-Py2.png, image-2020-06-16-10-20-51-231.png, verified1-GCP-DP13-Flight-prepare-R-py2.jpg, verified1-GCP-Spark-AIRBNB-Prapare-Py3.jpg
>
>
> *Preconditions:*
> 1. Zeppelin is created on AWS/GCP
> *Steps to reproduce:*
> 1. Run playbooks flight preparation Py2/Py3/R/Scala for local/remote kernels
> *Actual result:*
> 1. Playbooks run with error
> *Expected result:*
> 1. Playbooks run successful
> ------------------------------------------------------------------------------------------
> (i) For GCP Playbook preparation fails only for airbnb see attachments
> ----
> *AWS*
> +Flight preparation Py2+
> ||Local|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +Flight preparation R+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| *{color:#00875a}verified{color}* (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 6.0.0 py3| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||Spark py2| {color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3| {color:#de350b}*runs with error*{color} (04/06/2020|
> +Flight preparation scala+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 5.30.0 py3| {color:#00875a}*verified*{color} (09/06/2020)|
> ||EMR 6.0.0 py2| {color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py3| *{color:#de350b}runs with error{color}* (09/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> +AIRBNB+
> ||Local py2|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||Local py3|*{color:#de350b}runs with error{color}* (04/06/2020)|
> ||EMR 5.30.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020)|
> ||EMR 5.30.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020)|
> ||EMR 6.0.0 py2|*{color:#de350b}runs with error{color}* (09/06/2020) |
> ||EMR 6.0.0 py3|{color:#de350b}*runs with error*{color} (09/06/2020|
> ||Spark py2|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ||Spark py3|{color:#de350b}*runs with error*{color} (04/06/2020)|
> ----
> *GCP*
> +AIRBNB+
> ||Local py2|{color:#de350b}*runs with error* {color} (11/06/2020)|
> ||Local py3|{color:#de350b}*runs with error -failed to start pyspark*{color} (11/06/2020)|
> ||DP 1.3 py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.4 py2|{color:#de350b}*runs with error*{color} (11/06/2020) |
> ||DP 1.4 py3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.5 ubuntu py2|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||Spark py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||Spark py3|*{color:#de350b}runs with error -failed to start pyspark{color}* (11/06/2020)|
> +Flight preparation Py2+
> ||Local|{color:#00875a}*verfied*{color} (11/06/2020)|
> ||DP 1.3|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.4|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP1.5 ubuntu|{color:#00875a}*runs with error* {color}(16/06/2020)|
> ||Spark|{color:#00875a}*verified*{color} (11/06/2020)|
> +Flight preparation R+
> ||Local py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Local py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.3 py2|{color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b} *runs with error*{color} (11/06/2020)|
> ||DP 1.4 py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.4 py3|*{color:#00875a}verified{color}* (11/06/2020)|
> ||DP 1.5 ubuntu py2|{color:#de350b}*runs with error*{color} (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with error* ** {color}(16/06/2020)|
> ||Spark py2| {color:#00875a}*verified*{color} (11/06/2020)|
> ||Spark py3|{color:#00875a}*verified* {color}(11/06/2020)|
> +Flight preparation scala+
> ||Local py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Local py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.3 py2| {color:#de350b}*runs with error*{color} (11/06/2020)|
> ||DP 1.3 py3|{color:#de350b}*runs with error* {color}(11/06/2020)|
> ||DP 1.4 py2|*{color:#00875a}verified{color}* (11/06/2020)|
> ||DP 1.4 py3|{color:#00875a}*verified*{color} (11/06/2020)|
> ||DP 1.5 ubuntu py2 |{color:#de350b}*runs with erro*{color}r (16/06/2020)|
> ||DP 1.5 ubuntu py3|{color:#de350b}*runs with erro**r* {color}(16/06/2020)|
> ||Spark py2|{color:#00875a}*verified*{color} (11/06/2020)|
> ||Spark py3|{color:#00875a}*verified*{color} (11/06/2020)|
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@dlab.apache.org
For additional commands, e-mail: dev-help@dlab.apache.org