You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datalab.apache.org by "Vira Vitanska (Jira)" <ji...@apache.org> on 2021/07/01 09:10:00 UTC
[jira] [Updated] (DATALAB-2482) [Apache Zeppelin] Spark
drivers/executors memory are not allocated according to best practice
[ https://issues.apache.org/jira/browse/DATALAB-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vira Vitanska updated DATALAB-2482:
-----------------------------------
Description:
Spark driver/executor memory is allocated according to the ticket https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor memory * 0/90
*Actual result:*
# Calculation is not equal to spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal to spark memory (sudo ps aux | grep java)
was:
Spark driver/executor memory is allocated according to the ticket https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it does not work.
*Preconditions:*
# Zeppelin is in running status
*Steps to reproduce:*
# Run Playbook on Zeppelin
# Run on notebook sudo ps aux | grep java
# Calculate the memory by formula Spark executor memory = total executor memory * 0/90
*Actual result:*
# Calculation is not equal spark memory (sudo ps aux | grep java)
*Expected result:*
# Calculation is equal spark memory (sudo ps aux | grep java)
> [Apache Zeppelin] Spark drivers/executors memory are not allocated according to best practice
> ---------------------------------------------------------------------------------------------
>
> Key: DATALAB-2482
> URL: https://issues.apache.org/jira/browse/DATALAB-2482
> Project: Apache DataLab
> Issue Type: Bug
> Security Level: Public(Regular Issues)
> Components: DataLab Main
> Reporter: Vira Vitanska
> Assignee: Mykola Bodnar
> Priority: Minor
> Labels: AWS, AZURE, Debian, DevOps, GCP, RedHat
> Fix For: v.2.5
>
>
> Spark driver/executor memory is allocated according to the ticket https://issues.apache.org/jira/browse/DATALAB-2342/ But for Apache Zeppelin it does not work.
> *Preconditions:*
> # Zeppelin is in running status
> *Steps to reproduce:*
> # Run Playbook on Zeppelin
> # Run on notebook sudo ps aux | grep java
> # Calculate the memory by formula Spark executor memory = total executor memory * 0/90
> *Actual result:*
> # Calculation is not equal to spark memory (sudo ps aux | grep java)
> *Expected result:*
> # Calculation is equal to spark memory (sudo ps aux | grep java)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@datalab.apache.org
For additional commands, e-mail: dev-help@datalab.apache.org