You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "joyjit das (JIRA)" <ji...@apache.org> on 2018/07/13 11:20:01 UTC
[jira] [Created] (LIVY-483) set spark memory configuration by
SparkR code not working
joyjit das created LIVY-483:
-------------------------------
Summary: set spark memory configuration by SparkR code not working
Key: LIVY-483
URL: https://issues.apache.org/jira/browse/LIVY-483
Project: Livy
Issue Type: Bug
Components: Core
Affects Versions: 0.5.0
Environment: Livy version: 0.5 version latest 2008 release
Spark: 2.1.1
JupyterNote book: 4.3.1
SparkMagic: 0.11.3
Reporter: joyjit das
Attachments: Screenshot from 2018-07-12 10-53-12.png, Screenshot from 2018-07-12 10-53-41.png, Screenshot from 2018-07-12 10-54-41.png, Screenshot from 2018-07-12 10-54-59.png, Screenshot from 2018-07-12 10-57-04.png, Screenshot from 2018-07-12 10-57-25.png
Hi,
When we are trying to allocate spark memory by sparkR from jupyter notebook Spark always setting default config memory.We want to set spark memory configuration by SparkR code but with current Livy it's not working.Same things when trying with pySpark its working properly.I'm attaching both screenshots which we have tried from pySpark and sparkR with this mail.
If you need further any information regarding this issue please let us know.
Livy version: 0.5 version latest 2008 release
Spark: 2.1.1
JupyterNote book: *4.3.1*
SparkMagic: 0.11.3
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)