You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/12/10 16:06:11 UTC
[jira] [Commented] (SPARK-2109) Setting SPARK_MEM for bin/pyspark
does not work.
[ https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051078#comment-15051078 ]
Apache Spark commented on SPARK-2109:
-------------------------------------
User 'ScrapCodes' has created a pull request for this issue:
https://github.com/apache/spark/pull/1050
> Setting SPARK_MEM for bin/pyspark does not work.
> -------------------------------------------------
>
> Key: SPARK-2109
> URL: https://issues.apache.org/jira/browse/SPARK-2109
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.0.0
> Reporter: Prashant Sharma
> Assignee: Prashant Sharma
> Priority: Critical
> Fix For: 1.0.1, 1.1.0
>
>
> prashant@sc:~/work/spark$ SPARK_MEM=10G bin/pyspark
> Python 2.7.6 (default, Mar 22 2014, 22:59:56)
> [GCC 4.8.2] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> Traceback (most recent call last):
> File "/home/prashant/work/spark/python/pyspark/shell.py", line 43, in <module>
> sc = SparkContext(appName="PySparkShell", pyFiles=add_files)
> File "/home/prashant/work/spark/python/pyspark/context.py", line 94, in __init__
> SparkContext._ensure_initialized(self, gateway=gateway)
> File "/home/prashant/work/spark/python/pyspark/context.py", line 190, in _ensure_initialized
> SparkContext._gateway = gateway or launch_gateway()
> File "/home/prashant/work/spark/python/pyspark/java_gateway.py", line 51, in launch_gateway
> gateway_port = int(proc.stdout.readline())
> ValueError: invalid literal for int() with base 10: 'Warning: SPARK_MEM is deprecated, please use a more specific config option\n'
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org