[jira] [Assigned] (SPARK-2109) Setting SPARK_MEM for bin/pyspark does not work.

["Prashant Sharma (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prashant Sharma reassigned SPARK-2109:
--------------------------------------

    Assignee: Prashant Sharma

> Setting SPARK_MEM for bin/pyspark does not work. 
> -------------------------------------------------
>
>                 Key: SPARK-2109
>                 URL: https://issues.apache.org/jira/browse/SPARK-2109
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.0.0
>            Reporter: Prashant Sharma
>            Assignee: Prashant Sharma
>            Priority: Critical
>             Fix For: 1.0.1, 1.1.0
>
>
> prashant@sc:~/work/spark$ SPARK_MEM=10G bin/pyspark 
> Python 2.7.6 (default, Mar 22 2014, 22:59:56) 
> [GCC 4.8.2] on linux2
> Type "help", "copyright", "credits" or "license" for more information.
> Traceback (most recent call last):
>   File "/home/prashant/work/spark/python/pyspark/shell.py", line 43, in <module>
>     sc = SparkContext(appName="PySparkShell", pyFiles=add_files)
>   File "/home/prashant/work/spark/python/pyspark/context.py", line 94, in __init__
>     SparkContext._ensure_initialized(self, gateway=gateway)
>   File "/home/prashant/work/spark/python/pyspark/context.py", line 190, in _ensure_initialized
>     SparkContext._gateway = gateway or launch_gateway()
>   File "/home/prashant/work/spark/python/pyspark/java_gateway.py", line 51, in launch_gateway
>     gateway_port = int(proc.stdout.readline())
> ValueError: invalid literal for int() with base 10: 'Warning: SPARK_MEM is deprecated, please use a more specific config option\n'



--
This message was sent by Atlassian JIRA
(v6.2#6252)