You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Umar Javed <um...@gmail.com> on 2013/11/30 01:11:38 UTC

Configuring system properties for spark-shell

>From the configuration page:

'To set a system property for configuring Spark, you need to either pass it
with a -D flag to the JVM (for example java -Dspark.cores.max=5 MyProgram)
or call System.setProperty in your code *before* creating your Spark
context, as follows:'

Since running spark-shell provides you with a Spark Context, the only way
to set system properties when running spark-shell seems to be passing the
-D flag to the JVM. How do you do this when using the start-* scripts in
/bin?

thanks!
Umar