You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2016/09/20 08:20:20 UTC
[jira] [Created] (SPARK-17605) Add option spark.usePython and
spark.useR for applications that use both pyspark and sparkr
Jeff Zhang created SPARK-17605:
----------------------------------
Summary: Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr
Key: SPARK-17605
URL: https://issues.apache.org/jira/browse/SPARK-17605
Project: Spark
Issue Type: Improvement
Components: Spark Submit
Reporter: Jeff Zhang
For applications (zeppelin & livy ) that use both pyspark and sparkr, we have to duplicate the code in SparkSubmit to figure the where is the requirement resources for pyspark & sparkr (pyspark.zip, py4j, sparkr.zip and R file in jars). It would be better to provide option spark.usePython and spark.useR, so that downstream project which use both pyspark and sparkr in one spark application don't need to duplicate the code in SparkSubmit, can just leverage these 2 options.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org