You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2016/09/20 08:20:20 UTC

[jira] [Created] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr

Jeff Zhang created SPARK-17605:
----------------------------------

             Summary: Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr
                 Key: SPARK-17605
                 URL: https://issues.apache.org/jira/browse/SPARK-17605
             Project: Spark
          Issue Type: Improvement
          Components: Spark Submit
            Reporter: Jeff Zhang


For applications (zeppelin & livy ) that use both pyspark and sparkr, we have to duplicate the code in SparkSubmit to figure the where is the requirement resources for pyspark & sparkr (pyspark.zip, py4j, sparkr.zip and R file in jars). It would be better to provide option spark.usePython and spark.useR, so that downstream project which use both pyspark and sparkr in one spark application don't need to duplicate the code in SparkSubmit, can just leverage these 2 options. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org