You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by TJ Klein <TJ...@gmail.com> on 2014/10/21 21:57:02 UTC
Spark-Submit Python along with JAR
Hi,
I'd like to run my python script using "spark-submit" together with a JAR
file containing Java specifications for a Hadoop file system. How can I do
that? It seems I can either provide a JAR file or a PYthon file to
spark-submit.
So far I have been running my code in ipython with IPYTHON_OPTS="notebook
--pylab inline" /usr/local/spark/bin/pyspark --jars
/usr/local/spark/HadoopFileFormat.jar
Best,
Tassilo
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Submit-Python-along-with-JAR-tp16938.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org