You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by alexeyy3 <al...@searshc.com> on 2016/02/04 23:17:43 UTC
submit spark job with spcified file for driver
Is it possible to specify a file (with key-value properties) when submitting
spark app with spark-submit? Some mails refers to the key --file, but docs.
does not mention it.
If you can specify a file, how to access it from spark job driver?
Thank you, Alexey
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
RE: submit spark job with spcified file for driver
Posted by Mohammed Guller <mo...@glassbeam.com>.
Here is the description for the --file option that you can specify to spark-submit:
--files FILES Comma-separated list of files to be placed in the working directory of each executor.
Mohammed
Author: Big Data Analytics with Spark
-----Original Message-----
From: alexeyy3 [mailto:alexey.yakubovich@searshc.com]
Sent: Thursday, February 4, 2016 2:18 PM
To: user@spark.apache.org
Subject: submit spark job with spcified file for driver
Is it possible to specify a file (with key-value properties) when submitting spark app with spark-submit? Some mails refers to the key --file, but docs.
does not mention it.
If you can specify a file, how to access it from spark job driver?
Thank you, Alexey
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: submit spark job with spcified file for driver
Posted by Ted Yu <yu...@gmail.com>.
Please take a look at:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
You would see '--files' argument
On Thu, Feb 4, 2016 at 2:17 PM, alexeyy3 <al...@searshc.com>
wrote:
> Is it possible to specify a file (with key-value properties) when
> submitting
> spark app with spark-submit? Some mails refers to the key --file, but docs.
> does not mention it.
> If you can specify a file, how to access it from spark job driver?
>
> Thank you, Alexey
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/submit-spark-job-with-spcified-file-for-driver-tp26153.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>