Equivalent to --files for driver?

[Everett Anderson <ev...@nuna.com.INVALID>]

Hi,

I'm running Spark 1.6.2 on YARN and I often use the cluster deploy mode
with spark-submit. While the --files param is useful for getting files onto
the cluster in the working directories of the executors, the driver's
working directory doesn't get them.

Is there some equivalent to --files for the driver program when run in this
mode?

Re: Equivalent to --files for driver?

[Jacek Laskowski <ja...@japila.pl>]

Hi Everett,

I'd bet on --driver-class-path (but didn't check that out myself).

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Wed, Sep 21, 2016 at 10:17 PM, Everett Anderson
<ev...@nuna.com.invalid> wrote:
> Hi,
>
> I'm running Spark 1.6.2 on YARN and I often use the cluster deploy mode with
> spark-submit. While the --files param is useful for getting files onto the
> cluster in the working directories of the executors, the driver's working
> directory doesn't get them.
>
> Is there some equivalent to --files for the driver program when run in this
> mode?
>

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org