You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sujith Chacko (JIRA)" <ji...@apache.org> on 2019/03/12 13:44:00 UTC
[jira] [Commented] (SPARK-23450) jars option in spark submit is
documented in misleading way
[ https://issues.apache.org/jira/browse/SPARK-23450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790558#comment-16790558 ]
Sujith Chacko commented on SPARK-23450:
---------------------------------------
As pr my understanding the jar will be distributed to the worker nodes. Already tested a UDF scenario where a custom jar is added to the nodes via --jars and executed the UDF query and its working fine
> jars option in spark submit is documented in misleading way
> -----------------------------------------------------------
>
> Key: SPARK-23450
> URL: https://issues.apache.org/jira/browse/SPARK-23450
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.2.1
> Reporter: Gregory Reshetniak
> Priority: Major
>
> I am wondering if the {{--jars}} option on spark submit is actually meant for distributing the dependency jars onto the nodes in cluster?
>
> In my case I can see it working as a "symlink" of sorts. But the documentation is written in the way that suggests otherwise. Please help me figure out if this is a bug or just my reading of the docs. Thanks!
> _
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org