You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by nitinkak001 <ni...@gmail.com> on 2016/10/18 17:36:21 UTC

How to add all jars in a folder to executor classpath?

I need to add all the jars in hive/lib to my spark job executor classpath. I
tried this

spark.executor.extraLibraryPath=/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hive/lib
and 
spark.executor.extraClassPath=/opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/lib/hive/lib/*

but it does not add any jars to the classpath of the executor. How can I add
all the jars in a folder to executor or driver class path and what if I have
multiple folders? What is the syntax for that?

I am using Spark 1.6.0



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-add-all-jars-in-a-folder-to-executor-classpath-tp27916.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org