You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by amin mohebbi <am...@yahoo.com.INVALID> on 2018/06/27 05:27:24 UTC
submitting dependencies
Could you please help me to understand how I should submit my spark application ?
I have used this connector (pygmalios/reactiveinflux-spark) to connect spark with influxdb.
|
|
|
| | |
|
|
|
| |
pygmalios/reactiveinflux-spark
reactiveinflux-spark - Connector between Spark and InfluxDB.
|
|
|
The code is working fine, but when I submit the jar file through spark-submit I will face this error
"Exception in thread "main" java.lang.NoClassDefFoundError: com/pygmalios/reactiveinflux/ReactiveInfluxDbName"
I submit like this : spark-submit --jars /home/sshuser/reactiveinflux-spark_2.10-1.4.0.10.0.5.1.jar sapn_2.11-1.0.jar
Can you help to solve this issue?
Best Regards ....................................................... Amin Mohebbi PhD candidate in Software Engineering at university of Malaysia Tel : +60 18 2040 017 E-Mail : TP025921@ex.apiit.edu.my amin_524@me.com
Re: submitting dependencies
Posted by Jean Georges Perrin <jg...@jgp.net>.
Have you tried to build a uber jar to bundle all your classes together?
> On Jun 27, 2018, at 01:27, amin mohebbi <aminn_524@yahoo.com.INVALID <ma...@yahoo.com.INVALID>> wrote:
>
> Could you please help me to understand how I should submit my spark application ?
>
> I have used this connector (pygmalios/reactiveinflux-spark <https://github.com/pygmalios/reactiveinflux-spark>) to connect spark with influxdb.
>
>
> pygmalios/reactiveinflux-spark
> reactiveinflux-spark - Connector between Spark and InfluxDB.
> <https://github.com/pygmalios/reactiveinflux-spark>
>
>
> The code is working fine, but when I submit the jar file through spark-submit I will face this error
>
> "Exception in thread "main" java.lang.NoClassDefFoundError: com/pygmalios/reactiveinflux/ReactiveInfluxDbName"
>
> I submit like this :
> spark-submit --jars /home/sshuser/reactiveinflux-spark_2.10-1.4.0.10.0.5.1.jar sapn_2.11-1.0.jar
>
> Can you help to solve this issue?
>
>
> Best Regards ....................................................... Amin Mohebbi PhD candidate in Software Engineering at university of Malaysia Tel : +60 18 2040 017 E-Mail : TP025921@ex.apiit.edu.my <ma...@ex.apiit.edu.my> amin_524@me.com <ma...@me.com>