Spark SQL NoSuchMethodException...DriverWrapper.()

[Mirko Bernardoni <mi...@ixxus.com>]

Hi All,

I’m using Spark 1.6.1 and I’m getting the error below. This appear also with the current branch 1.6
The code that is generating the error is loading a table from MsSql server.
I’ve also looked if the microsoft jdbc driver is loaded correctly and it is (I’m using an uber jar with all the dependencies inside)
With the version 1.6.0 and the same source the error is not appearing.
I will really appreciate any help or suggestion.

Many thanks,
Mirko




Exception in thread "main" java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.worker.DriverWrapper$.main(DriverWrapper.scala:58)
        at org.apache.spark.deploy.worker.DriverWrapper.main(DriverWrapper.scala)
Caused by: java.lang.InstantiationException: org.apache.spark.sql.execution.datasources.jdbc.DriverWrapper
        at java.lang.Class.newInstance(Class.java:427)
        at org.apache.spark.sql.execution.datasources.jdbc.DriverRegistry$.register(DriverRegistry.scala:46)
        at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$$anonfun$createConnectionFactory$2.apply(JdbcUtils.scala:53)
        at org.apache.spark.sql.execution.datasources.jdbc.JdbcUtils$$anonfun$createConnectionFactory$2.apply(JdbcUtils.scala:52)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:120)
        at org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation.<init>(JDBCRelation.scala:91)
        at org.apache.spark.sql.execution.datasources.jdbc.DefaultSource.createRelation(DefaultSource.scala:57)
        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:158)
        at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119)
        at com.ixxus.analytic.batch.AlfrescoToRDD.loadDataFrameAsRdd(AlfrescoToRDD.scala:250)
        at com.ixxus.analytic.batch.AlfrescoToRDD.loadTags(AlfrescoToRDD.scala:189)
        at com.ixxus.analytic.phase.extraction.ExtractionJob$.execute(ExtractionJob.scala:29)
        at com.ixxus.analytic.program.AllProgram$.main(AllProgram.scala:36)
        at com.ixxus.analytic.program.AllProgram.main(AllProgram.scala)
        ... 6 more
Caused by: java.lang.NoSuchMethodException: org.apache.spark.sql.execution.datasources.jdbc.DriverWrapper.<init>()
        at java.lang.Class.getConstructor0(Class.java:3082)
        at java.lang.Class.newInstance(Class.java:412)
        ... 19 more