[jira] [Commented] (PHOENIX-4240) Error while persisting data from Apache Spark Dataset to Pheonix 4.9

["Josh Mahonin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16183004#comment-16183004 ] 

Josh Mahonin commented on PHOENIX-4240:
---------------------------------------

Can you confirm what Spark version you're running? With the Phoenix 4.9.0 release, the phoenix-spark module was compiled against Spark 1.6.0.

If you're running Spark 2.x, you either need to upgrade to the latest Phoenix, or compile your own version with an updated Spark version set here:
https://github.com/apache/phoenix/blob/v4.9.0-HBase-1.2/pom.xml#L102

> Error while persisting data from Apache Spark Dataset to Pheonix 4.9
> --------------------------------------------------------------------
>
>                 Key: PHOENIX-4240
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-4240
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.9.0
>         Environment: Linux (RedHat 7)
>            Reporter: Naveen
>
> Following error is appering when i am trying to persist data from apache spark dataset to pheonix.
> Error Code:
> dataset.write().format("org.apache.phoenix.spark").mode(SaveMode.Overwrite)
>         .options(ImmutableMap.of("driver", "org.apache.phoenix.jdbc.PhoenixDriver","zkUrl",
>                 "jdbc:phoenix:<host>:2181:/hbase-unsecure","table","CELL_91"))
>         .save();
> Exception in thread "main" java.lang.AbstractMethodError: org.apache.phoenix.spark.DefaultSource.createRelation(Lorg/apache/spark/sql/SQLContext;Lorg/apache/spark/sql/SaveMode;Lscala/collection/immutable/Map;Lorg/apache/spark/sql/Dataset;)Lorg/apache/spark/sql/sources/BaseRelation;
> 	at org.apache.spark.sql.execution.datasources.DataSource.write(DataSource.scala:429)
> 	at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:211)
> 	at com.yaskawa.opclient.spark.Phoenix.main(Phoenix.java:33)
> Please guide me to resolve.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)