[jira] [Commented] (PHOENIX-6783) Phoenix5-Spark3 Connector SQL Support

["Istvan Toth (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600609#comment-17600609 ] 

Istvan Toth commented on PHOENIX-6783:
--------------------------------------

This is probably a setup problem.
Check that the connector JAR and dependencies are available and have correct permissions on each node,  and that the configuration is correct.

> Phoenix5-Spark3 Connector SQL Support
> -------------------------------------
>
>                 Key: PHOENIX-6783
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-6783
>             Project: Phoenix
>          Issue Type: Bug
>          Components: spark-connector
>         Environment: # Pure Spark 3.0.3
>  # phoenix5-spark3-shaded-6.0.0-SNAPSHOT.jar located in $SPARK_HOME/jars
>  # SQL used to create Spark Phoenix data source table is:
> {{create table Table1 (ID long, COL1 string) using  phoenix options (table 'Table1', zkUrl '192.168.0.103:2181', primary 'ID')}}
>            Reporter: yj
>            Priority: Major
>
> While conducting the Spark 3.0 Integration test using *Phoenix5-spark3-shaded module of project [Phoenix-Connectors|https://github.com/apache/phoenix-connectors]* the following questions occurred.
>  
> The test process is as follows:
> 1. Phoenix created a table called "TABLE1" and then loaded the data into that table.
> 2. After that, I tried to select the data of the table using Spark.
>  
> As written in the README of Phoenix5-spark3 module, the part that loads Phoenix data into the Spark DataFrame using the Phoenix data source seems to work well.
> However, when I *create Phoenix Spark data source table through Spark SQL* and try to select that data source table, the following error occurs:
> {{java.util.concurrent.ExecutionException: org.apache.spark.sql.AnalysisException: phoenix is not a valid Spark SQL Data Source}}
>  
> I wonder if the Phoenix-Connectors does not support creating Phoenix Spark data source tables, or if there is any other reason for this error.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)