You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Rama Mullapudi (JIRA)" <ji...@apache.org> on 2018/02/03 01:25:00 UTC
[jira] [Updated] (PHOENIX-4581) phoenix-spark is not pushing
timestamp filter correctly
[ https://issues.apache.org/jira/browse/PHOENIX-4581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rama Mullapudi updated PHOENIX-4581:
------------------------------------
Description:
phoenix-spark is not pushing timestamp filter correctly
val tblDF = spark.sqlContext.read.format("org.apache.phoenix.spark").option("table", "ORDER_LINE").option("zkUrl" , "host:2181:/hbase-secure").load().filter(col("CREATE_TMS").gt(lit(current_timestamp()))).show()
Query being sent to phoenix
select .... FROM ORDER_LINE WHERE ( "CREATE_TMS" > 2018-02-02 20:06:51.545)
As timstamp string does not have quotes query fails to run.
was:
phoenix-spark is not pushing timestamp filter correctly
val tblDF = spark.sqlContext.read.format("org.apache.phoenix.spark").option("table", "ORDER_LINE").option("zkUrl" , "suhadoomgrqa001,suhadoomgrqa002,suhadoomgrqa003:2181:/hbase-secure").load().filter(col("CREATE_TMS").gt(lit(current_timestamp()))).show()
Query being sent to phoenix
select .... FROM ORDER_LINE WHERE ( "CREATE_TMS" > 2018-02-02 20:06:51.545)
As timstamp string does not have quotes query fails to run.
> phoenix-spark is not pushing timestamp filter correctly
> -------------------------------------------------------
>
> Key: PHOENIX-4581
> URL: https://issues.apache.org/jira/browse/PHOENIX-4581
> Project: Phoenix
> Issue Type: Bug
> Reporter: Rama Mullapudi
> Priority: Major
>
> phoenix-spark is not pushing timestamp filter correctly
>
> val tblDF = spark.sqlContext.read.format("org.apache.phoenix.spark").option("table", "ORDER_LINE").option("zkUrl" , "host:2181:/hbase-secure").load().filter(col("CREATE_TMS").gt(lit(current_timestamp()))).show()
>
> Query being sent to phoenix
> select .... FROM ORDER_LINE WHERE ( "CREATE_TMS" > 2018-02-02 20:06:51.545)
>
> As timstamp string does not have quotes query fails to run.
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)