You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Rajeshbabu Chintaguntla (Jira)" <ji...@apache.org> on 2022/04/07 15:36:00 UTC
[jira] [Resolved] (PHOENIX-6683) Surround the OR filters with parentheses while converting spark filters to phoenix expessions
[ https://issues.apache.org/jira/browse/PHOENIX-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajeshbabu Chintaguntla resolved PHOENIX-6683.
----------------------------------------------
Fix Version/s: connectors-6.0.0
Resolution: Fixed
Merged it. Thanks for review [~stoty].
> Surround the OR filters with parentheses while converting spark filters to phoenix expessions
> ---------------------------------------------------------------------------------------------
>
> Key: PHOENIX-6683
> URL: https://issues.apache.org/jira/browse/PHOENIX-6683
> Project: Phoenix
> Issue Type: Bug
> Components: spark-connector
> Reporter: Rajeshbabu Chintaguntla
> Assignee: Rajeshbabu Chintaguntla
> Priority: Major
> Fix For: connectors-6.0.0
>
>
> If there are mix of *AND* and *OR* filters in the query while converting the to phoenix filter from spark filters no parentheses got added to *OR* filters which is leading to wrong filter and finally getting wrong data.
> For example if the filter is used is below
> {code}
> where ENTITY_INSTANCE_ID = 40 and (CANCELLATION_FLAG <> 'Y' OR CANCELLATION_FLAG IS NULL ) and CASE_MATCH_TYPE='M'
> {code}
> which is getting converted to an expression and leading to wrong result because result is always giving most of the records matching CANCELLATION_FLAG is not 'Y'
> {code}
> NOT "CANCELLATION_FLAG" = 'Y' OR "CANCELLATION_FLAG" IS NULL AND "CASE_MATCH_TYPE" IS NOT NULL AND "ENTITY_INSTANCE_ID" = 40 AND "ENTITY_INSTANCE_ID" IS NOT NULL AND "CASE_MATCH_TYPE" = 'M'
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)