[jira] [Created] (FLINK-35080) Allow to specify additional pushdown filter in table properties

["Grzegorz Kołakowski (Jira)" <ji...@apache.org>]

Grzegorz Kołakowski created FLINK-35080:
-------------------------------------------

             Summary: Allow to specify additional pushdown filter in table properties
                 Key: FLINK-35080
                 URL: https://issues.apache.org/jira/browse/FLINK-35080
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / JDBC
            Reporter: Grzegorz Kołakowski


Currently, flink-connector-jdbc supports filter pushdown only for basic operators such as: comparison operators, logical operators, is null, is not null and like.

In some use-cases more complex filters need to be applied against the data, which cannot be pushed down by the connector, so a lot of data is fetched by Flink unnecessarily. For instance, expressions using PostgreSQL's jsonb or stored procedures needs to be recreated in Flink SQL with built-in functions or with UDFs. In addition, you not always own the target relational database in order to create a view which already contains needed predicates.

 

It would be nice, if it is possible to specify additional pushdown parameter in table definition, e.g.:
{code:java}
CREATE TABLE test ( ... )
WITH (
    ...
    'extra-pushdown-predicate' = 'some_jsonb_column ?  ''xyz''' 
);{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)