You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Flavio Pompermaier (Jira)" <ji...@apache.org> on 2020/04/23 21:44:00 UTC
[jira] [Created] (FLINK-17360) Support custom partitioners in
JDBCReadOptions
Flavio Pompermaier created FLINK-17360:
------------------------------------------
Summary: Support custom partitioners in JDBCReadOptions
Key: FLINK-17360
URL: https://issues.apache.org/jira/browse/FLINK-17360
Project: Flink
Issue Type: Improvement
Components: Table SQL / API
Reporter: Flavio Pompermaier
Suport custom ParameterValuesProvider. At the moment only NumericBetweenParametersProvider is handled if a partition column and min/max values are specified.
In a discussion in the mailing list some discussion about this was made.
Me ([~f.pompermaier]):
Then we can add a *scan.parametervalues.provider.class* in order to customize the splitting of the query (we can also add a check that the query contains at least 1 question mark).
If we introduce a custom parameters provider we need also to specify parameters, using something like:
'scan.parametervalues.0.name' = 'minDate',
'scan.parametervalues.0.value'= '12/10/2019'
'scan.parametervalues.1.name' = 'maxDate',
'scan.parametervalues.1.value'= '01/01/2020'
[~lzljs3620320]
Maybe we need add something like "scan.parametervalues.provider.type", it can be "bound, specify, custom":
- when *bound*, using old p*artitionLowerBound* and *partitionUpperBound*, *numPartitions*
- when *specify*, using specify parameters like your proposal
- when *custom*, need *scan.parametervalues.provider.class*
Actually I don't know if specify and custom can be separated..but this can be further discussed
--
This message was sent by Atlassian Jira
(v8.3.4#803005)