You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "tinny cat (Jira)" <ji...@apache.org> on 2020/07/10 02:19:00 UTC
[jira] [Updated] (FLINK-18547) the filesystem sql connector can't
work well
[ https://issues.apache.org/jira/browse/FLINK-18547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
tinny cat updated FLINK-18547:
------------------------------
Description:
The options ‘partition.time-extractor.kind’，‘partition.time-extractor.class’，‘partition.time-extractor.timestamp-pattern’ ，Configuration does not take effect，beacause the configurations are not associated with TableBucketAssigner. Resulting in failure to get the correct BucketId
{code:java}
public static String generatePartitionPath(LinkedHashMap<String, String> partitionSpec) {
if (partitionSpec.isEmpty()) {
return "";
}
StringBuilder suffixBuf = new StringBuilder();
int i = 0;
for (Map.Entry<String, String> e : partitionSpec.entrySet()) {
if (i > 0) {
suffixBuf.append(Path.SEPARATOR);
}
suffixBuf.append(escapePathName(e.getKey()));
suffixBuf.append('=');
suffixBuf.append(escapePathName(e.getValue()));
i++;
}
suffixBuf.append(Path.SEPARATOR);
return suffixBuf.toString();
}
{code}
was:
The options ‘partition.time-extractor.kind’，‘partition.time-extractor.class’，‘partition.time-extractor.timestamp-pattern’ ，Configuration does not take effect，beacause the configurations are not associated with TableBucketAssigner. Resulting in failure to get the correct BucketId
{code:java}
//代码占位符
public static String generatePartitionPath(LinkedHashMap<String, String> partitionSpec) { if (partitionSpec.isEmpty()) { return ""; } StringBuilder suffixBuf = new StringBuilder(); int i = 0; for (Map.Entry<String, String> e : partitionSpec.entrySet()) { if (i > 0) { suffixBuf.append(Path.SEPARATOR); } suffixBuf.append(escapePathName(e.getKey())); suffixBuf.append('='); suffixBuf.append(escapePathName(e.getValue())); i++; } suffixBuf.append(Path.SEPARATOR); return suffixBuf.toString(); }
{code}
> the filesystem sql connector can't work well
> --------------------------------------------
>
> Key: FLINK-18547
> URL: https://issues.apache.org/jira/browse/FLINK-18547
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem
> Affects Versions: 1.11.0
> Reporter: tinny cat
> Priority: Critical
>
> The options ‘partition.time-extractor.kind’，‘partition.time-extractor.class’，‘partition.time-extractor.timestamp-pattern’ ，Configuration does not take effect，beacause the configurations are not associated with TableBucketAssigner. Resulting in failure to get the correct BucketId
> {code:java}
> public static String generatePartitionPath(LinkedHashMap<String, String> partitionSpec) {
> if (partitionSpec.isEmpty()) {
> return "";
> }
> StringBuilder suffixBuf = new StringBuilder();
> int i = 0;
> for (Map.Entry<String, String> e : partitionSpec.entrySet()) {
> if (i > 0) {
> suffixBuf.append(Path.SEPARATOR);
> }
> suffixBuf.append(escapePathName(e.getKey()));
> suffixBuf.append('=');
> suffixBuf.append(escapePathName(e.getValue()));
> i++;
> }
> suffixBuf.append(Path.SEPARATOR);
> return suffixBuf.toString();
> }
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)