You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Timo Walther (JIRA)" <ji...@apache.org> on 2018/11/01 09:04:00 UTC
[jira] [Commented] (FLINK-10689) Port Table API extension points to
flink-table-common
[ https://issues.apache.org/jira/browse/FLINK-10689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16671291#comment-16671291 ]
Timo Walther commented on FLINK-10689:
--------------------------------------
Yes, it would be very helpful if we could parallelize the subtasks. However, many issues about catalogs, connectors, and the Hive integration mutually depend on each other, so we need be careful which tasks to do first in order to keep duplicate work and merge conflicts low.
We could already port {{org.apache.flink.table.functions}} without waiting for FLINK-10688. However, porting {{org.apache.flink.table.catalog}} is a bit more tricky as it depends on sources and sinks interfaces (thus FLINK-10688). The external catalog builder depends on {{org.apache.flink.table.descriptors.Schema}} which depends on {{org.apache.flink.table.descriptors.Rowtime}} which depends on {{org.apache.flink.table.sources.tsextractors.TimestampExtractor}} which pulls in {{Expression}} and thus the entire Table API which does not belong in a {{common}} module. Once we are confident how the improved [unified connector interfaces|https://docs.google.com/document/d/1Yaxp1UJUFW-peGLt8EIidwKIZEWrrA-pznWLuvaH39Y/edit#heading=h.41fd6rs7b3cf] look like we might need to rework table sources/sink interfaces as well as utility classes such as {{TimestampExtractor}}s. IMHO this has highest priority once the 1.7 release is out.
Feel free to starting porting everything that clearly belongs into a {{common}} module and does not pull in unrelated classes, if you see a possibility for it.
> Port Table API extension points to flink-table-common
> -----------------------------------------------------
>
> Key: FLINK-10689
> URL: https://issues.apache.org/jira/browse/FLINK-10689
> Project: Flink
> Issue Type: Sub-task
> Components: Table API & SQL
> Reporter: Timo Walther
> Assignee: xueyu
> Priority: Major
>
> After FLINK-10687 and FLINK-10688 have been resolved, we should also port the remaining extension points of the Table API to flink-table-common. This includes interfaces for UDFs and the external catalog interface.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)