You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "leesenlen (Jira)" <ji...@apache.org> on 2022/05/19 08:00:00 UTC
[jira] [Commented] (FLINK-17337) Send UPDATE messages instead of INSERT and DELETE in streaming join operator
[ https://issues.apache.org/jira/browse/FLINK-17337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539375#comment-17539375 ]
leesenlen commented on FLINK-17337:
-----------------------------------
What was the reason for the simplification using -D/-I instead of -U/+U at the beginning?
> Send UPDATE messages instead of INSERT and DELETE in streaming join operator
> ----------------------------------------------------------------------------
>
> Key: FLINK-17337
> URL: https://issues.apache.org/jira/browse/FLINK-17337
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Runtime
> Reporter: Jark Wu
> Priority: Minor
> Labels: auto-deprioritized-major
> Fix For: 1.16.0
>
>
> Currently, streaming join operator always send INSERT and DELETE messages for simplification if it's not inner join. However, we can send UPDATE_BEFORE and UPDATE_AFTER messages instead of INSERT and DELETE. For example, when we recieve right record "b", then we can send {{UB[a, null]}} and {{UA[a,b]}} instead of {{D[a,null]}}, {{I[a,b]}}. This is an optimization, because UB can be omitted in some cases to reduce IO cost and computation.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)