You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/05/16 04:29:00 UTC

[jira] [Assigned] (FLINK-27622) Make `AsyncDataStream.OutputMode` configurable for table module

     [ https://issues.apache.org/jira/browse/FLINK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee reassigned FLINK-27622:
------------------------------------

    Assignee: lincoln lee

> Make `AsyncDataStream.OutputMode` configurable for table module
> ---------------------------------------------------------------
>
>                 Key: FLINK-27622
>                 URL: https://issues.apache.org/jira/browse/FLINK-27622
>             Project: Flink
>          Issue Type: Improvement
>          Components: Table SQL / API
>            Reporter: lincoln lee
>            Assignee: lincoln lee
>            Priority: Major
>             Fix For: 1.16.0
>
>
> The `AsyncDataStream.OutputMode` is hardcoded to 'AsyncDataStream.OutputMode.ORDERED' for now:
> {code}
> //   org.apache.flink.table.planner.plan.nodes.exec.common.CommonExecLookupJoin
>         // force ORDERED output mode currently, optimize it to UNORDERED
>         // when the downstream do not need orderness
>         return new AsyncWaitOperatorFactory<>(
>                 asyncFunc, asyncTimeout, asyncBufferCapacity, AsyncDataStream.OutputMode.ORDERED);
> {code}
> It should be configurable to users same as the other two async options  'table.exec.async-lookup.buffer-capacity' & 'table.exec.async-lookup.timeout'.
> Also, there must be some plan validation for correctness concern when output mode is unordered(that's the reason I know why not be exposed before).
> Further, we should offer more precisely control for async join operation more than job level config, e.g., an async lookup join hint can do this per-join operation.
> It's the time to get this work!



--
This message was sent by Atlassian Jira
(v8.20.7#820007)