You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Junyao Huang (Jira)" <ji...@apache.org> on 2024/03/13 03:22:00 UTC
[jira] [Updated] (FLINK-34659) How to implement global sort in latest flink datastream API
[ https://issues.apache.org/jira/browse/FLINK-34659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Junyao Huang updated FLINK-34659:
---------------------------------
Attachment: image-2024-03-13-11-21-57-846.png
> How to implement global sort in latest flink datastream API
> -----------------------------------------------------------
>
> Key: FLINK-34659
> URL: https://issues.apache.org/jira/browse/FLINK-34659
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
> Affects Versions: 1.18.1
> Reporter: Junyao Huang
> Priority: Major
> Attachments: image-2024-03-13-11-21-57-846.png
>
>
> [https://nightlies.apache.org/flink/flink-docs-master/zh/docs/dev/datastream/dataset_migration/#%E7%AC%AC%E4%B8%89%E7%B1%BB]
>
> {{DataStream<Integer> dataStream = // [...]// assign subtask ID to all recordsDataStream<Tuple2<String, Integer>> dataStream1 = dataStream.map(new AddSubtaskIDMapFunction());dataStream1.keyBy(value -> value.f0) .window(EndOfStreamWindows.get()) .apply(new WindowFunction<>(){ // implement user-defined map partition or sort partition logic });}}
> {{}}
> {{will this cause OOM in streaming execution mode?}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)