You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Junyao Huang (Jira)" <ji...@apache.org> on 2024/03/13 03:22:00 UTC

[jira] [Created] (FLINK-34659) How to implement global sort in latest flink datastream API

Junyao Huang created FLINK-34659:
------------------------------------

             Summary: How to implement global sort in latest flink datastream API
                 Key: FLINK-34659
                 URL: https://issues.apache.org/jira/browse/FLINK-34659
             Project: Flink
          Issue Type: Bug
          Components: API / DataStream
    Affects Versions: 1.18.1
            Reporter: Junyao Huang
         Attachments: image-2024-03-13-11-21-57-846.png

[https://nightlies.apache.org/flink/flink-docs-master/zh/docs/dev/datastream/dataset_migration/#%E7%AC%AC%E4%B8%89%E7%B1%BB]
 
{{DataStream<Integer> dataStream = // [...]// assign subtask ID to all recordsDataStream<Tuple2<String, Integer>> dataStream1 = dataStream.map(new AddSubtaskIDMapFunction());dataStream1.keyBy(value -> value.f0)           .window(EndOfStreamWindows.get())           .apply(new WindowFunction<>(){           // implement user-defined map partition or sort partition logic           });}}

{{}}

{{will this cause OOM in streaming execution mode?}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)