You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Teng Hu (JIRA)" <ji...@apache.org> on 2019/06/15 03:00:00 UTC

[jira] [Created] (FLINK-12855) Stagger panes on partitions to distribute workload.

Teng Hu created FLINK-12855:
-------------------------------

             Summary: Stagger panes on partitions to distribute workload.
                 Key: FLINK-12855
                 URL: https://issues.apache.org/jira/browse/FLINK-12855
             Project: Flink
          Issue Type: New Feature
          Components: API / DataStream
            Reporter: Teng Hu
         Attachments: stagger_window.png, stagger_window_delay.png, stagger_window_throughput.png

Flink natively triggers all panes belonging to same window at the same time. In other words, all panes are aligned and their triggers all fire simultaneously, causing the thundering herd effect.

This new feature provides the option that panes could be staggered across partitioned streams, so that their workloads are distributed.

Attachment: proof of concept working






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)