You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Márton Balassi (JIRA)" <ji...@apache.org> on 2015/02/06 17:37:34 UTC
[jira] [Created] (FLINK-1493) Support for streaming jobs preserving
global ordering of records
Márton Balassi created FLINK-1493:
-------------------------------------
Summary: Support for streaming jobs preserving global ordering of records
Key: FLINK-1493
URL: https://issues.apache.org/jira/browse/FLINK-1493
Project: Flink
Issue Type: New Feature
Components: Streaming
Reporter: Márton Balassi
Distributed streaming jobs do not give total, global ordering guarantees for records only partial ordering is provided by the system: records travelling on the same exact route of the physical plan are ordered, but they aren't between routes.
It turns out that although this feature can only be implemented via "merge sorting" in the input buffers on a timestamp field thus creating substantial latency is still desired for a number of applications.
Just a heads up for the implementation: the sorting introduces back pressure in the buffers and might cause deadlocks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)