You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by aljoscha <gi...@git.apache.org> on 2015/12/09 15:13:12 UTC

[GitHub] flink pull request: [FLINK-3121] Emit Final Watermark in Kafka Sou...

GitHub user aljoscha opened a pull request:

    https://github.com/apache/flink/pull/1447

    [FLINK-3121] Emit Final Watermark in Kafka Source

    Kafka sources that don't read from any partition never emit a watermark,
    thereby blocking the progress of event-time in downstream operations.
    This changes the Kafka Source to emit a Long.MAX_VALUE watermark if it
    knows that it will never receive data.
    
    This also changes the Timestamp Extraction operator to reacto to a
    Long.MAX_VALUE watermark by itself emitting a Long.MAX_VALUE watermark.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/aljoscha/flink watermark-fix-kafka

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/1447.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1447
    
----
commit 01cbfe2cb556af1780670b16ec833084383b4cd1
Author: Aljoscha Krettek <al...@gmail.com>
Date:   2015-12-09T11:13:22Z

    [FLINK-3121] Emit Final Watermark in Kafka Source
    
    Kafka sources that don't read from any partition never emit a watermark,
    thereby blocking the progress of event-time in downstream operations.
    This changes the Kafka Source to emit a Long.MAX_VALUE watermark if it
    knows that it will never receive data.
    
    This also changes the Timestamp Extraction operator to reacto to a
    Long.MAX_VALUE watermark by itself emitting a Long.MAX_VALUE watermark.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] flink pull request: [FLINK-3121] Emit Final Watermark in Kafka Sou...

Posted by asfgit <gi...@git.apache.org>.

Github user asfgit closed the pull request at:

    https://github.com/apache/flink/pull/1447


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] flink pull request: [FLINK-3121] Emit Final Watermark in Kafka Sou...

Posted by rmetzger <gi...@git.apache.org>.

Github user rmetzger commented on the pull request:

    https://github.com/apache/flink/pull/1447#issuecomment-163555582
  
    +1 for the Kafka part.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---