You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/02 18:36:00 UTC
[jira] [Work logged] (BEAM-6333) allow disabling/configuring
automatic watermark generation for idle kafka partitions
[ https://issues.apache.org/jira/browse/BEAM-6333?focusedWorklogId=180357&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-180357 ]
ASF GitHub Bot logged work on BEAM-6333:
----------------------------------------
Author: ASF GitHub Bot
Created on: 02/Jan/19 18:35
Start Date: 02/Jan/19 18:35
Worklog Time Spent: 10m
Work Description: rangadi commented on issue #7382: [BEAM-6333] allow disabling idle partition watermark advancement
URL: https://github.com/apache/beam/pull/7382#issuecomment-450945157
Left a comment on the Jira. Lets discuss about actual usecase and what we want to do there. We can then look into specific changes.. I have a few minor comments on the implementation. Would like to understand the motivation more.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 180357)
Time Spent: 10m
Remaining Estimate: 20m (was: 0.5h)
> allow disabling/configuring automatic watermark generation for idle kafka partitions
> ------------------------------------------------------------------------------------
>
> Key: BEAM-6333
> URL: https://issues.apache.org/jira/browse/BEAM-6333
> Project: Beam
> Issue Type: Improvement
> Components: io-java-kafka
> Affects Versions: 2.9.0
> Reporter: Jan Doms
> Assignee: Raghu Angadi
> Priority: Major
> Labels: easyfix, pull-request-available
> Original Estimate: 0.5h
> Time Spent: 10m
> Remaining Estimate: 20m
>
> For pipelines that require the emitted watermarks to be absolutely correct the current behavior using 2 seconds timeout could lead to problems.
> Therefor it should be possible to disable this behavior. While changing the code the hardcoded 2 seconds can also be made configurable. (There's already a TODO about that in the code.)
>
> A (preliminary) PR making this change is available: https://github.com/apache/beam/pull/7382.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)