You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/08/13 15:23:00 UTC
[jira] [Work logged] (BEAM-10698) SDFs broken for Dataflow runner
v2 due to timestamps being out of bound
[ https://issues.apache.org/jira/browse/BEAM-10698?focusedWorklogId=470280&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-470280 ]
ASF GitHub Bot logged work on BEAM-10698:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 13/Aug/20 15:22
Start Date: 13/Aug/20 15:22
Worklog Time Spent: 10m
Work Description: chamikaramj edited a comment on pull request #12561:
URL: https://github.com/apache/beam/pull/12561#issuecomment-673538098
We already publish that use_runner_v2 enables streaming engine: https://cloud.google.com/dataflow/docs/guides/deploying-a-pipeline#dataflow-runner-v2
Pipeline differences come from here: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py#L760
So seems like this will not change user expectations ? Note that this issue affects all SDFs including x-lang Kafka.
cc: @robertwb @lukecwik
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 470280)
Time Spent: 1h 20m (was: 1h 10m)
> SDFs broken for Dataflow runner v2 due to timestamps being out of bound
> -----------------------------------------------------------------------
>
> Key: BEAM-10698
> URL: https://issues.apache.org/jira/browse/BEAM-10698
> Project: Beam
> Issue Type: Bug
> Components: cross-language, io-py-kafka
> Reporter: Chamikara Madhusanka Jayalath
> Assignee: Boyuan Zhang
> Priority: P0
> Fix For: 2.24.0
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Seems like this is a regression introduced by [https://github.com/apache/beam/pull/11749]
> I have a short term fix here: [https://github.com/apache/beam/pull/12557]
> We should either.
> (1) Include [https://github.com/apache/beam/pull/12557] in the release branch
> (2) Find the underlying issue that produces wrong timestamps and do that fix
> (3) Revert [https://github.com/apache/beam/pull/11749] from the 2.24.0 release branch.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)