[jira] [Work logged] (BEAM-9945) Use consistent element count for progress counter.

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-9945?focusedWorklogId=432349&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-432349 ]

ASF GitHub Bot logged work on BEAM-9945:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 09/May/20 08:27
            Start Date: 09/May/20 08:27
    Worklog Time Spent: 10m 
      Work Description: robertwb commented on pull request #11652:
URL: https://github.com/apache/beam/pull/11652#issuecomment-626128559


   R: @lukecwik 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 432349)
    Time Spent: 20m  (was: 10m)

> Use consistent element count for progress counter.
> --------------------------------------------------
>
>                 Key: BEAM-9945
>                 URL: https://issues.apache.org/jira/browse/BEAM-9945
>             Project: Beam
>          Issue Type: Improvement
>          Components: beam-model, sdk-go, sdk-java-harness, sdk-py-harness
>            Reporter: Robert Bradshaw
>            Priority: Critical
>             Fix For: 2.21.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> This influences how the SDK communicates progress and how splitting is performed.
> We currently inspect the element count of the output (which has inconsistent definitions across SDKs, see BEAM-9934). Instead, we can move to using an explicit, separate metric. 
> This can currently lead to incorrect progress reporting and in some cases even a crash in the UW depending on the SDK, and makes it more difficult (but not impossible) to fix element counts in the future. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)