[jira] [Work logged] (BEAM-3909) Add tests for Flink DoFnOperator side-input checkpointing

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-3909?focusedWorklogId=83014&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-83014 ]

ASF GitHub Bot logged work on BEAM-3909:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 22/Mar/18 01:12
            Start Date: 22/Mar/18 01:12
    Worklog Time Spent: 10m 
      Work Description: aljoscha opened a new pull request #4931: [BEAM-3909] Add tests for Flink DoFnOperator side-input checkpointing
URL: https://github.com/apache/beam/pull/4931
 
 
   We test both checkpointing of pushed-back data and of side-input data.
   
   This extends `PushbackSideInputDoFnRunner` to allow resetting any cached information we keep about ready windows. Otherwise, it will not consider side inputs that might have become ready in the same bundle.
   
   Other than that, this only adds tests. The structure of the tests is:
    - Feed in some data
    - Checkpoint the operator and throw it away
    - Restore the operator
    - Send in some new data and verify that we get what we expect
   
   In the first two tests we first send in side-input data, which tests that side-inputs are correctly checkpointed. In the second set of tests we first send in main-input data, which is retained because side inputs are not ready.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 83014)
            Time Spent: 10m
    Remaining Estimate: 0h

> Add tests for Flink DoFnOperator side-input checkpointing
> ---------------------------------------------------------
>
>                 Key: BEAM-3909
>                 URL: https://issues.apache.org/jira/browse/BEAM-3909
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)