You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Tyson Hamilton (Jira)" <ji...@apache.org> on 2020/10/28 17:38:00 UTC

[jira] [Commented] (BEAM-11149) SplittableDoFnTest.testBundleFinalizationOccursOnBoundedSplittableDoFn SDK initiated SDF checkpoints

    [ https://issues.apache.org/jira/browse/BEAM-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17222304#comment-17222304 ] 

Tyson Hamilton commented on BEAM-11149:
---------------------------------------

Boyuan, could you take a look please and advise?

> SplittableDoFnTest.testBundleFinalizationOccursOnBoundedSplittableDoFn SDK initiated SDF checkpoints
> ----------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-11149
>                 URL: https://issues.apache.org/jira/browse/BEAM-11149
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core, test-failures
>            Reporter: Tyson Hamilton
>            Assignee: Boyuan Zhang
>            Priority: P2
>
> SplittableDoFnTest.testBundleFinalizationOccursOnBoundedSplittableDoFn is failing in :runners:google-cloud-dataflow-java:validatesRunnerV2Test with error,
>  
> {code:java}
> java.lang.RuntimeException: SDK initiated SDF checkpoints are unsupported within batch DataflowSDK initiated SDF checkpoints are unsupported within batch DataflowSDK initiated SDF checkpoints are unsupported within batch DataflowSDK initiated SDF checkpoints are unsupported within batch DataflowWorkflow failed. Causes: S06:s4/ProcessElementAndRestrictionWithSizing+PAssert$19/GroupGlobally/Reify.Window/ParDo(Anonymous)+PAssert$19/GroupGlobally/ParDo(ToSingletonIterables)+PAssert$19/GroupGlobally/WithKeys/AddKeys/Map+PAssert$19/GroupGlobally/GroupByKey/Write failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers:   splittabledofntest0testbu-10280032-b1jz-harness-gkvf      Root cause: SDK initiated SDF checkpoints are unsupported within batch Dataflow,  splittabledofntest0testbu-10280032-b1jz-harness-gkvf      Root cause: SDK initiated SDF checkpoints are unsupported within batch Dataflow,  splittabledofntest0testbu-10280032-b1jz-harness-gkvf      Root cause: SDK initiated SDF checkpoints are unsupported within batch Dataflow,  splittabledofntest0testbu-10280032-b1jz-harness-gkvf      Root cause: SDK initiated SDF checkpoints are unsupported within batch Dataflow
> {code}
> See: https://scans.gradle.com/s/u4jd52ao4ulwm/tests/:runners:google-cloud-dataflow-java:validatesRunnerV2Test/org.apache.beam.sdk.transforms.SplittableDoFnTest/testBundleFinalizationOccursOnBoundedSplittableDoFn?expanded-stacktrace=WyIwIl0#1



--
This message was sent by Atlassian Jira
(v8.3.4#803005)