You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/05 01:22:00 UTC

[GitHub] [beam] damccorm opened a new issue, #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently

damccorm opened a new issue, #21708:
URL: https://github.com/apache/beam/issues/21708

   testBigQueryStorageWrite30MProto seems to have been failing since being originally introduced. First failure I found: https://ci-beam.apache.org/job/beam_PostCommit_Java_DataflowV2/1391/, which includes when this PR was merged: https://github.com/apache/beam/pull/17038
   
   I don't see any explicit reason this might be failing either in the console logs or Dataflow logs. Here's the console logs:
   
   ```
   
   java.lang.RuntimeException: Workflow failed. Causes: S06:WriteToBQ/StorageApiLoads/GroupIntoBatches/ParDo(GroupIntoBatches)/ParMultiDo(GroupIntoBatches)/Reshard/Read+WriteToBQ/StorageApiLoads/GroupIntoBatches/ParDo(GroupIntoBatches)/ParMultiDo(GroupIntoBatches)/Reshard/UnreifyWindow+WriteToBQ/StorageApiLoads/GroupIntoBatches/ParDo(GroupIntoBatches)/ParMultiDo(GroupIntoBatches)+WriteToBQ/StorageApiLoads/StorageApiWriteSharded/Write
   Records/ParMultiDo(WriteRecords)/Reshard/Reify+WriteToBQ/StorageApiLoads/StorageApiWriteSharded/Write
   Records/ParMultiDo(WriteRecords)/Reshard/Write failed., The job failed because a work item has failed
   4 times. Look in previous log entries for the cause of each one of the 4 failures. For more information,
   see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these
   workers: 
   
     testpipeline-jenkins-0319-03190548-sfjp-harness-263n
         Root cause: The worker lost
   contact with the service.,
   
   ```
   
   
   Imported from Jira [BEAM-14263](https://issues.apache.org/jira/browse/BEAM-14263). Original Jira may contain additional context.
   Reported by: danoliveira.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21708:
URL: https://github.com/apache/beam/issues/21708#issuecomment-1526084647

   I'm going to unassign this for now, then. Feel free to comment or grab it again.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21708:
URL: https://github.com/apache/beam/issues/21708#issuecomment-1428719365

   @reuvenlax is this fixed? not intended to work? what's the read on this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #21708:
URL: https://github.com/apache/beam/issues/21708#issuecomment-1481851329

   The suite has been perma-red for a very long time. This is probably representing tests that are not supposed to pass (yet) and/or have a limitation. I know the firestore tests were being disabled in some contexts, but this is yet another context to adjust. Since this job is so vague, probably we should split it and eliminate it, or perhaps it is already redundant.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently
URL: https://github.com/apache/beam/issues/21708


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #21708: beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently

Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #21708:
URL: https://github.com/apache/beam/issues/21708#issuecomment-1341287593

   @reuvenlax any update on this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] beam_PostCommit_Java_DataflowV2, testBigQueryStorageWrite30MProto failing consistently [beam]

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #21708:
URL: https://github.com/apache/beam/issues/21708#issuecomment-1747067999

   obsolete - now it runs 3M proto and test is healthy


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org