You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "burkedavison (via GitHub)" <gi...@apache.org> on 2023/11/09 00:52:29 UTC

[PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

burkedavison opened a new pull request, #29359:
URL: https://github.com/apache/beam/pull/29359

   Do not merge.
   
   Updating google_cloud_bigtable to 2.25.3 to test against Beam 2.49.0.
   
   ------------------------
   
   Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
   
    - [ ] Mention the appropriate issue in your description (for example: `addresses #123`), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment `fixes #<ISSUE NUMBER>` instead.
    - [ ] Update `CHANGES.md` with noteworthy changes.
    - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://github.com/apache/beam/blob/master/CONTRIBUTING.md#make-the-reviewers-job-easier).
   
   To check the build health, please visit [https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md](https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md)
   
   GitHub Actions Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   [![Build python source distribution and wheels](https://github.com/apache/beam/workflows/Build%20python%20source%20distribution%20and%20wheels/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule)
   [![Python tests](https://github.com/apache/beam/workflows/Python%20tests/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule)
   [![Java tests](https://github.com/apache/beam/workflows/Java%20Tests/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule)
   [![Go tests](https://github.com/apache/beam/workflows/Go%20tests/badge.svg?branch=master&event=schedule)](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule)
   
   See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more information about GitHub Actions CI or the [workflows README](https://github.com/apache/beam/blob/master/.github/workflows/README.md) to see a list of phrases to trigger workflows.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison closed pull request #29359: (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0
URL: https://github.com/apache/beam/pull/29359


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811013796

   Run Java PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811115475

   Run Java_PVR_Flink_Batch PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1804349377

   Hey @byronellis , could you trigger the Java PreCommits? I must not have permissions, as they're being skipped for me at the moment: https://github.com/apache/beam/actions?query=actor%3Aburkedavison


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811115783

   Run Java Spark PortableValidatesRunner Batch


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1813094313

   Run Java_PVR_Flink_Batch PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1810672165

   First invocation: https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6337/
   One failure: https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6337/testReport/junit/org.apache.beam.sdk.util/UnboundedScheduledExecutorServiceTest/testThreadsAreAddedOnlyAsNeededWithContention/
   
   org.apache.beam.sdk.util.UnboundedScheduledExecutorServiceTest.testThreadsAreAddedOnlyAsNeededWithContention
   ```
   java.lang.AssertionError
   	at org.junit.Assert.fail(Assert.java:87)
   	at org.junit.Assert.assertTrue(Assert.java:42)
   	at org.junit.Assert.assertTrue(Assert.java:53)
   	at org.apache.beam.sdk.util.UnboundedScheduledExecutorServiceTest.testThreadsAreAddedOnlyAsNeededWithContention(UnboundedScheduledExecutorServiceTest.java:556)
   ...
   Nov 13, 2023 6:24:14 PM org.apache.beam.sdk.util.UnboundedScheduledExecutorServiceTest testThreadsAreAddedOnlyAsNeededWithContention
   INFO: Created 194 threads to execute at most 100 parallel tasks
   ```
   Rerunning.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1810979239

   Second invocation: https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6341/
   
   Two failures:
   * [Replicated] [o.a.b.s.u.UnboundedScheduledExecutorServiceTest.testThreadsAreAddedOnlyAsNeededWithContention](https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6341/testReport/junit/org.apache.beam.sdk.util/UnboundedScheduledExecutorServiceTest/testThreadsAreAddedOnlyAsNeededWithContention/)
   * [New] [org.apache.beam.sdk.io.FileIOTest.testMatchWatchForNewFiles](https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6341/testReport/junit/org.apache.beam.sdk.io/FileIOTest/testMatchWatchForNewFiles/)
   
   ```
   org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.RuntimeException: Extract file timestamp failed: got file timestamp == 0.
   	at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:374)
   	at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:342)
   	at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:218)
   	at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:67)
   	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:321)
   	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:398)
   	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:335)
   	at org.apache.beam.sdk.io.FileIOTest.testMatchWatchForNewFiles(FileIOTest.java:363)
   ...
   Caused by: java.lang.RuntimeException: Extract file timestamp failed: got file timestamp == 0.
   	at org.apache.beam.sdk.io.FileIO$MatchAll$ExtractFilenameAndLastUpdateFn.apply(FileIO.java:752)
   	at org.apache.beam.sdk.io.FileIO$MatchAll$ExtractFilenameAndLastUpdateFn.apply(FileIO.java:746)
   	at org.apache.beam.sdk.transforms.Watch$WatchGrowthFn.lambda$new$b100bdc2$1(Watch.java:861)
   	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.hash.AbstractHasher.putObject(AbstractHasher.java:118)
   	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.hash.AbstractHashFunction.hashObject(AbstractHashFunction.java:33)
   	at org.apache.beam.sdk.transforms.Watch$WatchGrowthFn.hash128(Watch.java:975)
   	at org.apache.beam.sdk.transforms.Watch$WatchGrowthFn.computeNeverSeenBeforeResults(Watch.java:986)
   	at org.apache.beam.sdk.transforms.Watch$WatchGrowthFn.process(Watch.java:913)
   ```
   See [Standard Error section](https://ci-beam.apache.org/job/beam_PreCommit_Java_Phrase/6341/testReport/junit/org.apache.beam.sdk.io/FileIOTest/testMatchWatchForNewFiles/) for additional output


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1803967503

   Error during `beam_PreCommit_Java`: "Setup Repository"
   https://github.com/apache/beam/actions/runs/6813097594/job/18526908727
   ```
   Prepare all required actions
   Run ./.github/actions/rerun-job-action
   Run URL=https://api.github.com/repos/apache/beam/pulls/29359/commits
   Run URL="https://api.github.com/repos/apache/beam/commits/b1d35c6[44](https://github.com/apache/beam/actions/runs/6813097594/job/18526908727#step:5:46)5f797c4031437066c62a2fb702f8a4b/check-runs"
   Run URL="https://api.github.com/repos/apache/beam/actions/runs?check_suite_id="
   Run URL="https://api.github.com/repos/apache/beam/actions/runs/null/jobs"
   jq: error (at <stdin>:4): Cannot iterate over null (null)
   Error: Process completed with exit code 5.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811116081

   Run Java Dataflow V2 ValidatesRunner Streaming


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "byronellis (via GitHub)" <gi...@apache.org>.
byronellis commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1808733332

   Run Java PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1804345357

   Run Java PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1810665155

   Run Java PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1803925919

   Run Java PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1803958843

   retest this please


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "byronellis (via GitHub)" <gi...@apache.org>.
byronellis commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1804354362

   I did, stuff is still pending I think


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811114103

   All tests passed on 3rd invocation w/o source change.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811115934

   Run PostCommit_Java_DataflowV2


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1811115303

   Run Java Postcommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] (No need to review) Testing google_cloud_bigtable 2.25.3 with Beam 2.49.0 [beam]

Posted by "burkedavison (via GitHub)" <gi...@apache.org>.
burkedavison commented on PR #29359:
URL: https://github.com/apache/beam/pull/29359#issuecomment-1812606891

   Run Java_PVR_Flink_Batch PreCommit


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org