You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/09/12 13:22:30 UTC

Build failed in Jenkins: beam_PostCommit_Python_Examples_Dataflow #869

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/869/display/redirect?page=changes>

Changes:

[noreply] [TPC-DS] Use common queries argument for Jenkins jobs (#23139)

[noreply] pubsublite: Reduce commit logspam (#22762)


------------------------------------------
[...truncated 59.73 KB...]
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:33.677Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:33.710Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey: GroupByKey not followed by a combiner.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:33.776Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey: GroupByKey not followed by a combiner.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:33.847Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:33.877Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.050Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.197Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.239Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.276Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/LeaderboardUserGlobalWindows into AddEventTimestamps
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.297Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/LeaderboardTeamFixedWindows into AddEventTimestamps
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.330Z: JOB_MESSAGE_DETAILED: Fusing consumer DecodeString into ReadPubSub/Read
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.451Z: JOB_MESSAGE_DETAILED: Fusing consumer ParseGameEventFn into DecodeString
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.479Z: JOB_MESSAGE_DETAILED: Fusing consumer AddEventTimestamps into ParseGameEventFn
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.538Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/ExtractAndSumScore/Map(<lambda at leader_board.py:151>) into CalculateTeamScores/LeaderboardTeamFixedWindows
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.569Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/ConvertToAccumulators into CalculateTeamScores/ExtractAndSumScore/Map(<lambda at leader_board.py:151>)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.606Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream into CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/ConvertToAccumulators
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.642Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine into CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.674Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/Extract into CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.709Z: JOB_MESSAGE_DETAILED: Fusing consumer TeamScoresDict into CalculateTeamScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/Extract
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.744Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/ConvertToRow into TeamScoresDict
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.779Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination into WriteTeamScoreSums/ConvertToRow
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.803Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.836Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/ToHashableTableRef into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.870Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/WithFixedSharding into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/ToHashableTableRef
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.903Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/Map(reify_timestamps) into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/WithFixedSharding
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.938Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/WriteStream into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/Map(reify_timestamps)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.972Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/MergeBuckets into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/ReadStream
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:34.996Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/FlatMap(restore_timestamps) into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/MergeBuckets
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.028Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/FlatMap(restore_timestamps)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.060Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/FromHashableTableRef into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.095Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into WriteTeamScoreSums/WriteToBigQuery/_StreamToBigQuery/FromHashableTableRef
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.125Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/ExtractAndSumScore/Map(<lambda at leader_board.py:151>) into CalculateUserScores/LeaderboardUserGlobalWindows
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.146Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/ConvertToAccumulators into CalculateUserScores/ExtractAndSumScore/Map(<lambda at leader_board.py:151>)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.177Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/WriteStream into CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/ConvertToAccumulators
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.212Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine into CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/GroupByKey/ReadStream
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.244Z: JOB_MESSAGE_DETAILED: Fusing consumer CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/Extract into CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.270Z: JOB_MESSAGE_DETAILED: Fusing consumer FormatUserScoreSums into CalculateUserScores/ExtractAndSumScore/CombinePerKey(sum)/Combine/Extract
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.302Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/ConvertToRow into FormatUserScoreSums
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.335Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination into WriteUserScoreSums/ConvertToRow
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.412Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/AppendDestination
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.463Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/ToHashableTableRef into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/AddInsertIds
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.489Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/WithFixedSharding into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/ToHashableTableRef
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.554Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/Map(reify_timestamps) into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/WithFixedSharding
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.591Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/WriteStream into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/Map(reify_timestamps)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.625Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/MergeBuckets into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/ReadStream
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.650Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/FlatMap(restore_timestamps) into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/GroupByKey/MergeBuckets
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.680Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/CommitInsertIds/FlatMap(restore_timestamps)
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.714Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/FromHashableTableRef into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.741Z: JOB_MESSAGE_DETAILED: Fusing consumer WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn) into WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/FromHashableTableRef
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.774Z: JOB_MESSAGE_BASIC: Running job using Streaming Engine
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.797Z: JOB_MESSAGE_BASIC: Using cloud KMLS key to protect persistent state.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.905Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.944Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:35.981Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:36.005Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:36.066Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:36.101Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:36.146Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:58:46.456Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:59:12.953Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[32mINFO    [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:242 2022-09-12T12:59:47.243Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
[33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:253 Timing out on waiting for job 2022-09-12_05_58_20-7673661972781028106 after 601 seconds
[32mINFO    [0m apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to perform query SELECT total_score FROM `apache-beam-testing.leader_board_it_dataset16629874247514.leader_board_users` WHERE total_score=5000 LIMIT 1 to BQ
[32mINFO    [0m apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:96 Read from given query (SELECT total_score FROM `apache-beam-testing.leader_board_it_dataset16629874247514.leader_board_users` WHERE total_score=5000 LIMIT 1), total rows 0
[32mINFO    [0m apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:101 Generate checksum: da39a3ee5e6b4b0d3255bfef95601890afd80709
[33m=============================== warnings summary ===============================[0m
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py:37
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/grpc_helpers.py>:37: DeprecationWarning: Support for grpcio-gcp is deprecated. This feature will be
              removed from `google-api-core` after January 1, 2024. If you need to
              continue to use this feature, please pin to a specific version of
              `google-api-core`.
    warnings.warn(

../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
apache_beam/typehints/pandas_type_compatibility_test.py:66
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    }).set_index(pd.Int64Index(range(123, 223), name='an_index')),

apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
apache_beam/typehints/pandas_type_compatibility_test.py:89
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(123, 223), name='an_index'),

apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(475, 575), name='another_index'),

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/pytest_postCommitIT-df-py39-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
[31m====== [31m[1m1 failed[0m, [32m16 passed[0m, [33m3 skipped[0m, [33m86 warnings[0m[31m in 1544.16s (0:25:44)[0m[31m =======[0m

> Task :sdks:python:test-suites:dataflow:py39:examples FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 187

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:examples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 27m 1s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nozqcmekmigp4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Python_Examples_Dataflow #870

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/870/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org