You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/07/21 23:15:10 UTC
Build failed in Jenkins: beam_PostCommit_Python310 #1102
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1102/display/redirect>
Changes:
------------------------------------------
[...truncated 14.05 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 6916.33s (1:55:16)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 1m 34s
209 actionable tasks: 147 executed, 56 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/7jzerfyoirexs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python310 #1118
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1118/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1117
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1117/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/pubsub from 1.32.0 to 1.33.0 in /sdks (#27651)
------------------------------------------
[...truncated 9.64 MB...]
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:33 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:33 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.util.log: Logging initialized @7449ms to org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.Server: Started @7552ms
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.AbstractConnector: Started ServerConnector@7fad216f{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@57725c75{/jobs,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4b5a7470{/jobs/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2882061b{/jobs/job,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3a9c9544{/jobs/job/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@13857a57{/stages,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4cf63a37{/stages/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@41ccb7a4{/stages/stage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1f4d7b45{/stages/stage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@37344672{/stages/pool,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3ce067a5{/stages/pool/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@356feb5c{/storage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5f0e9787{/storage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5cb23c19{/storage/rdd,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@770c8f4c{/storage/rdd/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@44245758{/environment,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@276b2321{/environment/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@177a6f41{/executors,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@28d97459{/executors/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@e38c01d{/executors/threadDump,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@12361e6c{/executors/threadDump/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@75e69ac7{/static,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@16adaa1b{/,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6eaaf3d5{/api,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4ac0eb0b{/jobs/job/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@66e80f48{/stages/stage/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@49df28f3{/metrics/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:34 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: MetricQueryResults()
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:35 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:35 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0725152732-553102e3_aad464ff-f4ab-4fbd-8aa4-22b606495a64 on Spark master local[4]
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:45939.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:44139.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:39561
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725152732-553102e3_aad464ff-f4ab-4fbd-8aa4-22b606495a64: Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725152732-553102e3_aad464ff-f4ab-4fbd-8aa4-22b606495a64 finished.
INFO:apache_beam.utils.subprocess_server:23/07/25 15:27:38 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped Spark@7fad216f{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread read_state:
self.run()
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 946, in run
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 262, in run
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
for work_request in self._control_stub.Control(get_responses()):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
self._target(*self._args, **self._kwargs)
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39561 {created_time:"2023-07-25T15:27:38.739748428+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
raise self
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1035, in pull_responses
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45939 {created_time:"2023-07-25T15:27:38.739758275+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
Exception in thread read_grpc_client_inputs:
for response in responses:
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44139 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-07-25T15:27:38.739748442+00:00"}"
>
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39561 {created_time:"2023-07-25T15:27:38.739748428+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 326
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:postCommitPy310IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 40m 48s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/wlvo4m7p2lwdi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1116
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1116/display/redirect>
Changes:
------------------------------------------
[...truncated 7.99 MB...]
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:43 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:43 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:44 INFO org.sparkproject.jetty.util.log: Logging initialized @7356ms to org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:44 INFO org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:44 INFO org.sparkproject.jetty.server.Server: Started @7460ms
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:44 INFO org.sparkproject.jetty.server.AbstractConnector: Started ServerConnector@468c558f{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@47e27673{/jobs,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7b68ba8c{/jobs/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7893f9c5{/jobs/job,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@75270c4f{/jobs/job/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@23efd1d8{/stages,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@72bf49cc{/stages/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5197aa5e{/stages/stage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@632d775d{/stages/stage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@25802884{/stages/pool,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@57ecd42{/stages/pool/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@72b60f3e{/storage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2922241{/storage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@20e29a7e{/storage/rdd,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6df514d0{/storage/rdd/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@46b72268{/environment,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@488708a6{/environment/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@56b67e0c{/executors,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@256439e0{/executors/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4070824{/executors/threadDump,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@63d3f7bf{/executors/threadDump/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1c2e991d{/static,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@42bfba08{/,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@66399205{/api,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@24dbce43{/jobs/job/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@712e4811{/stages/stage/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3626c930{/metrics/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: MetricQueryResults()
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:45 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0725091943-b0c3c9c1_120742d8-76e7-4214-b498-ca590b7435fb on Spark master local[4]
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:37873.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:39311.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:34197
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725091943-b0c3c9c1_120742d8-76e7-4214-b498-ca590b7435fb: Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725091943-b0c3c9c1_120742d8-76e7-4214-b498-ca590b7435fb finished.
INFO:apache_beam.utils.subprocess_server:23/07/25 09:19:49 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped Spark@468c558f{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self._target(*self._args, **self._kwargs)
self.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1035, in pull_responses
File "/usr/lib/python3.10/threading.py", line 946, in run
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34197 {created_time:"2023-07-25T09:19:49.612627052+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
for response in responses:
self._target(*self._args, **self._kwargs)
Exception in thread read_grpc_client_inputs:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 262, in run
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
for work_request in self._control_stub.Control(get_responses()):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
raise self
self._target(*self._args, **self._kwargs)
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39311 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-07-25T09:19:49.612678468+00:00"}"
>
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
raise self
for elements in elements_iterator:
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37873 {created_time:"2023-07-25T09:19:49.612750056+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34197 {created_time:"2023-07-25T09:19:49.612627052+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 326
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:postCommitPy310IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 34m 3s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/fo2nzqkbjepjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1115
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1115/display/redirect>
Changes:
------------------------------------------
[...truncated 12.76 MB...]
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:27 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:28 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.util.log: Logging initialized @7507ms to org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.Server: Started @7636ms
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.AbstractConnector: Started ServerConnector@5457ba34{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@717f19e7{/jobs,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@46095e1f{/jobs/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1017bbfb{/jobs/job,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@603e531b{/jobs/job/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@154d617c{/stages,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@79ef730d{/stages/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@153a9dfd{/stages/stage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1e6e01c7{/stages/stage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@37f62be2{/stages/pool,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@53dde642{/stages/pool/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4001f3d3{/storage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5c61e56f{/storage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@266466a3{/storage/rdd,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@23e836c{/storage/rdd/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4aea0f5b{/environment,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@57001887{/environment/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@73c11c92{/executors,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1b6fa73a{/executors/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@53789c14{/executors/threadDump,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1bcaded1{/executors/threadDump/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@157a9f80{/static,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@46c3ff51{/,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1fb0c68d{/api,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@b5b7ab5{/jobs/job/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@14446c97{/stages/stage/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5981db98{/metrics/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: MetricQueryResults()
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0725032127-130acb45_d6436a13-cbb0-43cd-a3c6-e37e182341d0 on Spark master local[4]
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:31 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:31 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:31 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:31 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:35457.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:43851.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:37373
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:32 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725032127-130acb45_d6436a13-cbb0-43cd-a3c6-e37e182341d0: Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0725032127-130acb45_d6436a13-cbb0-43cd-a3c6-e37e182341d0 finished.
INFO:apache_beam.utils.subprocess_server:23/07/25 03:21:33 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped Spark@5457ba34{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread run_worker_1-1:
Traceback (most recent call last):
Exception in thread read_state:
Traceback (most recent call last):
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37373 {created_time:"2023-07-25T03:21:34.531168694+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread read_grpc_client_inputs:
self.run()
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 946, in run
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1035, in pull_responses
File "/usr/lib/python3.10/threading.py", line 946, in run
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 262, in run
for response in responses:
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for work_request in self._control_stub.Control(get_responses()):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35457 {created_time:"2023-07-25T03:21:34.531269588+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37373 {created_time:"2023-07-25T03:21:34.531168694+00:00", grpc_status:14, grpc_message:"Socket closed"}"
> raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43851 {created_time:"2023-07-25T03:21:34.531218232+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 326
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:postCommitPy310IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 24m 2s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/hhj3q3k3rvpc6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1114
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1114/display/redirect>
Changes:
------------------------------------------
[...truncated 6.78 MB...]
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:17 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:17 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.util.log: Logging initialized @7535ms to org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.Server: Started @7664ms
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.AbstractConnector: Started ServerConnector@35092b9c{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@79e28f58{/jobs,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@119d19ce{/jobs/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@24f8d648{/jobs/job,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@35e98504{/jobs/job/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@58d455c7{/stages,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6c5f642{/stages/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2122a754{/stages/stage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@61664f05{/stages/stage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3cdabb7f{/stages/pool,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@688d7da3{/stages/pool/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@38a669d{/storage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3b0f72d5{/storage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@10b7a190{/storage/rdd,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@b5905e7{/storage/rdd/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2ad64214{/environment,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2056f3ff{/environment/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@390b6554{/executors,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@506a15d2{/executors/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@395b9cb0{/executors/threadDump,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5834d45d{/executors/threadDump/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@25f50443{/static,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6922ef3c{/,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6ddcf53{/api,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@612eb5{/jobs/job/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:18 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3a9051a4{/stages/stage/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:19 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@442d3ab0{/metrics/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:19 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: MetricQueryResults()
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:19 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:19 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0724212016-f312efb3_658564b4-4130-4c04-9e1f-9f9ff7ca2c43 on Spark master local[4]
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:43153.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:44475.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:33903
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:21 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0724212016-f312efb3_658564b4-4130-4c04-9e1f-9f9ff7ca2c43: Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0724212016-f312efb3_658564b4-4130-4c04-9e1f-9f9ff7ca2c43 finished.
INFO:apache_beam.utils.subprocess_server:23/07/24 21:20:23 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped Spark@35092b9c{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self.run()
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 262, in run
File "/usr/lib/python3.10/threading.py", line 946, in run
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33903 {created_time:"2023-07-24T21:20:23.960399005+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1035, in pull_responses
for response in responses:
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
for work_request in self._control_stub.Control(get_responses()):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
for elements in elements_iterator:
raise self
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44475 {created_time:"2023-07-24T21:20:23.960424728+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43153 {created_time:"2023-07-24T21:20:23.960519774+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
> return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33903 {created_time:"2023-07-24T21:20:23.960399005+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 326
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:postCommitPy310IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 23m 35s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/6anub7bf22r3m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1113
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1113/display/redirect?page=changes>
Changes:
[noreply] [Python] Create BigQuery wrapper with pipeline options for
------------------------------------------
[...truncated 18.86 MB...]
[31mFAILED[0m apache_beam/io/gcp/bigquery_read_it_test.py::[1mReadUsingStorageApiTests::test_iobase_source_with_query_and_filters[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
response = task()
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
return getattr(self, request_type)(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 663, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1040, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 232, in process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 568, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 570, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 261, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1533, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline' [while running 'Direct read with query/_PassThroughThenCleanupTempDatasets/ParDo(CleanUpProjects)-ptransform-27']
[31mFAILED[0m apache_beam/io/gcp/bigquery_read_it_test.py::[1mReadUsingStorageApiTests::test_iobase_source_with_row_restriction[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
response = task()
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
return getattr(self, request_type)(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 663, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1040, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 232, in process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 568, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 570, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 261, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1533, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline' [while running 'Read with BigQuery Storage API/_PassThroughThenCleanupTempDatasets/ParDo(CleanUpProjects)-ptransform-27']
[31mFAILED[0m apache_beam/io/gcp/bigquery_read_it_test.py::[1mReadUsingStorageApiTests::test_iobase_source_with_very_selective_filters[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
Traceback (most recent call last):
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
response = task()
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
lambda: self.create_worker().do_instruction(request), request)
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
return getattr(self, request_type)(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py", line 663, in process_bundle
bundle_processor.process_bundle(instruction_id))
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1040, in process_bundle
input_op_by_transform_id[element.transform_id].process_encoded(
File "/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/apache_beam/runners/worker/bundle_processor.py", line 232, in process_encoded
self.output(decoded_value)
File "apache_beam/runners/worker/operations.py", line 568, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 570, in apache_beam.runners.worker.operations.Operation.output
File "apache_beam/runners/worker/operations.py", line 261, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1513, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 625, in apache_beam.runners.common.SimpleInvoker.invoke_process
File "apache_beam/runners/common.py", line 1607, in apache_beam.runners.common._OutputHandler.handle_process_outputs
File "apache_beam/runners/common.py", line 1720, in apache_beam.runners.common._OutputHandler._write_value_to_tag
File "apache_beam/runners/worker/operations.py", line 264, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
File "apache_beam/runners/worker/operations.py", line 951, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/worker/operations.py", line 952, in apache_beam.runners.worker.operations.DoOperation.process
File "apache_beam/runners/common.py", line 1425, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 1533, in apache_beam.runners.common.DoFnRunner._reraise_augmented
File "apache_beam/runners/common.py", line 1423, in apache_beam.runners.common.DoFnRunner.process
File "apache_beam/runners/common.py", line 839, in apache_beam.runners.common.PerWindowInvoker.invoke_process
File "apache_beam/runners/common.py", line 985, in apache_beam.runners.common.PerWindowInvoker._invoke_process_per_window
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_internal.py",> line 156, in process
if 'temp_table_ref' in pipeline_details.keys():
AttributeError: '_InvalidUnpickledPCollection' object has no attribute 'pipeline' [while running 'Read with BigQuery Storage API/_PassThroughThenCleanupTempDatasets/ParDo(CleanUpProjects)-ptransform-27']
[31m===== [31m[1m12 failed[0m, [32m71 passed[0m, [33m42 skipped[0m, [33m670 warnings[0m[31m in 8727.66s (2:25:27)[0m[31m =====[0m
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 52
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 326
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:postCommitPy310IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 31m 55s
209 actionable tasks: 154 executed, 49 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/wuzbksxtyrome
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1112
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1112/display/redirect>
Changes:
------------------------------------------
[...truncated 11.18 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8131.81s (2:15:31)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 22m 16s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/254wja66sg5lw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1111
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1111/display/redirect>
Changes:
------------------------------------------
[...truncated 11.20 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8470.10s (2:21:10)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 27m 52s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/jauajmhkkc2l2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1110
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1110/display/redirect>
Changes:
------------------------------------------
[...truncated 11.21 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8275.08s (2:17:55)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 24m 23s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/4ut7voi4q2bze
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1109
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1109/display/redirect>
Changes:
------------------------------------------
[...truncated 11.12 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8693.27s (2:24:53)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 31m 45s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/mwh574qyyxbie
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1108
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1108/display/redirect>
Changes:
------------------------------------------
[...truncated 11.14 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8182.80s (2:16:22)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 23m 14s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/aubot5nlgppgk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1107
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1107/display/redirect>
Changes:
------------------------------------------
[...truncated 11.16 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8360.49s (2:19:20)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 25m 52s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/iwzepste233s2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1106
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1106/display/redirect>
Changes:
------------------------------------------
[...truncated 11.09 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8492.52s (2:21:32)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 28m 9s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/7dejjeo6xcftm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1105
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1105/display/redirect?page=changes>
Changes:
[noreply] add null value edge case unit test for Row.equals (#27614)
------------------------------------------
[...truncated 11.30 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/io/gcp/bigquery_test.py::[1mPubSubBigQueryIT::test_file_loads[0m - RuntimeError: Timeout after 600 seconds while waiting for job 2023-07-22_09_04_15-10979145793047112314 enters expected state CANCELLED. Current state is CANCELLING.
[31m===== [31m[1m1 failed[0m, [32m82 passed[0m, [33m42 skipped[0m, [33m646 warnings[0m[31m in 8485.51s (2:21:25)[0m[31m ======[0m
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 28m 53s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/zzzk2twfbmjzs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1104
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1104/display/redirect>
Changes:
------------------------------------------
[...truncated 8.87 MB...]
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1012, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1384, in process_bundle
result = result_future.get() # type: beam_fn_api_pb2.InstructionResponse
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/portability/fn_api_runner/worker_handlers.py",> line 1163, in get
raise self._exception
RuntimeError: SDK exited unexpectedly. Final status is exited. Final log line is 2023/07/22 09:20:07 failed to install required packages: failed to install requirements: exit status 1
> Task :sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile FAILED
> Task :sdks:python:test-suites:portable:py310:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:37455
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f3a6f114550> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f3a6f1145e0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f3a6f114d30> ====================
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/runners/spark/3/job-server/build/libs/beam-runners-spark-3-job-server-2.50.0-SNAPSHOT.jar'> '--spark-master-url' 'local[4]' '--artifacts-dir' '/tmp/beam-temp9nqp70fj/artifacts43zpzsrp' '--job-port' '56339' '--artifact-port' '0' '--expansion-port' '0']
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:20 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService started on localhost:34533
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:21 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService started on localhost:41745
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:21 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on localhost:56339
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:21 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Job server now running, terminate with Ctrl+C
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:22 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for job_225eaa0d-9889-4680-8a67-da88f30c5e8a.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:22 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for job_225eaa0d-9889-4680-8a67-da88f30c5e8a.ref_Environment_default_environment_1.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:22 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for job_225eaa0d-9889-4680-8a67-da88f30c5e8a.null.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:22 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for job_225eaa0d-9889-4680-8a67-da88f30c5e8a.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:23 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job BeamApp-jenkins-0722092023-caf035d3_f7983554-c08f-4b2d-bc69-c5a8ef42f5c5
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:23 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation BeamApp-jenkins-0722092023-caf035d3_f7983554-c08f-4b2d-bc69-c5a8ef42f5c5
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:23 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:24 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.util.log: Logging initialized @7301ms to org.sparkproject.jetty.util.log.Slf4jLog
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.Server: jetty-9.4.44.v20210927; built: 2021-09-27T23:02:44.612Z; git: 8da83308eeca865e495e53ef315a249d63ba9332; jvm 1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.Server: Started @7412ms
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.AbstractConnector: Started ServerConnector@3d1f0c93{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@671d9e60{/jobs,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@71724a97{/jobs/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@440f5f64{/jobs/job,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4f31b19a{/jobs/job/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2f40f111{/stages,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7ea4cb15{/stages/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7e0c0408{/stages/stage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6f844f66{/stages/stage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@13bd85e4{/stages/pool,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1eb1aa3f{/stages/pool/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@38fad03a{/storage,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6142fad8{/storage/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@77c4525e{/storage/rdd,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@79583b8e{/storage/rdd/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3cc804e4{/environment,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5f31820e{/environment/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@15361848{/executors,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4bcd5fbe{/executors/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@298b95ce{/executors/threadDump,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6c3b7439{/executors/threadDump/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@44ae27ef{/static,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@77fad99d{/,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@94a402a{/api,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@565e6fd0{/jobs/job/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4dd413d5{/stages/stage/kill,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.sparkproject.jetty.server.handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5860a796{/metrics/json,null,AVAILABLE,@Spark}
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: MetricQueryResults()
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:25 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0722092023-caf035d3_f7983554-c08f-4b2d-bc69-c5a8ef42f5c5 on Spark master local[4]
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:35941.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:43241.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:44951
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:27 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:28 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0722092023-caf035d3_f7983554-c08f-4b2d-bc69-c5a8ef42f5c5: Pipeline translated successfully. Computing outputs
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.01 seconds.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0722092023-caf035d3_f7983554-c08f-4b2d-bc69-c5a8ef42f5c5 finished.
INFO:apache_beam.utils.subprocess_server:23/07/22 09:20:29 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped Spark@3d1f0c93{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
Exception in thread read_state:
File "/usr/lib/python3.10/threading.py", line 946, in run
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 262, in run
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44951 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-07-22T09:20:29.822222618+00:00"}"
>
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
for work_request in self._control_stub.Control(get_responses()):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
Exception in thread read_grpc_client_inputs:
self._target(*self._args, **self._kwargs)
Traceback (most recent call last):
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1035, in pull_responses
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
raise self
for response in responses:
self.run()
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35941 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-07-22T09:20:29.822313528+00:00"}"
>
File "/usr/lib/python3.10/threading.py", line 946, in run
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "recvmsg:Connection reset by peer"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43241 {created_time:"2023-07-22T09:20:29.822212385+00:00", grpc_status:14, grpc_message:"recvmsg:Connection reset by peer"}"
>
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44951 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-07-22T09:20:29.822222618+00:00"}"
>
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 23m 8s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/sa6sfnfgfg6se
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python310 #1103
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python310/1103/display/redirect>
Changes:
------------------------------------------
[...truncated 11.12 MB...]
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2744: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2746: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2770: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2788: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2809: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2097: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2101: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2107: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1183: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1185: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1726: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/transforms/external_it_test.py::ExternalTransformIT::test_job_python_from_python_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2916: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2917: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2930: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml> -
[33m========== [32m83 passed[0m, [33m[1m42 skipped[0m, [33m[1m646 warnings[0m[33m in 8458.85s (2:20:58)[0m[33m ===========[0m
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 130
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableLocalRunnerTestWithRequirementsFile'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 2h 27m 54s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
Publishing failed.
The response from https://ge.apache.org/scans/publish/gradle/3.13.2/upload was not from Gradle Enterprise.
The specified server address may be incorrect, or your network environment may be interfering.
Please report this problem to your Gradle Enterprise administrator via https://ge.apache.org/help and include the following via copy/paste:
----------
Gradle version: 7.5.1
Plugin version: 3.13.2
Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/upload
Request ID: 80dd6703-c192-4427-9748-5663280a9e27
Response status code: 502
Response content type: text/html
----------
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org