You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/08/02 06:28:56 UTC
Build failed in Jenkins: beam_PostCommit_Python_Examples_Direct #702
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/702/display/redirect>
Changes:
------------------------------------------
[...truncated 424.69 KB...]
apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py38.xml> -
=== 22 passed, 3 skipped, 6501 deselected, 84 warnings in 267.11s (0:04:27) ====
> Task :sdks:python:test-suites:direct:py39:examples
INFO apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1
INFO apache_beam.io.filebasedsink:filebasedsink.py:358 Renamed 1 shards in 0.00 seconds.
PASSED [ 91%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
-------------------------------- live log call ---------------------------------
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[move_grouped_columns_to_index_DataFrame_139790317526944]]:139790317584336]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139790308882704]}, partitioning=Arbitrary, ops=[ComputedExpression[move_grouped_columns_to_index_DataFrame_139790317526944]], outputs={PlaceholderExpression[placeholder_DataFrame_139790308882704], ComputedExpression[move_grouped_columns_to_index_DataFrame_139790317526944]}]
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[apply_DataFrame_139790395581152]]:139790317582992]> for Stage[inputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_139790317526944]}, partitioning=Index['airline'], ops=[ComputedExpression[apply_DataFrame_139790395581152]], outputs={ComputedExpression[apply_DataFrame_139790395581152]}]
INFO apache_beam.io.fileio:fileio.py:586 Added temporary directory gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46
WARNING apache_beam.options.pipeline_options:pipeline_options.py:339 Discarding unparseable args: ['--sleep_secs=20', '--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test']
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f2349b673a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f2349b674c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f2349b679d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f2349b67a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f2349b67c10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f2349b67ca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f2349b67dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f2349b67e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f2349b67ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f2349b67f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f2349b601f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f2349b60310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f2349b60160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f2349b60280> ====================
INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 100
INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f236e7603d0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:561 Started BigQuery job: <JobReference
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing None
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:445 Using location 'US' from table <TableReference
datasetId: 'airline_ontime_data'
projectId: 'apache-beam-testing'
tableId: 'flights'> referenced by query
SELECT
FlightDate AS date,
IATA_CODE_Reporting_Airline AS airline,
Origin AS departure_airport,
Dest AS arrival_airport,
DepDelay AS departure_delay,
ArrDelay AS arrival_delay
FROM `apache-beam-testing.airline_ontime_data.flights`
WHERE
FlightDate >= '2012-12-23' AND FlightDate <= '2012-12-25' AND
DepDelay IS NOT NULL AND ArrDelay IS NOT NULL
WARNING apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:890 Dataset apache-beam-testing:beam_temp_dataset_d1b4f73e225f4c69a48fa83aa37ca5af does not exist so we will create it as temporary with location=US
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:561 Started BigQuery job: <JobReference
jobId: 'beam_bq_job_QUERY_BQ_EXPORT_JOB_aa65c13d-3_1659421703_215'
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing beam_bq_job_QUERY_BQ_EXPORT_JOB_aa65c13d-3_1659421703_215
INFO root:bigquery_tools.py:634 Job status: RUNNING
INFO root:bigquery_tools.py:634 Job status: DONE
INFO apache_beam.io.gcp.bigquery_tools:bigquery_tools.py:561 Started BigQuery job: <JobReference
jobId: 'beam_bq_job_EXPORT_BQ_EXPORT_JOB_aa65c13d-3_1659421709_139'
location: 'US'
projectId: 'apache-beam-testing'>
bq show -j --format=prettyjson --project_id=apache-beam-testing beam_bq_job_EXPORT_BQ_EXPORT_JOB_aa65c13d-3_1659421709_139
INFO root:bigquery_tools.py:634 Job status: RUNNING
INFO root:bigquery_tools.py:634 Job status: DONE
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.05014395713806152 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04306435585021973 seconds.
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/8654770770997268729_41804b41-dd3f-436a-8b36-a7921b58a73c to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3b887a12-b5f6-4c40-976c-f3019236c2c2 as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/8654770770997268729_41804b41-dd3f-436a-8b36-a7921b58a73c', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356307200.0, 1356393600.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.05043530464172363 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/745757667000176335_fd71e87c-14e7-4177-88f5-da8f1a464281 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3b887a12-b5f6-4c40-976c-f3019236c2c2 as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/745757667000176335_fd71e87c-14e7-4177-88f5-da8f1a464281', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356393600.0, 1356480000.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.0405726432800293 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/132881346888142235_b2a6faeb-4e66-4dfa-a849-a5ef425127dc to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-3b887a12-b5f6-4c40-976c-f3019236c2c2 as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03690582-63af-42e0-ab32-206daff58d46/132881346888142235_b2a6faeb-4e66-4dfa-a849-a5ef425127dc', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356220800.0, 1356307200.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.03994393348693848 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03740239143371582 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04659771919250488 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.06048703193664551 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 3 files in 0.04579734802246094 seconds.
PASSED [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
-------------------------------- live log call ---------------------------------
INFO root:pipeline.py:185 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_139790318483344], ComputedExpression[set_index_DataFrame_139790318483248], ComputedExpression[pre_combine_sum_DataFrame_139790316845712]]:139790306566096]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139790316900256]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_139790318483344], ComputedExpression[set_index_DataFrame_139790318483248], ComputedExpression[pre_combine_sum_DataFrame_139790316845712]], outputs={PlaceholderExpression[placeholder_DataFrame_139790316900256], ComputedExpression[pre_combine_sum_DataFrame_139790316845712]}]
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_139790316843264]]:139790306562928]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139790316845712]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_139790316843264]], outputs={ComputedExpression[post_combine_sum_DataFrame_139790316843264]}]
INFO apache_beam.io.fileio:fileio.py:586 Added temporary directory /tmp/.temp57bff363-94ef-44af-af1d-3eac08bff7b3
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f2349b673a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f2349b674c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f2349b679d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f2349b67a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f2349b67c10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f2349b67ca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f2349b67dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f2349b67e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f2349b67ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f2349b67f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f2349b601f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f2349b60310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f2349b60160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f2349b60280> ====================
INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 100
INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f2373393340> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file /tmp/.temp57bff363-94ef-44af-af1d-3eac08bff7b3/3481080395213459323_acd256fe-dcf3-4821-acbc-b19481704923 to dir: /tmp as tmp2k2g3zpe.result-00000-of-00001. Res: FileResult(file_name='/tmp/.temp57bff363-94ef-44af-af1d-3eac08bff7b3/3481080395213459323_acd256fe-dcf3-4821-acbc-b19481704923', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window GlobalWindow
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1398941893/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1398941893/lib/python3.9/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2288: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2294: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2739: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2741: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2765: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2284: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py39.xml> -
=== 22 passed, 3 skipped, 6501 deselected, 84 warnings in 283.12s (0:04:43) ====
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 92
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py37:examples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 6m 19s
21 actionable tasks: 15 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zvelkyky7q4r2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_Examples_Direct #704
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/704/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Examples_Direct #703
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/703/display/redirect>
Changes:
------------------------------------------
[...truncated 422.97 KB...]
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2288: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2294: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2739: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2741: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2765: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2284: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py38.xml> -
=== 22 passed, 3 skipped, 6501 deselected, 84 warnings in 192.55s (0:03:12) ====
> Task :sdks:python:test-suites:direct:py39:examples
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04436182975769043 seconds.
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/8654770770997268729_62f1d8f9-6ccb-4a08-82fe-22512db92e76 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-828efe87-7fe2-4e5a-9e30-1bfc672f260e as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/8654770770997268729_62f1d8f9-6ccb-4a08-82fe-22512db92e76', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356307200.0, 1356393600.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.04358720779418945 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/745757667000176335_0f866ef4-4d1d-45a2-a13b-c8f709c99fea to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-828efe87-7fe2-4e5a-9e30-1bfc672f260e as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/745757667000176335_0f866ef4-4d1d-45a2-a13b-c8f709c99fea', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356393600.0, 1356480000.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.04016733169555664 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/132881346888142235_e0f493d5-4f12-4891-a962-f0d82a4065d1 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-828efe87-7fe2-4e5a-9e30-1bfc672f260e as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00000-of-00001. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempb6bfdf02-8d1e-4211-9248-25bc9940618e/132881346888142235_e0f493d5-4f12-4891-a962-f0d82a4065d1', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window [1356220800.0, 1356307200.0)
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 0 files in 0.03886127471923828 seconds.
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04427027702331543 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.04207253456115723 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 1 files in 0.03314089775085449 seconds.
INFO apache_beam.io.gcp.gcsio:gcsio.py:583 Starting the file information of the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:607 Finished listing 3 files in 0.050264835357666016 seconds.
PASSED [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
-------------------------------- live log call ---------------------------------
INFO root:pipeline.py:185 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_139686449126512], ComputedExpression[set_index_DataFrame_139686393816928], ComputedExpression[pre_combine_sum_DataFrame_139686447674512]]:139686533171712]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139686448300528]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_139686449126512], ComputedExpression[set_index_DataFrame_139686393816928], ComputedExpression[pre_combine_sum_DataFrame_139686447674512]], outputs={PlaceholderExpression[placeholder_DataFrame_139686448300528], ComputedExpression[pre_combine_sum_DataFrame_139686447674512]}]
INFO root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_139686447673408]]:139686447676576]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139686447674512]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_139686447673408]], outputs={ComputedExpression[post_combine_sum_DataFrame_139686447673408]}]
INFO apache_beam.io.fileio:fileio.py:586 Added temporary directory /tmp/.temp32bff3dd-279a-4c32-bc7c-1e66e3b9614f
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f0b21f8d3a0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f0b21f8d4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f0b21f8d9d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f0b21f8da60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f0b21f8dc10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f0b21f8dca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f0b21f8ddc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f0b21f8de50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f0b21f8dee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f0b21f8df70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f0b21f831f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f0b21f83310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f0b21f83160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f0b21f83280> ====================
INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 100
INFO apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f0b48ae5820> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO apache_beam.io.fileio:fileio.py:668 Moving temporary file /tmp/.temp32bff3dd-279a-4c32-bc7c-1e66e3b9614f/8605662438439467710_0b0dd4ab-010d-4621-a58e-4ca7438848c8 to dir: /tmp as tmpzp4gpm4x.result-00000-of-00001. Res: FileResult(file_name='/tmp/.temp32bff3dd-279a-4c32-bc7c-1e66e3b9614f/8605662438439467710_0b0dd4ab-010d-4621-a58e-4ca7438848c8', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO apache_beam.io.fileio:fileio.py:692 Checking orphaned temporary files for destination None and window GlobalWindow
INFO apache_beam.io.fileio:fileio.py:707 Some files may be left orphaned in the temporary folder: []
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1398941893/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1398941893/lib/python3.9/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/build/gradleenv/1398941893/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2288: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2294: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2739: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2741: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2765: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2284: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/pytest_postCommitExamples-direct-py39.xml> -
=== 22 passed, 3 skipped, 6501 deselected, 84 warnings in 192.64s (0:03:12) ====
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Direct/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 92
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py37:examples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 34s
21 actionable tasks: 15 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/okh24cs7k7d56
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org