You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/06/15 02:34:11 UTC
Build failed in Jenkins: beam_PostCommit_Python311 #294
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/294/display/redirect>
Changes:
------------------------------------------
[...truncated 10.08 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting control server on port 37685
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting data server on port 44903
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting state server on port 39199
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting logging server on port 37045
INFO:root:starting control server on port 37685
INFO:root:starting data server on port 44903
INFO:root:starting state server on port 39199
INFO:root:starting logging server on port 37045
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe274234050> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe274234050> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker container is running. container_id = b'3347fe4086d6a20957ee93f572d3977353d8446f4ae264574056ed666e4584df', worker_id = worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'3347fe4086d6a20957ee93f572d3977353d8446f4ae264574056ed666e4584df', worker_id = worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 931336879
}
message: "semi_persistent_directory: /tmp"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1686783825
nanos: 938749790
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\', \'--pipeline_type_check\']"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 941395044
}
message: "Pipeline_options: {\'gcp_oauth_scopes\': [\'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\', \'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\'], \'experiments\': [\'beam_fn_api\'], \'requirements_file\': \'/tmp/tmp0hi970jn/requirements.txt\', \'save_main_session\': True, \'sdk_location\': \'container\', \'job_endpoint\': \'embed\', \'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\', \'environment_cache_millis\': \'0\'}"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 946691751
}
message: "Creating state cache with size 0"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 947135686
}
message: "Creating insecure control channel for localhost:37685."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 961881637
}
message: "Control channel established."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 962785959
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 967246055
}
message: "Python sdk harness starting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 970854759
}
message: "Creating insecure state channel for localhost:39199."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 971158981
}
message: "State channel established."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686783825
nanos: 972578525
}
message: "Creating client data channel for localhost:44903"
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 36301851
}
message: "No more requests from control plane"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 36433458
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 36510229
}
message: "Closing all cached grpc data channels."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 36600112
}
message: "Closing all cached gRPC state handlers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 37379980
}
message: "Done consuming work."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686783826
nanos: 37511587
}
message: "Python sdk harness exiting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in 44.99358868598938 seconds with state DONE.
INFO:root:Completed job in 44.99358868598938 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-8 (poll_for_job_completion) (140563831277312) ~~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140565653923584) ~~~~~~~~~~~~~~~~~~~~~
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 285, in _perform_spawn
reply.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 220, in run
self._result = func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 967, in _thread_receiver
msg = Message.from_io(io)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 45m 40s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/2efvhdbprw5hi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python311 #302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/302/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python311 #301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/301/display/redirect?page=changes>
Changes:
[noreply] .test-infra Pipeline reads from Dataflow API and writes to BigQuery
------------------------------------------
[...truncated 11.32 MB...]
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2664: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2666: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/dataframe/io_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_read_it_test.py: 7 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_io_read_it_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2690: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_test.py: 2 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2024: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2028: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/game_stats_it_test.py: 2 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/examples/complete/game/leader_board_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_test.py: 6 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 4 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2034: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1169: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py: 1 warning
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 1 warning
apache_beam/io/gcp/big_query_query_to_table_it_test.py: 4 warnings
apache_beam/io/gcp/bigquery_file_loads_test.py: 3 warnings
apache_beam/io/gcp/bigquery_write_it_test.py: 3 warnings
apache_beam/io/gcp/bigquery_test.py: 3 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1178: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2708: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/dataframe/io_it_test.py: 2 warnings
apache_beam/io/gcp/bigquery_json_it_test.py: 1 warning
apache_beam/io/gcp/bigquery_read_it_test.py: 9 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2729: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: The default value of numeric_only in DataFrame.mean is deprecated. In a future version, it will default to False. In addition, specifying 'numeric_only=None' is deprecated. Select only valid columns or specify the value of numeric_only to silence this warning.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_aggregation
apache_beam/examples/dataframe/taxiride_it_test.py::TaxirideIT::test_enrich
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/fileio.py>:593: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1694: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
streaming = self.test_pipeline.options.view_as(StandardOptions).streaming
apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:693: BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2836: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2837: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery_read_it_test.py::ReadAllBQTests::test_read_queries
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2850: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/pytest_postCommitIT-df-py311.xml> -
[36m[1m=========================== short test summary info ============================[0m
[31mFAILED[0m apache_beam/ml/inference/sklearn_inference_it_test.py::[1mSklearnInference::test_sklearn_mnist_classification[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. Please check the worker logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
[31mFAILED[0m apache_beam/ml/inference/sklearn_inference_it_test.py::[1mSklearnInference::test_sklearn_regression[0m - Failed: Timeout >4500.0s
[31m===== [31m[1m2 failed[0m, [32m81 passed[0m, [33m39 skipped[0m, [33m600 warnings[0m[31m in 12159.56s (3:22:39)[0m[31m =====[0m
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 30m 27s
209 actionable tasks: 145 executed, 58 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/rngo3jdwdqsta
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python311 #300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/300/display/redirect>
Changes:
------------------------------------------
[...truncated 10.35 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting control server on port 41397
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting data server on port 45073
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting state server on port 40321
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting logging server on port 38393
INFO:root:starting control server on port 41397
INFO:root:starting data server on port 45073
INFO:root:starting state server on port 40321
INFO:root:starting logging server on port 38393
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f856c2f4090> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f856c2f4090> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker container is running. container_id = b'b89e21afd24a71d71ef5a87fec9e63be15f9982de4c8341c260a9ab871c0480b', worker_id = worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'b89e21afd24a71d71ef5a87fec9e63be15f9982de4c8341c260a9ab871c0480b', worker_id = worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 362205743
}
message: "semi_persistent_directory: /tmp"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1686913583
nanos: 368169784
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\', \'--pipeline_type_check\']"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 370357751
}
message: "Pipeline_options: {\'gcp_oauth_scopes\': [\'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\', \'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\'], \'experiments\': [\'beam_fn_api\'], \'requirements_file\': \'/tmp/tmpojnyjz08/requirements.txt\', \'save_main_session\': True, \'sdk_location\': \'container\', \'job_endpoint\': \'embed\', \'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\', \'environment_cache_millis\': \'0\'}"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 374371528
}
message: "Creating state cache with size 0"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 374687433
}
message: "Creating insecure control channel for localhost:41397."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 390871286
}
message: "Control channel established."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 391610383
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 394366502
}
message: "Python sdk harness starting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 397412776
}
message: "Creating insecure state channel for localhost:40321."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 397681236
}
message: "State channel established."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 398979663
}
message: "Creating client data channel for localhost:45073"
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454201698
}
message: "No more requests from control plane"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454344511
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454406738
}
message: "Closing all cached grpc data channels."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 454459428
}
message: "Closing all cached gRPC state handlers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 455412626
}
message: "Done consuming work."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686913583
nanos: 455506324
}
message: "Python sdk harness exiting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in 32.11256980895996 seconds with state DONE.
INFO:root:Completed job in 32.11256980895996 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-7 (poll_for_job_completion) (140438127146752) ~~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140439947081472) ~~~~~~~~~~~~~~~~~~~~~
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 285, in _perform_spawn
reply.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 220, in run
self._result = func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 967, in _thread_receiver
msg = Message.from_io(io)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 37m 50s
209 actionable tasks: 147 executed, 56 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/az4t6cmlkxdbc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python311 #299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/299/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python311 #298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/298/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python311 #297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/297/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python311 #296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/296/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python311 #295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python311/295/display/redirect>
Changes:
------------------------------------------
[...truncated 9.60 MB...]
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting control server on port 46027
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting data server on port 44453
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting state server on port 33337
INFO:root:starting control server on port 46027
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:starting logging server on port 36591
INFO:root:starting data server on port 44453
INFO:root:starting state server on port 33337
INFO:root:starting logging server on port 36591
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26a7a93b90> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f26a7a93b90> for environment ref_Environment_default_environment_1 (beam:env:docker:v1, b'\n%apache/beam_python3.11_sdk:2.49.0.dev')
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
INFO:root:Attempting to pull image apache/beam_python3.11_sdk:2.49.0.dev
Error response from daemon: manifest for apache/beam_python3.11_sdk:2.49.0.dev not found: manifest unknown: manifest unknown
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:root:Unable to pull image apache/beam_python3.11_sdk:2.49.0.dev, defaulting to local image if it exists
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Waiting for docker to start up. Current status is running
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Docker container is running. container_id = b'82e472ecea10f4a5097738a90bcc6372477307521c78a42a3bb0f5c7db6710c7', worker_id = worker_0
INFO:root:Waiting for docker to start up. Current status is running
INFO:root:Docker container is running. container_id = b'82e472ecea10f4a5097738a90bcc6372477307521c78a42a3bb0f5c7db6710c7', worker_id = worker_0
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 646191596
}
message: "semi_persistent_directory: /tmp"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:110"
thread: "MainThread"
WARNING:root:severity: WARN
timestamp {
seconds: 1686805535
nanos: 651179790
}
message: "Discarding unparseable args: [\'--direct_runner_use_stacked_bundle\', \'--pipeline_type_check\']"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/options/pipeline_options.py:367"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 653275728
}
message: "Pipeline_options: {\'gcp_oauth_scopes\': [\'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\', \'https://www.googleapis.com/auth/bigquery\', \'https://www.googleapis.com/auth/cloud-platform\', \'https://www.googleapis.com/auth/devstorage.full_control\', \'https://www.googleapis.com/auth/userinfo.email\', \'https://www.googleapis.com/auth/datastore\', \'https://www.googleapis.com/auth/spanner.admin\', \'https://www.googleapis.com/auth/spanner.data\'], \'experiments\': [\'beam_fn_api\'], \'requirements_file\': \'/tmp/tmpm9ecyp50/requirements.txt\', \'save_main_session\': True, \'sdk_location\': \'container\', \'job_endpoint\': \'embed\', \'environment_type\': \'DOCKER\', \'sdk_worker_parallelism\': \'1\', \'environment_cache_millis\': \'0\'}"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:134"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 656768321
}
message: "Creating state cache with size 0"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/statecache.py:234"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 657061100
}
message: "Creating insecure control channel for localhost:46027."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:187"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 670673847
}
message: "Control channel established."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:195"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 671376466
}
message: "Initializing SDKHarness with unbounded number of workers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:243"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 674429178
}
message: "Python sdk harness starting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:211"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 677896022
}
message: "Creating insecure state channel for localhost:33337."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:889"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 678181886
}
message: "State channel established."
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:896"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 679619073
}
message: "Creating client data channel for localhost:44453"
instruction_id: "bundle_1"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:770"
thread: "Thread-14"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742129802
}
message: "No more requests from control plane"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:272"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742273569
}
message: "SDK Harness waiting for in-flight requests to complete"
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:273"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742345571
}
message: "Closing all cached grpc data channels."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/data_plane.py:803"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 742396116
}
message: "Closing all cached gRPC state handlers."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:908"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 743447303
}
message: "Done consuming work."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py:285"
thread: "MainThread"
INFO:root:severity: INFO
timestamp {
seconds: 1686805535
nanos: 743542194
}
message: "Python sdk harness exiting."
log_location: "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker_main.py:213"
thread: "MainThread"
INFO:apache_beam.runners.portability.local_job_service:Completed job in 31.94184112548828 seconds with state DONE.
INFO:root:Completed job in 31.94184112548828 seconds with state DONE.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
> Task :sdks:python:test-suites:portable:py311:postCommitPy311
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) should be supplied
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
~~~~~~~~ Stack of Thread-12 (poll_for_job_completion) (140712725182208) ~~~~~~~~
File "/usr/lib/python3.11/threading.py", line 995, in _bootstrap
self._bootstrap_inner()
File "/usr/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/usr/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 214, in poll_for_job_completion
time.sleep(sleep_secs)
~~~~~~~~~~~~~~~~~~~~~ Stack of <unknown> (140714647496448) ~~~~~~~~~~~~~~~~~~~~~
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 285, in _perform_spawn
reply.run()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 220, in run
self._result = func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 967, in _thread_receiver
msg = Message.from_io(io)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 432, in from_io
header = io.read(9) # type 1, channel 4, payload 4
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/execnet/gateway_base.py",> line 400, in read
data = self._read(numbytes - len(buf))
+++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++
> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 141
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 3h 46m 48s
209 actionable tasks: 144 executed, 59 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/cnfyex45j3nam
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org