You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/09/03 10:29:51 UTC
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6886
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6886/display/redirect>
Changes:
------------------------------------------
[...truncated 608.25 KB...]
#9 393.8 google-cloud-pubsublite==1.8.3
#9 393.8 google-cloud-recommendations-ai==0.10.4
#9 393.8 google-cloud-resource-manager==1.10.3
#9 393.8 google-cloud-spanner==3.40.0
#9 393.8 google-cloud-storage==2.10.0
#9 393.8 google-cloud-videointelligence==2.11.3
#9 393.8 google-cloud-vision==3.4.4
#9 393.8 google-crc32c==1.5.0
#9 393.8 google-pasta==0.2.0
#9 393.8 google-resumable-media==2.5.0
#9 393.8 googleapis-common-protos==1.60.0
#9 393.8 greenlet==2.0.2
#9 393.8 grpc-google-iam-v1==0.12.6
#9 393.8 grpcio==1.56.2
#9 393.8 grpcio-status==1.56.2
#9 393.8 guppy3==3.1.3
#9 393.8 h5py==3.9.0
#9 393.8 hdfs==2.7.2
#9 393.8 httplib2==0.22.0
#9 393.8 hypothesis==6.82.3
#9 393.8 idna==3.4
#9 393.8 importlib-metadata==6.8.0
#9 393.8 iniconfig==2.0.0
#9 393.8 joblib==1.3.2
#9 393.8 keras==2.13.1
#9 393.8 libclang==16.0.6
#9 393.8 Markdown==3.4.4
#9 393.8 MarkupSafe==2.1.3
#9 393.8 mmh3==4.0.1
#9 393.8 mock==5.1.0
#9 393.8 nltk==3.8.1
#9 393.8 nose==1.3.7
#9 393.8 numpy==1.24.3
#9 393.8 oauth2client==4.1.3
#9 393.8 oauthlib==3.2.2
#9 393.8 objsize==0.6.1
#9 393.8 opt-einsum==3.3.0
#9 393.8 orjson==3.9.4
#9 393.8 overrides==6.5.0
#9 393.8 packaging==23.1
#9 393.8 pandas==1.5.3
#9 393.8 parameterized==0.9.0
#9 393.8 pip==23.0.1
#9 393.8 pluggy==1.2.0
#9 393.8 proto-plus==1.22.3
#9 393.8 protobuf==4.23.4
#9 393.8 psycopg2-binary==2.9.7
#9 393.8 pyarrow==11.0.0
#9 393.8 pyasn1==0.5.0
#9 393.8 pyasn1-modules==0.3.0
#9 393.8 pycparser==2.21
#9 393.8 pydot==1.4.2
#9 393.8 PyHamcrest==2.0.4
#9 393.8 pymongo==4.4.1
#9 393.8 PyMySQL==1.1.0
#9 393.8 pyparsing==3.1.1
#9 393.8 pytest==7.4.0
#9 393.8 pytest-timeout==2.1.0
#9 393.8 pytest-xdist==3.3.1
#9 393.8 python-dateutil==2.8.2
#9 393.8 python-snappy==0.6.1
#9 393.8 pytz==2023.3
#9 393.8 PyYAML==6.0.1
#9 393.8 regex==2023.8.8
#9 393.8 requests==2.31.0
#9 393.8 requests-mock==1.11.0
#9 393.8 requests-oauthlib==1.3.1
#9 393.8 rsa==4.9
#9 393.8 scikit-learn==1.3.0
#9 393.8 scipy==1.10.1
#9 393.8 setuptools==68.1.2
#9 393.8 Shapely==1.8.5.post1
#9 393.8 six==1.16.0
#9 393.8 sortedcontainers==2.4.0
#9 393.8 soupsieve==2.4.1
#9 393.8 SQLAlchemy==1.4.49
#9 393.8 sqlparse==0.4.4
#9 393.8 tenacity==8.2.2
#9 393.8 tensorboard==2.13.0
#9 393.8 tensorboard-data-server==0.7.1
#9 393.8 tensorflow==2.13.0
#9 393.8 tensorflow-estimator==2.13.0
#9 393.8 tensorflow-io-gcs-filesystem==0.33.0
#9 393.8 termcolor==2.3.0
#9 393.8 testcontainers==3.7.1
#9 393.8 threadpoolctl==3.2.0
#9 393.8 tomli==2.0.1
#9 393.8 tqdm==4.66.0
#9 393.8 typing_extensions==4.5.0
#9 393.8 uritemplate==4.1.1
#9 393.8 urllib3==1.26.16
#9 393.8 websocket-client==1.6.1
#9 393.8 Werkzeug==2.3.6
#9 393.8 wheel==0.41.2
#9 393.8 wrapt==1.15.0
#9 393.8 zipp==3.16.2
#9 393.8 zstandard==0.21.0
#9 DONE 395.0s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.008 Collecting pip-licenses<5
#13 1.069 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.078 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.078 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.138 Collecting prettytable>=2.3.0
#13 1.153 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.207 Collecting wcwidth
#13 1.222 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.466 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.628 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.629 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.780
#13 2.780 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.780 [notice] To update, run: pip install --upgrade pip
#13 12.06 INFO:root:Successfully pulled licenses for 137 dependencies
#13 12.06 Skip pulling license for bs4
#13 DONE 12.2s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.3s
#16 exporting to image
#16 exporting layers
#16 exporting layers 22.0s done
#16 writing image sha256:0f4efb878b3c3d05b0a5af2bbe28f1dad68c75d2ea5d1f5328a56a9ac510078a done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.0s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:36785
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fe2ed6ec940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fe2ed6ec9d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fe2ed6eb160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:41959
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 8s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/zss3o2sdzekba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_Portable_Python_Cron #6894
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6894/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6893
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6893/display/redirect?page=changes>
Changes:
[noreply] Pass runtime configs & variables to BeamSqlSeekableTable (#28253)
------------------------------------------
[...truncated 1.02 MB...]
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "Ae4K7gruCg==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_2/PairWithRestriction0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:element_count:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "LA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_13"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/write/ref_PCollection_PCollection_15:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:element_count:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "Ag==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_15"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-WriteBundles_25"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/write/ref_PCollection_PCollection_15:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-WriteBundles_25"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/write/ref_PCollection_PCollection_15:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:data_channel:read_index:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "LA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_13:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_13:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/write/ref_PCollection_PCollection_15:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-WriteBundles_25"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:element_count:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "Ag==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_14"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-Pair_26"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_13:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-Pair_26"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_13:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-Pair_26"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-Pair_26"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Write-Write-WriteImpl-WriteBundles_25"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_13:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AtYCqwGrAQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_15"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "IswFExk=",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_13"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AtQCqgGqAQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_14"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }]
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server:}
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO:apache_beam.utils.subprocess_server:INFO: JobManager for job 4b4be71b5ccc1af9248ee2ab32244e85 with leader id adb98d9a3cc84c7a9bdf69f8d9dc49df lost leadership.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO:apache_beam.utils.subprocess_server:INFO: Stop job leader service.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down TaskExecutorLocalStateStoresManager.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$7
INFO:apache_beam.utils.subprocess_server:INFO: Removing cache directory /tmp/flink-web-ui
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO:apache_beam.utils.subprocess_server:INFO: Shut down complete.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO:apache_beam.utils.subprocess_server:INFO: FileChannelManager removed spill file directory /tmp/flink-io-b9adabfd-0a3d-4119-a8da-78cb4c9682cd
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down the network environment and its components.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO:apache_beam.utils.subprocess_server:INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-12226af7-5db5-40e9-ada6-f2dcd5021449
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down the kvState service and its components.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO:apache_beam.utils.subprocess_server:INFO: Stop job leader service.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO:apache_beam.utils.subprocess_server:INFO: removed file cache directory /tmp/flink-dist-cache-3e695578-621d-48cd-bb44-8ba5e0dfb1d5
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO:apache_beam.utils.subprocess_server:INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO:apache_beam.utils.subprocess_server:INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO:apache_beam.utils.subprocess_server:INFO: Closing components.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO:apache_beam.utils.subprocess_server:INFO: Stopping SessionDispatcherLeaderProcess.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO:apache_beam.utils.subprocess_server:INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO:apache_beam.utils.subprocess_server:INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO:apache_beam.utils.subprocess_server:INFO: Stopping resource manager service.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO:apache_beam.utils.subprocess_server:INFO: Closing the slot manager.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO:apache_beam.utils.subprocess_server:INFO: Suspending the slot manager.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO:apache_beam.utils.subprocess_server:INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:29 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO:apache_beam.utils.subprocess_server:INFO: Stopping Akka RPC service.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:30 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO:apache_beam.utils.subprocess_server:INFO: Stopping Akka RPC service.
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:30 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO:apache_beam.utils.subprocess_server:INFO: Stopped Akka RPC service.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:30 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down BLOB cache
INFO:apache_beam.utils.subprocess_server:Sep 05, 2023 4:26:30 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down BLOB cache
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 52s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/lmtffsqny7x4w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6892
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6892/display/redirect>
Changes:
------------------------------------------
[...truncated 634.48 KB...]
#9 401.9 google-cloud-pubsublite==1.8.3
#9 401.9 google-cloud-recommendations-ai==0.10.4
#9 401.9 google-cloud-resource-manager==1.10.3
#9 401.9 google-cloud-spanner==3.40.0
#9 401.9 google-cloud-storage==2.10.0
#9 401.9 google-cloud-videointelligence==2.11.3
#9 401.9 google-cloud-vision==3.4.4
#9 401.9 google-crc32c==1.5.0
#9 401.9 google-pasta==0.2.0
#9 401.9 google-resumable-media==2.5.0
#9 401.9 googleapis-common-protos==1.60.0
#9 401.9 greenlet==2.0.2
#9 401.9 grpc-google-iam-v1==0.12.6
#9 401.9 grpcio==1.56.2
#9 401.9 grpcio-status==1.56.2
#9 401.9 guppy3==3.1.3
#9 401.9 h5py==3.9.0
#9 401.9 hdfs==2.7.2
#9 401.9 httplib2==0.22.0
#9 401.9 hypothesis==6.82.3
#9 401.9 idna==3.4
#9 401.9 importlib-metadata==6.8.0
#9 401.9 iniconfig==2.0.0
#9 401.9 joblib==1.3.2
#9 401.9 keras==2.13.1
#9 401.9 libclang==16.0.6
#9 401.9 Markdown==3.4.4
#9 401.9 MarkupSafe==2.1.3
#9 401.9 mmh3==4.0.1
#9 401.9 mock==5.1.0
#9 401.9 nltk==3.8.1
#9 401.9 nose==1.3.7
#9 401.9 numpy==1.24.3
#9 401.9 oauth2client==4.1.3
#9 401.9 oauthlib==3.2.2
#9 401.9 objsize==0.6.1
#9 401.9 opt-einsum==3.3.0
#9 401.9 orjson==3.9.4
#9 401.9 overrides==6.5.0
#9 401.9 packaging==23.1
#9 401.9 pandas==1.5.3
#9 401.9 parameterized==0.9.0
#9 401.9 pip==23.0.1
#9 401.9 pluggy==1.2.0
#9 401.9 proto-plus==1.22.3
#9 401.9 protobuf==4.23.4
#9 401.9 psycopg2-binary==2.9.7
#9 401.9 pyarrow==11.0.0
#9 401.9 pyasn1==0.5.0
#9 401.9 pyasn1-modules==0.3.0
#9 401.9 pycparser==2.21
#9 401.9 pydot==1.4.2
#9 401.9 PyHamcrest==2.0.4
#9 401.9 pymongo==4.4.1
#9 401.9 PyMySQL==1.1.0
#9 401.9 pyparsing==3.1.1
#9 401.9 pytest==7.4.0
#9 401.9 pytest-timeout==2.1.0
#9 401.9 pytest-xdist==3.3.1
#9 401.9 python-dateutil==2.8.2
#9 401.9 python-snappy==0.6.1
#9 401.9 pytz==2023.3
#9 401.9 PyYAML==6.0.1
#9 401.9 regex==2023.8.8
#9 401.9 requests==2.31.0
#9 401.9 requests-mock==1.11.0
#9 401.9 requests-oauthlib==1.3.1
#9 401.9 rsa==4.9
#9 401.9 scikit-learn==1.3.0
#9 401.9 scipy==1.10.1
#9 401.9 setuptools==68.1.2
#9 401.9 Shapely==1.8.5.post1
#9 401.9 six==1.16.0
#9 401.9 sortedcontainers==2.4.0
#9 401.9 soupsieve==2.4.1
#9 401.9 SQLAlchemy==1.4.49
#9 401.9 sqlparse==0.4.4
#9 401.9 tenacity==8.2.2
#9 401.9 tensorboard==2.13.0
#9 401.9 tensorboard-data-server==0.7.1
#9 401.9 tensorflow==2.13.0
#9 401.9 tensorflow-estimator==2.13.0
#9 401.9 tensorflow-io-gcs-filesystem==0.33.0
#9 401.9 termcolor==2.3.0
#9 401.9 testcontainers==3.7.1
#9 401.9 threadpoolctl==3.2.0
#9 401.9 tomli==2.0.1
#9 401.9 tqdm==4.66.0
#9 401.9 typing_extensions==4.5.0
#9 401.9 uritemplate==4.1.1
#9 401.9 urllib3==1.26.16
#9 401.9 websocket-client==1.6.1
#9 401.9 Werkzeug==2.3.6
#9 401.9 wheel==0.41.2
#9 401.9 wrapt==1.15.0
#9 401.9 zipp==3.16.2
#9 401.9 zstandard==0.21.0
#9 DONE 403.1s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.015 Collecting pip-licenses<5
#13 1.081 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.089 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.090 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.150 Collecting prettytable>=2.3.0
#13 1.166 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.222 Collecting wcwidth
#13 1.237 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.500 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.662 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.663 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.814
#13 2.814 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.814 [notice] To update, run: pip install --upgrade pip
#13 24.47 Skip pulling license for bs4
#13 24.47 INFO:root:Successfully pulled licenses for 137 dependencies
#13 DONE 24.6s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 21.9s done
#16 writing image sha256:fabca85cdc1b77a5a665eef7b586a62ecc8b30582e230a5c3ce2f2b963cddc4f done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.0s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:39815
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f786ca1a940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f786ca1a9d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f786ca19160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:41661
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 27s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/5q66fzfcejtpw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6891
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6891/display/redirect>
Changes:
------------------------------------------
[...truncated 634.78 KB...]
#9 410.8 google-cloud-pubsublite==1.8.3
#9 410.8 google-cloud-recommendations-ai==0.10.4
#9 410.8 google-cloud-resource-manager==1.10.3
#9 410.8 google-cloud-spanner==3.40.0
#9 410.8 google-cloud-storage==2.10.0
#9 410.8 google-cloud-videointelligence==2.11.3
#9 410.8 google-cloud-vision==3.4.4
#9 410.8 google-crc32c==1.5.0
#9 410.8 google-pasta==0.2.0
#9 410.8 google-resumable-media==2.5.0
#9 410.8 googleapis-common-protos==1.60.0
#9 410.8 greenlet==2.0.2
#9 410.8 grpc-google-iam-v1==0.12.6
#9 410.8 grpcio==1.56.2
#9 410.8 grpcio-status==1.56.2
#9 410.8 guppy3==3.1.3
#9 410.8 h5py==3.9.0
#9 410.8 hdfs==2.7.2
#9 410.8 httplib2==0.22.0
#9 410.8 hypothesis==6.82.3
#9 410.8 idna==3.4
#9 410.8 importlib-metadata==6.8.0
#9 410.8 iniconfig==2.0.0
#9 410.8 joblib==1.3.2
#9 410.8 keras==2.13.1
#9 410.8 libclang==16.0.6
#9 410.8 Markdown==3.4.4
#9 410.8 MarkupSafe==2.1.3
#9 410.8 mmh3==4.0.1
#9 410.8 mock==5.1.0
#9 410.8 nltk==3.8.1
#9 410.8 nose==1.3.7
#9 410.8 numpy==1.24.3
#9 410.8 oauth2client==4.1.3
#9 410.8 oauthlib==3.2.2
#9 410.8 objsize==0.6.1
#9 410.8 opt-einsum==3.3.0
#9 410.8 orjson==3.9.4
#9 410.8 overrides==6.5.0
#9 410.8 packaging==23.1
#9 410.8 pandas==1.5.3
#9 410.8 parameterized==0.9.0
#9 410.8 pip==23.0.1
#9 410.8 pluggy==1.2.0
#9 410.8 proto-plus==1.22.3
#9 410.8 protobuf==4.23.4
#9 410.8 psycopg2-binary==2.9.7
#9 410.8 pyarrow==11.0.0
#9 410.8 pyasn1==0.5.0
#9 410.8 pyasn1-modules==0.3.0
#9 410.8 pycparser==2.21
#9 410.8 pydot==1.4.2
#9 410.8 PyHamcrest==2.0.4
#9 410.8 pymongo==4.4.1
#9 410.8 PyMySQL==1.1.0
#9 410.8 pyparsing==3.1.1
#9 410.8 pytest==7.4.0
#9 410.8 pytest-timeout==2.1.0
#9 410.8 pytest-xdist==3.3.1
#9 410.8 python-dateutil==2.8.2
#9 410.8 python-snappy==0.6.1
#9 410.8 pytz==2023.3
#9 410.8 PyYAML==6.0.1
#9 410.8 regex==2023.8.8
#9 410.8 requests==2.31.0
#9 410.8 requests-mock==1.11.0
#9 410.8 requests-oauthlib==1.3.1
#9 410.8 rsa==4.9
#9 410.8 scikit-learn==1.3.0
#9 410.8 scipy==1.10.1
#9 410.8 setuptools==68.1.2
#9 410.8 Shapely==1.8.5.post1
#9 410.8 six==1.16.0
#9 410.8 sortedcontainers==2.4.0
#9 410.8 soupsieve==2.4.1
#9 410.8 SQLAlchemy==1.4.49
#9 410.8 sqlparse==0.4.4
#9 410.8 tenacity==8.2.2
#9 410.8 tensorboard==2.13.0
#9 410.8 tensorboard-data-server==0.7.1
#9 410.8 tensorflow==2.13.0
#9 410.8 tensorflow-estimator==2.13.0
#9 410.8 tensorflow-io-gcs-filesystem==0.33.0
#9 410.8 termcolor==2.3.0
#9 410.8 testcontainers==3.7.1
#9 410.8 threadpoolctl==3.2.0
#9 410.8 tomli==2.0.1
#9 410.8 tqdm==4.66.0
#9 410.8 typing_extensions==4.5.0
#9 410.8 uritemplate==4.1.1
#9 410.8 urllib3==1.26.16
#9 410.8 websocket-client==1.6.1
#9 410.8 Werkzeug==2.3.6
#9 410.8 wheel==0.41.2
#9 410.8 wrapt==1.15.0
#9 410.8 zipp==3.16.2
#9 410.8 zstandard==0.21.0
#9 DONE 412.0s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.079 Collecting pip-licenses<5
#13 1.145 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.155 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.156 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.216 Collecting prettytable>=2.3.0
#13 1.239 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.297 Collecting wcwidth
#13 1.313 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.614 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.790 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.791 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.948
#13 2.948 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.948 [notice] To update, run: pip install --upgrade pip
#13 72.28 INFO:root:Successfully pulled licenses for 137 dependencies
#13 72.28 Skip pulling license for bs4
#13 DONE 72.3s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 22.5s done
#16 writing image sha256:ede486f6afad025dab372bc8318f7deaafc9daf66f294436745be6489621b288 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.5s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:37421
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f30e8c45940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f30e8c459d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f30e8c44160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:44491
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 27s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/r7r7oza3rdass
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6890
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6890/display/redirect>
Changes:
------------------------------------------
[...truncated 629.00 KB...]
#9 402.7 google-cloud-pubsublite==1.8.3
#9 402.7 google-cloud-recommendations-ai==0.10.4
#9 402.7 google-cloud-resource-manager==1.10.3
#9 402.7 google-cloud-spanner==3.40.0
#9 402.7 google-cloud-storage==2.10.0
#9 402.7 google-cloud-videointelligence==2.11.3
#9 402.7 google-cloud-vision==3.4.4
#9 402.7 google-crc32c==1.5.0
#9 402.7 google-pasta==0.2.0
#9 402.7 google-resumable-media==2.5.0
#9 402.7 googleapis-common-protos==1.60.0
#9 402.7 greenlet==2.0.2
#9 402.7 grpc-google-iam-v1==0.12.6
#9 402.7 grpcio==1.56.2
#9 402.7 grpcio-status==1.56.2
#9 402.7 guppy3==3.1.3
#9 402.7 h5py==3.9.0
#9 402.7 hdfs==2.7.2
#9 402.7 httplib2==0.22.0
#9 402.7 hypothesis==6.82.3
#9 402.7 idna==3.4
#9 402.7 importlib-metadata==6.8.0
#9 402.7 iniconfig==2.0.0
#9 402.7 joblib==1.3.2
#9 402.7 keras==2.13.1
#9 402.7 libclang==16.0.6
#9 402.7 Markdown==3.4.4
#9 402.7 MarkupSafe==2.1.3
#9 402.7 mmh3==4.0.1
#9 402.7 mock==5.1.0
#9 402.7 nltk==3.8.1
#9 402.7 nose==1.3.7
#9 402.7 numpy==1.24.3
#9 402.7 oauth2client==4.1.3
#9 402.7 oauthlib==3.2.2
#9 402.7 objsize==0.6.1
#9 402.7 opt-einsum==3.3.0
#9 402.7 orjson==3.9.4
#9 402.7 overrides==6.5.0
#9 402.7 packaging==23.1
#9 402.7 pandas==1.5.3
#9 402.7 parameterized==0.9.0
#9 402.7 pip==23.0.1
#9 402.7 pluggy==1.2.0
#9 402.7 proto-plus==1.22.3
#9 402.7 protobuf==4.23.4
#9 402.7 psycopg2-binary==2.9.7
#9 402.7 pyarrow==11.0.0
#9 402.7 pyasn1==0.5.0
#9 402.7 pyasn1-modules==0.3.0
#9 402.7 pycparser==2.21
#9 402.7 pydot==1.4.2
#9 402.7 PyHamcrest==2.0.4
#9 402.7 pymongo==4.4.1
#9 402.7 PyMySQL==1.1.0
#9 402.7 pyparsing==3.1.1
#9 402.7 pytest==7.4.0
#9 402.7 pytest-timeout==2.1.0
#9 402.7 pytest-xdist==3.3.1
#9 402.7 python-dateutil==2.8.2
#9 402.7 python-snappy==0.6.1
#9 402.7 pytz==2023.3
#9 402.7 PyYAML==6.0.1
#9 402.7 regex==2023.8.8
#9 402.7 requests==2.31.0
#9 402.7 requests-mock==1.11.0
#9 402.7 requests-oauthlib==1.3.1
#9 402.7 rsa==4.9
#9 402.7 scikit-learn==1.3.0
#9 402.7 scipy==1.10.1
#9 402.7 setuptools==68.1.2
#9 402.7 Shapely==1.8.5.post1
#9 402.7 six==1.16.0
#9 402.7 sortedcontainers==2.4.0
#9 402.7 soupsieve==2.4.1
#9 402.7 SQLAlchemy==1.4.49
#9 402.7 sqlparse==0.4.4
#9 402.7 tenacity==8.2.2
#9 402.7 tensorboard==2.13.0
#9 402.7 tensorboard-data-server==0.7.1
#9 402.7 tensorflow==2.13.0
#9 402.7 tensorflow-estimator==2.13.0
#9 402.7 tensorflow-io-gcs-filesystem==0.33.0
#9 402.7 termcolor==2.3.0
#9 402.7 testcontainers==3.7.1
#9 402.7 threadpoolctl==3.2.0
#9 402.7 tomli==2.0.1
#9 402.7 tqdm==4.66.0
#9 402.7 typing_extensions==4.5.0
#9 402.7 uritemplate==4.1.1
#9 402.7 urllib3==1.26.16
#9 402.7 websocket-client==1.6.1
#9 402.7 Werkzeug==2.3.6
#9 402.7 wheel==0.41.2
#9 402.7 wrapt==1.15.0
#9 402.7 zipp==3.16.2
#9 402.7 zstandard==0.21.0
#9 DONE 403.8s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.0s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.016 Collecting pip-licenses<5
#13 1.077 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.085 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.086 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.143 Collecting prettytable>=2.3.0
#13 1.160 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.217 Collecting wcwidth
#13 1.232 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.497 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.665 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.666 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.817
#13 2.817 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.817 [notice] To update, run: pip install --upgrade pip
#13 18.84 INFO:root:Successfully pulled licenses for 137 dependencies
#13 18.84 Skip pulling license for bs4
#13 DONE 18.9s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 22.6s done
#16 writing image sha256:19207235463bc214cbbf8568caadb91120b6026f065d5cf16799238b007c3d2e done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.6s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:39637
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f59f2935940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f59f29359d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f59f2934160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:45227
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 25s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/s7zurpedbkub6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6889
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6889/display/redirect>
Changes:
------------------------------------------
[...truncated 608.16 KB...]
#9 405.7 google-cloud-pubsublite==1.8.3
#9 405.7 google-cloud-recommendations-ai==0.10.4
#9 405.7 google-cloud-resource-manager==1.10.3
#9 405.7 google-cloud-spanner==3.40.0
#9 405.7 google-cloud-storage==2.10.0
#9 405.7 google-cloud-videointelligence==2.11.3
#9 405.7 google-cloud-vision==3.4.4
#9 405.7 google-crc32c==1.5.0
#9 405.7 google-pasta==0.2.0
#9 405.7 google-resumable-media==2.5.0
#9 405.7 googleapis-common-protos==1.60.0
#9 405.7 greenlet==2.0.2
#9 405.7 grpc-google-iam-v1==0.12.6
#9 405.7 grpcio==1.56.2
#9 405.7 grpcio-status==1.56.2
#9 405.7 guppy3==3.1.3
#9 405.7 h5py==3.9.0
#9 405.7 hdfs==2.7.2
#9 405.7 httplib2==0.22.0
#9 405.7 hypothesis==6.82.3
#9 405.7 idna==3.4
#9 405.7 importlib-metadata==6.8.0
#9 405.7 iniconfig==2.0.0
#9 405.7 joblib==1.3.2
#9 405.7 keras==2.13.1
#9 405.7 libclang==16.0.6
#9 405.7 Markdown==3.4.4
#9 405.7 MarkupSafe==2.1.3
#9 405.7 mmh3==4.0.1
#9 405.7 mock==5.1.0
#9 405.7 nltk==3.8.1
#9 405.7 nose==1.3.7
#9 405.7 numpy==1.24.3
#9 405.7 oauth2client==4.1.3
#9 405.7 oauthlib==3.2.2
#9 405.7 objsize==0.6.1
#9 405.7 opt-einsum==3.3.0
#9 405.7 orjson==3.9.4
#9 405.7 overrides==6.5.0
#9 405.7 packaging==23.1
#9 405.7 pandas==1.5.3
#9 405.7 parameterized==0.9.0
#9 405.7 pip==23.0.1
#9 405.7 pluggy==1.2.0
#9 405.7 proto-plus==1.22.3
#9 405.7 protobuf==4.23.4
#9 405.7 psycopg2-binary==2.9.7
#9 405.7 pyarrow==11.0.0
#9 405.7 pyasn1==0.5.0
#9 405.7 pyasn1-modules==0.3.0
#9 405.7 pycparser==2.21
#9 405.7 pydot==1.4.2
#9 405.7 PyHamcrest==2.0.4
#9 405.7 pymongo==4.4.1
#9 405.7 PyMySQL==1.1.0
#9 405.7 pyparsing==3.1.1
#9 405.7 pytest==7.4.0
#9 405.7 pytest-timeout==2.1.0
#9 405.7 pytest-xdist==3.3.1
#9 405.7 python-dateutil==2.8.2
#9 405.7 python-snappy==0.6.1
#9 405.7 pytz==2023.3
#9 405.7 PyYAML==6.0.1
#9 405.7 regex==2023.8.8
#9 405.7 requests==2.31.0
#9 405.7 requests-mock==1.11.0
#9 405.7 requests-oauthlib==1.3.1
#9 405.7 rsa==4.9
#9 405.7 scikit-learn==1.3.0
#9 405.7 scipy==1.10.1
#9 405.7 setuptools==68.1.2
#9 405.7 Shapely==1.8.5.post1
#9 405.7 six==1.16.0
#9 405.7 sortedcontainers==2.4.0
#9 405.7 soupsieve==2.4.1
#9 405.7 SQLAlchemy==1.4.49
#9 405.7 sqlparse==0.4.4
#9 405.7 tenacity==8.2.2
#9 405.7 tensorboard==2.13.0
#9 405.7 tensorboard-data-server==0.7.1
#9 405.7 tensorflow==2.13.0
#9 405.7 tensorflow-estimator==2.13.0
#9 405.7 tensorflow-io-gcs-filesystem==0.33.0
#9 405.7 termcolor==2.3.0
#9 405.7 testcontainers==3.7.1
#9 405.7 threadpoolctl==3.2.0
#9 405.7 tomli==2.0.1
#9 405.7 tqdm==4.66.0
#9 405.7 typing_extensions==4.5.0
#9 405.7 uritemplate==4.1.1
#9 405.7 urllib3==1.26.16
#9 405.7 websocket-client==1.6.1
#9 405.7 Werkzeug==2.3.6
#9 405.7 wheel==0.41.2
#9 405.7 wrapt==1.15.0
#9 405.7 zipp==3.16.2
#9 405.7 zstandard==0.21.0
#9 DONE 406.9s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.034 Collecting pip-licenses<5
#13 1.097 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.106 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.106 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.167 Collecting prettytable>=2.3.0
#13 1.182 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.338 Collecting wcwidth
#13 1.360 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.624 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.790 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.791 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.944
#13 2.944 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.944 [notice] To update, run: pip install --upgrade pip
#13 18.93 INFO:root:Successfully pulled licenses for 137 dependencies
#13 18.93 Skip pulling license for bs4
#13 DONE 19.0s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 22.2s done
#16 writing image sha256:df53a58cad3312cffa8af8210fe470cb9d57d13911d00d74d442be4c68c5fb07 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.2s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:36959
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f6391534940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f63915349d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f6391537160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:42653
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 27s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/4jjl6whgubwae
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6888
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6888/display/redirect>
Changes:
------------------------------------------
[...truncated 628.38 KB...]
#9 399.0 google-cloud-pubsublite==1.8.3
#9 399.0 google-cloud-recommendations-ai==0.10.4
#9 399.0 google-cloud-resource-manager==1.10.3
#9 399.0 google-cloud-spanner==3.40.0
#9 399.0 google-cloud-storage==2.10.0
#9 399.0 google-cloud-videointelligence==2.11.3
#9 399.0 google-cloud-vision==3.4.4
#9 399.0 google-crc32c==1.5.0
#9 399.0 google-pasta==0.2.0
#9 399.0 google-resumable-media==2.5.0
#9 399.0 googleapis-common-protos==1.60.0
#9 399.0 greenlet==2.0.2
#9 399.0 grpc-google-iam-v1==0.12.6
#9 399.0 grpcio==1.56.2
#9 399.0 grpcio-status==1.56.2
#9 399.0 guppy3==3.1.3
#9 399.0 h5py==3.9.0
#9 399.0 hdfs==2.7.2
#9 399.0 httplib2==0.22.0
#9 399.0 hypothesis==6.82.3
#9 399.0 idna==3.4
#9 399.0 importlib-metadata==6.8.0
#9 399.0 iniconfig==2.0.0
#9 399.0 joblib==1.3.2
#9 399.0 keras==2.13.1
#9 399.0 libclang==16.0.6
#9 399.0 Markdown==3.4.4
#9 399.0 MarkupSafe==2.1.3
#9 399.0 mmh3==4.0.1
#9 399.0 mock==5.1.0
#9 399.0 nltk==3.8.1
#9 399.0 nose==1.3.7
#9 399.0 numpy==1.24.3
#9 399.0 oauth2client==4.1.3
#9 399.0 oauthlib==3.2.2
#9 399.0 objsize==0.6.1
#9 399.0 opt-einsum==3.3.0
#9 399.0 orjson==3.9.4
#9 399.0 overrides==6.5.0
#9 399.0 packaging==23.1
#9 399.0 pandas==1.5.3
#9 399.0 parameterized==0.9.0
#9 399.0 pip==23.0.1
#9 399.0 pluggy==1.2.0
#9 399.0 proto-plus==1.22.3
#9 399.0 protobuf==4.23.4
#9 399.0 psycopg2-binary==2.9.7
#9 399.0 pyarrow==11.0.0
#9 399.0 pyasn1==0.5.0
#9 399.0 pyasn1-modules==0.3.0
#9 399.0 pycparser==2.21
#9 399.0 pydot==1.4.2
#9 399.0 PyHamcrest==2.0.4
#9 399.0 pymongo==4.4.1
#9 399.0 PyMySQL==1.1.0
#9 399.0 pyparsing==3.1.1
#9 399.0 pytest==7.4.0
#9 399.0 pytest-timeout==2.1.0
#9 399.0 pytest-xdist==3.3.1
#9 399.0 python-dateutil==2.8.2
#9 399.0 python-snappy==0.6.1
#9 399.0 pytz==2023.3
#9 399.0 PyYAML==6.0.1
#9 399.0 regex==2023.8.8
#9 399.0 requests==2.31.0
#9 399.0 requests-mock==1.11.0
#9 399.0 requests-oauthlib==1.3.1
#9 399.0 rsa==4.9
#9 399.0 scikit-learn==1.3.0
#9 399.0 scipy==1.10.1
#9 399.0 setuptools==68.1.2
#9 399.0 Shapely==1.8.5.post1
#9 399.0 six==1.16.0
#9 399.0 sortedcontainers==2.4.0
#9 399.0 soupsieve==2.4.1
#9 399.0 SQLAlchemy==1.4.49
#9 399.0 sqlparse==0.4.4
#9 399.0 tenacity==8.2.2
#9 399.0 tensorboard==2.13.0
#9 399.0 tensorboard-data-server==0.7.1
#9 399.0 tensorflow==2.13.0
#9 399.0 tensorflow-estimator==2.13.0
#9 399.0 tensorflow-io-gcs-filesystem==0.33.0
#9 399.0 termcolor==2.3.0
#9 399.0 testcontainers==3.7.1
#9 399.0 threadpoolctl==3.2.0
#9 399.0 tomli==2.0.1
#9 399.0 tqdm==4.66.0
#9 399.0 typing_extensions==4.5.0
#9 399.0 uritemplate==4.1.1
#9 399.0 urllib3==1.26.16
#9 399.0 websocket-client==1.6.1
#9 399.0 Werkzeug==2.3.6
#9 399.0 wheel==0.41.2
#9 399.0 wrapt==1.15.0
#9 399.0 zipp==3.16.2
#9 399.0 zstandard==0.21.0
#9 DONE 400.2s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.0s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.041 Collecting pip-licenses<5
#13 1.095 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.104 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.104 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.208 Collecting prettytable>=2.3.0
#13 1.224 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.334 Collecting wcwidth
#13 1.350 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.617 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.784 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.785 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.935
#13 2.935 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.935 [notice] To update, run: pip install --upgrade pip
#13 11.65 Skip pulling license for bs4
#13 11.65 INFO:root:Successfully pulled licenses for 137 dependencies
#13 DONE 11.7s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 21.7s done
#16 writing image sha256:d5ad68a14a20e3c580410d758c47e9dd32d3be438722e86e4ad9be00883a4a3b done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 21.7s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:40899
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f34f09dd940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f34f09dd9d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f34f09de160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:39593
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 12s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/f7pgfl4u2lduo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6887
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6887/display/redirect>
Changes:
------------------------------------------
[...truncated 614.00 KB...]
#9 407.2 google-cloud-pubsublite==1.8.3
#9 407.2 google-cloud-recommendations-ai==0.10.4
#9 407.2 google-cloud-resource-manager==1.10.3
#9 407.2 google-cloud-spanner==3.40.0
#9 407.2 google-cloud-storage==2.10.0
#9 407.2 google-cloud-videointelligence==2.11.3
#9 407.2 google-cloud-vision==3.4.4
#9 407.2 google-crc32c==1.5.0
#9 407.2 google-pasta==0.2.0
#9 407.2 google-resumable-media==2.5.0
#9 407.2 googleapis-common-protos==1.60.0
#9 407.2 greenlet==2.0.2
#9 407.2 grpc-google-iam-v1==0.12.6
#9 407.2 grpcio==1.56.2
#9 407.2 grpcio-status==1.56.2
#9 407.2 guppy3==3.1.3
#9 407.2 h5py==3.9.0
#9 407.2 hdfs==2.7.2
#9 407.2 httplib2==0.22.0
#9 407.2 hypothesis==6.82.3
#9 407.2 idna==3.4
#9 407.2 importlib-metadata==6.8.0
#9 407.2 iniconfig==2.0.0
#9 407.2 joblib==1.3.2
#9 407.2 keras==2.13.1
#9 407.2 libclang==16.0.6
#9 407.2 Markdown==3.4.4
#9 407.2 MarkupSafe==2.1.3
#9 407.2 mmh3==4.0.1
#9 407.2 mock==5.1.0
#9 407.2 nltk==3.8.1
#9 407.2 nose==1.3.7
#9 407.2 numpy==1.24.3
#9 407.2 oauth2client==4.1.3
#9 407.2 oauthlib==3.2.2
#9 407.2 objsize==0.6.1
#9 407.2 opt-einsum==3.3.0
#9 407.2 orjson==3.9.4
#9 407.2 overrides==6.5.0
#9 407.2 packaging==23.1
#9 407.2 pandas==1.5.3
#9 407.2 parameterized==0.9.0
#9 407.2 pip==23.0.1
#9 407.2 pluggy==1.2.0
#9 407.2 proto-plus==1.22.3
#9 407.2 protobuf==4.23.4
#9 407.2 psycopg2-binary==2.9.7
#9 407.2 pyarrow==11.0.0
#9 407.2 pyasn1==0.5.0
#9 407.2 pyasn1-modules==0.3.0
#9 407.2 pycparser==2.21
#9 407.2 pydot==1.4.2
#9 407.2 PyHamcrest==2.0.4
#9 407.2 pymongo==4.4.1
#9 407.2 PyMySQL==1.1.0
#9 407.2 pyparsing==3.1.1
#9 407.2 pytest==7.4.0
#9 407.2 pytest-timeout==2.1.0
#9 407.2 pytest-xdist==3.3.1
#9 407.2 python-dateutil==2.8.2
#9 407.2 python-snappy==0.6.1
#9 407.2 pytz==2023.3
#9 407.2 PyYAML==6.0.1
#9 407.2 regex==2023.8.8
#9 407.2 requests==2.31.0
#9 407.2 requests-mock==1.11.0
#9 407.2 requests-oauthlib==1.3.1
#9 407.2 rsa==4.9
#9 407.2 scikit-learn==1.3.0
#9 407.2 scipy==1.10.1
#9 407.2 setuptools==68.1.2
#9 407.2 Shapely==1.8.5.post1
#9 407.2 six==1.16.0
#9 407.2 sortedcontainers==2.4.0
#9 407.2 soupsieve==2.4.1
#9 407.2 SQLAlchemy==1.4.49
#9 407.2 sqlparse==0.4.4
#9 407.2 tenacity==8.2.2
#9 407.2 tensorboard==2.13.0
#9 407.2 tensorboard-data-server==0.7.1
#9 407.2 tensorflow==2.13.0
#9 407.2 tensorflow-estimator==2.13.0
#9 407.2 tensorflow-io-gcs-filesystem==0.33.0
#9 407.2 termcolor==2.3.0
#9 407.2 testcontainers==3.7.1
#9 407.2 threadpoolctl==3.2.0
#9 407.2 tomli==2.0.1
#9 407.2 tqdm==4.66.0
#9 407.2 typing_extensions==4.5.0
#9 407.2 uritemplate==4.1.1
#9 407.2 urllib3==1.26.16
#9 407.2 websocket-client==1.6.1
#9 407.2 Werkzeug==2.3.6
#9 407.2 wheel==0.41.2
#9 407.2 wrapt==1.15.0
#9 407.2 zipp==3.16.2
#9 407.2 zstandard==0.21.0
#9 DONE 408.3s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.084 Collecting pip-licenses<5
#13 1.157 Downloading pip_licenses-4.3.2-py3-none-any.whl (19 kB)
#13 1.167 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.168 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.2)
#13 1.226 Collecting prettytable>=2.3.0
#13 1.243 Downloading prettytable-3.8.0-py3-none-any.whl (27 kB)
#13 1.302 Collecting wcwidth
#13 1.321 Downloading wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
#13 2.606 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.783 Successfully installed pip-licenses-4.3.2 prettytable-3.8.0 wcwidth-0.2.6
#13 2.784 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.938
#13 2.938 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.938 [notice] To update, run: pip install --upgrade pip
#13 18.40 Skip pulling license for bs4
#13 18.40 INFO:root:Successfully pulled licenses for 137 dependencies
#13 DONE 18.5s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.3s
#16 exporting to image
#16 exporting layers
#16 exporting layers 22.4s done
#16 writing image sha256:488838400547d5e77d538ca9a009d88ec3df30b1b8459529fb54187721002d74 done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.51.0.dev done
#16 DONE 22.4s
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:40797
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fedc6b55940> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fedc6b559d0> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fedc6b56160> ====================
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch FAILED
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:46621
Traceback (most recent call last):
File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/examples/wordcount.py",> line 106, in run
output | 'Write' >> WriteToText(known_args.output)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/runner.py",> line 192, in run_pipeline
return self.run_portable_pipeline(
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 381, in run_portable_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/portable_runner.py",> line 296, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 106, in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/job_server.py",> line 150, in subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/apache_beam/runners/portability/flink_runner.py",> line 102, in path_to_jar
raise ValueError(
ValueError: Unable to parse jar URL "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar".> If using a full URL, make sure the scheme is specified. If using a local file path, make sure the file exists; you may have to first build the job server using `./gradlew runners:flink:1.16:job-server:shadowJar`.
> Task :sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 29s
149 actionable tasks: 95 executed, 42 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/7uddcdkkvehuw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org