You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/04/06 16:22:26 UTC
Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #3598
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/3598/display/redirect>
Changes:
------------------------------------------
[...truncated 90.04 KB...]
Successfully installed pip-23.0.1 setuptools-67.6.1 wheel-0.40.0
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.12.1-py3-none-any.whl (142 kB)
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.4-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.12.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.4 tenacity-5.1.5
Executing python <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 124 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 1.918437 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.20.2 build -o ./build/target/linux_amd64/boot boot.go boot_test.go
> Task :sdks:python:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.10.7 grpcio-1.53.0 grpcio-tools-1.51.3 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.0 platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.1 py-1.11.0 setuptools-67.6.1 six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.21.0 wheel-0.40.0
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
- Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :sdks:python:test-suites:portable:py311:setupVirtualenv
Successfully installed distlib-0.3.6 filelock-3.10.7 grpcio-1.53.0 grpcio-tools-1.51.3 mypy-protobuf-3.4.0 numpy-1.24.2 packaging-23.0 platformdirs-3.2.0 pluggy-1.0.0 protobuf-4.22.1 py-1.11.0 setuptools-67.6.1 six-1.16.0 toml-0.10.2 tox-3.20.1 types-protobuf-4.22.0.2 virtualenv-20.21.0 wheel-0.40.0
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:547: UserWarning: Normalizing '2.48.0.dev' to '2.48.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.85kB done
#1 DONE 0.1s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/18] FROM docker.io/library/eclipse-temurin:8@sha256:005d3189b2ec1612c3ade6eadabd1935c312f03aa7905cf0528e9d71980ad512
#4 resolve docker.io/library/eclipse-temurin:8@sha256:005d3189b2ec1612c3ade6eadabd1935c312f03aa7905cf0528e9d71980ad512 0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 46.74MB 1.0s done
#5 DONE 1.0s
#6 [ 2/18] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 4.3s
#7 [ 3/18] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.1s
#8 [ 4/18] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.1s
#9 [ 5/18] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.1s
#10 [ 6/18] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.1s
#11 [ 7/18] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.1s
#12 [ 8/18] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.1s
#13 [ 9/18] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.2s
#14 [10/18] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.1s
#15 [11/18] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/18] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.2s
#17 [13/18] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/18] RUN rm /opt/apache/beam/options/LICENSE
#18 DONE 2.2s
#19 [15/18] COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#19 DONE 0.1s
#20 [16/18] RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
> Task :runners:flink:1.16:job-server:shadowJar
> Task :sdks:java:container:java8:docker
#20 DONE 1.4s
#21 [17/18] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#21 DONE 1.3s
#22 [18/18] COPY target/profiler/* /opt/google_cloud_profiler/
#22 DONE 0.2s
#23 exporting to image
#23 exporting layers
#23 exporting layers 0.6s done
#23 writing image sha256:4d8f858a510648e449d775789de14cfa2337e05decd60a08336ba45a8d23d914 done
#23 naming to docker.io/apache/beam_java8_sdk:2.48.0.dev done
#23 DONE 0.6s
> Task :runners:flink:1.16:job-server:shadowJar FROM-CACHE
> Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK
[1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
[0m[1mflink-runner-test installdeps: -rbuild-requirements.txt
[0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.2.0,certifi==2022.12.7,cffi==1.15.1,charset-normalizer==3.1.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==40.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.6,dnspython==2.3.0,docker==6.0.1,docopt==0.6.2,execnet==1.9.0,fastavro==1.7.3,fasteners==0.18,freezegun==1.2.2,greenlet==2.0.2,grpcio==1.53.0,grpcio-tools==1.51.3,hdfs==2.7.0,httplib2==0.21.0,hypothesis==6.70.2,idna==3.4,iniconfig==2.0.0,joblib==1.2.0,mock==5.0.1,mypy-protobuf==3.4.0,numpy==1.24.2,objsize==0.6.1,orjson==3.8.9,packaging==23.0,pandas==1.5.3,parameterized==0.8.1,pluggy==1.0.0,proto-plus==1.22.2,protobuf==4.22.1,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==4.3.3,PyMySQL==1.0.3,pyparsing==3.0.9,pytest==7.2.2,pytest-timeout==2.1.0,pytest-xdist==3.2.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0,regex==2023.3.23,requests==2.28.2,requests-mock==1.10.0,scikit-learn==1.2.2,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.47,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.1.0,types-protobuf==4.22.0.2,typing_extensions==4.5.0,urllib3==1.26.15,websocket-client==1.5.1,wrapt==1.15.0,zstandard==0.20.0>
[0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='2766785269'
[0m[1mflink-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.11.2
[1mflink-runner-test run-test-pre: commands[1] | pip --version
[0mpip 23.0.1 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pip> (python 3.11)
[1mflink-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mflink-runner-test run-test: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.48.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.11.2, pytest-7.2.2, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python,> configfile: pytest.ini
plugins: hypothesis-6.70.2, xdist-3.2.1, timeout-2.1.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items
apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s.. [100%]
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
from imp import load_source
target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 2 warnings in 839.22s (0:13:59) ============
[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m flink-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py311:flinkValidatesRunner
> Task :sdks:python:test-suites:portable:flinkValidatesRunnerPrecommit
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD SUCCESSFUL in 19m 42s
151 actionable tasks: 101 executed, 46 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/lkekszollhp3k
Build step 'Invoke Gradle script' changed build result to SUCCESS
FATAL: Remote call on apache-beam-jenkins-15 failed
java.lang.OutOfMemoryError: unable to create native thread: possibly out of memory or process/resource limits reached
at java.base/java.lang.Thread.start0(Native Method)
at java.base/java.lang.Thread.start(Thread.java:798)
at java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:937)
at java.base/java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1354)
at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:140)
at jenkins.util.InterceptingExecutorService.submit(InterceptingExecutorService.java:36)
at jenkins.util.InterceptingExecutorService.submit(InterceptingExecutorService.java:36)
at hudson.remoting.DelegatingExecutorService.submit(DelegatingExecutorService.java:52)
at hudson.remoting.InterceptingExecutorService.submit(InterceptingExecutorService.java:50)
at hudson.remoting.InterceptingExecutorService.submit(InterceptingExecutorService.java:44)
at org.jenkinsci.remoting.util.AnonymousClassWarnings.check(AnonymousClassWarnings.java:66)
at org.jenkinsci.remoting.util.AnonymousClassWarnings$1.annotateClass(AnonymousClassWarnings.java:123)
at java.base/java.io.ObjectOutputStream.writeNonProxyDesc(ObjectOutputStream.java:1281)
at java.base/java.io.ObjectOutputStream.writeClassDesc(ObjectOutputStream.java:1222)
at java.base/java.io.ObjectOutputStream.writeNonProxyDesc(ObjectOutputStream.java:1285)
at java.base/java.io.ObjectOutputStream.writeClassDesc(ObjectOutputStream.java:1222)
at java.base/java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1418)
at java.base/java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1169)
at java.base/java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1543)
at java.base/java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1500)
at java.base/java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1423)
at java.base/java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1169)
at java.base/java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:345)
at hudson.remoting.Command.writeTo(Command.java:111)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.write(AbstractSynchronousByteArrayCommandTransport.java:42)
at hudson.remoting.Channel.send(Channel.java:765)
at hudson.remoting.Request.call(Request.java:167)
at hudson.remoting.Channel.call(Channel.java:999)
Caused: java.io.IOException: Remote call on apache-beam-jenkins-15 failed
at hudson.remoting.Channel.call(Channel.java:1004)
at hudson.Launcher$RemoteLauncher.kill(Launcher.java:1150)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_Python_PVR_Flink_Cron #3599
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/3599/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org