You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/16 10:13:07 UTC

Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #2606

See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/2606/display/redirect>

Changes:


------------------------------------------
[...truncated 57.57 KB...]
Collecting pluggy>=0.12.0
  Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting six>=1.14.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting py>=1.4.17
  Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting protobuf<4.0dev,>=3.5.0.post1
  Using cached protobuf-3.20.1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting grpcio>=1.37.0
  Using cached grpcio-1.47.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB)
Collecting pyparsing!=3.0.5,>=2.0.2
  Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting platformdirs<3,>=2
  Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB)
Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.0.0
    Uninstalling setuptools-44.0.0:
      Successfully uninstalled setuptools-44.0.0
Successfully installed distlib-0.3.1 filelock-3.7.1 grpcio-1.47.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.1 py-1.11.0 pyparsing-3.0.9 setuptools-63.2.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.15.1 wheel-0.37.1

> Task :sdks:python:test-suites:portable:py39:setupVirtualenv

> Task :sdks:java:container:pullLicenses
Collecting pip
  Using cached pip-22.1.2-py3-none-any.whl (2.1 MB)
Collecting setuptools
  Using cached setuptools-63.2.0-py3-none-any.whl (1.2 MB)
Collecting wheel
  Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
    Found existing installation: pip 20.0.2
    Uninstalling pip-20.0.2:
      Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.0.0
    Uninstalling setuptools-44.0.0:
      Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.1.2 setuptools-63.2.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
  Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
  Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/license_scripts/pull_licenses_java.py --license_index=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/reports/dependency-license/index.json        --output_dir=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target/java_third_party_licenses        --dep_url_yaml=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/license_scripts/dep_urls_java.yaml        --manual_license_path=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/license_scripts/manual_licenses
INFO:root:Pulling license for 242 dependencies using 16 threads.
INFO:root:Replaced local file URL with file:///home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING for xz-1.5

> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py:530: UserWarning: Normalizing '2.41.0.dev' to '2.41.0.dev0'
  warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :release:go-licenses:java:docker
 ---> Running in 627e96486203
Removing intermediate container 627e96486203
 ---> 114c03d2c025
Step 3/8 : COPY go.mod ./
 ---> 5c6ff3dc78e8
Step 4/8 : RUN go install github.com/google/go-licenses@latest
 ---> Running in 209158d7272b
go: downloading github.com/google/go-licenses v1.2.1
go: downloading github.com/otiai10/copy v1.6.0
go: downloading github.com/golang/glog v0.0.0-20160126235308-23def4e6c14b
go: downloading github.com/spf13/cobra v1.4.0
go: downloading golang.org/x/tools v0.1.10
go: downloading gopkg.in/src-d/go-git.v4 v4.13.1
go: downloading go.opencensus.io v0.23.0
go: downloading golang.org/x/net v0.0.0-20211112202133-69e39bad7dc2
go: downloading github.com/google/licenseclassifier v0.0.0-20210722185704-3043a050f148
go: downloading golang.org/x/mod v0.6.0-dev.0.20220106191415-9b9b3d81d5e3
go: downloading github.com/spf13/pflag v1.0.5
go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da
go: downloading gopkg.in/src-d/go-billy.v4 v4.3.2
go: downloading github.com/sergi/go-diff v1.2.0
go: downloading golang.org/x/crypto v0.0.0-20220112180741-5e0467b6c7ce
go: downloading github.com/jbenet/go-context v0.0.0-20150711004518-d14ea06fba99
go: downloading github.com/emirpasic/gods v1.12.0
go: downloading github.com/mitchellh/go-homedir v1.1.0
go: downloading github.com/xanzy/ssh-agent v0.2.1
go: downloading github.com/src-d/gcfg v1.4.0
go: downloading github.com/kevinburke/ssh_config v0.0.0-20190725054713-01f96b0aa0cd
go: downloading golang.org/x/sys v0.0.0-20220111092808-5a964db01320
go: downloading gopkg.in/warnings.v0 v0.1.2
go: downloading golang.org/x/xerrors v0.0.0-20200804184101-5ec99f83aff1

> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE

> Task :sdks:java:container:pullLicenses
INFO:root:pull_licenses_java.py succeed. It took 7.098809 seconds with 16 threads.
Copying licenses from /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target/java_third_party_licenses to /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target/third_party_licenses.
Finished license_scripts.sh

> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target'. Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/java/container/build/target'. Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :release:go-licenses:java:docker
Removing intermediate container 209158d7272b
 ---> 103376a2d3f4
Step 5/8 : COPY get-licenses.sh /opt/apache/beam/
 ---> ffe0d5689953
Step 6/8 : ARG sdk_location
 ---> Running in 837d7913070d
Removing intermediate container 837d7913070d
 ---> 66f787aca16f
Step 7/8 : ENV sdk_location=$sdk_location
 ---> Running in 980cc052ae3c
Removing intermediate container 980cc052ae3c
 ---> ff4347b69967
Step 8/8 : ENTRYPOINT /opt/apache/beam/get-licenses.sh
 ---> Running in 0570aa83c0fb
Removing intermediate container 0570aa83c0fb
 ---> 68683f7f7db3
Successfully built 68683f7f7db3
Successfully tagged golicenses-java:latest

> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/java/container
go: downloading github.com/apache/beam/sdks/v2 v2.40.0
go: downloading github.com/apache/beam v2.40.0+incompatible
go: downloading github.com/golang/protobuf v1.5.2
go: downloading google.golang.org/grpc v1.47.0
go: downloading google.golang.org/protobuf v1.28.0
go: downloading google.golang.org/genproto v0.0.0-20220602131408-e326c6e8e9c8
go: downloading golang.org/x/net v0.0.0-20220607020251-c690dde0001d
go: downloading golang.org/x/sys v0.0.0-20220520151302-bc2c85ada10a
go: downloading golang.org/x/text v0.3.7
go: added github.com/apache/beam/sdks/v2 v2.40.0
go: added github.com/golang/protobuf v1.5.2
go: added golang.org/x/net v0.0.0-20220607020251-c690dde0001d
go: added golang.org/x/sys v0.0.0-20220520151302-bc2c85ada10a
go: added golang.org/x/text v0.3.7
go: added google.golang.org/genproto v0.0.0-20220602131408-e326c6e8e9c8
go: added google.golang.org/grpc v1.47.0
go: added google.golang.org/protobuf v1.28.0
+ go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses
W0716 10:03:38.975370      28 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.0.0-20220520151302-bc2c85ada10a/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0716 10:03:44.803900     188 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.0.0-20220520151302-bc2c85ada10a/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.40.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.40.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/c690dde0:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/bc2c85ad:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/e326c6e8e9c8/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.47.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
flink-runner-test installed: apache-beam @ file:///home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.1,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.2,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.7,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.39,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,typing_extensions==4.3.0,urllib3==1.26.10,wcwidth==0.2.5,websocket-client==1.3.3,wrapt==1.14.1
flink-runner-test run-test-pre: PYTHONHASHSEED='340418086'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.9.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.1.2 from /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip (python 3.9)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh
flink-runner-test run-test: commands[0] | /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh flink-runner-test /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.41.0-SNAPSHOT.jar --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Python_PVR_Flink_Cron/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python, inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 210 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%]
s.......s....s...s..s....FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-15' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy139.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
	at hudson.Launcher$ProcStarter.join(Launcher.java:524)
	at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
	at hudson.model.Build$BuildExecution.build(Build.java:199)
	at hudson.model.Build$BuildExecution.doRun(Build.java:164)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
	at hudson.model.Run.execute(Run.java:1896)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
	at hudson.model.ResourceController.execute(ResourceController.java:101)
	at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Pipe closed after 0 cycles
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
	at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
	at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
	at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
	at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
	at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-15 is offline; cannot locate jdk_1.8_latest

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org