You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/22 18:39:10 UTC

Build failed in Jenkins: beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #572

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/572/display/redirect?page=changes>

Changes:

[noreply] Bump google.golang.org/api from 0.83.0 to 0.85.0 in /sdks (#21974)

[noreply] [Go SDK] Adds a snippet for GBK in BPG (#21842)

[noreply] Update parameterized requirement in /sdks/python (#21975)

[noreply] Merge pull request #21981 from [Playground] Upgrade Flutter linter, fix


------------------------------------------
[...truncated 475.77 KB...]
uritemplate==4.1.1
urllib3==1.26.9
wcwidth==0.2.5
websocket-client==1.3.2
Werkzeug==2.1.2
wheel==0.37.1
wrapt==1.14.1
zipp==3.8.0
Removing intermediate container 2351d634e152
 ---> 0df1f8c95cc3
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 74102d172ba7
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 4b6b43f7f530
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> c81377fc2aa5
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 8d5e07edef89
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in dbf2894a379c
Removing intermediate container dbf2894a379c
 ---> 772a711d09f3
Step 21/31 : FROM beam as third_party_licenses
 ---> 772a711d09f3
Step 22/31 : ARG pull_licenses
 ---> Running in b2faa524972c
Removing intermediate container b2faa524972c
 ---> ffd124ff4a3e
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 2c8a15bfa2d6
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> fffe611d0a87
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in dfdc267f1b98
Removing intermediate container dfdc267f1b98
 ---> f552e63c6e67
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 8102e81d87e9
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<4.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 27e3a065321b
Collecting pip-licenses<4.0.0
  Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=66c631ee123ae08cdfda829e7654c8cc239c94d1bf74e88a332d099be145653d
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.4
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 22.0.4; however, version 22.1.2 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 134 dependencies
[0mSkip pulling license for  bs4
Removing intermediate container 27e3a065321b
 ---> 3da122d5ef09
Step 28/31 : FROM beam
 ---> 772a711d09f3
Step 29/31 : ARG pull_licenses
 ---> Running in 403c5f4ec379
Removing intermediate container 403c5f4ec379
 ---> 024619c253c7
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
 ---> d23991948862
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
 ---> Running in a8fb27fe23da
Removing intermediate container a8fb27fe23da
 ---> 5fb515aa7c8f
Successfully built 5fb515aa7c8f
Successfully tagged apache/beam_python3.9_sdk:2.41.0.dev

> Task :runners:google-cloud-dataflow-java:buildAndPushDockerPythonContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.

As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.

See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker

The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/python]
50066622d2f0: Preparing
d5272d7af596: Preparing
12427cf20d55: Preparing
49285abda59e: Preparing
389548256793: Preparing
017e9197461c: Preparing
cec9706f09c5: Preparing
861247e486f5: Preparing
e72864283721: Preparing
ab44457315ef: Preparing
bc9aa9939b8e: Preparing
71b685ab3874: Preparing
72a9a3accec3: Preparing
854177f75519: Preparing
2c8851d1af39: Preparing
c6679bcc482d: Preparing
aedb4b362167: Preparing
285c8ba236e9: Preparing
13b045a1dfd2: Preparing
2fbabeba902e: Preparing
ee509ed6e976: Preparing
71b685ab3874: Waiting
9177197c67d0: Preparing
7dbadf2b9bd8: Preparing
e7597c345c2e: Preparing
c6679bcc482d: Waiting
017e9197461c: Waiting
2c8851d1af39: Waiting
285c8ba236e9: Waiting
13b045a1dfd2: Waiting
ab44457315ef: Waiting
9177197c67d0: Waiting
854177f75519: Waiting
861247e486f5: Waiting
2fbabeba902e: Waiting
e72864283721: Waiting
bc9aa9939b8e: Waiting
ee509ed6e976: Waiting
e7597c345c2e: Waiting
aedb4b362167: Waiting
389548256793: Pushed
49285abda59e: Pushed
50066622d2f0: Pushed
12427cf20d55: Pushed
d5272d7af596: Pushed
cec9706f09c5: Pushed
017e9197461c: Pushed
e72864283721: Pushed
ab44457315ef: Pushed
bc9aa9939b8e: Pushed
854177f75519: Pushed
c6679bcc482d: Layer already exists
aedb4b362167: Layer already exists
285c8ba236e9: Layer already exists
13b045a1dfd2: Layer already exists
2fbabeba902e: Layer already exists
ee509ed6e976: Layer already exists
9177197c67d0: Layer already exists
2c8851d1af39: Pushed
7dbadf2b9bd8: Layer already exists
e7597c345c2e: Layer already exists
861247e486f5: Pushed
71b685ab3874: Pushed
72a9a3accec3: Pushed
20220622181729: digest: sha256:d9667d12239c636bf10b2185a79d4fe556e3caa1a992dda8ddffd56fd794b1bb size: 5361

> Task :runners:google-cloud-dataflow-java:setupXVR

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 38685
Launching Python expansion service @ 43585

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220622181729 --experiments=shuffle_mode=appliance --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --numprocesses=8 --timeout=4500 --log-cli-level=INFO
>>>   collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.2, pluggy-1.0.0
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw1] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw2] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw3] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw4] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw5] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw6] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
[gw7] Python 3.9.10 (main, Jan 15 2022, 18:17:56)  -- [GCC 9.3.0]
gw0 [9] / gw1 [9] / gw2 [9] / gw3 [9] / gw4 [9] / gw5 [9] / gw6 [9] / gw7 [9]

scheduling tests via LoadScheduling

apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map 
[gw6] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join 
[gw0] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg 
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data 
[gw4] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_project 
[gw7] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql 
[gw3] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map 
[gw5] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_row 
[gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data 
[gw1] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter 
[gw0] node down: Not properly terminated
[gw0] FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data Terminated

The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=d1bc93b3-010c-47ee-96dc-dd9ce62e03a0, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 3994722
  log file: /home/jenkins/.gradle/daemon/7.4/daemon-3994722.out.log
----- Last  20 lines from daemon log file - daemon-3994722.out.log -----
[gw2] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data 
[gw1] PASSED apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter 
[gw0] node down: Not properly terminated
[gw0] FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data Terminated
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
Remove shutdown hook failed
java.lang.IllegalStateException: Shutdown in progress
	at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
	at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
	at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:38)
	at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:208)
	at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:365)
	at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:108)
	at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:84)
	at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
	at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
----- End of the daemon log -----


FAILURE: Build failed with an exception.

* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow #573

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_PythonUsingJavaSQL_Dataflow/573/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org