You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/12/14 18:59:04 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Samza #588
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/588/display/redirect?page=changes>
Changes:
[aydar.zaynutdinov] [BEAM-13438][Playground]
[stranniknm] [BEAM-13446]: fix incorrect tab symbol
[noreply] [BEAM-13159] Add Redis Stream (XADD) Write Support (#15858)
[noreply] Merge pull request #15994: [BEAM-13263] Support OnWindowExpiration in
[noreply] Bump dataflow container version to beam-master-20211213 (#16213)
[noreply] Merge pull request #16198 from [BEAM-13437][Playground] Add
[noreply] Merge pull request #16195 from a[BEAM-13436][Playground] Add
[noreply] [BEAM-13355] add Big Query parameter to enable users to specify load_…
------------------------------------------
[...truncated 482.88 KB...]
[0m[91mWARNING: You are using pip version 21.2.4; however, version 21.3.1 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0m[91mINFO:root:Successfully pulled licenses for 130 dependencies
[0mSkip pulling license for bs4
Removing intermediate container 7a1a194ebdd5
---> 5a02d962580f
Step 28/31 : FROM beam
---> 4064ebe9241d
Step 29/31 : ARG pull_licenses
---> Running in 2899f38a3e7d
Removing intermediate container 2899f38a3e7d
---> 4469bc12f3e5
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> a14dac28dacc
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 462c90b924bf
Removing intermediate container 462c90b924bf
---> ba74081edb93
Successfully built ba74081edb93
Successfully tagged apache/beam_python3.6_sdk:2.36.0.dev
> Task :runners:samza:job-server:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 42355
Launching Python expansion service @ 35177
> Task :runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava
$ TESTS=./test/integration/... ./test/regression
$ RUNNER=portable
$ TIMEOUT=2h
$ SIMULTANEOUS=3
$ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
$ PROJECT=apache-beam-testing
$ DATAFLOW_PROJECT=apache-beam-testing
$ REGION=us-central1
$ trap exit_background_processes SIGINT SIGTERM EXIT
$ key=--io_expansion_jar
$ case --io_expansion_jar in
$ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.36.0-SNAPSHOT.jar>
$ key=--pipeline_opts
$ case --pipeline_opts in
$ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.36.0-SNAPSHOT.jar>
$ key=--test_expansion_addr
$ case --test_expansion_addr in
$ TEST_EXPANSION_ADDR=localhost:42355
$ key=--runner
$ case --runner in
$ RUNNER=samza
$ key=--tests
$ case --tests in
$ TESTS=./test/integration/xlang ./test/integration/io/xlang/...
$ key=--endpoint
$ case --endpoint in
$ ENDPOINT=localhost:37251
$ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src>
$ test -d sdks/go/test
$ EXPANSION_PORT=54379
$ IO_EXPANSION_ADDR=localhost:45561
No IO expansion address specified; starting a new IO expansion server on localhost:45561
$ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.36.0-SNAPSHOT.jar> 45561
$ IO_EXPANSION_PID=25276
$ SIMULTANEOUS=1
$ TAG=dev
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
Starting expansion service at localhost:45561
Dec 14, 2021 6:35:35 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@69b794e2
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3f200884
beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4d339552
beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f0f2775
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:go:container:copyLicenses UP-TO-DATE
> Task :sdks:go:container:dockerClean
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:container:resolveBuildDependencies SKIPPED
> Task :sdks:go:container:installDependencies SKIPPED
> Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:skipPullLicenses
> Task :sdks:go:container:dockerPrepare
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=2f0e603d-0485-4bb5-b790-951e9197c8e9, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 26318
log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-26318.out.log
----- Last 20 lines from daemon log file - daemon-26318.out.log -----
2021-12-14T18:35:35.017+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [d8fa3698-5147-4fd9-b9c2-9ca86c22705d port:41803, addresses:[localhost/127.0.0.1]]
2021-12-14T18:35:35.017+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [d8fa3698-5147-4fd9-b9c2-9ca86c22705d port:41803, addresses:[localhost/127.0.0.1]]
2021-12-14T18:35:35.017+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
2021-12-14T18:35:35.017+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
2021-12-14T18:35:35.018+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
2021-12-14T18:35:35.018+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2021-12-14T18:35:35.018+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
2021-12-14T18:35:35.036+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=2f0e603d-0485-4bb5-b790-951e9197c8e9, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src}.> Dispatching build started information...
2021-12-14T18:35:35.037+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 252: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@5761335c
2021-12-14T18:35:35.037+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MAIL, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, _, GIT_COMMIT, COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME]
2021-12-14T18:35:35.038+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
2021-12-14T18:35:35.039+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 26318). The daemon log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-26318.out.log
2021-12-14T18:35:35.051+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 5 mins 49.457 secs, performance: 99%]
2021-12-14T18:35:35.056+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 250: received class org.gradle.launcher.daemon.protocol.CloseInput
2021-12-14T18:35:35.056+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 250: Received IO message from client: org.gradle.launcher.daemon.protocol.CloseInput@5ea2d1e7
2021-12-14T18:35:35.060+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
2021-12-14T18:35:35.060+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=d46d2bdd-c322-4490-a10a-27aa0ec3e725,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=26318,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Configuration on demand is an incubating feature.
Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/container/.gogradle/project_gopath>
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :sdks:go:container:docker
$ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev
> Task :runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingJava
> Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingPython
> Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly
> Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37251 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5137 items / 5127 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py ... [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=========== 10 passed, 5127 deselected, 2 warnings in 174.65 seconds ===========
> Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingPython
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37251 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5137 items / 5127 deselected / 10 selected
apache_beam/io/external/generate_sequence_test.py .ss [ 30%]
apache_beam/transforms/validate_runner_xlang_test.py ....... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
============ 8 passed, 2 skipped, 5127 deselected in 244.96 seconds ============
> Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingSql
>>> RUNNING integration tests with pipeline options: --runner=PortableRunner --job_endpoint=localhost:37251 --environment_cache_millis=10000 --experiments=beam_fn_api
>>> pytest options:
>>> collect markers: -m=xlang_sql_expansion_service
============================= test session starts ==============================
platform linux -- Python 3.6.13, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 5137 items / 5128 deselected / 9 selected
apache_beam/transforms/sql_test.py ......... [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
================= 9 passed, 5128 deselected in 228.95 seconds ==================
> Task :runners:samza:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 25196.
Stopping expansion service pid: 25197.
> Task :runners:samza:job-server:samzaJobServerCleanup
Stopping job server pid: 30831.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/test/build.gradle'> line: 212
* What went wrong:
Execution failed for task ':runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38m 34s
209 actionable tasks: 163 executed, 39 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/26icxw3lqkzb4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Samza #589
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/589/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org