You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/05/19 11:58:26 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3734
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3734/display/redirect?page=changes>
Changes:
[bulat.safiullin] [BEAM-14428] change text, change styling of connectors and contribute
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-11 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/>
The recommended git tool is: NONE
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git --version # 'git version 2.25.1'
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --force --progress -- https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 212d63d291b0c4cbc685c320ea5b8768b9234b64 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 212d63d291b0c4cbc685c320ea5b8768b9234b64 # timeout=10
Commit message: "Merge pull request #17572: [BEAM-14428] I/O, community, and contribute pages improvements"
> git rev-list --no-walk ea1f292e9cf31fc8c4803b10d811f0d3ee184ae7 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib
[EnvInject] - Variables injected successfully.
[beam_PostCommit_XVR_Spark] $ /bin/bash -xe /tmp/jenkins3238417990783521934.sh
+ echo '*** RUN CROSS-LANGUAGE SPARK USING PYTHON 3.7 ***'
*** RUN CROSS-LANGUAGE SPARK USING PYTHON 3.7 ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses -PpythonVersion=3.7 :runners:spark:2:job-server:validatesCrossLanguageRunner
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy FROM-CACHE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle FROM-CACHE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins FROM-CACHE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=2e669872-2d6d-47f9-8160-eef80ded1633, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 37612
log file: /home/jenkins/.gradle/daemon/7.4/daemon-37612.out.log
----- Last 20 lines from daemon log file - daemon-37612.out.log -----
2022-05-19T11:58:25.058+0000 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=2e669872-2d6d-47f9-8160-eef80ded1633, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src}.>
2022-05-19T11:58:25.059+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=2e669872-2d6d-47f9-8160-eef80ded1633, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src}> with connection: socket connection from /127.0.0.1:33503 to /127.0.0.1:36226.
2022-05-19T11:58:25.059+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=2e669872-2d6d-47f9-8160-eef80ded1633, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src},> connection = DefaultDaemonConnection: socket connection from /127.0.0.1:33503 to /127.0.0.1:36226] after 0.0 minutes of idle
2022-05-19T11:58:25.059+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [666d9d43-68fa-42da-a83f-c2db628c7064 port:33503, addresses:[localhost/127.0.0.1]]
2022-05-19T11:58:25.060+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [666d9d43-68fa-42da-a83f-c2db628c7064 port:33503, addresses:[localhost/127.0.0.1]]
2022-05-19T11:58:25.060+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
2022-05-19T11:58:25.060+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
2022-05-19T11:58:25.061+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
2022-05-19T11:58:25.061+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2022-05-19T11:58:25.061+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
2022-05-19T11:58:25.061+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=2e669872-2d6d-47f9-8160-eef80ded1633, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src}.> Dispatching build started information...
2022-05-19T11:58:25.061+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 27: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@4fa01716
2022-05-19T11:58:25.062+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MOTD_SHOWN, DBUS_SESSION_BUS_ADDRESS, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, XDG_SESSION_TYPE, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, XDG_SESSION_CLASS, _, GIT_COMMIT, COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME]
2022-05-19T11:58:25.063+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
2022-05-19T11:58:25.063+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 37612). The daemon log file: /home/jenkins/.gradle/daemon/7.4/daemon-37612.out.log
2022-05-19T11:58:25.064+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 1 mins 1.624 secs, performance: 100%]
2022-05-19T11:58:25.065+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
2022-05-19T11:58:25.065+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=f16d5926-2322-4fce-aa23-560f64909578,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=37612,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Configuration on demand is an incubating feature.
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark #3737
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3737/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3736
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3736/display/redirect?page=changes>
Changes:
[chamikaramj] Corrects I/O connectors availability status in Beam Website.
[noreply] Vortex performance improvement: Enable multiple stream clients per
[noreply] [BEAM-14488] Alias async flags. (#17711)
[noreply] [BEAM-14487] Make drain & update terminal states. (#17710)
[noreply] [BEAM-14484] Improve behavior surrounding primary roots in
[noreply] Improve validation error message (#17719)
------------------------------------------
[...truncated 892.14 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:00 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:00 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:01 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:02 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQL:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT COUNT(*) AS `count`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:03 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:35:03 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fb77f318d40> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fb77f318dd0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fb77f317560> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>
def test_zetasql_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT64) AS `int`,
CAST('foo' AS STRING) AS `str`,
CAST(3.14 AS FLOAT64) AS `flt`""",
dialect="zetasql")
> assert_that(out, equal_to([(1, "foo", 3.14)]))
apache_beam/transforms/sql_test.py:160:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:573: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:438: in run_pipeline
job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:317: in create_job_service
return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:139: in result
self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <grpc._utilities._ChannelReadyFuture object at 0x7fb76c7841d0>
timeout = 60
def _block(self, timeout):
until = None if timeout is None else time.time() + timeout
with self._condition:
while True:
if self._cancelled:
raise grpc.FutureCancelledError()
elif self._matured:
return
else:
if until is None:
self._condition.wait()
else:
remaining = until - time.time()
if remaining < 0:
> raise grpc.FutureTimeoutError()
E grpc.FutureTimeoutError
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:85: FutureTimeoutError
----------------------------- Captured stderr call -----------------------------
E0520 00:36:09.587729988 2110514 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:755 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '40497' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:40497'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 20, 2022 12:36:16 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamValuesRel(tuples=[[{ 0 }]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fb77f318d40> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fb77f318dd0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fb77f317560> ====================
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 9 failed, 1 skipped, 5576 deselected in 662.17 seconds ============
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 7 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingJava/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 39m 1s
253 actionable tasks: 169 executed, 73 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/axtxducgdrx6o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3735
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3735/display/redirect?page=changes>
Changes:
[singh.vikash2310] fixed typos in README.md
[noreply] Update the PTransform and associated APIs to be less class-based.
------------------------------------------
[...truncated 1.26 MB...]
if remaining < 0:
> raise grpc.FutureTimeoutError()
E grpc.FutureTimeoutError
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:85: FutureTimeoutError
----------------------------- Captured stderr call -----------------------------
E0519 18:39:55.644607673 1279194 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:755 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '50983' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:50983'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:39:57 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:39:58 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:39:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:39:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:40:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQL:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT COUNT(*) AS `count`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:40:01 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:40:01 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f44f172fb00> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f44f172fb90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f44f172b320> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>
def test_zetasql_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT64) AS `int`,
CAST('foo' AS STRING) AS `str`,
CAST(3.14 AS FLOAT64) AS `flt`""",
dialect="zetasql")
> assert_that(out, equal_to([(1, "foo", 3.14)]))
apache_beam/transforms/sql_test.py:160:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:573: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:438: in run_pipeline
job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:317: in create_job_service
return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:139: in result
self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <grpc._utilities._ChannelReadyFuture object at 0x7f44e0492c10>
timeout = 60
def _block(self, timeout):
until = None if timeout is None else time.time() + timeout
with self._condition:
while True:
if self._cancelled:
raise grpc.FutureCancelledError()
elif self._matured:
return
else:
if until is None:
self._condition.wait()
else:
remaining = until - time.time()
if remaining < 0:
> raise grpc.FutureTimeoutError()
E grpc.FutureTimeoutError
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:85: FutureTimeoutError
----------------------------- Captured stderr call -----------------------------
E0519 18:41:11.176767169 1279194 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:755 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '56055' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:56055'
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:56055.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:56055.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:17 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:56055.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:56055.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:21 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:22 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:27 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 19, 2022 6:41:32 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamValuesRel(tuples=[[{ 0 }]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f44f172fb00> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f44f172fb90> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f44f172b320> ====================
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
============ 9 failed, 1 skipped, 5576 deselected in 879.66 seconds ============
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 5 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 44m 25s
253 actionable tasks: 174 executed, 68 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/4lau36iv3w2bo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org