You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/08/30 21:13:57 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3079
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3079/display/redirect?page=changes>
Changes:
[noreply] [Playground] [Infrastructure] Adding the Cloud Datastore client to save
[noreply] Fix jdbc date conversion offset 1 day (#22738)
[noreply] Set state integration test (#22935)
------------------------------------------
[...truncated 71.25 KB...]
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:io:parquet:compileJava FROM-CACHE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar
> Task :sdks:java:testing:expansion-service:compileTestJava FROM-CACHE
> Task :sdks:java:testing:expansion-service:testClasses
> Task :sdks:java:io:debezium:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:io:jdbc:compileJava
Note: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/io/jdbc/src/main/java/org/apache/beam/sdk/io/jdbc/JdbcIO.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:debezium:expansion-service:startShadowScripts
> Task :sdks:java:io:debezium:expansion-service:shadowDistTar
> Task :sdks:java:io:debezium:expansion-service:shadowDistZip
> Task :sdks:java:io:debezium:expansion-service:assemble
> Task :sdks:java:io:debezium:expansion-service:analyzeClassesDependencies FROM-CACHE
> Task :sdks:java:io:debezium:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:debezium:expansion-service:analyzeDependencies UP-TO-DATE
> Task :sdks:java:io:debezium:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:debezium:expansion-service:test NO-SOURCE
> Task :sdks:java:io:debezium:expansion-service:check UP-TO-DATE
> Task :sdks:java:io:debezium:expansion-service:build
> Task :sdks:python:container:py37:copyDockerfileDependencies
> Task :sdks:python:container:goPrepare UP-TO-DATE
> Task :sdks:python:container:goBuild
> Task :sdks:python:container:py37:copyLauncherDependencies
> Task :sdks:python:container:py37:copyLicenseScripts
> Task :sdks:python:container:py37:copyLicenses
> Task :sdks:python:container:py37:dockerClean UP-TO-DATE
> Task :sdks:java:core:jar
> Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE
> Task :sdks:python:installGcpTest
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar FROM-CACHE
> Task :sdks:java:io:jdbc:classes
> Task :runners:core-construction-java:processTestResources NO-SOURCE
> Task :runners:java-job-service:createCheckerFrameworkManifest
> Task :sdks:java:io:jdbc:jar
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:processResources NO-SOURCE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :runners:portability:java:createCheckerFrameworkManifest
> Task :sdks:java:extensions:schemaio-expansion-service:compileJava FROM-CACHE
> Task :sdks:java:extensions:schemaio-expansion-service:classes UP-TO-DATE
> Task :sdks:java:extensions:schemaio-expansion-service:jar
> Task :sdks:java:extensions:schemaio-expansion-service:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:schemaio-expansion-service:testClasses UP-TO-DATE
> Task :sdks:java:extensions:schemaio-expansion-service:packageTests
> Task :sdks:java:extensions:schemaio-expansion-service:assemble
> Task :sdks:java:core:generateTestAvroJava
> Task :sdks:java:io:google-cloud-platform:expansion-service:compileJava NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:classes UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:jar
> Task :sdks:java:io:google-cloud-platform:expansion-service:compileTestJava NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:testClasses UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:packageTests
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:core:generateTestGrammarSource NO-SOURCE
> Task :sdks:java:extensions:schemaio-expansion-service:analyzeClassesDependencies
> Task :sdks:java:extensions:schemaio-expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:extensions:schemaio-expansion-service:analyzeDependencies
> Task :sdks:java:core:compileTestJava FROM-CACHE
> Task :sdks:java:core:processTestResources
> Task :sdks:java:core:testClasses
> Task :sdks:java:core:shadowTestJar FROM-CACHE
> Task :runners:core-construction-java:compileTestJava FROM-CACHE
> Task :runners:core-construction-java:testClasses UP-TO-DATE
> Task :runners:core-construction-java:testJar
> Task :sdks:java:extensions:python:createCheckerFrameworkManifest
> Task :sdks:java:extensions:python:compileJava FROM-CACHE
> Task :sdks:java:extensions:python:processResources
> Task :sdks:java:extensions:python:classes
> Task :sdks:java:extensions:python:compileTestJava FROM-CACHE
> Task :sdks:java:extensions:python:processTestResources NO-SOURCE
> Task :sdks:java:extensions:python:testClasses UP-TO-DATE
> Task :runners:direct-java:createCheckerFrameworkManifest
> Task :runners:local-java:createCheckerFrameworkManifest
> Task :runners:local-java:compileJava FROM-CACHE
> Task :runners:local-java:processResources NO-SOURCE
> Task :runners:local-java:classes UP-TO-DATE
> Task :runners:local-java:jar
> Task :runners:portability:java:compileJava FROM-CACHE
> Task :runners:portability:java:processResources NO-SOURCE
> Task :runners:portability:java:classes UP-TO-DATE
> Task :runners:direct-java:compileJava FROM-CACHE
> Task :runners:direct-java:processResources NO-SOURCE
> Task :runners:direct-java:classes UP-TO-DATE
> Task :runners:portability:java:compileTestJava FROM-CACHE
> Task :runners:portability:java:processTestResources NO-SOURCE
> Task :runners:portability:java:testClasses UP-TO-DATE
> Task :sdks:java:extensions:join-library:createCheckerFrameworkManifest
> Task :sdks:java:extensions:join-library:compileJava FROM-CACHE
> Task :sdks:java:extensions:join-library:processResources NO-SOURCE
> Task :sdks:java:extensions:join-library:classes UP-TO-DATE
> Task :sdks:java:extensions:join-library:jar
> Task :runners:direct-java:shadowJar FROM-CACHE
> Task :sdks:java:io:mongodb:createCheckerFrameworkManifest
> Task :sdks:java:io:mongodb:compileJava FROM-CACHE
> Task :sdks:java:io:mongodb:processResources NO-SOURCE
> Task :sdks:java:io:mongodb:classes UP-TO-DATE
> Task :sdks:java:io:mongodb:jar
> Task :sdks:java:extensions:sql:udf:createCheckerFrameworkManifest
> Task :sdks:java:extensions:sql:udf:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:udf:processResources NO-SOURCE
> Task :sdks:java:extensions:sql:udf:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:udf:jar
> Task :sdks:java:extensions:sql:expansion-service:createCheckerFrameworkManifest
> Task :sdks:java:extensions:sql:zetasql:createCheckerFrameworkManifest
> Task :sdks:java:extensions:sql:zetasql:processResources NO-SOURCE
> Task :sdks:java:extensions:sql:expansion-service:processResources NO-SOURCE
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py37:copyGolangLicenses
> Task :sdks:python:container:py37:dockerPrepare
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore
> Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc
> Task :sdks:java:extensions:schemaio-expansion-service:checkstyleMain
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:extensions:schemaio-expansion-service:checkstyleTest
> Task :release:go-licenses:go:createLicenses
> Task :sdks:go:container:copyGolangLicenses
> Task :sdks:python:installGcpTest
Collecting rsa<5,>=3.1.4
Using cached rsa-4.9-py3-none-any.whl (34 kB)
Collecting google-api-core[grpc]!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5
> Task :sdks:go:container:dockerPrepare
> Task :sdks:java:extensions:sql:generateFmppSources
> Task :sdks:java:extensions:sql:compileJavacc
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
> Task :sdks:java:extensions:sql:createCheckerFrameworkManifest
> Task :sdks:java:extensions:schemaio-expansion-service:javadoc
> Task :sdks:java:extensions:schemaio-expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:extensions:sql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:processResources
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar
> Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:zetasql:jar
> Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE
> Task :sdks:python:installGcpTest
WARNING: google-api-core 2.8.2 does not provide the extra 'grpcgcp'
> Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:extensions:schemaio-expansion-service:test
> Task :sdks:java:extensions:schemaio-expansion-service:spotbugsMain
> Task :sdks:java:container:pullLicenses
INFO:root:Pulling license for 240 dependencies using 16 threads.
INFO:root:Replaced local file URL with file:///home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 8.572116 seconds with 16 threads.
> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
- Gradle detected a problem with the following location: '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/container/build/target'. Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
- Gradle detected a problem with the following location: '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/container/build/target'. Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
> Task :sdks:python:container:py37:docker
> Task :sdks:go:container:docker
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:extensions:schemaio-expansion-service:shadowJar
> Task :sdks:java:extensions:schemaio-expansion-service:check
> Task :sdks:java:extensions:schemaio-expansion-service:build
> Task :sdks:java:io:google-cloud-platform:expansion-service:startScripts
> Task :sdks:java:io:google-cloud-platform:expansion-service:distTar
> Task :sdks:java:io:google-cloud-platform:expansion-service:distZip
> Task :sdks:java:container:java8:docker
---> Running in 4b4ab8a0c975
Removing intermediate container 4b4ab8a0c975
---> ecb945b3a3e3
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> f670f0d9c400
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in bbfae58a04df
> Task :sdks:python:installGcpTest
Successfully installed apache-beam-2.42.0.dev0 attrs-22.1.0 azure-core-1.25.0 azure-storage-blob-12.13.1 boto3-1.24.62 botocore-1.27.62 cachetools-4.2.4 certifi-2022.6.15 cffi-1.15.1 charset-normalizer-2.1.1 cloudpickle-2.1.0 crcmod-1.7 cryptography-37.0.4 deprecation-2.1.0 dill-0.3.1.1 docker-6.0.0 docopt-0.6.2 execnet-1.9.0 fastavro-1.6.0 fasteners-0.17.3 freezegun-1.2.2 google-api-core-2.8.1 google-apitools-0.5.31 google-auth-2.11.0 google-auth-httplib2-0.1.0 google-cloud-bigquery-2.34.4 google-cloud-bigquery-storage-2.13.2 google-cloud-bigtable-1.7.2 google-cloud-core-2.3.2 google-cloud-datastore-1.15.5 google-cloud-dlp-3.8.1 google-cloud-language-1.3.2 google-cloud-pubsub-2.13.6 google-cloud-pubsublite-1.4.3 google-cloud-recommendations-ai-0.7.1 google-cloud-spanner-1.19.3 google-cloud-videointelligence-1.16.3 google-cloud-vision-1.0.2 google-crc32c-1.3.0 google-resumable-media-2.3.3 googleapis-common-protos-1.56.4 greenlet-1.1.3 grpc-google-iam-v1-0.12.4 grpcio-gcp-0.2.2 grpcio-status-1.47.0 hdfs-2.7.0 httplib2-0.20.4 idna-3.3 iniconfig-1.1.1 isodate-0.6.1 jmespath-1.0.1 joblib-1.1.0 mock-2.0.0 msrest-0.7.1 numpy-1.21.6 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.8.0 overrides-6.2.0 pandas-1.3.5 parameterized-0.8.1 pbr-5.10.0 proto-plus-1.22.1 psycopg2-binary-2.9.3 pyarrow-7.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pytest-7.1.2 pytest-forked-1.4.0 pytest-timeout-2.1.0 pytest-xdist-2.5.0 python-dateutil-2.8.2 pytz-2022.2.1 pyyaml-6.0 regex-2022.8.17 requests-2.28.1 requests-oauthlib-1.3.1 requests_mock-1.10.0 rsa-4.9 s3transfer-0.6.0 scikit-learn-1.0.2 scipy-1.7.3 sqlalchemy-1.4.40 tenacity-5.1.5 testcontainers-3.6.1 threadpoolctl-3.1.0 tomli-2.0.1 typing-extensions-4.3.0 urllib3-1.26.12 websocket-client-1.4.0 wrapt-1.14.1 zstandard-0.18.0
> Task :sdks:java:container:java8:docker
Removing intermediate container bbfae58a04df
---> a076dfda01e8
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
> Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar
> Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip
> Task :sdks:java:io:google-cloud-platform:expansion-service:assemble
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-5' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy138.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Unexpected termination of the channel
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75)
Caused by: java.io.EOFException
at java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2905)
at java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3400)
at java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:936)
at java.base/java.io.ObjectInputStream.<init>(ObjectInputStream.java:379)
at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:49)
at hudson.remoting.Command.readFrom(Command.java:142)
at hudson.remoting.Command.readFrom(Command.java:128)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-5 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #3081
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3081/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #3080
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3080/display/redirect>
Changes:
------------------------------------------
[...truncated 2.67 MB...]
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f412c364820> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f412c364940> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f412c364e50> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f412c364ee0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f412c3650d0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f412c365160> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f412c365280> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f412c365310> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f412c3653a0> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f412c365430> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f412c365670> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f412c365790> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f412c3655e0> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f412c365700> ====================
INFO root:portable_runner.py:574 starting control server on port 41683
INFO root:portable_runner.py:574 starting data server on port 43721
INFO root:portable_runner.py:574 starting state server on port 36327
INFO root:portable_runner.py:574 starting logging server on port 45175
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f415b976eb0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.42.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'8bcfa7a7ae29b15a637070dd6a1f0e62c7e9aea890622a7afe5139d1152550b1', worker_id = worker_87
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f415c1343d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.9_sdk:2.42.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.9_sdk:2.42.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.9_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'26238296aad19ed52dd8a4f300ff7e733a514a113ad267665faf8c26a0c45313', worker_id = worker_88
INFO root:portable_runner.py:574 Completed job in 27.896316289901733 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE
PASSED [100%]
=================================== FAILURES ===================================
__________________________ SqlTransformTest.test_map ___________________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_map>
def test_map(self):
with TestPipeline() as p:
out = (
p
| beam.Create([
Shopper('bob', {
'bananas': 6, 'cherries': 3
}),
Shopper('alice', {
'apples': 2, 'bananas': 3
})
]).with_output_types(Shopper)
| SqlTransform("SELECT * FROM PCOLLECTION WHERE shopper = 'alice'"))
> assert_that(out, equal_to([('alice', {'apples': 2, 'bananas': 3})]))
apache_beam/transforms/sql_test.py:190:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:597: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:116: in run
state = result.wait_until_finish()
apache_beam/runners/portability/portable_runner.py:607: in wait_until_finish
raise self._runtime_exception
apache_beam/runners/portability/portable_runner.py:613: in _observe_state
for state_response in self._state_stream:
../../build/gradleenv/1922375555/lib/python3.9/site-packages/grpc/_channel.py:426: in __next__
return self._next()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exc...0.1:45639","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>
def _next(self):
with self._state.condition:
if self._state.code is None:
event_handler = _event_handler(self._state,
self._response_deserializer)
self._state.due.add(cygrpc.OperationType.receive_message)
operating = self._call.operate(
(cygrpc.ReceiveMessageOperation(_EMPTY_FLAGS),),
event_handler)
if not operating:
self._state.due.remove(cygrpc.OperationType.receive_message)
elif self._state.code is grpc.StatusCode.OK:
raise StopIteration()
else:
raise self
def _response_ready():
return (self._state.response is not None or
(cygrpc.OperationType.receive_message
not in self._state.due and
self._state.code is not None))
_common.wait(self._state.condition.wait, _response_ready)
if self._state.response is not None:
response = self._state.response
self._state.response = None
return response
elif cygrpc.OperationType.receive_message not in self._state.due:
if self._state.code is grpc.StatusCode.OK:
raise StopIteration()
elif self._state.code is not None:
> raise self
E grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
E status = StatusCode.DEADLINE_EXCEEDED
E details = "Deadline Exceeded"
E debug_error_string = "{"created":"@1661904019.076144685","description":"Error received from peer ipv4:127.0.0.1:45639","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Deadline Exceeded","grpc_status":4}"
E >
../../build/gradleenv/1922375555/lib/python3.9/site-packages/grpc/_channel.py:826: _MultiThreadedRendezvous
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:254 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar>
INFO root:external.py:769 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar'> '33995' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Starting expansion service at localhost:33995
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:58:56 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:33995.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:58:59 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:58:59 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:59:00 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:59:03 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 SELECT `PCOLLECTION`.`shopper`, `PCOLLECTION`.`cart`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WHERE `PCOLLECTION`.`shopper` = 'alice'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:59:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 LogicalProject(shopper=[$0], cart=[$1])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 LogicalFilter(condition=[=($0, 'alice')])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 30, 2022 11:59:05 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamCalcRel(expr#0..1=[{inputs}], expr#2=['alice':VARCHAR], expr#3=[=($t0, $t2)], proj#0..1=[{exprs}], $condition=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.42.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f3d7eb040d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f3d7eb04160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f3d7eb048b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev
INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f412c364820> ====================
INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f412c364940> ====================
INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f412c364e50> ====================
INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f412c364ee0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f412c3650d0> ====================
INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f412c365160> ====================
INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f412c365280> ====================
INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f412c365310> ====================
INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f412c3653a0> ====================
INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f412c365430> ====================
INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f412c365670> ====================
INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f412c365790> ====================
INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f412c3655e0> ====================
INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f412c365700> ====================
INFO root:portable_runner.py:574 starting control server on port 44631
INFO root:portable_runner.py:574 starting data server on port 43013
INFO root:portable_runner.py:574 starting state server on port 39343
INFO root:portable_runner.py:574 starting logging server on port 43505
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f412c21dfa0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.9_sdk:2.42.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.9_sdk:2.42.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.9_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:574 Docker container is running. container_id = b'e929904f9a3535d1a2a2d1371b060884d12ef44ce9fec4df68a303b1f273c66a', worker_id = worker_77
INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f412c239fd0> for environment external_4beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev')
INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.42.0.dev
INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_map - grpc....
= 1 failed, 8 passed, 2 skipped, 6544 deselected, 2 warnings in 365.72s (0:06:05) =
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1876076.
Stopping expansion service pid: 1876077.
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1871027
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 26m 1s
232 actionable tasks: 32 executed, 200 up-to-date
Publishing build scan...
https://gradle.com/s/uehnq4djoe4eo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org