You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2024/01/13 05:26:32 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5058
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5058/display/redirect>
Changes:
------------------------------------------
[...truncated 119.48 KB...]
> Task :release:go-licenses:py:dockerRun
+ rm -rf '/output/*'
+ go get github.com/apache/beam/sdks/v2/python/container
go: downloading github.com/apache/beam/sdks/v2 v2.53.0
go: downloading github.com/apache/beam v2.53.0+incompatible
> Task :release:go-licenses:go:createLicenses
> Task :sdks:go:container:copyGolangLicenses
> Task :sdks:go:container:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:go:container:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bookworm
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bookworm@sha256:b16cef8cbcb20935c0f052e37fc3d38dc92bfec0bcfb894c328547f81e932d67
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.77MB 0.2s done
#5 DONE 0.3s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.703 Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB]
#6 0.988 Get:2 http://deb.debian.org/debian bookworm-updates InRelease [52.1 kB]
#6 1.088 Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]
#6 1.659 Get:4 http://deb.debian.org/debian bookworm/main amd64 Packages [8787 kB]
> Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
> Task :sdks:java:container:java8:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 2.59kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/eclipse-temurin:8
#3 DONE 0.3s
#4 [ 1/16] FROM docker.io/library/eclipse-temurin:8@sha256:efd0b5cad8d7f23cc947bbe136353ea39167f71f91a6e96796fc2c4e863653f7
#4 resolve docker.io/library/eclipse-temurin:8@sha256:efd0b5cad8d7f23cc947bbe136353ea39167f71f91a6e96796fc2c4e863653f7 0.0s done
#4 CACHED
#5 [internal] load build context
#5 transferring context: 47.31MB 0.4s done
#5 DONE 0.4s
#6 [ 2/16] ADD target/slf4j-api.jar /opt/apache/beam/jars/
#6 DONE 6.6s
#7 [ 3/16] ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
#7 DONE 0.7s
#8 [ 4/16] ADD target/jcl-over-slf4j.jar /opt/apache/beam/jars/
#8 DONE 0.4s
#9 [ 5/16] ADD target/log4j-over-slf4j.jar /opt/apache/beam/jars/
#9 DONE 0.5s
#10 [ 6/16] ADD target/log4j-to-slf4j.jar /opt/apache/beam/jars/
#10 DONE 0.3s
#11 [ 7/16] ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
#11 DONE 0.2s
#12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/
#12 DONE 0.2s
#13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/
#13 DONE 0.4s
#14 [10/16] COPY target/LICENSE /opt/apache/beam/
#14 DONE 0.2s
#15 [11/16] COPY target/NOTICE /opt/apache/beam/
#15 DONE 0.1s
#16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
#16 DONE 0.3s
#17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/
#17 DONE 0.1s
#18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#18 DONE 0.1s
> Task :release:go-licenses:py:dockerRun FAILED
go: downloading github.com/golang/protobuf v1.5.3
go: downloading google.golang.org/protobuf v1.31.0
go: downloading google.golang.org/grpc v1.59.0
go: downloading golang.org/x/net v0.19.0
go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20231120223509-83a465c0220f
go: downloading golang.org/x/sys v0.15.0
go: downloading google.golang.org/genproto v0.0.0-20231106174013-bbf56f31fb17
go: downloading golang.org/x/text v0.14.0
github.com/apache/beam/sdks/v2/python/container imports
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx imports
google.golang.org/grpc imports
google.golang.org/grpc/internal/transport imports
golang.org/x/net/http2 imports
golang.org/x/net/idna imports
golang.org/x/text/secure/bidirule: golang.org/x/text@v0.14.0: Get "https://proxy.golang.org/golang.org/x/text/@v/v0.14.0.mod": read tcp 172.17.0.2:48520->142.250.103.141:443: read: connection reset by peer
github.com/apache/beam/sdks/v2/python/container imports
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx imports
google.golang.org/grpc imports
google.golang.org/grpc/internal/transport imports
golang.org/x/net/http2 imports
golang.org/x/net/idna imports
golang.org/x/text/unicode/bidi: golang.org/x/text@v0.14.0: Get "https://proxy.golang.org/golang.org/x/text/@v/v0.14.0.mod": read tcp 172.17.0.2:48520->142.250.103.141:443: read: connection reset by peer
github.com/apache/beam/sdks/v2/python/container imports
github.com/apache/beam/sdks/v2/go/pkg/beam/core/runtime/xlangx/expansionx imports
google.golang.org/grpc imports
google.golang.org/grpc/internal/transport imports
golang.org/x/net/http2 imports
golang.org/x/net/idna imports
golang.org/x/text/unicode/norm: golang.org/x/text@v0.14.0: Get "https://proxy.golang.org/golang.org/x/text/@v/v0.14.0.mod": read tcp 172.17.0.2:48520->142.250.103.141:443: read: connection reset by peer
> Task :sdks:go:container:docker
#6 2.529 Get:5 http://deb.debian.org/debian bookworm-updates/main amd64 Packages [12.7 kB]
#6 2.529 Get:6 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [134 kB]
#6 4.433 Fetched 9185 kB in 4s (2404 kB/s)
#6 4.433 Reading package lists...
#6 5.260 Reading package lists...
#6 6.026 Building dependency tree...
#6 6.229 Reading state information...
#6 6.492 The following additional packages will be installed:
#6 6.493 libssl3 openssl
#6 6.600 The following NEW packages will be installed:
#6 6.601 ca-certificates libssl3 openssl
#6 6.701 0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded.
#6 6.701 Need to get 3591 kB of archives.
#6 6.701 After this operation, 8893 kB of additional disk space will be used.
#6 6.701 Get:1 http://deb.debian.org/debian bookworm/main amd64 libssl3 amd64 3.0.11-1~deb12u2 [2019 kB]
#6 7.014 Get:2 http://deb.debian.org/debian bookworm/main amd64 openssl amd64 3.0.11-1~deb12u2 [1419 kB]
#6 7.109 Get:3 http://deb.debian.org/debian bookworm/main amd64 ca-certificates all 20230311 [153 kB]
#6 8.590 debconf: delaying package configuration, since apt-utils is not installed
#6 8.667 Fetched 3591 kB in 1s (7163 kB/s)
#6 9.051 Selecting previously unselected package libssl3:amd64.
#6 9.051 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6098 files and directories currently installed.)
#6 9.062 Preparing to unpack .../libssl3_3.0.11-1~deb12u2_amd64.deb ...
#6 9.072 Unpacking libssl3:amd64 (3.0.11-1~deb12u2) ...
#6 9.365 Selecting previously unselected package openssl.
#6 9.367 Preparing to unpack .../openssl_3.0.11-1~deb12u2_amd64.deb ...
#6 9.395 Unpacking openssl (3.0.11-1~deb12u2) ...
#6 9.953 Selecting previously unselected package ca-certificates.
#6 9.955 Preparing to unpack .../ca-certificates_20230311_all.deb ...
#6 9.995 Unpacking ca-certificates (20230311) ...
#6 10.18 Setting up libssl3:amd64 (3.0.11-1~deb12u2) ...
#6 10.20 Setting up openssl (3.0.11-1~deb12u2) ...
#6 10.22 Setting up ca-certificates (20230311) ...
> Task :sdks:java:container:java8:docker
#19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#19 DONE 0.3s
#20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/
#20 DONE 0.1s
#21 exporting to image
#21 exporting layers
#21 exporting layers 0.2s done
#21 writing image sha256:8037419e91ccbdcf5b576cc9ca6fab6130f7a1584ee35c03938591b50a0c9522 done
#21 naming to docker.io/apache/beam_java8_sdk:2.54.0.dev done
#21 DONE 0.2s
> Task :sdks:go:container:docker
#6 11.36 Updating certificates in /etc/ssl/certs...
#6 12.18 140 added, 0 removed; done.
#6 12.24 Processing triggers for libc-bin (2.36-9+deb12u3) ...
#6 12.27 Processing triggers for ca-certificates (20230311) ...
#6 12.28 Updating certificates in /etc/ssl/certs...
#6 12.88 0 added, 0 removed; done.
#6 12.88 Running hooks in /etc/ca-certificates/update.d...
#6 12.91 done.
#6 DONE 13.0s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.2s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.0s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.0s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.0s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:72a9584016f3606b4ba1e020def9791c9ba2c9d99eb42f9102af4ea1eff7b3e9 done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':release:go-licenses:py:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 6m 21s
252 actionable tasks: 163 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ww2cx52d67sqq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5097
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5097/display/redirect?page=changes>
Changes:
[noreply] Decommission all remaining jenkins jobs (#30113)
------------------------------------------
[...truncated 1.76 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:12 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f669ae3f1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f669ae3f280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f669ae3f9d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fb17d23b4c0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fb17d23b5e0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fb17d23baf0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fb17d23bb80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fb17d23bd30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fb17d23bdc0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fb17d23bee0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fb17d23bf70> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fb17d23c040> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fb17d23c0d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fb17d23c310> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fb17d23c430> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fb17d23c280> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fb17d23c3a0> ====================
INFO root:portable_runner.py:543 starting control server on port 42099
INFO root:portable_runner.py:543 starting data server on port 41897
INFO root:portable_runner.py:543 starting state server on port 43723
INFO root:portable_runner.py:543 starting logging server on port 41015
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb17c05d340> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'6dc5da90bce2abc0856c3bfdfb1e06e40a7210f61dc9dba05811492fd2245243', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fb1b1abe2e0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:46837')
INFO root:portable_runner.py:543 Requesting worker at localhost:46837
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:25 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:42099.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:34 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:48:34 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-52e2fbcc-d0f9-4989-9af5-656d16b893be failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 295.98s (0:04:55) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2465244
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2485105.
Stopping expansion service pid: 2485106.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 52s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/4zyuuqkc3qx4u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5096
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5096/display/redirect>
Changes:
------------------------------------------
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:51 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:46:53 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f415c5df1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f415c5df280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f415c5df9d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f56621134c0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f56621135e0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5662113af0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5662113b80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5662113d30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5662113dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5662113ee0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5662113f70> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5662115040> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f56621150d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5662115310> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5662115430> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5662115280> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f56621153a0> ====================
INFO root:portable_runner.py:543 starting control server on port 33819
INFO root:portable_runner.py:543 starting data server on port 45185
INFO root:portable_runner.py:543 starting state server on port 34541
INFO root:portable_runner.py:543 starting logging server on port 33333
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f56941b6790> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'91f865540a618a87ecee8616fbc98628d2ff6b1c6db157d8d9dfc1ab50f3af8a', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f569402b7c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:36381')
INFO root:portable_runner.py:543 Requesting worker at localhost:36381
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:04 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:33819.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:14 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 11:47:14 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-94514494-873e-40a8-9a05-c92fc2127286 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 288.59s (0:04:48) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1643381
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1669265.
Stopping expansion service pid: 1669266.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 31s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ilkxthguqxmli
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5095
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5095/display/redirect>
Changes:
------------------------------------------
[...truncated 1.74 MB...]
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar>
INFO root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar'> '42139' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.55.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:42139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:54 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:42139.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:57 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:58:59 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe1105e0ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe1105e0f70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe1105df700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7febded874c0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7febded875e0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7febded87af0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7febded87b80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7febded87d30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7febded87dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7febded87ee0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7febded87f70> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7febded88040> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7febded880d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7febded88310> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7febded88430> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7febded88280> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7febded883a0> ====================
INFO root:portable_runner.py:543 starting control server on port 40077
INFO root:portable_runner.py:543 starting data server on port 34579
INFO root:portable_runner.py:543 starting state server on port 32819
INFO root:portable_runner.py:543 starting logging server on port 35385
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fec12b2c670> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'464d18dd407983360468a12ff412520112d81e626fafe23a6b93d60ae4598222', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fec0e3a07f0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:42139')
INFO root:portable_runner.py:543 Requesting worker at localhost:42139
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:11 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:40077.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:20 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 25, 2024 5:59:20 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-ae4acd53-8b1b-4e46-aa86-df4b0b8e9e5f failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 311.29s (0:05:11) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 316889
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 331913.
Stopping expansion service pid: 331914.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 45s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ijgixbr6cwuhs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5094
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5094/display/redirect>
Changes:
------------------------------------------
[...truncated 1.79 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:60013.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:32 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:32 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:33 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:35 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.55.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f874e7cbee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f874e7cbf70> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f874e7cd700> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f128cb984c0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f128cb985e0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f128cb98af0> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f128cb98b80> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f128cb98d30> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f128cb98dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f128cb98ee0> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f128cb98f70> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f128cb99040> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f128cb990d0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f128cb99310> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f128cb99430> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f128cb99280> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f128cb993a0> ====================
INFO root:portable_runner.py:543 starting control server on port 39273
INFO root:portable_runner.py:543 starting data server on port 34553
INFO root:portable_runner.py:543 starting state server on port 37585
INFO root:portable_runner.py:543 starting logging server on port 46431
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f12c157d9a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.55.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.55.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.55.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a3035d638056a53e6b286df6ef2a9131e9888602f3332fcc529c05c157fe8d82', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f12c15f6c40> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:60013')
INFO root:portable_runner.py:543 Requesting worker at localhost:60013
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:46 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:39273.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:55 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 11:48:55 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-2e716f66-a9c0-4518-afcb-d1cd04bab07d failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7309 deselected in 293.38s (0:04:53) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3586159
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3617947.
Stopping expansion service pid: 3617948.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 13s
261 actionable tasks: 184 executed, 67 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/dnnit2qsfxzma
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5093
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5093/display/redirect>
Changes:
------------------------------------------
[...truncated 1.44 MB...]
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '37499' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:37499
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:39 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:flatten:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:log_for_testing:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ffa506eac10> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ffa506eaca0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ffa506e8430> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fe5bf62a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fe5bf62a310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fe5bf62a820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fe5bf62a8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fe5bf62aa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fe5bf62aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fe5bf62ac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fe5bf62aca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fe5bf62ad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fe5bf62adc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fe5bf62b040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fe5bf62b160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fe5bf62af70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fe5bf62b0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 38409
INFO root:portable_runner.py:543 starting data server on port 42949
INFO root:portable_runner.py:543 starting state server on port 37157
INFO root:portable_runner.py:543 starting logging server on port 34833
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fe5ee6aee50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5037f5d3d198a8d98a81aabba8f63ad28b3c76a9d325d378919af93346a50c1f', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fe5f0fb7d60> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:37499')
INFO root:portable_runner.py:543 Requesting worker at localhost:37499
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:47:53 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:38409.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:48:02 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:48:02 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-0c868536-1204-47f8-acae-0adc9a32189c failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7306 deselected in 289.97s (0:04:49) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2762273
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2786184.
Stopping expansion service pid: 2786185.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 21s
261 actionable tasks: 173 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/gtitdctshandi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_PostCommit_XVR_Direct - Build # 5092 - Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_XVR_Direct - Build # 5092 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5092/ to view the results.
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5091
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5091/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
E AttributeError: 'bytes' object has no attribute 'end'
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '45883' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:45883
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:36 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:window_into_strategy:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:45883.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:38 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:39 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:41 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f0b226eaa60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f0b226eaaf0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f0b226eb280> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fefa6e831f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fefa6e83310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fefa6e83820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fefa6e838b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fefa6e83a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fefa6e83af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fefa6e83c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fefa6e83ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fefa6e83d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fefa6e83dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fefa6e84040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fefa6e84160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fefa6e83f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fefa6e840d0> ====================
INFO root:portable_runner.py:543 starting control server on port 44343
INFO root:portable_runner.py:543 starting data server on port 41609
INFO root:portable_runner.py:543 starting state server on port 35937
INFO root:portable_runner.py:543 starting logging server on port 44751
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fefd8ec94c0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'402df4a2eb45ca8e71dd5a959900e1d95b9890da53fcc86776d3d162efa48890', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fefdbe96280> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:45883')
INFO root:portable_runner.py:543 Requesting worker at localhost:45883
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:44:52 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-13.c.apache-beam-testing.internal:44343.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:45:01 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24, 2024 5:45:01 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-8c03aaf0-89be-47af-a0d4-e55e2c1e1e42 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 290.74s (0:04:50) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1555692
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1558804.
Stopping expansion service pid: 1558805.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 21s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/kxa2cnilfr3e2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5090
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5090/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
>
component_coder_ids: "HyVSQosVbwVarIntCoder"
component_coder_ids: "HyVSQosVbwIterableCoder"
>
>
coders: <
key: "HyVSQosVbwRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$f21e325f-2200-484f-825f-8454a13a12e8"
>
>
>
coders: <
key: "HyVSQosVbwVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "HyVSQosVbwVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "HyVSQosVbwbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar\022@ad70115bcd9f3d60630a1551c6c3c977540f32379e395fc947775954abf43412"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-rXARW82fPWBjChVRxsPJd1QPMjeeOV_JR3dZVKv0NBI.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/23 23:22:40 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1706052160843561412
2024/01/23 23:22:43 Prepared job with id: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a and staging token: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Submitted job: go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: STOPPED
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: STARTING
2024/01/23 23:22:43 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: RUNNING
2024/01/23 23:22:43 2024-01-23 23:22:43. (1): ==================== <function annotate_downstream_side_inputs at 0x7f0c446841f0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f0c44684310> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (3): ==================== <function pack_combiners at 0x7f0c44684820> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (4): ==================== <function lift_combiners at 0x7f0c446848b0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (5): ==================== <function expand_sdf at 0x7f0c44684a60> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (6): ==================== <function expand_gbk at 0x7f0c44684af0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (7): ==================== <function sink_flattens at 0x7f0c44684c10> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (8): ==================== <function greedily_fuse at 0x7f0c44684ca0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (9): ==================== <function read_to_impulse at 0x7f0c44684d30> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (10): ==================== <function impulse_to_input at 0x7f0c44684dc0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (11): ==================== <function sort_stages at 0x7f0c44685040> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f0c44685160> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (13): ==================== <function setup_timer_mapping at 0x7f0c44684f70> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (14): ==================== <function populate_data_channel_coders at 0x7f0c446850d0> ====================
2024/01/23 23:22:43 2024-01-23 23:22:43. (15): starting control server on port 33995
2024/01/23 23:22:43 2024-01-23 23:22:43. (16): starting data server on port 39037
2024/01/23 23:22:43 2024-01-23 23:22:43. (17): starting state server on port 42937
2024/01/23 23:22:43 2024-01-23 23:22:43. (18): starting logging server on port 44647
2024/01/23 23:22:43 2024-01-23 23:22:43. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c78bea0a0> for environment HyVSQosVbwbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/23 23:22:43 2024-01-23 23:22:43. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/23 23:22:44 2024-01-23 23:22:44. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/23 23:22:49 2024-01-23 23:22:49. (22): Waiting for docker to start up. Current status is running
2024/01/23 23:22:49 2024-01-23 23:22:49. (23): Docker container is running. container_id = b'e7142f83cec1658871333b75d840efd94f9da4a10b3c5e002845524780f1be6c', worker_id = worker_16
2024/01/23 23:22:50 2024-01-23 23:22:50. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0c79698130> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/23 23:22:53 2024-01-23 23:22:53. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/23 23:22:53 2024-01-23 23:22:53. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/23 23:22:54 2024-01-23 23:22:54. (27): Waiting for docker to start up. Current status is running
2024/01/23 23:22:54 2024-01-23 23:22:54. (28): Docker container is running. container_id = b'2d5b68a79c09dc668c7232a6ff12d09f8e8ca9b9c2a8b61b063433b47d3b11d9', worker_id = worker_18
2024/01/23 23:22:58 2024-01-23 23:22:58. (29): Completed job in 14.266560792922974 seconds with state DONE.
2024/01/23 23:22:58 Job[go-testjdbcio_postgresreadwrite-839-bd7ac768-a8dc-4762-8101-84ebd679a56a] state: DONE
2024/01/23 23:22:58 🐳 Terminating container: 4074f8f598e9
2024/01/23 23:22:58 🚫 Container terminated: 4074f8f598e9
--- PASS: TestJDBCIO_PostgresReadWrite (45.83s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 108.834s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.022s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40195
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpcprps8qk/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40157
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 3s
261 actionable tasks: 183 executed, 68 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/v4azomgq5pnj6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5089
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5089/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
coders: <
key: "oegwhlvaUaKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "oegwhlvaUaVarIntCoder"
component_coder_ids: "oegwhlvaUaRowCoder"
>
>
coders: <
key: "oegwhlvaUaKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "oegwhlvaUaVarIntCoder"
component_coder_ids: "oegwhlvaUaCoder1"
>
>
coders: <
key: "oegwhlvaUaKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "oegwhlvaUaVarIntCoder"
component_coder_ids: "oegwhlvaUaIterableCoder"
>
>
coders: <
key: "oegwhlvaUaRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$c3aecc09-c8cc-4be7-8b4a-680f87728385"
>
>
>
coders: <
key: "oegwhlvaUaVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "oegwhlvaUaVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "oegwhlvaUabeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar\022@4c6749adba74b4713313f2bcddcdcc43d70815d4c887f4b7feafdab4740e3332"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/23 17:34:31 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1706031271551235705
2024/01/23 17:34:35 Prepared job with id: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8 and staging token: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Submitted job: go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: STOPPED
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: STARTING
2024/01/23 17:34:36 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: RUNNING
2024/01/23 17:34:36 2024-01-23 17:34:36. (1): ==================== <function annotate_downstream_side_inputs at 0x7f3d00ebb1f0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f3d00ebb310> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (3): ==================== <function pack_combiners at 0x7f3d00ebb820> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (4): ==================== <function lift_combiners at 0x7f3d00ebb8b0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (5): ==================== <function expand_sdf at 0x7f3d00ebba60> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (6): ==================== <function expand_gbk at 0x7f3d00ebbaf0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (7): ==================== <function sink_flattens at 0x7f3d00ebbc10> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (8): ==================== <function greedily_fuse at 0x7f3d00ebbca0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (9): ==================== <function read_to_impulse at 0x7f3d00ebbd30> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (10): ==================== <function impulse_to_input at 0x7f3d00ebbdc0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (11): ==================== <function sort_stages at 0x7f3d00ebc040> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f3d00ebc160> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (13): ==================== <function setup_timer_mapping at 0x7f3d00ebbf70> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (14): ==================== <function populate_data_channel_coders at 0x7f3d00ebc0d0> ====================
2024/01/23 17:34:36 2024-01-23 17:34:36. (15): starting control server on port 43057
2024/01/23 17:34:36 2024-01-23 17:34:36. (16): starting data server on port 41867
2024/01/23 17:34:36 2024-01-23 17:34:36. (17): starting state server on port 40945
2024/01/23 17:34:36 2024-01-23 17:34:36. (18): starting logging server on port 39591
2024/01/23 17:34:36 2024-01-23 17:34:36. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3d35f0c520> for environment oegwhlvaUabeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/23 17:34:38 2024-01-23 17:34:38. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/23 17:34:38 2024-01-23 17:34:38. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/23 17:34:40 2024-01-23 17:34:40. (22): Waiting for docker to start up. Current status is running
2024/01/23 17:34:40 2024-01-23 17:34:40. (23): Docker container is running. container_id = b'7f5a1eb1d8e838b0088fa5287f636fd8aa3fe4bed6b34880bca122afe00a2e0d', worker_id = worker_17
2024/01/23 17:34:42 2024-01-23 17:34:42. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f3cfc516130> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/23 17:34:45 2024-01-23 17:34:45. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/23 17:34:45 2024-01-23 17:34:45. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/23 17:34:47 2024-01-23 17:34:47. (27): Waiting for docker to start up. Current status is running
2024/01/23 17:34:47 2024-01-23 17:34:47. (28): Docker container is running. container_id = b'9534b4f4c22c03cbb3c09c4fd6589b2ef6e205f8ed52e080ee49808879e402c3', worker_id = worker_19
2024/01/23 17:34:51 2024-01-23 17:34:51. (29): Completed job in 15.148397207260132 seconds with state DONE.
2024/01/23 17:34:51 Job[go-testjdbcio_postgresreadwrite-291-21cf1562-a141-4b6d-a09b-af56dfbf65e8] state: DONE
2024/01/23 17:34:51 🐳 Terminating container: 7ebd56a4a6cb
2024/01/23 17:34:51 🚫 Container terminated: 7ebd56a4a6cb
--- PASS: TestJDBCIO_PostgresReadWrite (62.40s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 154.526s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.060s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 45793
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpc9dxbfhx/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39009
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 46m 4s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/qyqh6j42bjwoe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5088
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5088/display/redirect>
Changes:
------------------------------------------
[...truncated 1.67 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:58275.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:11 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:13 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:14 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f97a72d4a60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f97a72d4af0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f97a72d5280> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f5d6ffb11f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5d6ffb1310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5d6ffb1820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f5d6ffb18b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5d6ffb1a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5d6ffb1af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5d6ffb1c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5d6ffb1ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5d6ffb1d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5d6ffb1dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f5d6ffb2040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f5d6ffb2160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5d6ffb1f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f5d6ffb20d0> ====================
INFO root:portable_runner.py:543 starting control server on port 40725
INFO root:portable_runner.py:543 starting data server on port 38129
INFO root:portable_runner.py:543 starting state server on port 45377
INFO root:portable_runner.py:543 starting logging server on port 39677
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f5da5045910> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'f22dd15bc792882eb148b6e9547eff1dbb74eb55d4a8717500e455db7e5ad8c3', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f5da454b580> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:58275')
INFO root:portable_runner.py:543 Requesting worker at localhost:58275
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:25 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-14.c.apache-beam-testing.internal:40725.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:37 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 5:10:37 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-f6559805-a98a-46c5-817e-13ef42d1be82 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 343.18s (0:05:43) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 144583
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 158493.
Stopping expansion service pid: 158494.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 40m 27s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/qpeopet32l7kg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5087
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5087/display/redirect>
Changes:
------------------------------------------
[...truncated 1.73 MB...]
E File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
E if input_watermark > window.end + self.allowed_lateness:
E AttributeError: 'bytes' object has no attribute 'end'
apache_beam/runners/portability/portable_runner.py:576: RuntimeError
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:339 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO root:external.py:1017 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:203 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '54769' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.54.0-SNAPSHOT.jar'> '--alsoStartLoopbackWorker']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Starting expansion service at localhost:54769
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:23 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:org.apache.beam:bigquery_read:v1, beam:transform:org.apache.beam:bigquery_write:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6c779568
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@f381794
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2cdd0d4b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7e9131d5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:24 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:25 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:25 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:27 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa2d926e9d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa2d926ea60> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa2d926f1f0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fca167731f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fca16773310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fca16773820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fca167738b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fca16773a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fca16773af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fca16773c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fca16773ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fca16773d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fca16773dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fca16774040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fca16774160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fca16773f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fca167740d0> ====================
INFO root:portable_runner.py:543 starting control server on port 39865
INFO root:portable_runner.py:543 starting data server on port 39247
INFO root:portable_runner.py:543 starting state server on port 45417
INFO root:portable_runner.py:543 starting logging server on port 32823
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fca47bad040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7d8351897af97fec58408467a0eb12d9ce26168128e306c17adfb50d31efb47c', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fca47b7b400> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:54769')
INFO root:portable_runner.py:543 Requesting worker at localhost:54769
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:38 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:39865.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:47 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 23, 2024 11:27:47 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-13b2404f-7a3f-4e93-94a7-5ca9a3811626 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 284.33s (0:04:44) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 621741
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 623527.
Stopping expansion service pid: 623528.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 52s
261 actionable tasks: 221 executed, 30 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/emoes2s3pk772
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5086
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5086/display/redirect?page=changes>
Changes:
[noreply] Address Feedback from Beam Website Feedback Form. (#30064)
------------------------------------------
[...truncated 1.04 MB...]
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:653)
at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
Caused by: org.postgresql.util.PSQLException: Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:303)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
at org.postgresql.Driver.makeConnection(Driver.java:465)
at org.postgresql.Driver.connect(Driver.java:264)
at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:52)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:374)
at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:106)
at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:649)
at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:607)
at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
at org.postgresql.core.PGStream.<init>(PGStream.java:95)
at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
... 36 more
2024/01/22 16:09:38 Job[go-testjdbcio_basicreadwrite-841-a3b772c1-8748-4767-8597-4bc1dd7b24b3] state: FAILED
jdbc_test.go:116: Failed to execute job: job go-testjdbcio_basicreadwrite-841-a3b772c1-8748-4767-8597-4bc1dd7b24b3 failed:
Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1406, in process_bundle
raise RuntimeError(result.error)
RuntimeError: org.apache.beam.sdk.util.UserCodeException: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.)
at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:653)
at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
Caused by: org.postgresql.util.PSQLException: Connection to localhost:33479 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:303)
at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51)
at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225)
at org.postgresql.Driver.makeConnection(Driver.java:465)
at org.postgresql.Driver.connect(Driver.java:264)
at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:52)
at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:374)
at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:106)
at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:649)
at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:531)
at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:731)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.getConnection(JdbcIO.java:1524)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn.processElement(JdbcIO.java:1537)
at org.apache.beam.sdk.io.jdbc.JdbcIO$ReadFn$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.FnApiDoFnRunner.outputTo(FnApiDoFnRunner.java:1792)
at org.apache.beam.fn.harness.FnApiDoFnRunner.access$3000(FnApiDoFnRunner.java:143)
at org.apache.beam.fn.harness.FnApiDoFnRunner$NonWindowObservingProcessBundleContext.output(FnApiDoFnRunner.java:2650)
at org.apache.beam.sdk.transforms.MapElements$2.processElement(MapElements.java:151)
at org.apache.beam.sdk.transforms.MapElements$2$DoFnInvoker.invokeProcessElement(Unknown Source)
at org.apache.beam.fn.harness.FnApiDoFnRunner.processElementForParDo(FnApiDoFnRunner.java:803)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:348)
at org.apache.beam.fn.harness.data.PCollectionConsumerRegistry$MetricTrackingFnDataReceiver.accept(PCollectionConsumerRegistry.java:275)
at org.apache.beam.fn.harness.BeamFnDataReadRunner.forwardElementToConsumer(BeamFnDataReadRunner.java:213)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.multiplexElements(BeamFnDataInboundObserver.java:158)
at org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver.awaitCompletion(BeamFnDataInboundObserver.java:123)
at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:550)
at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:607)
at org.postgresql.core.PGStream.createSocket(PGStream.java:231)
at org.postgresql.core.PGStream.<init>(PGStream.java:95)
at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:98)
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213)
... 36 more
2024/01/22 16:09:38 🐳 Terminating container: 9eb08b15f51f
containers.go:100: error terminating container: Error response from daemon: No such container: 9eb08b15f51fd99e58afda492d2d06220548fcfde7313fc164f4773970bc9812
--- FAIL: TestJDBCIO_BasicReadWrite (62.68s)
=== RUN TestJDBCIO_PostgresReadWrite
jdbc_test.go:128: failed to start container with 5 retries: Error response from daemon: No such container: 9b09499a1ea926d3bd7db5a9bc46ab17f38eaa24dc34ab5c99c5593c04bfccab: creating reaper failed: failed to create container
--- FAIL: TestJDBCIO_PostgresReadWrite (15.00s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 80.747s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.036s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 40847
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp4ht4jmbo/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36063
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 22s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/34cb5zjfxtbwu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5085
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5085/display/redirect>
Changes:
------------------------------------------
[...truncated 1.20 MB...]
>
component_coder_ids: "KKWqINJGKcVarIntCoder"
component_coder_ids: "KKWqINJGKcIterableCoder"
>
>
coders: <
key: "KKWqINJGKcRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$d7f638c7-3f67-4411-97e9-5d7d2a70e8b6"
>
>
>
coders: <
key: "KKWqINJGKcVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "KKWqINJGKcVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "KKWqINJGKcbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar\022@4c6749adba74b4713313f2bcddcdcc43d70815d4c887f4b7feafdab4740e3332"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-TGdJrbp0tHEzE_K83c3MQ9cIFdTIh_S3_q_atHQOMzI.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/21 22:37:06 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-3-1705876626566602413
2024/01/21 22:37:10 Prepared job with id: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e and staging token: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Submitted job: go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: STOPPED
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: STARTING
2024/01/21 22:37:11 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: RUNNING
2024/01/21 22:37:11 2024-01-21 22:37:11. (1): ==================== <function annotate_downstream_side_inputs at 0x7fb7984019d0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fb798401af0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (3): ==================== <function pack_combiners at 0x7fb7983ff040> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (4): ==================== <function lift_combiners at 0x7fb7983ff0d0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (5): ==================== <function expand_sdf at 0x7fb7983ff280> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (6): ==================== <function expand_gbk at 0x7fb7983ff310> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (7): ==================== <function sink_flattens at 0x7fb7983ff430> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (8): ==================== <function greedily_fuse at 0x7fb7983ff4c0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (9): ==================== <function read_to_impulse at 0x7fb7983ff550> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (10): ==================== <function impulse_to_input at 0x7fb7983ff5e0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (11): ==================== <function sort_stages at 0x7fb7983ff820> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fb7983ff940> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (13): ==================== <function setup_timer_mapping at 0x7fb7983ff790> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (14): ==================== <function populate_data_channel_coders at 0x7fb7983ff8b0> ====================
2024/01/21 22:37:11 2024-01-21 22:37:11. (15): starting control server on port 43517
2024/01/21 22:37:11 2024-01-21 22:37:11. (16): starting data server on port 37569
2024/01/21 22:37:11 2024-01-21 22:37:11. (17): starting state server on port 40293
2024/01/21 22:37:11 2024-01-21 22:37:11. (18): starting logging server on port 38791
2024/01/21 22:37:11 2024-01-21 22:37:11. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb7cbfd3670> for environment KKWqINJGKcbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/21 22:37:11 2024-01-21 22:37:11. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/21 22:37:11 2024-01-21 22:37:11. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/21 22:37:14 2024-01-21 22:37:14. (22): Waiting for docker to start up. Current status is running
2024/01/21 22:37:14 2024-01-21 22:37:14. (23): Docker container is running. container_id = b'302e30f6ca67cc16ec183b04ebb59e318024c9e87fc32172920cb6fdbe5282ed', worker_id = worker_14
2024/01/21 22:37:16 2024-01-21 22:37:16. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fb7cd4210d0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/21 22:37:16 2024-01-21 22:37:16. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/21 22:37:17 2024-01-21 22:37:17. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/21 22:37:17 2024-01-21 22:37:17. (27): Waiting for docker to start up. Current status is running
2024/01/21 22:37:17 2024-01-21 22:37:17. (28): Docker container is running. container_id = b'3020b46f0d910f09509f228c9319fc71ffde61156217b58607d53df4b6754727', worker_id = worker_15
2024/01/21 22:37:22 2024-01-21 22:37:22. (29): Completed job in 11.135669708251953 seconds with state DONE.
2024/01/21 22:37:22 Job[go-testjdbcio_postgresreadwrite-656-3231edb5-d0c5-4f7c-9f4a-53354d67789e] state: DONE
2024/01/21 22:37:22 🐳 Terminating container: 36d2c45bc593
2024/01/21 22:37:22 🚫 Container terminated: 36d2c45bc593
--- PASS: TestJDBCIO_PostgresReadWrite (43.80s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 99.323s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.028s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 38813
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpm4k88azz/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35357
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 36m 41s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/bvlpzn262evv4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5084
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5084/display/redirect>
Changes:
------------------------------------------
[...truncated 1.20 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:14 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f220386b280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f220386b310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f220386ba60> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f92529d19d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f92529d1af0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f92529cc040> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f92529cc0d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f92529cc280> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f92529cc310> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f92529cc430> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f92529cc4c0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f92529cc550> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f92529cc5e0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f92529cc820> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f92529cc940> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f92529cc790> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f92529cc8b0> ====================
INFO root:portable_runner.py:543 starting control server on port 42349
INFO root:portable_runner.py:543 starting data server on port 45927
INFO root:portable_runner.py:543 starting state server on port 35033
INFO root:portable_runner.py:543 starting logging server on port 38499
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9286e17310> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7b511beb34ff1fe92ad1a904edeea6ddb33e5b0b818d0f374b4b24139ce2655e', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f9286fe2610> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:39689')
INFO root:portable_runner.py:543 Requesting worker at localhost:39689
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:26 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:42349.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:35 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 21, 2024 6:08:35 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-183776a4-8a46-41db-a412-096eeb6cd23c failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 295.25s (0:04:55) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2082237
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2083114.
Stopping expansion service pid: 2083115.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 36m 58s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/prxlvgqls7gkm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5083
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5083/display/redirect>
Changes:
------------------------------------------
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:org.apache.beam:bigquery_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:54 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:54 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:55 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc782c94280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc782c94310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc782c94a60> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f93f99e59d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f93f99e5af0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f93f99e6040> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f93f99e60d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f93f99e6280> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f93f99e6310> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f93f99e6430> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f93f99e64c0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f93f99e6550> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f93f99e65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f93f99e6820> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f93f99e6940> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f93f99e6790> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f93f99e68b0> ====================
INFO root:portable_runner.py:543 starting control server on port 41771
INFO root:portable_runner.py:543 starting data server on port 37323
INFO root:portable_runner.py:543 starting state server on port 34125
INFO root:portable_runner.py:543 starting logging server on port 36135
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f942df23580> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e76cd2dea4895fe116b2c8974d4b595369f83acedf9f0d9affccaff416b9ee32', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f942dfe0250> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:52427')
INFO root:portable_runner.py:543 Requesting worker at localhost:52427
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:07 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:41771.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:16 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20, 2024 11:03:16 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-d40b8520-b1a0-402d-9ff5-2b113ab55ac4 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 294.89s (0:04:54) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 986297
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 987191.
Stopping expansion service pid: 987192.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 18s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/lr3uwqirvoyqk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5082
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5082/display/redirect?page=changes>
Changes:
[noreply] [Python] Enrichment Transform with BigTable handler (#30001)
------------------------------------------
[...truncated 1.34 MB...]
coders: <
key: "fMHPWNBLKMKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "fMHPWNBLKMVarIntCoder"
component_coder_ids: "fMHPWNBLKMRowCoder"
>
>
coders: <
key: "fMHPWNBLKMKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "fMHPWNBLKMVarIntCoder"
component_coder_ids: "fMHPWNBLKMCoder1"
>
>
coders: <
key: "fMHPWNBLKMKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "fMHPWNBLKMVarIntCoder"
component_coder_ids: "fMHPWNBLKMIterableCoder"
>
>
coders: <
key: "fMHPWNBLKMRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$9d5aed3a-e324-47e1-9780-aafec6fa714e"
>
>
>
coders: <
key: "fMHPWNBLKMVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "fMHPWNBLKMVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "fMHPWNBLKMbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-EhOlsw5loEq-0j-S48CmpRhVu_K3XNUljpzhuT4lIhE.jar\022@1213a5b30e65a04abed23f92e3c0a6a51855bbf2b75cd5258e9ce1b93e252211"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-EhOlsw5loEq-0j-S48CmpRhVu_K3XNUljpzhuT4lIhE.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2024/01/19 17:17:02 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705684622947856629
2024/01/19 17:17:05 Prepared job with id: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f and staging token: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Submitted job: go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: STOPPED
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: STARTING
2024/01/19 17:17:05 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: RUNNING
2024/01/19 17:17:05 2024-01-19 17:17:05. (1): ==================== <function annotate_downstream_side_inputs at 0x7f21fd9e09d0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f21fd9e0af0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (3): ==================== <function pack_combiners at 0x7f21fd9dd040> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (4): ==================== <function lift_combiners at 0x7f21fd9dd0d0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (5): ==================== <function expand_sdf at 0x7f21fd9dd280> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (6): ==================== <function expand_gbk at 0x7f21fd9dd310> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (7): ==================== <function sink_flattens at 0x7f21fd9dd430> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (8): ==================== <function greedily_fuse at 0x7f21fd9dd4c0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (9): ==================== <function read_to_impulse at 0x7f21fd9dd550> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (10): ==================== <function impulse_to_input at 0x7f21fd9dd5e0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (11): ==================== <function sort_stages at 0x7f21fd9dd820> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f21fd9dd940> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (13): ==================== <function setup_timer_mapping at 0x7f21fd9dd790> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (14): ==================== <function populate_data_channel_coders at 0x7f21fd9dd8b0> ====================
2024/01/19 17:17:05 2024-01-19 17:17:05. (15): starting control server on port 35025
2024/01/19 17:17:05 2024-01-19 17:17:05. (16): starting data server on port 35605
2024/01/19 17:17:05 2024-01-19 17:17:05. (17): starting state server on port 39021
2024/01/19 17:17:05 2024-01-19 17:17:05. (18): starting logging server on port 46297
2024/01/19 17:17:05 2024-01-19 17:17:05. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f2231743c10> for environment fMHPWNBLKMbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/19 17:17:09 2024-01-19 17:17:09. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/19 17:17:09 2024-01-19 17:17:09. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/19 17:17:10 2024-01-19 17:17:10. (22): Waiting for docker to start up. Current status is running
2024/01/19 17:17:10 2024-01-19 17:17:10. (23): Docker container is running. container_id = b'9eaf56ec52c86d0194f556e3d124fbf92992a6d56dfe7c449aaa69bbd9175f01', worker_id = worker_15
2024/01/19 17:17:12 2024-01-19 17:17:12. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f21ec7c38b0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/19 17:17:14 2024-01-19 17:17:14. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/19 17:17:15 2024-01-19 17:17:15. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/19 17:17:16 2024-01-19 17:17:16. (27): Waiting for docker to start up. Current status is running
2024/01/19 17:17:16 2024-01-19 17:17:16. (28): Docker container is running. container_id = b'f24152dfe89dc0120dd0676ed45befc2db010c66bde34f5135a00617709f31e3', worker_id = worker_17
2024/01/19 17:17:19 2024-01-19 17:17:19. (29): Completed job in 13.872668743133545 seconds with state DONE.
2024/01/19 17:17:19 Job[go-testjdbcio_postgresreadwrite-955-fb6a9168-c164-4431-b291-1288adf0a78f] state: DONE
2024/01/19 17:17:19 🐳 Terminating container: 125b641a0e8b
2024/01/19 17:17:20 🚫 Container terminated: 125b641a0e8b
--- PASS: TestJDBCIO_PostgresReadWrite (40.24s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 105.030s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.047s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 34763
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpub6f9k6t/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35003
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 36m 47s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ib3hvp73tqnx6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5081
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5081/display/redirect>
Changes:
------------------------------------------
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:43 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:43 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:44 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:45 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:46 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:46 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fb04b110280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fb04b110310> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fb04b110a60> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd198bae9d0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd198baeaf0> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd198bac040> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd198bac0d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd198bac280> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd198bac310> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd198bac430> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd198bac4c0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd198bac550> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd198bac5e0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd198bac820> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd198bac940> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd198bac790> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd198bac8b0> ====================
INFO root:portable_runner.py:543 starting control server on port 38275
INFO root:portable_runner.py:543 starting data server on port 39909
INFO root:portable_runner.py:543 starting state server on port 39273
INFO root:portable_runner.py:543 starting logging server on port 40927
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd1cd0bb520> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'cb89a48290abb9721789ea415cdd323cfb5d6acb8a693ef29f53db60a401a34b', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fd1cd03fd90> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:47403')
INFO root:portable_runner.py:543 Requesting worker at localhost:47403
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:47:56 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:38275.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:48:06 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 19, 2024 2:48:06 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-5cea84fc-eeb1-4d13-ba47-b9f1194314f7 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7280 deselected in 284.02s (0:04:44) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3761892
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3762442.
Stopping expansion service pid: 3762443.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 39s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/fl4hdn6fxoozc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5080
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5080/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "hdsseiqwckbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-kdmwgmcqeYRetSKD9J4iJK7js8aYz0b1fICfEc5e3TE.jar\022@91d9b082672a79845eb52283f49e2224aee3b3c698cf46f57c809f11ce5edd31"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-kdmwgmcqeYRetSKD9J4iJK7js8aYz0b1fICfEc5e3TE.jar"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/18 20:02:41 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705608161167613568
2024/01/18 20:02:45 Prepared job with id: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640 and staging token: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Submitted job: go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: STOPPED
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: STARTING
2024/01/18 20:02:45 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: RUNNING
2024/01/18 20:02:45 2024-01-18 20:02:45. (1): ==================== <function annotate_downstream_side_inputs at 0x7f6e04eab9d0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f6e04eabaf0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (3): ==================== <function pack_combiners at 0x7f6e04ea7040> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (4): ==================== <function lift_combiners at 0x7f6e04ea70d0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (5): ==================== <function expand_sdf at 0x7f6e04ea7280> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (6): ==================== <function expand_gbk at 0x7f6e04ea7310> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (7): ==================== <function sink_flattens at 0x7f6e04ea7430> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (8): ==================== <function greedily_fuse at 0x7f6e04ea74c0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (9): ==================== <function read_to_impulse at 0x7f6e04ea7550> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (10): ==================== <function impulse_to_input at 0x7f6e04ea75e0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (11): ==================== <function sort_stages at 0x7f6e04ea7820> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f6e04ea7940> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (13): ==================== <function setup_timer_mapping at 0x7f6e04ea7790> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (14): ==================== <function populate_data_channel_coders at 0x7f6e04ea78b0> ====================
2024/01/18 20:02:45 2024-01-18 20:02:45. (15): starting control server on port 38163
2024/01/18 20:02:45 2024-01-18 20:02:45. (16): starting data server on port 39715
2024/01/18 20:02:45 2024-01-18 20:02:45. (17): starting state server on port 39347
2024/01/18 20:02:45 2024-01-18 20:02:45. (18): starting logging server on port 44603
2024/01/18 20:02:45 2024-01-18 20:02:45. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6e38640f70> for environment hdsseiqwckbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/18 20:02:45 2024-01-18 20:02:45. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/18 20:02:46 2024-01-18 20:02:46. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/18 20:02:53 2024-01-18 20:02:53. (22): Waiting for docker to start up. Current status is running
2024/01/18 20:02:53 2024-01-18 20:02:53. (23): Docker container is running. container_id = b'5c89b4268cbc31860792abceceb208ceac33bebaacf39a3cf99c04efe8f4841d', worker_id = worker_16
2024/01/18 20:02:54 2024-01-18 20:02:54. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6e39e9a850> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/18 20:02:57 2024-01-18 20:02:57. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/18 20:02:58 2024-01-18 20:02:58. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/18 20:02:59 2024-01-18 20:02:59. (27): Waiting for docker to start up. Current status is running
2024/01/18 20:02:59 2024-01-18 20:02:59. (28): Docker container is running. container_id = b'12f39c122fa79be254846b8b1722355390ffafd2187bf2fd0b8b7f99f54f9e1e', worker_id = worker_18
2024/01/18 20:03:05 2024-01-18 20:03:05. (29): Completed job in 19.60710096359253 seconds with state DONE.
2024/01/18 20:03:05 Job[go-testjdbcio_postgresreadwrite-319-755c060c-6cda-4277-94a2-64a0d6721640] state: DONE
2024/01/18 20:03:05 🐳 Terminating container: a0218a5340a1
2024/01/18 20:03:05 🚫 Container terminated: a0218a5340a1
--- PASS: TestJDBCIO_PostgresReadWrite (63.56s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 183.796s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.111s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:307
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:328
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:349
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:370
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:285
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:263
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:392
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PythonDependenciesTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:401
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:242
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.sdk.extensions.python.ConsecutivePythonTransformsTest > testConsecutivePythonMaps FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ConsecutivePythonTransformsTest.java:44
java.lang.NullPointerException at Preconditions.java:1010
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33431
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp9q1iqf4g/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 37919
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest > testDataframeSum FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at DataframeTransformTest.java:50
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at PythonMapTest.java:41
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at PythonMapTest.java:54
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at RunInferenceTransformTest.java:108
java.lang.NullPointerException at Preconditions.java:1010
org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED
org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at RunInferenceTransformTest.java:60
java.lang.NullPointerException at Preconditions.java:1010
17 tests completed, 15 failed
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 55s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/32zcl5zt6rlbe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5079
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5079/display/redirect>
Changes:
------------------------------------------
[...truncated 1.80 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:23 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:24 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:24 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:26 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe829146430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe8291464c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe829146c10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f650e8da1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f650e8da310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f650e8da820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f650e8da8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f650e8daa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f650e8daaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f650e8dac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f650e8daca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f650e8dad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f650e8dadc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f650e8db040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f650e8db160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f650e8daf70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f650e8db0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 43865
INFO root:portable_runner.py:543 starting data server on port 40477
INFO root:portable_runner.py:543 starting state server on port 41807
INFO root:portable_runner.py:543 starting logging server on port 37323
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f6543861b50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'a256318e4ae857aba3820934876d54ddcf2808e49ad94abff036744a452426fa', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f6543895460> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:40141')
INFO root:portable_runner.py:543 Requesting worker at localhost:40141
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:38 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:43865.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:47 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 11:53:47 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-d1aa053d-d8bb-428f-b7b9-128631980a61 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 287.64s (0:04:47) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1166213
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1182478.
Stopping expansion service pid: 1182479.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 42m
261 actionable tasks: 180 executed, 71 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/qtnjyooj2oj5y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5078
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5078/display/redirect?page=changes>
Changes:
[noreply] GCS autosharding flag (#29886)
------------------------------------------
[...truncated 1.64 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:01:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7ff802c48430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7ff802c484c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7ff802c48c10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f4f058b51f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f4f058b5310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f4f058b5820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f4f058b58b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f4f058b5a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f4f058b5af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f4f058b5c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f4f058b5ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f4f058b5d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f4f058b5dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f4f058b6040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f4f058b6160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f4f058b5f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f4f058b60d0> ====================
INFO root:portable_runner.py:543 starting control server on port 43089
INFO root:portable_runner.py:543 starting data server on port 42737
INFO root:portable_runner.py:543 starting state server on port 39889
INFO root:portable_runner.py:543 starting logging server on port 42097
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4f350b6820> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7c053c20d0d8cba3e572acab7f75fae1b9d60abf3f1d476998a5d27fbf39a5e4', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f4f3a130f70> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:41677')
INFO root:portable_runner.py:543 Requesting worker at localhost:41677
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:04 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:43089.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:14 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 18, 2024 6:02:14 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-3a9596fa-4ab4-48a5-a640-e5264e0f2a16 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 323.87s (0:05:23) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3847991
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3861358.
Stopping expansion service pid: 3861359.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 3s
261 actionable tasks: 182 executed, 69 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ictkzwzjyraxw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5077
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5077/display/redirect>
Changes:
------------------------------------------
[...truncated 1.81 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:03 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:04 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa37f7e3430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa37f7e34c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa37f7e3c10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f0ee1f5a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f0ee1f5a310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f0ee1f5a820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f0ee1f5a8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f0ee1f5aa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f0ee1f5aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f0ee1f5ac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f0ee1f5aca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f0ee1f5ad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f0ee1f5adc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f0ee1f5b040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f0ee1f5b160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f0ee1f5af70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f0ee1f5b0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 36527
INFO root:portable_runner.py:543 starting data server on port 42353
INFO root:portable_runner.py:543 starting state server on port 44579
INFO root:portable_runner.py:543 starting logging server on port 33385
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f0f167f0df0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'170ba6809c855fd7e73d8a5f50124bdc5bb8b86dae73609173f6b2184cd60904', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f0f167b2b20> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:48285')
INFO root:portable_runner.py:543 Requesting worker at localhost:48285
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:17 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:36527.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:26 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 11:48:26 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-888fb3fb-b9cc-4d77-8900-ae70d8173fee failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 298.72s (0:04:58) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2525790
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2537618.
Stopping expansion service pid: 2537619.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 44s
261 actionable tasks: 176 executed, 75 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/pdzrx7too23ws
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5076
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5076/display/redirect>
Changes:
------------------------------------------
[...truncated 1.77 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
WARNING root:subprocess_server.py:182 Waiting for grpc channel to be ready at localhost:33371.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:54:56 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f449247e430> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f449247e4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f449247ec10> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fdf9b4fb1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fdf9b4fb310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fdf9b4fb820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fdf9b4fb8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fdf9b4fba60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fdf9b4fbaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fdf9b4fbc10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fdf9b4fbca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fdf9b4fbd30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fdf9b4fbdc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fdf9b4fc040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf9b4fc160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fdf9b4fbf70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fdf9b4fc0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 33895
INFO root:portable_runner.py:543 starting data server on port 43791
INFO root:portable_runner.py:543 starting state server on port 35965
INFO root:portable_runner.py:543 starting logging server on port 41741
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdfd05952b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'644703cc7eea5cbd33a2f0f2b6826f911a1ec47dd57a54ffd4ab98c92aef2e27', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fdfcfd0aa60> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:33371')
INFO root:portable_runner.py:543 Requesting worker at localhost:33371
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:09 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:33895.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:20 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 17, 2024 5:55:20 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-96ee2fe7-ec79-448b-90c6-1e74b78744f7 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 339.22s (0:05:39) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1345264
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1352508.
Stopping expansion service pid: 1352509.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 44m 36s
261 actionable tasks: 221 executed, 30 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/mtxowiwv6ohcc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5075
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5075/display/redirect?page=changes>
Changes:
[noreply] Additional test for windmill OrderedListState implementation. (#29970)
------------------------------------------
[...truncated 1.34 MB...]
>
component_coder_ids: "bPNbGtuZnoVarIntCoder"
component_coder_ids: "bPNbGtuZnoIterableCoder"
>
>
coders: <
key: "bPNbGtuZnoRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$52ed2d85-aabb-4b04-9956-1a27f0ac6b3c"
>
>
>
coders: <
key: "bPNbGtuZnoVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "bPNbGtuZnoVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "bPNbGtuZnobeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar\022@82eef683ad89f017364dbc2b986b39254bd67e34f5f819f6d5565ec4593abd03"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/17 11:24:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705490645841044530
2024/01/17 11:24:08 Prepared job with id: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d and staging token: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Submitted job: go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: STOPPED
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: STARTING
2024/01/17 11:24:09 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: RUNNING
2024/01/17 11:24:09 2024-01-17 11:24:09. (1): ==================== <function annotate_downstream_side_inputs at 0x7f1814e801f0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f1814e80310> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (3): ==================== <function pack_combiners at 0x7f1814e80820> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (4): ==================== <function lift_combiners at 0x7f1814e808b0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (5): ==================== <function expand_sdf at 0x7f1814e80a60> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (6): ==================== <function expand_gbk at 0x7f1814e80af0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (7): ==================== <function sink_flattens at 0x7f1814e80c10> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (8): ==================== <function greedily_fuse at 0x7f1814e80ca0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (9): ==================== <function read_to_impulse at 0x7f1814e80d30> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (10): ==================== <function impulse_to_input at 0x7f1814e80dc0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (11): ==================== <function sort_stages at 0x7f1814e81040> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f1814e81160> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (13): ==================== <function setup_timer_mapping at 0x7f1814e80f70> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (14): ==================== <function populate_data_channel_coders at 0x7f1814e810d0> ====================
2024/01/17 11:24:09 2024-01-17 11:24:09. (15): starting control server on port 36883
2024/01/17 11:24:09 2024-01-17 11:24:09. (16): starting data server on port 42593
2024/01/17 11:24:09 2024-01-17 11:24:09. (17): starting state server on port 33969
2024/01/17 11:24:09 2024-01-17 11:24:09. (18): starting logging server on port 35753
2024/01/17 11:24:09 2024-01-17 11:24:09. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1846e912e0> for environment bPNbGtuZnobeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/17 11:24:12 2024-01-17 11:24:12. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/17 11:24:12 2024-01-17 11:24:12. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/17 11:24:14 2024-01-17 11:24:14. (22): Waiting for docker to start up. Current status is running
2024/01/17 11:24:14 2024-01-17 11:24:14. (23): Docker container is running. container_id = b'9a79cad589ca8336d967548231adbc4d7e6bf4e0632c7576d21848e4d4d7a9b2', worker_id = worker_15
2024/01/17 11:24:15 2024-01-17 11:24:15. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1846e97df0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/17 11:24:18 2024-01-17 11:24:18. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/17 11:24:18 2024-01-17 11:24:18. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/17 11:24:20 2024-01-17 11:24:20. (27): Waiting for docker to start up. Current status is running
2024/01/17 11:24:20 2024-01-17 11:24:20. (28): Docker container is running. container_id = b'0f0911f337b6061744f4573d119a69f0372bab938d759b1e28d88519d7514d10', worker_id = worker_17
2024/01/17 11:24:23 2024-01-17 11:24:23. (29): Completed job in 14.699676990509033 seconds with state DONE.
2024/01/17 11:24:23 Job[go-testjdbcio_postgresreadwrite-903-3f4d5e10-a84e-4334-8edc-b165e487974d] state: DONE
2024/01/17 11:24:23 🐳 Terminating container: 411648bf09a4
2024/01/17 11:24:23 🚫 Container terminated: 411648bf09a4
--- PASS: TestJDBCIO_PostgresReadWrite (46.98s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 139.762s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.073s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36227
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp9ggjjfz5/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 33763
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 44s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/7vtpyak3eaanw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5074
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5074/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
>
component_coder_ids: "DeYAOnKxWZVarIntCoder"
component_coder_ids: "DeYAOnKxWZIterableCoder"
>
>
coders: <
key: "DeYAOnKxWZRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$5640da34-f5af-4a10-b3d3-28a3833cd069"
>
>
>
coders: <
key: "DeYAOnKxWZVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "DeYAOnKxWZVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "DeYAOnKxWZbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar\022@82eef683ad89f017364dbc2b986b39254bd67e34f5f819f6d5565ec4593abd03"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-gu72g62J8Bc2TbwrmGs5JUvWfjT1-Bn21VZexFk6vQM.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/17 05:32:26 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705469546467463398
2024/01/17 05:32:28 Prepared job with id: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928 and staging token: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Submitted job: go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: STOPPED
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: STARTING
2024/01/17 05:32:29 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: RUNNING
2024/01/17 05:32:29 2024-01-17 05:32:29. (1): ==================== <function annotate_downstream_side_inputs at 0x7fcaed4ed1f0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fcaed4ed310> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (3): ==================== <function pack_combiners at 0x7fcaed4ed820> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (4): ==================== <function lift_combiners at 0x7fcaed4ed8b0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (5): ==================== <function expand_sdf at 0x7fcaed4eda60> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (6): ==================== <function expand_gbk at 0x7fcaed4edaf0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (7): ==================== <function sink_flattens at 0x7fcaed4edc10> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (8): ==================== <function greedily_fuse at 0x7fcaed4edca0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (9): ==================== <function read_to_impulse at 0x7fcaed4edd30> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (10): ==================== <function impulse_to_input at 0x7fcaed4eddc0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (11): ==================== <function sort_stages at 0x7fcaed4ee040> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fcaed4ee160> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (13): ==================== <function setup_timer_mapping at 0x7fcaed4edf70> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (14): ==================== <function populate_data_channel_coders at 0x7fcaed4ee0d0> ====================
2024/01/17 05:32:29 2024-01-17 05:32:29. (15): starting control server on port 36351
2024/01/17 05:32:29 2024-01-17 05:32:29. (16): starting data server on port 34265
2024/01/17 05:32:29 2024-01-17 05:32:29. (17): starting state server on port 33409
2024/01/17 05:32:29 2024-01-17 05:32:29. (18): starting logging server on port 36579
2024/01/17 05:32:29 2024-01-17 05:32:29. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcaec2c3160> for environment DeYAOnKxWZbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/17 05:32:32 2024-01-17 05:32:32. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/17 05:32:33 2024-01-17 05:32:33. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/17 05:32:34 2024-01-17 05:32:34. (22): Waiting for docker to start up. Current status is running
2024/01/17 05:32:34 2024-01-17 05:32:34. (23): Docker container is running. container_id = b'2ef963e32c73f75d4e2715420b5ab4b2f0a85521c0ea7ff0ce9987c7cc7dfcb0', worker_id = worker_15
2024/01/17 05:32:35 2024-01-17 05:32:35. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcaec2cf2e0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/17 05:32:37 2024-01-17 05:32:37. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/17 05:32:38 2024-01-17 05:32:38. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/17 05:32:39 2024-01-17 05:32:39. (27): Waiting for docker to start up. Current status is running
2024/01/17 05:32:39 2024-01-17 05:32:39. (28): Docker container is running. container_id = b'2a42a93a9d8efc3131a3d17556c748d838716152d6805720f5c418bfb1829be4', worker_id = worker_17
2024/01/17 05:32:43 2024-01-17 05:32:43. (29): Completed job in 13.82400369644165 seconds with state DONE.
2024/01/17 05:32:43 Job[go-testjdbcio_postgresreadwrite-770-3ee699bb-6670-4af9-b31c-3dfb47967928] state: DONE
2024/01/17 05:32:43 🐳 Terminating container: 0c03b199c459
2024/01/17 05:32:43 🚫 Container terminated: 0c03b199c459
--- PASS: TestJDBCIO_PostgresReadWrite (40.60s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 111.100s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.041s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35399
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpwezm6slu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 39151
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 55s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/cdrouuklkywfo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5073
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5073/display/redirect>
Changes:
------------------------------------------
[...truncated 1.78 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:13 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:13 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:14 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:15 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:16 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:16 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f58406c14c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f58406c1550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f58406c1ca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9756d181f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9756d18310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9756d18820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9756d188b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9756d18a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9756d18af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9756d18c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9756d18ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9756d18d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9756d18dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9756d19040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9756d19160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9756d18f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9756d190d0> ====================
INFO root:portable_runner.py:543 starting control server on port 33515
INFO root:portable_runner.py:543 starting data server on port 38699
INFO root:portable_runner.py:543 starting state server on port 34929
INFO root:portable_runner.py:543 starting logging server on port 33345
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f978b47abb0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'5e28ebddc9d689ab70539e87246fcecb801e5034006738dedb64638de0ad0f95', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f978b555880> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:35651')
INFO root:portable_runner.py:543 Requesting worker at localhost:35651
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:27 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:33515.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:36 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:36 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-7cfb5472-e9ae-49e6-a41e-ed44f7f9215a failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 297.30s (0:04:57) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1572938
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1584666.
Stopping expansion service pid: 1584667.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 54s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/ssw6n3nd7pdkg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5072
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5072/display/redirect>
Changes:
------------------------------------------
[...truncated 1.81 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:52 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:47:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fac0dfed4c0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fac0dfed550> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fac0dfedca0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f9dab6ba1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f9dab6ba310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f9dab6ba820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f9dab6ba8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f9dab6baa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f9dab6baaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f9dab6bac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f9dab6baca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f9dab6bad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f9dab6badc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f9dab6bb040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f9dab6bb160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f9dab6baf70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f9dab6bb0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 35161
INFO root:portable_runner.py:543 starting data server on port 34769
INFO root:portable_runner.py:543 starting state server on port 41083
INFO root:portable_runner.py:543 starting logging server on port 38149
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9dd37aa1f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'8b022aeb4ccb253700a2c4fd6334217c210c5968ae7f48f128c22ed0da558d60', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f9de06871c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:60771')
INFO root:portable_runner.py:543 Requesting worker at localhost:60771
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:06 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:35161.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:16 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:48:16 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-653e6f48-d81b-4882-ae41-f5008aa36c15 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 300.73s (0:05:00) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 394428
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 402477.
Stopping expansion service pid: 402478.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 33s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/t7wxxssglyceo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5071
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5071/display/redirect?page=changes>
Changes:
[noreply] Add a read timeout and cache BigQueryIOMetadata (#29662)
------------------------------------------
[...truncated 1.80 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:49 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:49 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:50 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:47:52 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f3d69f191f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f3d69f19280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f3d69f199d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f1aea1491f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f1aea149310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f1aea149820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f1aea1498b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f1aea149a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f1aea149af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f1aea149c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f1aea149ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f1aea149d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f1aea149dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f1aea14a040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f1aea14a160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f1aea149f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f1aea14a0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 44663
INFO root:portable_runner.py:543 starting data server on port 40005
INFO root:portable_runner.py:543 starting state server on port 38871
INFO root:portable_runner.py:543 starting logging server on port 34679
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f1b1e9e8f70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'7546b4b940dbc2caa9d980f54511d68b9469e5589f957c827686dd7d14c882a7', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f1b1f091040> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:55951')
INFO root:portable_runner.py:543 Requesting worker at localhost:55951
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:03 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:44663.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:12 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 11:48:12 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-595c4e0c-c175-4b9c-b1a6-cc85b33b1766 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 292.21s (0:04:52) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3407493
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3418929.
Stopping expansion service pid: 3418930.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 29s
261 actionable tasks: 178 executed, 73 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/iz5w22asgkxak
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5070
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5070/display/redirect>
Changes:
------------------------------------------
[...truncated 1.54 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:33 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:34 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:36 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f95695831f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f9569583280> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f95695839d0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff0bc5da1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff0bc5da310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff0bc5da820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff0bc5da8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff0bc5daa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff0bc5daaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff0bc5dac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff0bc5daca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff0bc5dad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff0bc5dadc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff0bc5db040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff0bc5db160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff0bc5daf70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff0bc5db0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 35571
INFO root:portable_runner.py:543 starting data server on port 32783
INFO root:portable_runner.py:543 starting state server on port 39907
INFO root:portable_runner.py:543 starting logging server on port 44251
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff0ebd618b0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'e6ca385c77075b218f59566e405524fd66f1b230146c2db6a393d963eace5bcc', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7ff0eafe3ca0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:54919')
INFO root:portable_runner.py:543 Requesting worker at localhost:54919
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:46 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:35571.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:56 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 16, 2024 5:53:56 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-3d96cfc6-b161-47c2-95d7-e83549bbf17d failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 280.57s (0:04:40) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1579869
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1580414.
Stopping expansion service pid: 1580415.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 34m 57s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/q7c4qtyhs5ym4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5069
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5069/display/redirect>
Changes:
------------------------------------------
[...truncated 1.80 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:14 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:15 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:15 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:17 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:17 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:17 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f8f985f2d30> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f8f985f2dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f8f985f1550> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fcac3de91f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fcac3de9310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fcac3de9820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fcac3de98b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fcac3de9a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fcac3de9af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fcac3de9c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fcac3de9ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fcac3de9d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fcac3de9dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fcac3dea040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fcac3dea160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fcac3de9f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fcac3dea0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 41759
INFO root:portable_runner.py:543 starting data server on port 44553
INFO root:portable_runner.py:543 starting state server on port 41177
INFO root:portable_runner.py:543 starting logging server on port 44051
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fcaf80ea460> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'32b125f5b1f5387b51073448af6013d196654990dd84b87e657e1d4a45f82bd1', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fcaf81631f0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:36225')
INFO root:portable_runner.py:543 Requesting worker at localhost:36225
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:28 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:41759.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:37 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 15, 2024 11:48:37 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-183ca85f-3b2a-4c8d-b3fd-1fe0779a5635 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 289.21s (0:04:49) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1091623
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1117160.
Stopping expansion service pid: 1117161.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 55s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/2dkuivto3drs4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5068
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5068/display/redirect>
Changes:
------------------------------------------
[...truncated 1.35 MB...]
>
component_coder_ids: "KfHVPrFieeVarIntCoder"
component_coder_ids: "KfHVPrFieeIterableCoder"
>
>
coders: <
key: "KfHVPrFieeRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$a0035829-0460-4bf3-b9c4-82abaf80712f"
>
>
>
coders: <
key: "KfHVPrFieeVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "KfHVPrFieeVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "c0"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c1"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\003\022$abc5e222-ab8f-4f6f-800a-a58bb0f45675"
>
>
>
environments: <
key: "KfHVPrFieebeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar\022@ae8c3c97fe17eef138d6aaa2e5187c8fb70dded37b48f7b9e35d10a950f51f7e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/15 17:24:00 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705339440400481253
2024/01/15 17:24:03 Prepared job with id: go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376 and staging token: go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376
2024/01/15 17:24:03 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376
2024/01/15 17:24:03 Submitted job: go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376
2024/01/15 17:24:03 2024-01-15 17:24:03. (1): ==================== <function annotate_downstream_side_inputs at 0x7f01399ac1f0> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f01399ac310> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (3): ==================== <function pack_combiners at 0x7f01399ac820> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (4): ==================== <function lift_combiners at 0x7f01399ac8b0> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (5): ==================== <function expand_sdf at 0x7f01399aca60> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (6): ==================== <function expand_gbk at 0x7f01399acaf0> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (7): ==================== <function sink_flattens at 0x7f01399acc10> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (8): ==================== <function greedily_fuse at 0x7f01399acca0> ====================
2024/01/15 17:24:03 Job[go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376] state: STOPPED
2024/01/15 17:24:03 Job[go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376] state: STARTING
2024/01/15 17:24:03 Job[go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376] state: RUNNING
2024/01/15 17:24:03 2024-01-15 17:24:03. (9): ==================== <function read_to_impulse at 0x7f01399acd30> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (10): ==================== <function impulse_to_input at 0x7f01399acdc0> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (11): ==================== <function sort_stages at 0x7f01399ad040> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f01399ad160> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (13): ==================== <function setup_timer_mapping at 0x7f01399acf70> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (14): ==================== <function populate_data_channel_coders at 0x7f01399ad0d0> ====================
2024/01/15 17:24:03 2024-01-15 17:24:03. (15): starting control server on port 36627
2024/01/15 17:24:03 2024-01-15 17:24:03. (16): starting data server on port 42715
2024/01/15 17:24:03 2024-01-15 17:24:03. (17): starting state server on port 37165
2024/01/15 17:24:03 2024-01-15 17:24:03. (18): starting logging server on port 36289
2024/01/15 17:24:03 2024-01-15 17:24:03. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f016db87790> for environment KfHVPrFieebeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/15 17:24:07 2024-01-15 17:24:07. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/15 17:24:07 2024-01-15 17:24:07. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/15 17:24:08 2024-01-15 17:24:08. (22): Waiting for docker to start up. Current status is running
2024/01/15 17:24:08 2024-01-15 17:24:08. (23): Docker container is running. container_id = b'09f343e9e65bbd54bb1f435fc49fe77e3691eb2cdd14e40bd2d9429403432a21', worker_id = worker_15
2024/01/15 17:24:10 2024-01-15 17:24:10. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f016db922e0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/15 17:24:12 2024-01-15 17:24:12. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/15 17:24:13 2024-01-15 17:24:13. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/15 17:24:14 2024-01-15 17:24:14. (27): Waiting for docker to start up. Current status is running
2024/01/15 17:24:14 2024-01-15 17:24:14. (28): Docker container is running. container_id = b'c629e49a323f16cbb10c3e59c0ada7c7135e99f45572cd8096fa3272f20743e3', worker_id = worker_17
2024/01/15 17:24:17 2024-01-15 17:24:17. (29): Completed job in 14.424577474594116 seconds with state DONE.
2024/01/15 17:24:17 Job[go-testjdbcio_postgresreadwrite-292-08ddd2f6-ed69-40bb-8230-c4b282e72376] state: DONE
2024/01/15 17:24:17 🐳 Terminating container: 2cb4fc452d8e
2024/01/15 17:24:18 🚫 Container terminated: 2cb4fc452d8e
--- PASS: TestJDBCIO_PostgresReadWrite (42.18s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 115.170s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.060s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43031
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp_x3f3ptj/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 35595
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 27s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3rmj2ivmfmn6e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5067
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5067/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
coders: <
key: "ccBlqGWeIgKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "ccBlqGWeIgVarIntCoder"
component_coder_ids: "ccBlqGWeIgRowCoder"
>
>
coders: <
key: "ccBlqGWeIgKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "ccBlqGWeIgVarIntCoder"
component_coder_ids: "ccBlqGWeIgCoder1"
>
>
coders: <
key: "ccBlqGWeIgKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "ccBlqGWeIgVarIntCoder"
component_coder_ids: "ccBlqGWeIgIterableCoder"
>
>
coders: <
key: "ccBlqGWeIgRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$2ed0c32b-aaea-430c-b011-c025c9b0baff"
>
>
>
coders: <
key: "ccBlqGWeIgVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "ccBlqGWeIgVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "ccBlqGWeIgbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar\022@ae8c3c97fe17eef138d6aaa2e5187c8fb70dded37b48f7b9e35d10a950f51f7e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/15 11:24:15 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705317855252046672
2024/01/15 11:24:18 Prepared job with id: go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a and staging token: go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a
2024/01/15 11:24:18 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a
2024/01/15 11:24:18 Submitted job: go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a
2024/01/15 11:24:18 Job[go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a] state: STOPPED
2024/01/15 11:24:18 Job[go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a] state: STARTING
2024/01/15 11:24:18 Job[go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a] state: RUNNING
2024/01/15 11:24:18 2024-01-15 11:24:18. (1): ==================== <function annotate_downstream_side_inputs at 0x7f30879261f0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f3087926310> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (3): ==================== <function pack_combiners at 0x7f3087926820> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (4): ==================== <function lift_combiners at 0x7f30879268b0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (5): ==================== <function expand_sdf at 0x7f3087926a60> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (6): ==================== <function expand_gbk at 0x7f3087926af0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (7): ==================== <function sink_flattens at 0x7f3087926c10> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (8): ==================== <function greedily_fuse at 0x7f3087926ca0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (9): ==================== <function read_to_impulse at 0x7f3087926d30> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (10): ==================== <function impulse_to_input at 0x7f3087926dc0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (11): ==================== <function sort_stages at 0x7f3087927040> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f3087927160> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (13): ==================== <function setup_timer_mapping at 0x7f3087926f70> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (14): ==================== <function populate_data_channel_coders at 0x7f30879270d0> ====================
2024/01/15 11:24:18 2024-01-15 11:24:18. (15): starting control server on port 33299
2024/01/15 11:24:18 2024-01-15 11:24:18. (16): starting data server on port 41995
2024/01/15 11:24:18 2024-01-15 11:24:18. (17): starting state server on port 35265
2024/01/15 11:24:18 2024-01-15 11:24:18. (18): starting logging server on port 45835
2024/01/15 11:24:18 2024-01-15 11:24:18. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f30bbfbdb50> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/15 11:24:22 2024-01-15 11:24:22. (20): Attempting to pull image apache/beam_go_sdk:dev
2024/01/15 11:24:22 2024-01-15 11:24:22. (21): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/15 11:24:26 2024-01-15 11:24:26. (22): Waiting for docker to start up. Current status is running
2024/01/15 11:24:26 2024-01-15 11:24:26. (23): Docker container is running. container_id = b'f624cd74f2ae1498ba052bb550bddd9553fb4d095a70697502772638d8f7c861', worker_id = worker_16
2024/01/15 11:24:27 2024-01-15 11:24:27. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f30bbf6e4c0> for environment ccBlqGWeIgbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/15 11:24:29 2024-01-15 11:24:29. (25): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/15 11:24:30 2024-01-15 11:24:30. (26): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/15 11:24:30 2024-01-15 11:24:30. (27): Waiting for docker to start up. Current status is running
2024/01/15 11:24:30 2024-01-15 11:24:30. (28): Docker container is running. container_id = b'8bfdf5b5a12a263098435505a7fcc7c530d6f5f56f27ce81e895692688029121', worker_id = worker_17
2024/01/15 11:24:43 2024-01-15 11:24:43. (29): Completed job in 24.78444743156433 seconds with state DONE.
2024/01/15 11:24:43 Job[go-testjdbcio_postgresreadwrite-355-11bb08c6-3d08-483a-b42a-80721530e05a] state: DONE
2024/01/15 11:24:43 🐳 Terminating container: 013a8ffff394
2024/01/15 11:24:43 🚫 Container terminated: 013a8ffff394
--- PASS: TestJDBCIO_PostgresReadWrite (66.75s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 152.647s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.046s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44837
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpja8h1fzn/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 44471
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 18s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/by6bpdekxu42s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5066
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5066/display/redirect>
Changes:
------------------------------------------
[...truncated 1.34 MB...]
coders: <
key: "msvDqMQNykKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "msvDqMQNykVarIntCoder"
component_coder_ids: "msvDqMQNykRowCoder"
>
>
coders: <
key: "msvDqMQNykKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "msvDqMQNykVarIntCoder"
component_coder_ids: "msvDqMQNykCoder1"
>
>
coders: <
key: "msvDqMQNykKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "msvDqMQNykVarIntCoder"
component_coder_ids: "msvDqMQNykIterableCoder"
>
>
coders: <
key: "msvDqMQNykRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$526dc76f-5f7e-4465-9c68-1a5aa272b5cb"
>
>
>
coders: <
key: "msvDqMQNykVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "msvDqMQNykVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "msvDqMQNykbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar\022@ae8c3c97fe17eef138d6aaa2e5187c8fb70dded37b48f7b9e35d10a950f51f7e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "s1"
root_transform_ids: "s3"
2024/01/15 05:36:41 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705297001997715596
2024/01/15 05:36:44 Prepared job with id: go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58 and staging token: go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58
2024/01/15 05:36:45 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58
2024/01/15 05:36:45 Submitted job: go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58
2024/01/15 05:36:45 Job[go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58] state: STOPPED
2024/01/15 05:36:45 Job[go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58] state: STARTING
2024/01/15 05:36:45 Job[go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58] state: RUNNING
2024/01/15 05:36:45 2024-01-15 05:36:45. (1): ==================== <function annotate_downstream_side_inputs at 0x7f4913c1e1f0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (2): ==================== <function fix_side_input_pcoll_coders at 0x7f4913c1e310> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (3): ==================== <function pack_combiners at 0x7f4913c1e820> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (4): ==================== <function lift_combiners at 0x7f4913c1e8b0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (5): ==================== <function expand_sdf at 0x7f4913c1ea60> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (6): ==================== <function expand_gbk at 0x7f4913c1eaf0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (7): ==================== <function sink_flattens at 0x7f4913c1ec10> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (8): ==================== <function greedily_fuse at 0x7f4913c1eca0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (9): ==================== <function read_to_impulse at 0x7f4913c1ed30> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (10): ==================== <function impulse_to_input at 0x7f4913c1edc0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (11): ==================== <function sort_stages at 0x7f4913c1f040> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7f4913c1f160> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (13): ==================== <function setup_timer_mapping at 0x7f4913c1ef70> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (14): ==================== <function populate_data_channel_coders at 0x7f4913c1f0d0> ====================
2024/01/15 05:36:45 2024-01-15 05:36:45. (15): starting control server on port 43701
2024/01/15 05:36:45 2024-01-15 05:36:45. (16): starting data server on port 35687
2024/01/15 05:36:45 2024-01-15 05:36:45. (17): starting state server on port 38591
2024/01/15 05:36:45 2024-01-15 05:36:45. (18): starting logging server on port 35787
2024/01/15 05:36:45 2024-01-15 05:36:45. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4948c711f0> for environment msvDqMQNykbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/15 05:36:48 2024-01-15 05:36:48. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/15 05:36:48 2024-01-15 05:36:48. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/15 05:36:50 2024-01-15 05:36:50. (22): Waiting for docker to start up. Current status is running
2024/01/15 05:36:50 2024-01-15 05:36:50. (23): Docker container is running. container_id = b'370a816271ee6863d2beeb186c0fbb1137d0076c492bb83af7a66451008af35c', worker_id = worker_15
2024/01/15 05:36:51 2024-01-15 05:36:51. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f4948c77ca0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/15 05:36:53 2024-01-15 05:36:53. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/15 05:36:54 2024-01-15 05:36:54. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/15 05:36:55 2024-01-15 05:36:55. (27): Waiting for docker to start up. Current status is running
2024/01/15 05:36:55 2024-01-15 05:36:55. (28): Docker container is running. container_id = b'63efd457bf02103af2478e77dbb205bf9a8152774fb59ae070a046e68fb47310', worker_id = worker_17
2024/01/15 05:37:00 2024-01-15 05:37:00. (29): Completed job in 14.970458269119263 seconds with state DONE.
2024/01/15 05:37:00 Job[go-testjdbcio_postgresreadwrite-418-ad359899-063b-4810-9680-3a8b818efb58] state: DONE
2024/01/15 05:37:00 🐳 Terminating container: bcb00636119e
2024/01/15 05:37:00 🚫 Container terminated: bcb00636119e
--- PASS: TestJDBCIO_PostgresReadWrite (48.44s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 121.836s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.045s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 36335
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp04g74pro/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 41853
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 52s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/zp4mdbycrkagk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5065
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5065/display/redirect>
Changes:
------------------------------------------
[...truncated 1.78 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:29 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:29 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:30 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:31 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:32 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f937fe75dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f937fe75e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f937fe775e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7ff75402a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7ff75402a310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7ff75402a820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7ff75402a8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7ff75402aa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7ff75402aaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7ff75402ac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7ff75402aca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7ff75402ad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7ff75402adc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7ff75402b040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7ff75402b160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7ff75402af70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7ff75402b0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 42105
INFO root:portable_runner.py:543 starting data server on port 44433
INFO root:portable_runner.py:543 starting state server on port 42121
INFO root:portable_runner.py:543 starting logging server on port 34101
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7ff7889c10d0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'c6245980964ce5f66e30f7c187c9a276e99af0f4e668e617d9675d81fc7e2060', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7ff7890c9940> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:52405')
INFO root:portable_runner.py:543 Requesting worker at localhost:52405
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:42 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:42105.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:52 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 11:48:52 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-de21e336-5dd6-44f2-8340-5ea75548f37c failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 300.61s (0:05:00) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 863387
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 871184.
Stopping expansion service pid: 871185.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 13s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xcfr3ulqg724c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5064
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5064/display/redirect>
Changes:
------------------------------------------
[...truncated 1.65 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:18 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:18 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:19 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:20 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fe4913b1dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fe4913b1e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fe4913b05e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fddb4bba1f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fddb4bba310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fddb4bba820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fddb4bba8b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fddb4bbaa60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fddb4bbaaf0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fddb4bbac10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fddb4bbaca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fddb4bbad30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fddb4bbadc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fddb4bbb040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fddb4bbb160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fddb4bbaf70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fddb4bbb0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 46513
INFO root:portable_runner.py:543 starting data server on port 45577
INFO root:portable_runner.py:543 starting state server on port 37031
INFO root:portable_runner.py:543 starting logging server on port 40623
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdde6533dc0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'38be6939434c84004cad683e6ad102a783d5e8f70c4a764c0fb271ee3f23ed57', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fdde65373d0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:57817')
INFO root:portable_runner.py:543 Requesting worker at localhost:57817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:32 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:46513.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:41 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:48:41 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-355bdef9-5a98-4466-bf9b-784e3901630b failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 299.27s (0:04:59) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4103369
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4108913.
Stopping expansion service pid: 4108914.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 57s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/2ejku6qxd7gci
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5063
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5063/display/redirect>
Changes:
------------------------------------------
[...truncated 1.47 MB...]
coders: <
key: "jqGjUPIcsJKvCoder"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jqGjUPIcsJVarIntCoder"
component_coder_ids: "jqGjUPIcsJRowCoder"
>
>
coders: <
key: "jqGjUPIcsJKvCoder1"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jqGjUPIcsJVarIntCoder"
component_coder_ids: "jqGjUPIcsJCoder1"
>
>
coders: <
key: "jqGjUPIcsJKvCoder2"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "jqGjUPIcsJVarIntCoder"
component_coder_ids: "jqGjUPIcsJIterableCoder"
>
>
coders: <
key: "jqGjUPIcsJRowCoder"
value: <
spec: <
urn: "beam:coder:row:v1"
payload: "\n\r\n\007role_id\032\002\020\004\022$31d684fa-feaa-4d47-be9b-6e3eb2f7d5c1"
>
>
>
coders: <
key: "jqGjUPIcsJVarIntCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\224\330\001\360<\254\355\000\005sr\000&org.apache.beam.sdk.coders.VarIntCoder\300K2\332\251KVh\002\000\000xr\000&j5\000\030AtomicC\001B8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
coders: <
key: "jqGjUPIcsJVoidCoder"
value: <
spec: <
urn: "beam:coders:javasdk:0.1"
payload: "\202SNAPPY\000\000\000\000\001\000\000\000\001\000\000\000\221\326\001\350\254\355\000\005sr\000$org.apache.beam.sdk.coders.VoidCoder\271\277U\233\350\r\257U\002\000\000xr\000&j3\000\030AtomicC\001@8\307\354\265\314\205tPF\002\000\000xr\000*j5\000(StructuredC\00198s\277\022\016\325\3246\021\002\000\000xr\000 j9\000\000C\001/0C\335\325\211\256\274~\370\002\000\000xp"
>
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go:apache/beam_go_sdk:2.54.0.dev"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:coder:timer:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
environments: <
key: "jqGjUPIcsJbeam:env:docker:v1"
value: <
urn: "beam:env:docker:v1"
payload: "\n apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:coder:nullable:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:control_request_elements_embedding:v1"
capabilities: "beam:protocol:state_caching:v1"
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:data_sampling:v1"
dependencies: <
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/artifacts/beam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar\022@ae8c3c97fe17eef138d6aaa2e5187c8fb70dded37b48f7b9e35d10a950f51f7e"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\ntbeam-sdks-java-extensions-schemaio-expansion-service-2.54.0-SNAPSHOT-row8l_4X7vE41qqi5Rh8j7cN3tN7SPe5410QqVD1H34.jar"
>
>
>
>
root_transform_ids: "e2"
root_transform_ids: "s1"
root_transform_ids: "e3"
root_transform_ids: "s3"
2024/01/14 11:23:14 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/integration/io/xlang/jdbc/jdbc_test.go> with GOOS=linux GOARCH=amd64 CGO_ENABLED=0 as /tmp/worker-4-1705231394524948504
2024/01/14 11:23:17 Prepared job with id: go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273 and staging token: go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273
2024/01/14 11:23:17 Staged binary artifact with token: go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273
2024/01/14 11:23:17 Submitted job: go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273
2024/01/14 11:23:17 Job[go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273] state: STOPPED
2024/01/14 11:23:17 Job[go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273] state: STARTING
2024/01/14 11:23:17 Job[go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273] state: RUNNING
2024/01/14 11:23:17 2024-01-14 11:23:17. (1): ==================== <function annotate_downstream_side_inputs at 0x7fcfd43731f0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (2): ==================== <function fix_side_input_pcoll_coders at 0x7fcfd4373310> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (3): ==================== <function pack_combiners at 0x7fcfd4373820> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (4): ==================== <function lift_combiners at 0x7fcfd43738b0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (5): ==================== <function expand_sdf at 0x7fcfd4373a60> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (6): ==================== <function expand_gbk at 0x7fcfd4373af0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (7): ==================== <function sink_flattens at 0x7fcfd4373c10> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (8): ==================== <function greedily_fuse at 0x7fcfd4373ca0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (9): ==================== <function read_to_impulse at 0x7fcfd4373d30> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (10): ==================== <function impulse_to_input at 0x7fcfd4373dc0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (11): ==================== <function sort_stages at 0x7fcfd4374040> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (12): ==================== <function add_impulse_to_dangling_transforms at 0x7fcfd4374160> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (13): ==================== <function setup_timer_mapping at 0x7fcfd4373f70> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (14): ==================== <function populate_data_channel_coders at 0x7fcfd43740d0> ====================
2024/01/14 11:23:17 2024-01-14 11:23:17. (15): starting control server on port 44337
2024/01/14 11:23:17 2024-01-14 11:23:17. (16): starting data server on port 36919
2024/01/14 11:23:17 2024-01-14 11:23:17. (17): starting state server on port 46371
2024/01/14 11:23:17 2024-01-14 11:23:17. (18): starting logging server on port 43739
2024/01/14 11:23:17 2024-01-14 11:23:17. (19): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd007f96580> for environment jqGjUPIcsJbeam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.54.0.dev')
2024/01/14 11:23:21 2024-01-14 11:23:21. (20): Attempting to pull image apache/beam_java8_sdk:2.54.0.dev
2024/01/14 11:23:21 2024-01-14 11:23:21. (21): Unable to pull image apache/beam_java8_sdk:2.54.0.dev, defaulting to local image if it exists
2024/01/14 11:23:23 2024-01-14 11:23:23. (22): Waiting for docker to start up. Current status is running
2024/01/14 11:23:23 2024-01-14 11:23:23. (23): Docker container is running. container_id = b'7e93dde047cbae7084554d8db5b6c1d1b3963c91fda732c082db60911823aa6d', worker_id = worker_15
2024/01/14 11:23:24 2024-01-14 11:23:24. (24): Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd007f9cfa0> for environment go (beam:env:docker:v1, b'\n\x16apache/beam_go_sdk:dev')
2024/01/14 11:23:26 2024-01-14 11:23:26. (25): Attempting to pull image apache/beam_go_sdk:dev
2024/01/14 11:23:27 2024-01-14 11:23:27. (26): Unable to pull image apache/beam_go_sdk:dev, defaulting to local image if it exists
2024/01/14 11:23:28 2024-01-14 11:23:28. (27): Waiting for docker to start up. Current status is running
2024/01/14 11:23:28 2024-01-14 11:23:28. (28): Docker container is running. container_id = b'6c5693ca64bf0daf718fdea0930a5ca0186937837deb7c8b0755712ba629b946', worker_id = worker_17
2024/01/14 11:23:31 2024-01-14 11:23:31. (29): Completed job in 14.292985916137695 seconds with state DONE.
2024/01/14 11:23:31 Job[go-testjdbcio_postgresreadwrite-956-7141eb31-0cc8-4e14-bc59-23bab9115273] state: DONE
2024/01/14 11:23:31 🐳 Terminating container: e8b213b121e5
2024/01/14 11:23:32 🚫 Container terminated: e8b213b121e5
--- PASS: TestJDBCIO_PostgresReadWrite (45.78s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 116.330s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:354: Test TestKafkaIO_BasicReadWrite is currently filtered for runner portable
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.074s
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42385
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.53.0-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpmsus9jay/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.53.0" for Docker environment
INFO:__main__:Listening for expansion requests at 42221
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 37m 28s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/eh2wftx6t53oa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5062
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5062/display/redirect>
Changes:
------------------------------------------
[...truncated 1.65 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:53:58 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:00 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f29d243cdc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f29d243ce50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f29d243f5e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7fd98f2e21f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7fd98f2e2310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7fd98f2e2820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7fd98f2e28b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7fd98f2e2a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7fd98f2e2af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7fd98f2e2c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7fd98f2e2ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7fd98f2e2d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7fd98f2e2dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7fd98f2e3040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7fd98f2e3160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7fd98f2e2f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7fd98f2e30d0> ====================
INFO root:portable_runner.py:543 starting control server on port 40127
INFO root:portable_runner.py:543 starting data server on port 38509
INFO root:portable_runner.py:543 starting state server on port 40867
INFO root:portable_runner.py:543 starting logging server on port 42687
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fd9c3ad7790> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'581cf6f2377db65793ce5bad4ff50c11521d8732dbac2f0701ba742c3db1ae19', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7fd9c3bdb1c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:59823')
INFO root:portable_runner.py:543 Requesting worker at localhost:59823
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:11 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:40127.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:20 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 14, 2024 5:54:20 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-70dd1bdc-9575-4b89-ae94-f550f1cf80f9 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 280.87s (0:04:40) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 273839
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 274368.
Stopping expansion service pid: 274369.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 35m 14s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/nwx4ssdw4u6yo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5061
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5061/display/redirect>
Changes:
------------------------------------------
[...truncated 1.78 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:36 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:36 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:36 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:38 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:39 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f6933f65dc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f6933f65e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f6933f675e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f82370261f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8237026310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8237026820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f82370268b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8237026a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8237026af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8237026c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8237026ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8237026d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8237026dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8237027040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8237027160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8237026f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f82370270d0> ====================
INFO root:portable_runner.py:543 starting control server on port 36911
INFO root:portable_runner.py:543 starting data server on port 43503
INFO root:portable_runner.py:543 starting state server on port 36717
INFO root:portable_runner.py:543 starting logging server on port 33907
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f826c05d4f0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'28966c6153448da3d611863fa12f2a6d6d5f6301917293cc5f43c60784eea0ac', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f826c0fbbe0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:56113')
INFO root:portable_runner.py:543 Requesting worker at localhost:56113
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:49:50 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:36911.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:50:00 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:50:00 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-a70ac32c-e0e5-4329-8466-bf1edece6810 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 312.07s (0:05:12) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 907539
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 916451.
Stopping expansion service pid: 916452.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 39m 34s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/kvdhozga5shyy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5060
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5060/display/redirect>
Changes:
------------------------------------------
[...truncated 1.78 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:50:59 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:50:59 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:00 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:02 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:02 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:02 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f53507cadc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f53507cae50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f53507cb5e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f58479091f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f5847909310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f5847909820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f58479098b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f5847909a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f5847909af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f5847909c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f5847909ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f5847909d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f5847909dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f584790a040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f584790a160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f5847909f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f584790a0d0> ====================
INFO root:portable_runner.py:543 starting control server on port 38941
INFO root:portable_runner.py:543 starting data server on port 35731
INFO root:portable_runner.py:543 starting state server on port 35661
INFO root:portable_runner.py:543 starting logging server on port 33721
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f587c6cbf70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'fef7a96a745d75d1376fda23893c553cf3ff9539874c49788e0ac5f334830ccd', worker_id = worker_89
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f587c6a8490> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:51709')
INFO root:portable_runner.py:543 Requesting worker at localhost:51709
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:13 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_90 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:38941.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:23 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:23 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Hanged up for url: "apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:35731"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 .
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 5:51:23 PM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_90.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-49518d07-0a60-4107-8931-788c41acda95 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 324.44s (0:05:24) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 4146409
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 4152719.
Stopping expansion service pid: 4152720.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 40m 44s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/3hrfehkhd7qxc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #5059
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5059/display/redirect>
Changes:
------------------------------------------
[...truncated 1.68 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:38 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:38 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:38 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:40 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:40 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:40 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to "apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f17fe03adc0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f17fe03ae50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f17fe03c5e0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function annotate_downstream_side_inputs at 0x7f8bdce801f0> ====================
INFO root:portable_runner.py:543 ==================== <function fix_side_input_pcoll_coders at 0x7f8bdce80310> ====================
INFO root:portable_runner.py:543 ==================== <function pack_combiners at 0x7f8bdce80820> ====================
INFO root:portable_runner.py:543 ==================== <function lift_combiners at 0x7f8bdce808b0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf at 0x7f8bdce80a60> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk at 0x7f8bdce80af0> ====================
INFO root:portable_runner.py:543 ==================== <function sink_flattens at 0x7f8bdce80c10> ====================
INFO root:portable_runner.py:543 ==================== <function greedily_fuse at 0x7f8bdce80ca0> ====================
INFO root:portable_runner.py:543 ==================== <function read_to_impulse at 0x7f8bdce80d30> ====================
INFO root:portable_runner.py:543 ==================== <function impulse_to_input at 0x7f8bdce80dc0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages at 0x7f8bdce81040> ====================
INFO root:portable_runner.py:543 ==================== <function add_impulse_to_dangling_transforms at 0x7f8bdce81160> ====================
INFO root:portable_runner.py:543 ==================== <function setup_timer_mapping at 0x7f8bdce80f70> ====================
INFO root:portable_runner.py:543 ==================== <function populate_data_channel_coders at 0x7f8bdce810d0> ====================
INFO root:portable_runner.py:543 starting control server on port 44203
INFO root:portable_runner.py:543 starting data server on port 37491
INFO root:portable_runner.py:543 starting state server on port 44615
INFO root:portable_runner.py:543 starting logging server on port 35725
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f8c1119fd30> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:543 Docker container is running. container_id = b'145463ea3ecf11181f507cbd2bd733415358b2c399afa1df1a4b5d319b97c4df', worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler object at 0x7f8c111b91c0> for environment external_8beam:env:anyof:v1 (beam:env:external:v1, b'\n\x11\n\x0flocalhost:37015')
INFO root:portable_runner.py:543 Requesting worker at localhost:37015
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:47:52 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Starting worker worker_88 pointing at apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:44203.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:48:01 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 13, 2024 11:48:01 AM org.apache.beam.fn.harness.ExternalWorkerService lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550 Job state changed to FAILED
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql - RuntimeError: Pipeline job-245ec638-a81b-4cf5-940e-80b5464ef2b6 failed in state FAILED: Error running pipeline.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 297, in _run_job
self.result = self._invoke_runner()
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",> line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 466, in run_stages
bundle_results = self._execute_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 794, in _execute_bundle
self._run_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",> line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 302, in __iter__
return itertools.chain(*self.partition(1))
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",> line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",> line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7279 deselected in 287.48s (0:04:47) =====
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3170870
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3198088.
Stopping expansion service pid: 3198089.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 38m 16s
261 actionable tasks: 172 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/xuqq3yswe7asu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org